What happens is SF doesn't have the traditional US organizational structure of 'heavily policed mall-like downtown -> elevated highway over poor neighborhoods -> suburbs' (like it or not, even NYC has turned into that with the gentrification of Manhattan and extreme Western Long Island).

So people see all that a city has to offer when they go to SF, while they'll never set foot in East New York.