It’s the horrendous commute times and income taxes, I guess. New York City ranks dead last among the 150 cities in both of those categories.
When I lived in Bay Ridge (Brooklyn), it took me 45 minutes to get to Midtown on the express bus. Where I live now near Princeton, it takes me 45-55 minutes to midtown by train. This is why I laugh when folks who live in Brooklyn or Queens act as if I live in the boonies and that I have a “long trip.” If you live in the Rockaways or Canarsie, it actually takes longer to get to midtown than if you live in Princeton.