Well-off does not equal rich.
Many of them are probably up to their eyeballs in debt, living paycheck-to-paycheck, afraid of losing their high-paying job or of the profits from their business declining even slightly.
The quote above supports your view. Traffic jams and being crammed in with a bunch of liberals in an overcrowded area doesn't help either.