Thing is, also rich people from around the globe want US Real Estate, and will bid up the prices, and reduce the supply available to Americans.
This is partially how the middle class is being decimated.