We can’t have the common proletariat daring to think he can live among the patricians, comrade.
</obligatory sarc tag>
It sounds kind of like “block busting” in the opposite direction. Rich person moves into a poor neighborhood and fixes his place up well beyond the local standard. Then another does the same followed by another until they become the majority and force the last of the original residents out.