If something bad happened like an earthquake, pandemic, or war people probably wouldn't be too eager to rebuild on the site right away. A modern house will crumble in short order if there is no one to take care of it.
Yeah OK but ... where does all the dirt come from ?