What homes? The ancestors of most of the blacks now in South Africa came from further north, seeking jobs in white-developed areas. As for the "table" (built-up areas, working modern farms, factories, etc), it was built by the white colonists. Once it was built, you had people coming in and desiring to sit at the table.
In retrospect, I think many South Africans may be thinking the colonization of North America was the better model.
American Indians died out because they had no immunity to European Diseases. Not so with Africans.