When you look at the distribution of remnant cultures, Bushmen for example, at present and then look at their historical distribution it seemes that they have been pushed to their present locations by people entering Africa not leaving, the same could be said of other remnants in other parts of the world.
I have always found it curious that things evolved in Africa and then left, it seems to me that the evidence points to things entering in waves.