Indeed. But it's only strange because of the assumptions made to date about human movement, and human abilities. If modern human beans have been around for 100,000 years, there's absolutely no reason to expect that they were stupid and sedentary for 90% of their history. Yet that's the apparent assumption.
Consider how little physical evidence there is of civilizations from 5,000 years ago, and then multiply the time span by 10 -- civilizations could have existed, and we'd be hard pressed to find them (or to distinguish them from newer ones....)
Now if you toss in a volcano bigger than the one that caused The Year Without a Summer in 1816, then you can kill off most of humanity, and destroy any civilizations that may have existed prior to the explosion.
I agree with your points.
When Toba exploded 75,000 years ago, some estimate that only 5,000 humans worldwide survived.
:-)