I agree with your points.
When Toba exploded 75,000 years ago, some estimate that only 5,000 humans worldwide survived.
A more likely explanation for the "lack of evidence for modern humans" is that most of them were living on coastal plains and along river estuaries. The "big thaws" from the LAST episode of global warming then put the evidence 150 meters below the ocean's surface.