What about the Red heads?
There is vanishingly little genetic diversity in the present human race including red heads. Neanderthal DNA by way of contrast is typically described as roughly halfway betweeen ours and that of a chimpanzee. In other words, the neanderthal who was the most advanced hominid, was basically a glorified ape despite his rough resemblance to us. Everybody who studies this stuff pretty much agrees this rules the neanderthal out as a plausible human ancestor and that has to rule the others out as well.