There are modern groups of humans that have a built in population control ~ although some males have exceedingly successful sperm, the aggregate population suffers from a 50% rate of indeterminate infertility.
The Neanderthals could well have suffered the same problem, and could also be the source of this problem in modern populations.
