Could it be that one of the primary staples of the caveman diet was..............caveman?
I read an interesting book once whose thesis was that the reason for our evolution into Sapiens was cannibalism--specifically that we ate brains of our fellows and this somehow gave the survivors more intellect.
I've met some people who I thought were short a large spoonful or two.