I thought it was more common for little people to have shorter lifespans than the general population.
It is. Outliers in any direction tend to have shorter lives.