From what I've been able to gather, over 90% of the people are homeless. Tourism (their main revenue source) severely crippled long-term (hotels, roads, etc.) Major crop damage.
I'm not going to start minimizing what happened in Haiti - but have you considered that there might be reasons why the death toll is different? Infrastructure, topographic, economic, or cultural factors? How many died from the storm and how many from second-order effects (lack of sanitization?)
Because high winds simply aren't very deadly at all. Look at the 15 killed in Andrew.
WATER is what kills. Grenada didn't have massive flash floods and mudslides going down denuded mountains. Their damage was mostly from wind, not flooding.