And for many, it was, mainly because of malaria and yellow fever. When the British occupied Cuba in 1762-1763 during the Third Silesian War, they lost far more men to disease than they did to Spanish bullets, and when they agreed to give Cuba back to Spain at the conclusion of the war, they were glad to get out.
Even then it wasnt a workers paradise.