I'm one of those people. I don't do drugs. (unless you consider caffeine and nicotine a drug in which case you are free to call me a hypocrite) Sure, I smoked pot back in college 20 years ago. The crap never agreed with me, it just made me paranoid.
But as my idol and adopted grandfather Milton Friedman said when he was criticized by the Wall Street Journal 30 years ago for being one of the few "intellectuals" who signed on against the WOD; "If Government can tell you what to put into your body, they can also tell you what you can write in your paper."
When they came for the employees of the oldest profession in the world, I did not speak out, as I had no interest in purchasing sex.
When they came for the purveyors of what was deemed to be "obscene" or "offensive", I did not speak out, as I was not a fan of entertainers like Lenny Bruce or Howard Stern.
When they came to ban the female mammary gland from TV, I did not speak out, because Brian Boitano told me not to.
When they came for the people who don't wear seatbelts, I did not speak out, as I always wore my seatbelt.
When they came for the marijuana smokers, I did not speak out, as I was not a marijuana smoker.
When they came for the steroid users, I did not speak out, as I was not a steroid user.
When they came for the pornographers, I did not speak out, as I was not a pornographer.
When they came for the gun owners, I did not speak out, as I was not a gun owner.
When they came for the gamblers, I did not speak out, as I was not a gambler.
When they came for the cigarette smokers, I did not speak out, as I was not a smoker.
When they came for the overweight and the obese, I did not speak out, as I was not overweight or obese.
When they came for the drinkers (again), I did not speak out, as I was not a drinker.
Then they came for me...and there was nobody left to speak out.