Caffeiene is mind-altering, remember - it increases your level of alertness and ability to concentrate, that's why so many businesses give that particular drug away for free to their employees.
Take caffeine and you won't do something you would never do if you weren't taking it. Both alcohol and weed have that exact effect -- people do things they would not otherwise do.
Caffeine doesn't cause judgement lapses or auto accidents. Caffeine doesn't result in additional children by women other than your wife. Taking caffeine won't result in going to bed with an Indian princess and waking up with an African queen.