The modern stigma with smoking isn’t that it is immoral, but that it is so low class and stupid, something for the ignorant and those lacking self-control.
Today it is similar to being a sloppy fat person, people’s respect for a smoker drops a notch, especially when watching them having to go outside in the cold,and all the other adjustments they make to their life and the lives of people with them, that and the daily cost makes you realize how desperately addicted and hopeless they are.
Nobody I know respects a person less because they smoke so this generalization is therefore incorrect. If this is your personal opinion then you are, of course, entitled to it.
Since you dislike smoking I'm not sure why you have a problem with a smoker stepping outside to smoke, but okay.
Only to the ill-mannered, the helpless fad followers and the junk science crowd.