Fair points.
I have trained with pistols with a thumb safety so long I’ve tried to “click” the non-existent thumb safety on my revolver before.
And I’ve been known to “click” it off on my Ruger when I don’t like the looks of a situation, but no where close to ready to draw and shoot.
As a matter of training, IF the gun has a safety, it should not come off until the gun is out of the holster and pointed in a safe direction (or towards the threat). That's not to say you cant do it earlier, just not how its supposed to be trained.
How often do you find yourself where you "don't like the looks of a situation?" Hopefully, if its enough to count, its occupational and not voluntary. Avoidance is best. Stay safe.
Not nearly the same situation, but a friend missed taking 2 bucks on one hunting trip with his 444 Marlin. On each occasion, he had a round in the chamber and the safety on. In each occasion, he pulled the trigger only to hear the “clack” of the hammer hitting the safety bar. Instinctively he worked the lever to load another round, and “clacked” again as the deer began to run away and disappear. On both occasions, he never even began to think that the problem was the safety, until long after the deer were gone and the shot was lost.
I am sure when he was practicing out the backdoor of his acreage, he never once forgot to remove the safety. But under Buck Fever, everything went out the window except point and shoot. It is even interesting that chambering another round was an automatic instinct, but the safety being on never occurred to him.
Twice. On the same hunt. He would have been better off carrying the Marlin unloaded and just chambering a round when needed. At least he would have gotten off a shot.
This lesson always stuck with me when thinking about whether to carry a firearm with or without a safety. I’m not saying it can’t be trained out like with your experience, but it is just one more thing to go wrong when you get Buck Fever or when you are under the stress of life and death. Tons of people have had success with 1911s cocked and locked, so plenty of people have been able to deactivate the safety in a life and death shoot, so it is just what you are personally comfortable with.