He only uses that term when people ask him what he did in the army and they have blank looks on their face when he says special forces.
You are right, he equates it with what they wore on their head.
“Ma’am, I am a Special Forces Soldier. I know and have practiced 11 ways to kill enemies of the Citizens and/or Constitution of the United States with just my thumb.....
I-AM-NOT-A-HAT.
:~)