Not all who wore the Brassard of Peace were weak and inferior. I must note that the “Guardians” (IIRC) who were the Police Officers of that society wore both the Brassard of Peace and carried arms. Everyone was thereby put on notice - by the combination of the Brassard and the weapon - that they could not be fired upon.
I'd also add, that if one were out drinking, or otherwise incapcitated/injured, a brassard was called for.