There used to be such a thing as “fighting words” and “fighting gestures” that would legally justify hitting someone that cursed you, or flipped you off, insulted your family. It is not politically correct to fist fight any more so most have forgotten but that man was old enough to remember when it was justified to punch people for things like that.
Still exists, but is now an exclusive right of black thugs.
That's why the word "dissin'" exists.
Does not apply to the knockout "game" however.