You are right, the catcher was the only one who wore one. However, even the catcher took his out when he hit. Open a catcher’s glove in the dugout you will find a cup.
Not in the helmet? Eeeehhwwwww. Lol