In those famous White House touch-football games that the press described as involving the Kennedy brothers, others in the clan, and visitors, JFK did not play unless it was for a photo-op. Jackie was injured in one game where JFK was only a “spectator”.
You are correct in that he did officially play football at Harvard.