I had mumps in Kindergarten. But my boys still swam fine enough. Not so much any more. Its more like a lazy river.
Prior to puberty is the key.
After puberty, especially after 18 or 20...can be bad news.
One of my kid had mumps in his late teens...no kiddos for him.
When mumps was going around in my youth, people always said a boy could become sterile if the mumps "go down" on him. I think that happened pretty rarely, and apparently referred to the infection moving from the neck glands to the groin.