I think there is no good reason to make up things that we really do not know about.
I agree - calling St Joseph 'virginal' is downright odd. Further, while the virgin birth is mentioned in scripture, I don't think it is ever explicitly referenced that Mary remained a virgin her whole life.
What is with the compulsion to extrapolate this kind of stuff? It's just odd to me.