I agree - calling St Joseph 'virginal' is downright odd. Further, while the virgin birth is mentioned in scripture, I don't think it is ever explicitly referenced that Mary remained a virgin her whole life.
What is with the compulsion to extrapolate this kind of stuff? It's just odd to me.
St. Joseph was not previously married before being espoused to the Blessed Virgin Mary - who remained ever virgin - hence Saint Joseph also.