Maybe he didn't know what his own had gone the way of the devil, when he commented about Mary. Didn't the Mary bashing come first? I am not sure daddy was paying much attention to his daughter.
It was not known at the time by the public; but he surely knew.
Or you could be right -- maybe he didn't.