Harry never was the brightest bulb
Of course, when it comes to their attraction to women, most men aren't very smart and I put myself at the top of the list of not-very-smart guys.;-)
But how smart does a person have to be to see that betraying his family isn't a good thing?
Such is the price of inbreeding.