Depends on what grounds. If Harvard disinvited Bush because his policies violated the Harvard charter, as principles individuals that we are we would understand their decision.
I think that is wishful thinking. I am not sure we would react that way. I am against abortion but I just wonder if this has ever happened before. Did Clinton speak at a Catholic University? Did Reagan who was not Catholic? Even the Bush’s were not Catholic? So how far do we go?