“as a Conservative libertarian, I would allow private colleges to discriminate on any basis they choose”
Yes.
Yet, these universities get billions in federal tax-payer originated funds. By their own standards and policies, these liberals are subject to oversight.
The Constitution left all moral/value questions to the States. The right to control, premised on a right to effectively bribe, is a dangerous & wrong-headed principle.