The fact that DEI has a negative impact on someone who, regardless of their skin color, may be completely competent and expert in their field, can be viewed as a potential liability simply based on the color of their skin, because it cannot be ascertained that they go to where they are on merit alone.
The only thing now based on merit alone in universities is award of an athletic scholarship.