The private schools take all the moderately qualified blacks (like the Obamas) and leave nothing for even elite schools like Berkeley. Berkeley measures it’s non athlete black male student population in the dozens, I believe.
Check this out:
http://opa.berkeley.edu/uc-berkeley-fall-enrollment-data
The data is a bit old but if you look at the years covered the rates stay about the same.
Looking at graduates in four years:
Asians and whites hover around 60%
Latinos: 35-40% Blacks: 25-35%