Read the book “Nine April Days”.
I've read several books on the period. The fact of the matter is that the confederacy didn't enlist more than a handful of blacks for combat duty, a few hundred at most. There weren't enough of them to give Custer, or any other Union cavalry division, their "worst whup'n" of the war.