Why not take the money from Africa? The slaves were captured by the kings of West Africa to get rid of their tribal competition. I’ve seen the palace of the Dabomey Kings in Benin. His throne had the skulls of captured kings embedded in it.
Or the slave traders, many of which were Muslim. The slaves went many places, not just America.
In fact, the vast majority of African slaves went to South America and the Caribbean. If I remember correctly, less than 10% made it to the U.S.