We’d probably have less blacks. England was a lot more serious against the slave trade than the US was, even though both countries banned the transatlantic slave trade at about the same time (around 1807).
For practical purposes, all blacks in this country are descended from those here in 1807. So how would a British connection have cut down on the number here?