A lot, but not nearly as many In the 1860 census the North had almost 4,000,000 foreigners, while the South had 233,000, this was one of the reasons for the South's defiance. Five Southern generals were born in Ireland.