The owners needed the slaves to work the plantations, etc. Does Paul expect that Union troops would have replaced the slaves after freeing them.
Well, did Union troops replace the slaves after the Civil War? Why would this scenario be any different? Poor white subsistence farmers, freed slaves, and a small number of immigrants would have started working for wages in the South, as happened anyway. That's all.