In another world/dimension where Lincoln wasn't assassinated this problem was resolved once and for ALL.
Assimilation.