When the Civil War broke out, Foster stood for the Union, not the Confederacy.
...he was also from Pennsylvania, not Kentucky