You have nothing on her - just fantasy associations. Also, just exactly who was she supposed to work with BUT the North, to help get the slaves out?
Sit and spin yourself.
spend a little time and investigate the Union commander she is associated with