It doesn't mean your a bad guy, just someone would not mind parting ways with lots of money for a women. If a women is married with a man before and then leaves that and ends up with you, whose to say she won't do it again?
I agree with you, but people can get divorces for all sorts of reasons - for example, maybe her partner was unfaithful.
All the story says was that they met when she was with someone else. In itself, that's not controversial (though the story makes it sound ornery, for sure).
So if a woman is with a man before and leaves that man (for a reason that is uncontroversial - his adultery, his abandonment, his abuse, for example), and then winds up becoming my companion, that doesn't mean the same set of facts will present themselves again.
I can have a wonderful fulfilling relationship with that woman (then again, maybe not). Millions of people leave bad relationships and start better ones with different people - it's not uncommon at all.