Are we then allowed to call wrong, wrong, and right, right?
He did wrong to get a woman pregnant without marrying her.
He did right to take responsibility for the consequences of his immoral action.
There will be more rejoicing for the sheep that was lost than for the 99 who were not.
If he was involved in "nefarious" activities then clearly he did not take full responsibility for his mistakes and actually chose to commit new wrongdoings.
That's just an if, however, and it is in itself wrong to assume that he was.