I would not concede to that argument. At the time there was no consensus that secession violated the Constitution.
And no consensus that it didn't. It took the Supreme Court to rule after the rebellion was over that secession without the consent of the states was not supported by the Constitution.