I suppose that is one perspective. Another is that the Southern States did not appreciate the selective meddling in their affairs by the Fed, no matter how justified such meddling may have been.
Of course slavery was cuckoo...but tell that to Lincoln, who did very little to abolish it 100%. He only selectively applied the Emancipation Proclomation, exempting the non-rebellious slaves states and certain non-rebellious parishes of Louisiana.
As wrong as the South was for relying so heavily on something as wretched as slavery, they were troubled by the heavy hand of the Fed.
When the southern states seceded the only federal effect on their lives was only the Constitutionally-mandated tasks that were all Lincoln ever intended to do- collect the duties at the ports and deliver the mail. It would be nice if that’s all we had to endure from the federal government today.