Sorry using that basis I would have to agree with the OlLine Rebel in post 13 that Lincoln would be the worst by far. On his watch over 600,000 US citizens died in a very destructive civil war and a major portion of the countries economy was laid waste to.
Then you must factor in that he also used war to force the seceded states to remain or rejoin the union. Before the Civil War it was a generally accepted fact that any state could leave the union at will. This is pretty much an abrogation of the notion of limited federal government.
To be sure I am not saying that the presidents on your list are not bad but by your standard I would put Lincoln at the top.
You are right; Lincoln should be the worst.
You are right; Lincoln was the worst.
There was no legal secession in 1860-61.
There was an insurrection, that Lincoln didn’t start.