Then they should have left BEFORE Texas seceded, or refugeed. They didn't, and should have been treated as prisoners of war, but it didn't work out that way.
Once Texas seceded, they were traitors.
No, the Texans who attempted to secede were the traitors.