Don't forget that the US treasury had received an infusion of that evil gold from the California Gold Rush, allowing purchase of foreign goods and services previously not available. And even some of the smallest mining towns here sent troop contingents to fight mainly for the North.
The California gold rush peaked 12 years before the beginning of the rebellion. They were called '49rs', remember?