Whites are the swing vote, though that might be too generous because of the size of the vote numbers they have.
I think white guilt was the swing vote, and many white Obama voters are getting over their guilt after a year of Obama policies.