Nov. 2016 and you might have a point.
As long as Obama controls the Senate, he is invulnerable. If he loses the Senate, it becomes much more dangerous for him and the Democrat agenda.