On your graph, 2007 is the year the Democrats took over Congress and it is also the year that unemployment started to rise.
Only Congress has the constitutional authority to spend money, tax, and directly affect the economy.
This unemployment squarely falls on the shoulders of Congress, and a president in agreement with them only makes it worse. When Obama took over in 2008, the combination of a Dem Congress and a Dem President caused unemployment to skyrocket.