To his credit, he forced LBJ out of office.
You line of reasoning has dangerous consequences and has been followed before: Germans sighed with relief when "Hitler -- to his credit, whatever his weaknesses are --- at least forced the previous government out of office."