Even the pro-Soviet Progressives didn't use Hiroshima and Nagasaki to attack Truman.
Truman's problem was more the economy and some scandals. Also he was seen as a petty little man after the larger than life Roosevelt.
After Pearl Harbor, there was only one vote in Congress against declaring war.