Because the skull cracking communists, aka "International Socialists" were the chief rivals to the skull cracking "National Socialists".
I don’t imagine that Hitler’s violation of the non-aggression pact with the Soviets was well received by all.