Wasn’t he shoved off to Governorship of Bermuda or something? It was pretty well known that he had Nazi sympathies before the war. MeThinks the Royal family put him in a place and position where he could do the least amount of damage.
He was no longer governor of the Bahamas by the start of the war. He and Wallace Simpson were living in Paris at the start of the war.