From what I have read Churchill was made aware, through ULTRA decrypts, of Edwards contacts with German representatives in Portugal. It infuriated Churchill but posed a rather delicate political situation. Edward was offered a genteel way out and he took it.
Makes sense.