He is possibly referring to rumors of an affair by Eisenhower with his British driver.
Which have been thoroughly debunked.
"Ike Was My Boss, Summersby's 1948 memoir of the war years, makes no mention of her "affair" with Eisenhower, but her 1976 autobiography suggests that it was common knowledge in wartime London and Washington. Persons close to Eisenhower, however, have maintained that the "affair" - which by her own account did not include any sexual act beyond kissing - was strictly a fantasy on her part, and have also questioned the authenticity of the 1976 book, which was not published until after her death."
Mighty thin; in fact downright anorexic.