The most sinister thing about this is that you can follow the Pence doctrine for years: never be alone in a room with a women other than your wife. But a woman can come forward and say "You were in a room alone with me 15 years ago, or maybe 17 or 20. Whatever. You said my blouse looked nice and I felt like a piece of meat. I've been traumatized ever since". You stammer "that never happened! And what's so bad about saying your blouse looked nice anyway?" Media jumps in. "So you are defending making unwanted comments about a woman's appearance, are you? Did you not see that she cried? We all know that women only cry if it's serious and they are telling the truth, that's just science. She's credible. And you're comments were rude and abrasive, by the way. Clearly you have anger management issues. Guilty."
There is literally nothing you can do to defend yourself against this sort of McCarthyism.