This is stupid. Obviously he and his wife were struggling. He discussed it with women he knew. Should have asked them? No. That said, unless he harassed them or asked them to do it via him engaging in intercourse, there is no reason to step down. An apology is good enough. IF this is all there is to it, Paul Ryan is ridiculous for lumping him in with Conyers and Franken.
Yeah, he knew them.
They also worked for him.