Actually, Scalise did speak to the neo-Nazis. They attended the first event, and thus provided Scalise with plausible deniability.
But he did speak to them.
And from at least one of them, neo-Nazi Kenny Knight, he received at least $1000.
Some of them arrived early and sat in on a speech he was making to a totally different group.
"But he did speak to them."
No, he was actually speaking to a different group. They were just there.
But hey. If you're hell-bent on smearing the guy, you could say something like, "neo-Nazis listened to a speech given by Scalise". Misleading, but factually correct.