Can't find the exact passage now, but on judgement day, when the false people gather around Christ and say, but Lord, we cast out demons in your name, Jesus will say to them, get away, you never knew me.
I would imagine this pastor will be right in the center of that group.
Ah, here it is : Many will say to me in that day, Lord, Lord, have we not prophesied in thy name? and in thy name have cast out devils? and in thy name done many wonderful works?
And then will I profess unto them, I never knew you: depart from me, ye that work iniquity (Matthew 7:22-23).