Well Padre Pio and other Saints messed with the devil frequently. Of course in their case messing with him meant kicking his sorry butt. Actually what happened is the devil messed with them and got more than he bargained for.
Humans don’t kick the devil’s butt... we’re simply not capable of it.
We can call on Jesus to do the butt-kicking for us, though. Anyone who thinks they can do it themselves is a ripe target for possession, because they’re suffering the sin of pride.