Depending on my mood, I ask them why they can't read English? If I get a snippy answer, I tell them they are tresspassers and I am going to call the police. (I can do that because it is a closed neighborhood posted "owners and guests only.")
I’ve done that too but after hearing about some folks going to the door to ask if you need mulch/mowing/etc and then pushing inside, I don’t even answer - just look out the glass and say NO