I wouldn't know.
But several thousand priests in a town would be a lot, wouldn't it? So maybe they were wannabe priests or something.
Or maybe they just had stupified looks on their faces from all the meditation, and Orwell took it personal.