I wouldn’t chalk this up to racism - the guy and the parents are full of hyperbole and hysterics.
Would we be claiming racism if she had followed a white male with red hark around with 2 children with brown hair?
Oh, let’s be honest, though. We wouldn’t even be aware of the situation if the guy was a red headed white guy, and the kids had brown hair, UNLESS the guy was acting suspicious, or the kids were acting scared. I have red hair, and none of my kids or grandkids have red hair. If I were a guy, I’d hate to be suspected on nothing more than that. But, as I said in another comment, male babysitters is just a weird concept, no matter what color they are.