I wouldn’t take it personally.
When we lived in Scarsdale, my wife used to walk along the streets with a couple of kids in a stroller, and maybe another on her back. (Actually, we have a lot of kids.) Once or twice a lady in a cadillac would come by, roll down her window, and tell my wife in a rude voice that she should be ashamed of herself for having so many kids, polluting the environment, and contributing to the population crisis.
I don’t remember if my wife answered her, but she certainly deserved a few rude words in return.
I remember going on a car trip with my family back in the 1960s. As we were getting out of the car, mom, dad and five kids, a grandmotherly-looking lady made some remark along the lines of “are all of those kids yours?” to my parents. We laughed, because back in our neighborhood we had 3 families who had 8, 10 and 13 kids.