My great-grandparents probably said the same thing when your great-grandparents came over here, whether they were legal or not. I don't have any problem with legal immigration myself, but sometimes people tend to equate all Hispanics with illegal aliens and then start disparaging the whole culture. My husband is Hispanic, a LEGALLY naturalized American citizen and veteran, has no accent whatsoever, and just because of his name, people give him grief over the phone tell him they want to talk to a "regular American", or even more absurdly, to "someone who speaks English", without even realizing they're talking to someone who speaks better English than they do.
talk to a regular American *LOL*