Yeah, it is very disconcerting.
Several years back, I was at a computer conference (now defunct) called Guide, for IBM mainframe stuff. Having breakfast one morning in a crowded coffee shop, the only open seat happened to be next to me. It was taken by a ME man, who turned out to be an IT guy for the Saudi Air Force. I tried to make conversation with him as I had recognized him from several sessions earlier in the week, and he acted like I had a communicable disease. He looked at me as though I were a pile of camel dung.
I have known several women who married Muslims, and their experiences have uniformly been disastrous. Beatings, financial disputes, child-rearing conflict, and general misery constituted the best of them. The rest were worse.
Combine this with my experience with an Iranian instructor in college who was loathe to even pass women, much less give me my A, I never, never, never have been attracted to any man who wasn't USA to the bone. I commend that attitude to every American woman.
I have heard it said now and then that just because someone looks ME doesn't mean he's an Islamic. But I'll bet you and I could tell the difference between a Hindu and a Muslim at fifty feet...