Been there, done that. Didn't bother to buy the T-shirt.
Generally speaking, the Muslims will ignore you, as long as you don't offend them. If you offend them, they will try to kill you. Needless to say, folks are pretty careful not to offend anybody.
In the six months that I was in Somalia, back before it went completely to Hell, I was only set upon by a mob and nearly killed twice. Deserved it both times, of course. You really had to be pretty careful about riling people up there.