It's the hat. It makes him look like Boris from Rocky & Bullwinkle.
lol, so true.
I've heard that the wearing of the hat is related to his Orthodox Jewish faith. He may not have intended to look like a gangster.