Didnt Howard Cosell lose his job for saying the same thing?
From Wikpedia:
re: Alvin Garrett (former Redskins WR)
Off the field, his major claim to fame is that during a 1983 Monday Night Football game, commentator Howard Cosell referred to Garrett as a “little monkey.” Garrett being African-American, some viewed the comment as racist, although Cosell frequently used the phrase (Garrett himself was pleased to be singled out). The strain of the controversy aided in Cosell’s resignation the following year.