My experience has been that the people that are indeed racist and use the "N" word a lot are people you remember. I don't see how Allen could have gotten so far in politics and life if he used the "N" word a lot. Deep seated racism is hard to hide.
I agree with you, but did you ever hear Lyndon Johnson trying to pronounce "ni-ni-niggro"?