In 1961 an African neighbor in a white neighborhood would not have been tolerated and he would have been called nigger, regardless of his nationality, here in the south. That is the way things stood in 1961.
In Hawaii (where Whites were a minority) it might have been different, more like things are (I hope) now.