It’s a slurred enunciation of “high yellow”. It was an insult to the “mulatto that had attained status in the white world”.
Think (LA TIMES), Magic Negro.
It’s also a reference to the yellah stripe across High Yellah’s back...