It seems that these primitive tribes are pretty much surrounded by more modern locals who keep their distance; beach areas and lower-lying land is far more inviting to the fishermen and the tourist-types who come for only a few days but retain the desires of amenities. It is unlikely that the average tribe spends a good deal of time near the beaches or the lower, more tillable, land sought by his neighbors.
In short, maybe he really went nowhere.