A more reasonable scenario is that the hunters explored outward, came back, a few dragged mates and daughters into the new territory, and the men coming to the new lands competed for the wives and daughters that had been there for years over trying to bring new women to the new land.
Like the one trapper who brings a wife, then has all the new AND old trappers fighting over his daughters - instead of trying to go to the old land, convince women to come, and drag new women in.
The woman who has been raised there has the advantage of proven resistance to local diseases and often local survival knowledge. That would put a premium on locally produced women over imports.