Not all levites stayed south. There were Levites in the northern kingdom. In the southern kingdom you had Judah, Benjamin and also Simeon (they were surrounded by Judah and probably absorbed very early on)
Levites had no tribal allotments as they were the ‘priestly’ class so they tended to live any where in Israel where they could be of service.