And the Romans lazy and letting themselves get run over. And not assimilating the barbarians within their borders (yes, Rome should have worked harder to assimilate their Germanics who they let in--legal immigrants).
What if you run into a group that refuses to assimilate in any large numbers? It has happened repeatedly in history and will happen again. The Romans are only the most widely known example.