“British” isn’t necessarily a reference to English. Even the Celts in the British Isles used that term before the English arrived.
The early inhabitants were Britons.