Not a whole lot of non-Anglos around.
A few Irish perhaps.
You might find a retired Pukka Sahib with a native servant or two but that was pretty much it.
Oh, being all bound by the objective historical conditions ... what’s wrong with you? It’s not like this stuff really happened anyway!
Actually, in a way, it’s not like this stuff really happened anyway. A history is one thing, and a historical fiction is a step removed, and a fantasy jumping off from a historical setting is something else again.
But on the other, other hand ... go with what’s in the text.