Further, the underlying electronics did not have to be two-state, or "binary". Some research computer were built that used trinary, or three-state, circuits: 0, 1, and 2; or in the basic theory -1, 0, 1. Not very useful, as it turns out.
Calculating machines (pre-electronics) in wide use even today do their calculations in base 10. You see this in handle-powered adding machines even today, although these tend to be hard to find in any store.
I suppose that the old-fashioned manual cash registers in the grocery stores worked in base 10, too.