If we went back to such small Congressional districts, then there would be well over 10,000 congressman. You think it’s difficult for congress to work on anything now, try giving it the population of a large town. Even the parliament of India, the largest legislative body in the world, representing over a billion people, only has about 800 members.
An aristocratic House of a few, out of touch members who use the perks of office to secure their lavish benefits was precisely what they feared, and is exactly what we have today.