Excellent point. We do have term limits. They are called elections. Why throw out the virtuous along with the wicked because a clock ran out? The wicked vastly outnumber the virtuous and term limits on the virtuous assures the wicked will always be a majority.
And how's that all working out?
When elections are rigged using the IRS as the bully I'd say elections don't matter much now do they?