The way I'd limit who can vote is, keep people on welfare from voting, like we do felons.
The US Constitution (Article I, Section 2) leaves it to the individual states to set the requirements for who can vote (subject to specific later amendments on race, sex, poll tax, and age.)