Goes all the way back to 1820
Excellent graphic for what asked when at this link...
A History of the Census Bureau's Birthplace and Citizenship Questions in One Table