That only applies if you're growing tobacco commercially. If it's for your own use, you're home free. If you're growing an acre of the stuff, don't try to persuade them it's for your own use.
I'm wondering about a couple of things. If it turns out to be legal...
A. How much land would be required to maintain 2 smokers in the house year-round.
B. How would tobacco grow in the dry climate of Denver.