Not if I was growing only what I needed in my bedroom.
My home is full of house plants. I don't see a pot plant that being any harder to grow.
"...this all started in 2002, when officials with the federal Drug Enforcement Administration raided the California home of Diane Monson, a chronic-pain patient, and destroyed her six marijuana plants. Monson became Raichs co-plaintiff." --The Boston Phoenix
"The DEA and the Butte County Sheriffs deputies raided Diane on August 15, 2002. The local District Attorney agreed Monsons six medical cannabis plants were lawful under local guidelines and Californias Compassionate Use Act, and personally contacted the United States Attorney. Nevertheless, DEA agents insisted on seizing and destroying Dianes six medical cannabis plants. To date, the DEA has never filed any charges against Monson." --Diane Monson's bio on supportive websites.
In other words, the DEA might not arrest you, but destroying your plants is definitely a course of action they take.