You have it upside down.
If the Constitution doesn't mention it, the government has no authorization to act on it. The rights of the people, however, are not listed and remain almost unlimited.
/johnny
I think the states come into the equation at some point.