That's not really the way it is supposed to work. You have 4th Amendment rights by virtue of being a human being. The Constitution doesn't grant those rights to anyone. It merely calls out certain rights the people retain that the government must respect.
The Supreme Court has ruled on this several times.
You are right, as I have learned. I don’t agree with the concept because it’s still circular. Stop and Identify laws illustrate that circularity. If a citizen doesn’t have to show id in a locality and all visitors need to carry ID at all times if an alien declares they are a citizen or won’t answer the question the police need to just let them go?