Rights once given up are difficult, if not impossible, to regain.
Im not sure your statement makes sense. A right is just that whether you exercise it or not. Its not given by govt but is recognized to be such outside of law. Now you might have to come to blows over its exercise but thats part of the territory.