If the land isn't yours, you have no such right under libertarianism. To assert such a right on land you do not own, or is publicly owned is initiation of force or fraud.
It's really not that hard to understand.
Under libertarianism you do have a right to free association. That means you do not have to do business with, give money or aid to, or be friends with anyone you don't want. It does not mean you get to banish anyone you can get a majority to vote out. That's democracy, not libertarianism.
In my example, the society would determine the scope of property rights. Voluntarily. This argument fails.