Inherent rights are natural; they are a part of you. They can’t be taken away, only infringed upon, and are not dependent on governments, laws, religious beliefs, or incantations.
You cannot appeal to naturalism on one hand - and just say that rights are natural if animals and bacteria don’t have the same rights.