Bigamists and members of NAMBLA could make the same argument as this guy.
The only thing more disturbing is putting the rights of the majority up to a minority vote. And THAT is done all the time! Or worse yet, no vote is taken. The majority's rights are just redefined by judicial fiat.