Well, you signed the contract and agreed to put yourself under the tyranny of your HOA. No one forced you to do so.
I just moved her. I signed a mortgage. I signed no contract.