These sound like zoning rules which you agree to when you move to an area. I know this first hand when my neighbor built a huge 2 1/2 story garage next to our property. The guy was a builder and knew the rules, it was an in your face act.
How was it "in your face"? Did he not want the garage and built it accordingly? Has he no right to his garage that complied with the zoning laws?
Should he complain about your home which is on the lot next to his property?