Site plan is part of the package you give the building inspector. I added a garage to my property, and we were well within the set back (which was like 25 feet), maybe a good ten feet to spare. It was a 24’ x 24’ garage, attached via a 6’ foot breezeway, which would tell you it extended 30’ from the edge of the house. The building inspector wanted a survey, which would have cost over a $100 bucks, but I whined enough that he waived it. (Clearly it was compliant.)
You don’t understand, these people did about everything the codes restrict you could imagine, and it was up to us to complain to get them to stop, the county didn’t do a darn thing on their own.
There is a creek running through both of our properties, that guy one day just put down big pipes and buried it the entire width of his from line to line. Illegal as hell, we complained to the state and everyone else and what it all boiled down to was nobody did anything, we would have had to sue him personally and screwing with a waterway in Michigan was suppose to be some mega no-no.
This is why my driveway is 8/10 of a mile long, and the only neighbor I can see is my mom on the other side of the lake. Some people can luck out and get the best neighbors in the world, or they can crap-out like we did and get gun shy because of it.