If some guy on the border doesn’t want a fence on his land, then lets just build it around his land. Hell, let him secede and join mexico if he wants.
My ancestors already tried that in 1861.