Certainly I am viewed as no adherent to the Libertarian cause but I would say that your characterization is unfair and needlessly contentious.
Libertarians have issues of contract making ability that are central to their political view that are very compatible with a conservative's, or Old Whig's, view of a land of Laws and not of men. A land of limited government with assignment of issues of Order always going to the smallest societal or governmental unit that can deal with it are issues of broad agreement amongst many conservatives of all stripe.
Lastly, both sides are in harmony that Equality-before-the-law is the only true equality that bears on political systems, and no labeling of Libertarians as overly friendly to issues of cash-payment as being central to society would let one envision libertarians promoting schemes of slavery.
Certainly I am viewed as no adherent to the Libertarian cause but I would say that your characterization is unfair and needlessly contentious.
But it's true.