This is exactly what happens in every conservative vs. Libertarian discussion. Whatever one Libertarian says they stand for, another finds a way to qualify it and say it doesn't really represent Libertarian beliefs. As the old joke goes, when two Libertarians actually agree on a position, they accuse each other of selling out.
The defining issue for me (although there are many others like drugs) is immigration. No matter how you slice it Libertarians favor open borders. I don't. I'm an American nationalist and Libertarians aren't. They're laissez-faire to the max, and national interests be damned. Unfortunately, a lot of politicians who call themselves "conservative" these days are sounding pretty Libertarian.
You've got to be kidding?!