Conservatives have no common ground with the left. You can pick almost any issue, and there will be no agreement.
However, conservatives and libertarians agree on a lot of issues, especially civil liberties, entitlement spending, and taxes.
If you were to set aside your differences on the issues where you disagree, you might actually make some progress on the issues where you agree.
Or, you could continue alienating anyone that has a bit of disagreement with you, and shrink into obscurity.
There will be no negotiations on core social issues. The Libertarians are not merely a never was party. They are also a never will be party.
Unfortunately for the libertarians, unrestrained libido is no substitute for personal integrity, and it produces vastly inferior results.
Yet libertarians and the left share much, conservatism is your enemy, something that you both desire to defeat and overcome.