Actually libertarianism is rightfully famous for being anti-conservative, socially liberal, for opposing traditional morality, and being for open borders, all strategies which create MORE big government voters and liberals, MORE laws and social programs and LESS responsibility.
I'm not for open borders, or Third World immigration. The current welfare system will attract an unlimited number of people wanting to mooch off it. The right to associate also means that people have the right to choose to NOT associate with some.