When I buy a piece of land, I don't want it to be taken away by anyone without my consent, eminent domain or not. And I don't think this makes me a Libertarian.
You're absolutely right. You don't have to lean libertarian to believe that this is a violation of your constitutional right to own property. In my opinion, this reflects the sad state of affairs in public discourse when what should be a mainstream Republican issue is considered on the fringe.