Scholars and the popular press put extremist ideologies on the opposite sides of the political spectrum because they had an emotional heat that more moderate and accommodating politicians didn't have.
It's good to get beyond the simplistic Nazis = right-wing, Communists = left-wing scheme, but if it's just replaced by a me = right-wing, everybody I happen to disagree with = left-wing scheme, there are still a lot of problems that haven't been ironed out.
What I am proposing is a primary axis based on individual rights versus the good of the state. Thus, libertarians are to the right of me since I believe in the need for a well functioning state.