I think you are missing the essential point, which has to do with how the rights of the individual rightist are to be protected from the mass of humanity. Those who sat on the Right in the French Assembly wanted to be safe from the mob. So too did the Founding Fathers--although they might not have been so snobbish about it--but that is almost precisely what Madison's comments on Democracy were about.
The Great movements of the Left, Communism, National Socialism, and various other varieties of Socialism, all embrace the mob--the power of numbers.
Again, see Political Spectrum, to illustrate my argument.