Close. The actual line reads, "But if in any blind pursuit of inordinate power, either should attempt it, this amendment may be appealed to as a restraint on both."
In that respect his unique interpretation of the 2nd Amendment ran counter to all other legal and historical authorities.
But keep going.
"This right ought not, however, in any government, to be abused to the disturbance of the public peace."
"An assemblage of persons with arms, for an unlawful purpose, is an indictable offence, and even the carrying of arms abroad by a single individual, attended with circumstances giving just reason to fear that he purposes to make an unlawful use of them, would be sufficient cause to require him to give surety of the peace. If he refused he would be liable to imprisonment."