My understanding of the libertarian policy position is that libertarians oppose government interference in the production, sale and use of recreational drugs among consenting adults. That's different, however, from having a personal interest in the use of such drugs.
Getting back to the Judge's self description as a “libertarian, traditionalist Catholic”, I would be curious to know if he opposes any legal restrictions on, say, late-term abortions and, if not, how he squares that with his traditionalist Catholic views.