Where the hell does that come from? I just don’t want moral judgements handed down to me from the ruling elite.
Of course not. The appropriate moral judgements are those any sane person would agree to - I don't wanted to be robbed, so stealing is wrong - I don't wanted to be killed, so most killing is wrong, etc.
Self interest will be adequate in most cases, and interestingly enough correlates pretty well with Biblical judgements.