If the Founding Fathers had that attitude, the USA would have fallen apart in two years. Private morality does not mean suppressing public righteous indignation.
The Founding Fathers set forth the a pathway for this country, to the best of my recollection.
There are laws to be abided by, without a doubt. But in the end...we will all have to answer to God. For every transgression...no matter how small.