Abusing a gift from the boss tends to be impolitic to say the least.
Warriors married daughters of warriors. You learn what you see and they saw daddy treat mom with politeness. Part of this was because even the girls were trained with weapons and part of this was because while the men were away the wife was in charge.
Warriors tend to be away a great deal. Not wise to abuse the lady who was in charge of your home and lands 75% of the time.
And of course there is, as your husband observed and as my dad taught me, the little fact that everyone has to sleep sometime.
Something I am very aware of, since I am married to a Japanese woman. :)
A 2 by 4 in the back of the head: whomp!