What you are talking about in the case of Lot is a case of angels of God being the targets of attempted rape. Lot was scared that if they actually got their hands on the angels, God would unleash the equivalent of a nuclear explosion on the whole city right then and there. People seldom think when they are scared and unprepared for the situation. Lot was both. Thankfully, the attackers got rendered blind, and with burning pain at that.
I can certainly agree with the idea of Lot’s being terrified witless. It fits with his entire trajectory as a character.