You even notice that in the opening gunfight scene Matt does NOT get off the first shot? He wasn't the fastest gun, but the most accurate. (Like lots of the heroes in Louis L'Amour novels.)
In one of the scenes BOR showed last night, the villian - it looked like DeForest Kelly - actually drew first but as you stated, Matt was more accurate.
I recall one episode in which a real badass gunfighter challenged Matt to a gunfight and bragged he would kill him. The gunfighter was know to be better than Dillon. Kitty and Doc both told Matt he was going to be killed.
Unlike most other good guy portrayals and the standard scenario for heroes, Matt faced him, drew first and killed him. The show could bring some real life into the picture at times.
Another memorable episode had Chester and Matt trailing a bad guy on the prairie for weeks. Eventually, they lost his trail and gave up and decided to return to Dodge. Matt advised Chester that not everything goes in their favor. The episode ended and the bad guy escaped. How often does that happen on TV?