I'm inclined to agree. Most of the stories were briefly and superficially entertaining but the characters, meh! Deputy Warren, Gomer and Goober, I found all 3 outright offensive. Yet Barney, Ernest T. and Floyd were, imo, excellent clown work. Never gave it much thought, but now that I think of it, it may have had something to do with the character each one played off - Ernest T. vs Barney was a lot funnier than Ernest T. vs Andy.
And the Darlings, they were wonderful, no matter whom they frustrated. Mr. Darling repeatedly warning innocent Andy to quit bewitching the overheated Charlene...priceless.
We have the whole series on DVD and have voluntarily watched it many times.
Worst episode: Andy's awful reaction to Opie's report of Mr. McBeevee. A lot of bugs flew out of Andy's psyche when that came along. Threatening and punishing a kid for, at worst, an imaginary companion; not giving him benefit of doubt; it was cruel and mean-spirited and boneheaded.
As for leftwinger Griffith -- hey, Andy, if you're departed, RIP, but if not, GTH!
LOL
I agree with much of what you said. I never saw the episode you mention, but Goober, and especially Gomer, were pretty high on the creepmeter for me. I liked Barney and Ernest T., and the Darlings were great.