Watergate had a cumulative effect in 1976.
Also, Reagan gave Ford a serious run in the primaries, and many in the GOP couldn’t enthusiastic support of an establishment guy like Ford.
I should have added that my comment was made purely as a student of history (and second hand from relatives), as I was but 6 1/2 months old when Jimmuh was elected.