I share your sentiments. However, there is a possibility that what you are tasting is an inactive coating, made of some paste with sugar as a component. Many drugs have such coatings, to delay absorbtion and cover the awful taste of the active ingredients.
It’s not the coating - I bit into the pill, sweet all the way through. My m-i-l is a doctor and says that most prescription medications taste bitter, and if it isn’t bitter, there may be something wrong with it. So I’m a pill biter by habit now. Folic acid isn’t supposed to be bitter however but sour.