I read for my pleasure, not to impress other people. Some of what I read winds up on the literati’s list of what people “should” read, most of it doesn’t, I don’t care one way or the other. Most folks who throw around quotes are just douches trying to impress people, I learned long ago that anybody that feels an internal need to impress the people around them isn’t impressive, so as soon as somebody throws a literati quote out I know to ignore them.
Taste has to be developed. If one doesn’t like Henry James or James Joyce the fault is not with them but with the reader. The obligation is on you to get to their level of sensibility.