Don't worry about it. I'm an American living in Scotland.
Yonder. Yon.
This plays right into the discussion you brought up about words being added, devalued and lost in the English language. In my life, I have heard the word "yon" used by a normal person exactly once and that was in Northern Ireland. The fellow was from a rural community and he used it quite matter-of-factly, as if he used it all the time. He was a coworker and his sentence was "Do you see yon skiff? Could you pick it up with the forklift?"
Yon is the archaic and/or dialectic form of the word yonder. They are both totally legitimate words. Using them in no way reflects poorly upon a person or besmirches their background but as I found out when I left my Georgia home for the Army and the world at large, Americans outside of the South think the word yonder sounds like "hick-speak".
This is how it goes even though there's no logic, no rhyme or reason behind it. Yonder is just as legitimate as any other word. In no way can it indicate ignorance or simpleness, in fact, failing to use the word is only limiting your vocabulary. (not yours- just generally speaking)
On 9/11 the BBC made fun of President Bush's use of the word "folks". They were quite plainly looking down their noses at him even though in the sense of what he was trying to convey, folks was a totally legitimate word choice.
The way language morphs and evolves is a strange business. It's sad to see so many words go into disuse because of silly reasons like this. I would much rather see people use the word "yon" regularly than to hear the word bling-bling to often. It's actually a beautiful word as is yonder. "Yonder is trouble looking to be found", for example. It's a pity to see the word not used more widely.