Yeah, I had some problems socializing as a youngster(but for different reasons) so I can relate. I took everything literally, and expected others to do the same. I think I was nearly twenty before I started to feel halfway comfortable with popular phrases and the fact that people don’t mean things literally. I still remember being disgusted with people for parroting the stupid things we say to each other as greetings...hi, how is your day...are you having a good day...how are you doing today...and other nonsense. My feeling was if you couldn’t think of anything more meaningful to say I would prefer you keep your thoughts to yourself. And I had a habit of telling people literally what I thought, although not with insulting words. So you can imagine what the average small talk was like for me...pure torture is what. They would almost always end up calling me names which would result in me literally punching them in the face. Yep, age 5 through 15 was not exactly a fairy tale for me. I think part of it was genetic. I still remember my mother and grandmother both saying sternly “state your business” when a stranger would approach them with meaningless chit chat.
Likewise. When you don't fit these years seem to be some of the worst. I was lucky to have a couple of loyal friends who weren't mainstream also. Still have them. One of the few TV shows I watch is “Big Bang Theory” sometimes because I sympathize with social clumsiness of the characters.