Me too and I regret it. Should have never been tolerant of my little brother having gay friends. He went from completely straight in HS and now he is 24 and getting more flaming by the day. I won’t let my 4 year old son around him unless it is in a large social situation and I try to limit those to as few as possible since his “friend” is always there and my wife and I are the only ones in the family that won’t accept him. In fact, we did Christmas dinner this year and he showed up with my brother uninvited. I’ve had it. If he wants to be around my child, he can be the bachelor uncle and figure out what he is when he is old enough to figure it out on his own. One thing he will not be; however, is the gay uncle.
Your doing the right thing.