I carried one in the Army, and the weight never bothered me one bit. But I couldn’t imagine trying to conceal it, since it is bulky.
I had the same issue back when it was the only pistol I had at the time. I just wore longer, bulkier shirts.