Each case is different. We had pilots shot down and captured during the Vietnam War. They were not stigmatized when they were released because they lost their aircraft. Some were promoted to flag rank and others received the MOH. The same holds true for other wars. Check out this article in the Naval Institute Proceedings:
Confronting the Chinese