What you need is the functional ability to perform certain tasks. It's known as a waiver of demonstrated ability and is issued by your local, friendly FAA inspector.
An instructor of mine always failed the color vision portion of the physical. In flight, however, he had no difficulty identifying aviation red and green.