Actually, something like this can happen. The best way to demonstrate this is to get out some black and white film and take some pictures with a red filter over the lens. That would simulate blue-blindness (although human blue-blindness is not exactly equivalent).I had a college professor with a blue deficiency. He said he could see blue in sunlight, but in dimmer light, blue objects looked black. Since he could see and understand blue, he could describe the perceived difference.
All objects in the real world have complex spectral distributions. Nothing in real life emits or reflects a single wavelength. There are an infinite number of possible mixtures of spectral colors that can give the subject impression of green (or any specified shade).
I'm sory, but you are JUST missing the point we are making.
Perception of color is NOT "color"
Yes, all things emit (or reflect) radiation to give the appearance of color. But that means color is of itself, in existance, and it does not require man for it to be.