Well, for one thing, if you wish to call "man" an animal, I will allow it for this discussion. (Seeing as I cannot know what an animal thinks)
I know a guy who is color-blind to blue. He knows a beautiful day when he sees it out his window though. He's reacting to the appearances without reacting to color. But how does he know its beautiful? It's gray to him!
If color exists independently of the eye and brain, why will some people say that two color chips match exactly, and other people say they don't?