The "just for fun" aspect of female nipples is learned, you know. There's no evolutionary need for them to be pleasurable. I would argue that if mens nipples were emotionally thought of as sensual, they would be sensual.
It's all up here >>>points to brain<<<
Actually, I have heard a theory that endorphins are released during nursing...you sit and rock, feeding the kid, and it's pleasant.