Perhaps not physically, but what about emotionally, developmentally, and morally?
I would say that's the result of the situation (which is ultimately the mother's responsibility) rather than anything the man does.