>>What then are we trying to create when we create “intelligence” scientifically?
Currently AI is working on noisy pattern recognition and natural language processing. The outcome is problem specific and amoral. We may eventually get to a point where we can talk to a computer and have it simulate feelings to facilitate communication, but abstract philosophical thinking and moral behavior is not along the current path of AI.
In fact, AI has gotten “dumber” recently, and backed away from serious problems that originated the field in favor of statistical text and image processing algorithms that end up being incomprehensible once trained.
We have enough problems with our computers doing things we don’t want them to do, without having them actually DESIGNED to make their own decisions with their own goals in mind.