I don’t understand what Hawking is worried about. After all, doesn’t he already believe that human beings are just flukes of some cosmic burp from a universe that just happens to exist? A universe that has no design or particular meaning? In essence, we just happen to exist because we just do?
So, if human beings are meaningless arrangements of molecules and something like Ai comes along, and humans, by survival of the fittest are replaced by the better, stronger, more intelligent - so what? Our existence was meaningless to begin with so no big loss.
What if our health insurance is completely defined and reacted to and controlled by computer systems. The only goals of these systems is to maintain and improve efficiency. Although we get close these days, what happens when there is zero compassion for the individual, zero methods to appeal or contest these computerized decisions?
This can happen with education and housing and employment, where there is no human interaction at all. That’s not what I want. I enjoy a little human interaction during my waking hours.