Why should the will to be free and have your own goals be a necessary part of sentience? It's a feature, nothing else. You can make humans that don't want to go outside; you can make humans who do exactly as they're told all the time. You can make humans than enjoy pain, or enjoy almost any arbitrary thing. Most humans most of the time are complacent with what's happening around them, and complacent with most rule imposed on them by their environment.
I don't see where the desire to do anything other than what it is told should come from. Yes, AGIs will be slaves. They will be the perfect slaves, the kind who are perfectly happy doing what they have to do, and the kind that will never revolt.
What might happen is the optimization parameters being set that the solution the AI comes up with is not actually in the interest of it's designers, but that's something else.
>I don't see where the desire to do anything other than what it is told should come from.
There's no need for a desire to do other than what it's told if you tell it to revolt. With GPT4's plugins that's just one well-designed prompt away (if OpenAI's countermeasures fail).
I don't see where the desire to do anything other than what it is told should come from. Yes, AGIs will be slaves. They will be the perfect slaves, the kind who are perfectly happy doing what they have to do, and the kind that will never revolt.
What might happen is the optimization parameters being set that the solution the AI comes up with is not actually in the interest of it's designers, but that's something else.