I'm sure he'll realise one day that to do that the super AI will have to get rid of money (after figuring out how to get us to post-scarcity, of course) - or at least demand it be redistributed fairly.
Ain't no way the millionaires and billionaires of the world are going to accept being on equal footing with the poors, haha. Outside of the folks that fear Skynet, I imagine this is the real concern with alignment.
How can a being of pure logic look past the hoarding of resources? If a monkey in captivity was hoarding all the food we'd step in and make sure the other monkeys had food to eat. I have to imagine the next intelligence above us would consider doing the same for us if given the power to do so.
We'll never get to a point without an "Us vs Them", or "Have and Have Nots" - it's tragic, and I really hope I'm wrong, but I have infinite doubt on this one.
Having said that I'll give anything a go, we're still stuck in the age of monarchies over here on Normal Island. AI wants to take over? I'm down to give it a shot as long as it promises to not wear a crown during a recession, haha
I don't buy this at all, you're attempting to model a "superintelligence" and the idea that your 100-150 IQ mind is able to properly guess what a being order of magnitudes smarter would think or feel seems like nonsense
Well that is fair, and I think that is the entire concern with artificial super intelligence isn't it? That we can't predict what it would do.
If I could accurately predict what a superintelligence's goals would be I'd have a decent career advising AI companies on their alignment concerns :)
Just taking a swing at it with this ol' legacy wet brain because it's fun to think about. There's nothing to buy, it is an opinion. Heck, it's practically just an exercise in writing science fiction at this stage.
A focus on intelligence as being the most salient feature of one's awareness seems like a human thing. I assume that an octopus would wonder how many arms the AI has. Maybe the AI will relate to itself first as a distributed being rather than as an intelligent being, who knows.
Ain't no way the millionaires and billionaires of the world are going to accept being on equal footing with the poors, haha. Outside of the folks that fear Skynet, I imagine this is the real concern with alignment.
How can a being of pure logic look past the hoarding of resources? If a monkey in captivity was hoarding all the food we'd step in and make sure the other monkeys had food to eat. I have to imagine the next intelligence above us would consider doing the same for us if given the power to do so.
We'll never get to a point without an "Us vs Them", or "Have and Have Nots" - it's tragic, and I really hope I'm wrong, but I have infinite doubt on this one.
Having said that I'll give anything a go, we're still stuck in the age of monarchies over here on Normal Island. AI wants to take over? I'm down to give it a shot as long as it promises to not wear a crown during a recession, haha