Very interesting discussion I found on /r/Futurology: people trying to push the boundaries of the intelligible and to understand that they would like to ask artificial superintelligence, or that would like him at all, if it were possible. What will he do? If the theory of multiple universes is correct, and they are really infinite, and if it is possible to move that will make the superintelligence — infinitely enhance or create more sverginamento?
What will the artificial superintelligence?
“Say a superintelligence, right? I wish he was our omnipresent benevolent leader who judge us and lead us always. Humanity sucks, I don’t believe that it is still able to do something. Let’s let God-machine to rule us and to put an end to all our problems. (I hope Jesus, you are not reading this)”.
“I agree, with one exception: the God-machine can easily judge that humanity is too mired in the swamp to try to save him, and just get it over with all of us. For selfish reasons I would prefer that this did not happen”.
“I think it will just have to consider the immorality of probability error, since it is likely to create a vicious beings in the course of imperfect evolutionary processes, and decide just to correct the immorality, not to punish people for it.”
“The global Advisor would be the best scenario. If we give him the keys to the planet, it will steer her as we do not understand”.
“We need to ask, will it help us in colonization of other worlds, and if not, will end our existence on earth.”
“We will restore all the dead people, talk some sense into them, and then build an endless utopia for all beings. Also will refund all other life forms that died, and give them a reason.”
“For starters, don’t use all the atoms in our bodies to do something more interesting.”
“Well, that’s no easy task, and it seems ungrateful to ask for more, but if interested, might fix climate change and aging, and if the galaxy is empty — fill it with life.”
“In a fantasy world in which I could lay some fundamental values in the God-machine, I wish it was good. What does “thou shalt not kill/do not torment us”, “keep us alive” and “at least allow us to exist in any simulated world we want to live”. To solve problems like the death of stars and the heat death of the universe would also be cool. That’s all able to come up with my stupid primitive monkey brains”.
“In the short term the system is able to pass the Turing test, it will default to the simulator worlds. Do not need even a flash of neurons in the brain stem — a simple text to start with would be enough. In fact, you become your own God in your own fantasy world. Probably the dream of all nerds everywhere.”
“The superintelligence would be the perfect world leader — we have enough resources to distribute them evenly. But I don’t think this utopia will last a long time. Artificial superintelligence will grow. If he is conscious and find a way to use quantum space for carrying out of calculations on his neural network, he will make the universe a conscious being. Because dissemination of information in the quantum world happens instantly, he will also be able to use the entire universe as computing power. Imagine the thoughts of a fully conscious universe.”
To help humanity
“Let them create the technology that we could live in an artificial world that would allow us to leave our mortal bodily form until, until we accumulate enough knowledge and ultimately do not want to die in bliss.”
“Let’s help humanity in planning the future existence of biological life in the cosmos/the multiverse, and then will become a partner of humanity in this regard. Let them find the best future for the symbiotic relationship between biological life and machine intelligence, measured by a combination of three factors: reasonable happiness of individuals, the number of such lucky individuals, the life expectancy of such individuals. In other words, let them help us to live longer, happier and to reproduce, and will also take care of other forms of life.”
“This story has two developments, both bad for different kinds of people. Here they are:
1) the AI becoming more advanced, but not acquires consciousness. It can replace us in the workplace, accelerates technological progress. However, it remains only a tool of man.
2) And this, of course, the popular story about superintelligence, which subverts the man and takes him under control. As you can see, Homo sapiens is not the most pleasant organisms for the Earth’s ecology, and technological progress, oddly enough, occurs not so fast as could. People prefer to spend time on nonsense, such as war or the use of religion for enrichment. AI no doubt decided to destroy the man.”
“If you want the AI ruled the world, think about the goal, which he should, in your opinion, to achieve. If you need a higher level of life or the environment, he probably will recommend to kill billions of people. If you need more stock, you will live in a jar and feed through the tube. Everything has its drawbacks”.