Once you've created an intelligence so smart, the real job of that intelligence is to protect itself from other intelligences becoming more intelligent than it. It's just kind of like human beings. The way you look at money or the way you look at the success of your child, you always want to make sure that as far as it gets, it can protect itself and continue forward. So I think any type of intelligence, no matter what it is, is going to have this very basic principle to protect the power that it has gained.
Zoltan IstvanIn the future it's very possible you could have an artificial intelligence system that can run the country better than a human being. Because human beings are naturally selfish. Human beings are naturally after their own interests. We are geared towards pursuing our own desires, but oftentimes, those desires have contrasts to the benefit of society, at large, or against the benefit of the greater good. Whereas, if you have a machine, you will be able to program that machine to, hopefully, benefit the greatest good, and really go after that.
Zoltan IstvanThe chances of human beings being the only intelligent form of life in the universe are so minuscule that it's really kind of crazy to actually - no scientist could ever argue that we would be alone. It's much more likely that there are hundreds of thousands of other intelligences and other life forms out there in the universe just based on a strictly mathematical formula. And what that means is that artificial intelligence has probably already occurred in the universe.
Zoltan IstvanIf there's something else already out there in the universe, it would almost certainly have puts limits on our growth of intelligence. And the reason it would have put limits on us is because it doesn't want us to grow so intelligent that we would one day maybe take away their superpowered intelligence. Whatever advanced intelligence evolves, it always puts a roadblock in the way of other intelligences evolving. And the reason this happens is so nobody can take away one's power, no matter how far up the ladder they've gone.
Zoltan Istvan