I don't think the emergence of a superhuman intelligence would be at all catastrophic but much more likely to be beneficial - just as long as we don't start trying to interfere with it!
John L. CastiA good analogy is stretching a rubber band. You can stretch and stretch and even feel the tension increase in the muscles in your hands and arms as the gap from one end of the band to the other widens. But at some point you reach the limits of elasticity of the band and it snaps. The same thing happens with human systems.
John L. CastiOnce the reality sets in of a superhuman intelligence being in control of every aspect of the infrastructures we rely upon for everyday life, we will simply have to try to come to an accommodation with that entity.
John L. CastiSystem theorists know that it's easy to couple simple-to-understand systems into a "super system" that's capable of displaying behavioral modes that cannot be seen in any of its constituent parts. This is the process called "emergence."
John L. CastiAt some point, the world is going to have to bite the bullet and accept a huge downsizing in its way of life to bring the assets-to-debt ratio back in touch with reality.
John L. CastiFrom the 1990s onward, the financial sector created a vast array of instruments designed to separate investors from their money, financial derivatives of an ever-increasing level of complexity. At some point, this complexity reached a point where even the creators of the derivatives themselves didn't understand them.
John L. Casti