System theorists know that it's easy to couple simple-to-understand systems into a "super system" that's capable of displaying behavioral modes that cannot be seen in any of its constituent parts. This is the process called "emergence."
John L. CastiWhat distinguishes a mathematical model from, say, a poem, a song, a portrait or any other kind of "model," is that the mathematical model is an image or picture of reality painted with logical symbols instead of with words, sounds or watercolors.
John L. CastiMy own guess is that quite quickly the machine intelligence will start dreaming machine dreams and thinking machine thoughts, both of which would totally incomprehensible to us. This would then lead to each species, we and the machines, moving off on to its own separate life trajectory.
John L. CastiIn fact, the very nature of an X-event is that it is both rare and surprising. So I would not say that any specific X-event is likely. What I would say, though, is that some X-event is not only plausible, but very likely in a time scale of a few years.
John L. CastiFrom the 1990s onward, the financial sector created a vast array of instruments designed to separate investors from their money, financial derivatives of an ever-increasing level of complexity. At some point, this complexity reached a point where even the creators of the derivatives themselves didn't understand them.
John L. Casti