If human beings are losing every time, it doesn't matter whether they're losing to a conscious machine or an completely non conscious machine, they still lost. The singularity is about the quality of decision-making, which is not consciousness at all.
Stuart J. RussellWhen people talk about the singularity, when people talk about superintelligent AI, they're not talking about sentience or consciousness. They're talking about superhuman ability to make high-quality decisions.
Stuart J. RussellIt's unlikely that machines would spontaneously decide they didn't like people, or that they had goals in opposition to those of human beings.
Stuart J. RussellGoogle or other search engines are examples of AI, and relatively simple AI, but they're still AI. That plus an awful lot of hardware to make it work fast enough.
Stuart J. RussellSome PhD physicists write software or work for hedge funds, but physics still has a problem with having very smart people but not enough opportunities.
Stuart J. RussellWhat AI could do is essentially be a power tool that magnifies human intelligence and gives us the ability to move our civilization forward. It might be curing disease, it might be eliminating poverty. Certainly it should include preventing environmental catastrophe. If AI could be instrumental to all those things, then I would feel it was worthwhile.
Stuart J. Russell