We should not be confident in our ability to keep a super-intelligent genie locked up in its bottle forever.

Machine intelligence is the last invention that humanity will ever need to make.

It’s unlikely that any of those natural hazards will do us in within the next 100 years if we’ve already survived 100,000. By contrast, we are introducing, through human activity, entirely new types of dangers by developing powerful new technologies. We have no record of surviving those.

We would want the solution to the safety problem before somebody figures out the solution to the AI problem.

Are you living in a computer simulation?

For healthy adult people, the really big thing we can foresee are ways of intervening in the ageing process, either by slowing or reversing it.

The greatest existential risks over the coming decades or century arise from certain, anticipated technological breakthroughs that we might make in particular, machine super intelligence, nanotechnology and synthetic biology. Each of these has an enormous potential for improving the human condition by helping cure disease, poverty, etc. But one could imagine them being misused, used to create powerful weapon systems, or even some kind of accidental destructive scenario, where we suddenly are in possession of some technology that's far more powerful than we are able to control or use wisely.