Your strength as a rationalist is your ability to be more confused by fiction than by reality. If you are equally good at explaining any outcome, you have zero knowledge.
Eliezer YudkowskyIf you want to build a recursively self-improving AI, have it go through a billion sequential self-modifications, become vastly smarter than you, and not die, you've got to work to a pretty precise standard.
Eliezer Yudkowsky- With respect, Professor McGonagall, I'm not quite sure you understand what I'm trying to do here. - With respect, Mr. Potter, I'm quite sure I don't. Unless - this is a guess, mind - you're trying to take over the world? - No! I mean yes - well, NO! - I think i should perhaps be alarmed that you have trouble answering the question.
Eliezer YudkowskyThe AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else.
Eliezer YudkowskyIf dragons were common, and you could look at one in the zoo - but zebras were a rare legendary creature that had finally been decided to be mythical - then there's a certain sort of person who would ignore dragons, who would never bother to look at dragons, and chase after rumors of zebras. The grass is always greener on the other side of reality. Which is rather setting ourselves up for eternal disappointment, eh? If we cannot take joy in the merely real, our lives shall be empty indeed.
Eliezer Yudkowsky