Perhaps the problem is the seeming need that people have of making black-and-white cutoffs when it comes to certain mysterious phenomena, such as life and consciousness. People seem to want there to be an absolute threshold between the living and the nonliving, and between the thinking and the "merely mechanical," ... But the onward march of science seems to force us ever more clearly into accepting intermediate levels of such properties.
Douglas HofstadterSometimes it seems as though each new step towards AI, rather than producing something which everyone agrees is real intelligence, merely reveals what real intelligence is not.
Douglas HofstadterHofstadter's Law: It always takes longer than you expect, even when you take into account Hofstadter's Law
Douglas HofstadterHow gullible are you? Is your gullibility located in some "gullibility center" in your brain? Could a neurosurgeon reach in and perform some delicate operation to lower your gullibility, otherwise leaving you alone? If you believe this, you are pretty gullible, and should perhaps consider such an operation.
Douglas Hofstadter