There never was a sounder logical maxim of scientific procedure than Ockham's razor: Entia non sunt multiplicanda praeter necessitatem. That is to say; before you try a complicated hypothesis, you should make quite sure that no simplification of it will explain the facts equally well.
Charles Sanders PeirceIt is a common observation that those who dwell continually upon their expectations are apt to become oblivious to the requirements of their actual situation.
Charles Sanders PeirceAll the progress we have made in philosophy ... is the result of that methodical skepticism which is the element of human freedom.
Charles Sanders PeirceWe should chiefly depend not upon that department of the soul which is most superficial and fallible (our reason), but upon that department that is deep and sure, which is instinct.
Charles Sanders PeirceKepler's discovery would not have been possible without the doctrine of conics. Now contemporaries of Kepler-such penetrating minds as Descartes and Pascal-were abandoning the study of geometry ... because they said it was so UTTERLY USELESS. There was the future of the human race almost trembling in the balance; for had not the geometry of conic sections already been worked out in large measure, and had their opinion that only sciences apparently useful ought to be pursued, the nineteenth century would have had none of those characters which distinguish it from the ancien régime.
Charles Sanders PeirceAmong the minor, yet striking characteristics of mathematics, may be mentioned the fleshless and skeletal build of its propositions; the peculiar difficulty, complication, and stress of its reasonings; the perfect exactitude of its results; their broad universality; their practical infallibility.
Charles Sanders PeirceTo suppose universal laws of nature capable of being apprehended by the mind and yet having no reason for their special forms, but standing inexplicable and irrational, is hardly a justifiable position. Uniformities are precisely the sort of facts that need to be accounted for. Law is par excellence the thing that wants a reason. Now the only possible way of accounting for the laws of nature, and for uniformity in general, is to suppose them results of evolution.
Charles Sanders Peirce