There never was a sounder logical maxim of scientific procedure than Ockham's razor: Entia non sunt multiplicanda praeter necessitatem. That is to say; before you try a complicated hypothesis, you should make quite sure that no simplification of it will explain the facts equally well.
Charles Sanders PeirceFor example, there are numbers of chemists who occupy themselves exclusively with the study of dyestuffs. They discover facts that are useful to scientific chemistry; but they do not rank as genuine scientific men. The genuine scientific chemist cares just as much to learn about erbium-the extreme rarity of which renders it commercially unimportant-as he does about iron. He is more eager to learn about erbium if the knowledge of it would do more to complete his conception of the Periodic Law, which expresses the mutual relations of the elements.
Charles Sanders PeirceThere is a kink in my damned brain that prevents me from thinking as other people think.
Charles Sanders PeirceIt is the man of science, eager to have his every opinion regenerated, his every idea rationalized, by drinking at the fountain of fact, and devoting all the energies of his life to the cult of truth, not as he understands it, but as he does not yet understand it, that ought properly to be called a philosopher.
Charles Sanders PeirceTrue science is distinctively the study of useless things. For the useful things will get studied without the aid of scientific men. To employ these rare minds on such work is like running a steam engine by burning diamonds.
Charles Sanders Peirce