It's better to solve the right problem approximately than to solve the wrong problem exactly.
John TukeyIn a single sentence the moral is: admit that complexity always increases, first from the model you fit to the data, thence to the model you use to think about and plan about the experiment and its analysis, and thence to the true situation.
John Tukey