It may be appropriate to quote a statement of Poincare, who said (partly in jest no doubt) that there must be something mysterious about the normal law since mathematicians think it is a law of nature whereas physicists are convinced that it is a mathematical theorem.
Henri PoincareAll the scientist creates in a fact is the language in which he enunciates it. If he predicts a fact, he will employ this language, and for all those who can speak and understand it, his prediction is free from ambiguity. Moreover, this prediction once made, it evidently does not depend upon him whether it is fulfilled or not.
Henri PoincareHow is it that there are so many minds that are incapable of understanding mathematics? ... the skeleton of our understanding, ... and actually they are the majority. ... We have here a problem that is not easy of solution, but yet must engage the attention of all who wish to devote themselves to education.
Henri Poincare