In physics, your solution should convince a reasonable person. In math, you have to convince a person who's trying to make trouble. Ultimately, in physics, you're hoping to convince Nature. And I've found Nature to be pretty reasonable.
Frank WilczekWhen religion talks about our aspirations and our sense of morality, I do not believe that science can contradict it. However, when religion contradicts science on matters of fact, religion must yield.
Frank Wilczek