...several of the first presidents, including Jefferson and Madison, generally refused to issue public prayers, despite importunings to do so. Under pressure, Madison relented in the War Of 1812, but held to his belief that chaplains shouldn't be appointed to the military or be allowed to open Congress.
James Madison[I]t is more convenient to prevent the passage of a law, than to declare it void after it has passed.
James MadisonWe maintain therefore that in matters of Religion, no man's right is abridged by the institution of Civil Society, and that Religion is wholly exempt from its cognizance.
James Madison