...several of the first presidents, including Jefferson and Madison, generally refused to issue public prayers, despite importunings to do so. Under pressure, Madison relented in the War Of 1812, but held to his belief that chaplains shouldn't be appointed to the military or be allowed to open Congress.

What spectacle can be more edifying or more seasonable, than that of Liberty and Learning, each leaning on the other for their mutual and surest support?

[T]he delegation of the government, in [a republic], to a small number of citizens elected by the rest . . . [is] to refine and enlarge the public views by passing them through the medium of a chosen body of citizens, whose wisdom may best discern the true interest of their country and whose patriotism and love of justice will be least likely to sacrifice it to temporary or partial considerations.

As to the permanent interest of individuals in the aggregated interests of the community, and in the proverbial maxim, that honesty is the best policy, present temptation is often found to be an overmatch for those considerations.

Since it is impossible for the people spontaneously and universally, to move in concert towards their object; and it is therefore essential, that such changes be instituted by some informal and unauthorized propositions, made by some patriotic and respectable citizen or number of citizens.

Our Constitution represents the work of the finger of Almighty God.

[T]he bill exceeds the rightful authority to which governments are limited by the essential distinction between civil and religious functions, and violates in particular the article of the Constitution of the United States which declares that Congress shall make no law respecting a religious establishment.... This particular church, therefore, would so far be a religious establishment by law, a legal force and sanction being given to certain articles in its constitution and administration.