The First Amendment was not intended to withdraw the Christian religion as a whole from the protection of Congress.

The duty imposed upon him [the president] to take care that the laws be faithfully executed, follows out the strong injunctions of his oath of office, that he will 'preserve, protect, and defend the Constitution.' The great object of the executive department is to accomplish this purpose; and without it, be the form of government whatever it may, it will be utterly worthless for offence or defense; for the redress of grievances or the protection of rights; for the happiness, or good order, or safety of the people.

The state governments have a full superintendence and control over the immense mass of local interests of their respective states, which connect themselves with the feelings, the affections, the municipal institutions, and the internal arrangements of the whole population. They possess, too, the immediate administration of justice in all cases, civil and criminal, which concern the property, personal rights, and peaceful pursuits of their own citizens.

[The necessary and proper clause] neither enlarges any power specifically granted; nor is it a grant of any new power to Congress; But it is merely a declaration, for the removal of all uncertainty, that the means of carrying into execution those otherwise granted are included in the grant.

I verily believe Christianity necessary to the support of civil society. One of the beautiful boasts of our municipal jurisprudence is that Christianity is a part of the Common Law... There never has been a period in which the Common Law did not recognize Christianity as lying its foundations.

How much more do they deserve our reverence and praise, whose lives are devoted to the formation of institutions, which, when they and their children are mingled in the common dust, may continue to cherish the principles and the practice of liberty in perpetual freshness and vigour.

There never has been a period of history, in which the Common Law did not recognize Christianity as lying at its foundation.