Correct. Also, I prefer/demand a government that acknowledges a power greater than itself. If government fails to acknowledge the existene of God (in whatever form or version that may manifest itself as) then all rights have to come from somewhere -- without God, those rights are entirely determined by man; therefore, those rights are subject to change by man. It undermines the inalienable nature of our most cherished rights.
Having said that, do I want Judeo-Christian statutes and symbols adorning court house and capitol grounds? No. It comes too close to violating the establishment clause, and it opens the jurisidiction up to the possibility of having fringe religions demanding their own little plot of ground. It's better to avoid that entirely.