CoChat
Sign Up
PreprintCited by 577Bayesian Modeling and Causal InferenceLogic, programming, and type systemsLogic, Reasoning, and Knowledge

Church: a language for generative models

Open access
Goodman, Noah, Mansinghka, Vikash, Roy, Daniel M., Bonawitz, Keith, Tenenbaum, Joshua B.·2012·arXiv
DOI 10.48550/arxiv.1206.3255arXiv 1206.3255
Open this paper in CoChat — free accountOpen PDF

Abstract

We introduce Church, a universal language for describing stochastic generative processes. Church is based on the Lisp model of lambda calculus, containing a pure Lisp as its deterministic subset. The semantics of Church is defined in terms of evaluation histories and conditional distributions on such histories. Church also includes a novel language construct, the stochastic memoizer, which enables simple description of many complex non-parametric models. We illustrate language features through several examples, including: a generalized Bayes net in which parameters cluster over trials, infinite PCFGs, planning by inference, and various non-parametric clustering models. Finally, we show how to implement query on any Church program, exactly and approximately, using Monte Carlo techniques.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1206.3255

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Probabilistic programming provides one such formal representation, allowing world models to be specified as (possibly Turing-complete) programs that integrate probabilistic uncertainty, symbolic code, and learned differentiable components.

    “Probabilistic programming provides one such formal representation, allowing world models to be specified as (possibly Turing-complete) programs that integrate probabilistic uncertainty, symbolic code, and learned differentiable components (Milch et al., 2007;Goodman et al., 2012;Bingham et al., 2019;Cusumano-Towner et al., 2019;Fremont et al., 2019).”

    From Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems (2024) · cites this paper as Goodman et al., 2012

    The Introduction (p. 1) describes Church as a formal stochastic programming language for generative models, and the Discussion (p. 9) describes its lambda-calculus basis and ability to compose generative processes. These passages support the probabilistic-program and symbolic-code aspects, but our copy does not establish that Church integrates learned differentiable components. (LLM, conf=0.87)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 16

  1. [1][1] H. Abelson and G. Sussman. Structure and Interpretation of Computer Programs . MIT Press, 1996. -
  2. [2][2] M.J. Beal, Z. Ghahramani, and C.E. Rasmussen. The infinite hidden Markov model. NIPS 14 , 2002. -
  3. [3][3] K. A. Bonawitz. Composable Probabilistic Inference with Blaise . PhD thesis, MIT, 2008. -
  4. [4][4] A. Church. A Set of Postulates for the Foundation of Logic. The Annals of Mathematics , 33(2):346-366, 1932. -
  5. [5][5] M. Johnson, T. Griffiths, and S. Goldwater. Adaptor grammars: A framework for specifying compositional nonparametric Bayesian models. NIPS 19 , 2007. -
  6. [6][6] R. Kelsey, W. Clinger, and J. Rees (eds.). Revised 5 Report on the Algorithmic Language Scheme. HigherOrder and Symbolic Computation , 11(1):7-105, 1998. -
  7. [7][7] C. Kemp, J.B. Tenenbaum, T.L. Griffiths, T. Yamada, and N. Ueda. Learning systems of concepts with an infinite relational model. Proc. 21st Natl Conf. Artif. Intell., AAAI Press , 2006. -
  8. [8][8] P. Liang, S. Petrov, M.I. Jordan, and D. Klein. The Infinite PCFG using Hierarchical Dirichlet Processes. Proc. EMNLP-CoNLL , 2007. -
  9. [9][9] D.J. Lunn, A. Thomas, N. Best, and D. Spiegelhalter. WinBUGS-A Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing , 10(4):325-337, 2000. -
  10. [11][11] J. McCarthy. A Basis for a Mathematical Theory of Computation. In Computer Programming and Formal Systems , pages 33-70, 1963. -
  11. [12][12] B. Milch, B. Marthi, S. Russell, D. Sontag, D.L. Ong, and A. Kolobov. BLOG: Probabilistic models with unknown objects. Proc. IJCAI , 2005. -
  12. [13][13] S. Muggleton. Stochastic logic programs. In L. de Raedt, editor, Advances in Inductive Logic Programming , pages 254-264. IOS Press, 1996. -
  13. [14][14] A. Pfeffer. IBAL: A probabilistic rational programming language. Proc. IJCAI , 2001. -
  14. [17][17] J.C. Reynolds. Definitional interpreters for higherorder programming. ACM Annual Conference , pages 717-740, 1972. -
  15. [18][18] M. Richardson and P. Domingos. Markov logic networks. Machine Learning , 62(1):107-136, 2006. -
  16. [19][19] T. Sato and Y. Kameya. PRISM: A symbolicstatistical modeling language. In International Joint Conference on Artificial Intelligence , 1997. -

Cited by

Sorted by citations

Authors
Goodman, N., Mansinghka, V., Roy, D. M., Bonawitz, K., & Tenenbaum, J. B.
Affiliations
MIT Computer Science and Artificial Intelligence Laboratory (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2012
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1206.3255
arXiv
1206.3255
OpenAlex
W1890754682
Cited by
577
References
0
Citations by year
2026: 2 · 2025: 1 · 2024: 7 · 2023: 13 · 2022: 26 · 2021: 36 · 2020: 42 · 2019: 67 · 2018: 52 · 2017: 45 · 2016: 62 · 2015: 72 · 2014: 40 · 2013: 39 · 2012: 20
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
  • Physical Sciences › Computer Science › Artificial Intelligence › Logic, programming, and type systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Logic, Reasoning, and Knowledge
Keywords
church language, generative models, lambda calculus, LISP, nonparametric models, Bayesian networks, nonparametric clustering, conditional distributions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review