CoChat
Sign Up
PreprintCited by 36Logic, Reasoning, and KnowledgeNatural Language Processing TechniquesTopic Modeling

From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought

Open access
Wong, Lionel, Grand, Gabriel, Lew, Alexander K., Goodman, Noah D., Mansinghka, Vikash K., Andreas, Jacob, Tenenbaum, Joshua B.·2023·arXiv
DOI 10.48550/arxiv.2306.12672arXiv 2306.12672
Open this paper in CoChat — free accountOpen PDF

Abstract

How does language inform our downstream thinking? In particular, how do humans make meaning from language--and how can we leverage a theory of linguistic meaning to build machines that think in more human-like ways? In this paper, we propose rational meaning construction, a computational framework for language-informed thinking that combines neural language models with probabilistic models for rational inference. We frame linguistic meaning as a context-sensitive mapping from natural language into a probabilistic language of thought (PLoT)--a general-purpose symbolic substrate for generative world modeling. Our architecture integrates two computational tools that have not previously come together: we model thinking with probabilistic programs, an expressive representation for commonsense reasoning; and we model meaning construction with large language models (LLMs), which support broad-coverage translation from natural language utterances to code expressions in a probabilistic programming language. We illustrate our framework through examples covering four core domains from cognitive science: probabilistic reasoning, logical and relational reasoning, visual and physical reasoning, and social reasoning. In each, we show that LLMs can generate context-sensitive translations that capture pragmatically-appropriate linguistic meanings, while Bayesian inference with the generated programs supports coherent and robust commonsense reasoning. We extend our framework to integrate cognitively-motivated symbolic modules (physics simulators, graphics engines, and planning algorithms) to provide a unified commonsense thinking interface from language. Finally, we explore how language can drive the construction of world models themselves. We hope this work will provide a roadmap towards cognitive models and AI systems that synthesize the insights of both modern and classical computational perspectives.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2306.12672

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Existing approaches either plan directly in natural language or use LLMs to translate from natural language to structured world models.

    “Existing approaches either plan directly in natural language (Huang et al., 2022c; Ahn et al., 2022) or use LLMs to translate from natural language to structured world models (Wong et al., 2023; Liu et al., 2023a; Zhang et al., 2023a; Li et al., 2023a; Guan et al., 2023; Silver et al., 2022; 2023).”

    From Cognitive Architectures for Language Agents (2023) · cites this paper as Wong et al., 2023

  • Inference in these programs can be used to reason over relational domains, grounded domains, and situations requiring planning and understanding the plans of others.

    “inference in these programs can be used to reason over relational domains (like kinship systems), grounded domains (like visual scenes), and situations that require planning and understanding the plans of others.”

    From Dissociating language and thought in large language models (2024) · cites this paper as [149]

  • Codex can translate text input into meaningful structured probabilistic programs.

    “a version of GPT-3 fine-tuned to generate both natural language and code (Codex) can translate text input into meaningful structured probabilistic programs”

    From Dissociating language and thought in large language models (2024) · cites this paper as [149]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 302

  1. Adolphs, R. (2009). The social brain: neural basis of social knowledge. Annual review of psychology, 60 , 693-716.
  2. Ahn, M., Brohan, A., Brown, N., Chebotar, Y., Cortes, O., David, B., . . . others (2022). Do as I can, not as I say: Grounding language in robotic affordances. arXiv preprint arXiv:2204.01691 . · arXiv
  3. Allen, K. R., Smith, K. A., & Tenenbaum, J. B. (2020). Rapid trial-and-error learning with simulation supports flexible tool use and physical reasoning. Proceedings of the National Academy of Sciences, 117 (47), 29302-29310.
  4. Amalric, M., & Dehaene, S. (2016, May). Origins of the brain networks for advanced mathematics in expert mathematicians. Proceedings of the National Academy of Sciences of the United States of America, 113 (18), 4909-4917. doi: 10.1073/pnas.1603205113 · DOI · Paper page
  5. Amalric, M., & Dehaene, S. (2019, April). A distinct cortical network for mathematical knowledge in the human brain. NeuroImage, 189 , 19-31. Retrieved 2019-07-26, from https://linkinghub.elsevier.com/ retrieve/pii/S1053811919300011 doi: 10.1016/j.neuroimage.2019.01.001 · DOI · Paper page
  6. Anderson, J. R. (1990). The adaptive character of thought. Psychology Press.
  7. Andreas, J. (2019). Good-enough compositional data augmentation. arXiv preprint arXiv:1904.09545 . · arXiv
  8. Armeni, I., He, Z.-Y., Gwak, J., Zamir, A. R., Fischer, M., Malik, J., & Savarese, S. (2019). 3d scene graph: A structure for unified semantics, 3d space, and camera. In Proceedings of the ieee/cvf international conference on computer vision (pp. 5664-5673).
  9. Artzi, Y., Lee, K., & Zettlemoyer, L. (2015, September). Broad-coverage ccg semantic parsing with amr. In Proceedings of the conference on empirical methods in natural language processing (pp. 1699-1710). Lisbon, Portugal: Association for Computational Linguistics. Retrieved from http://aclweb.org/ anthology/D15-1198
  10. Artzi, Y., & Zettlemoyer, L. (2013). Weakly supervised learning of semantic parsers for mapping instructions to actions. Transactions of the Association for Computational Linguistics, 1 (1), 49-62.
  11. Bai, J., Zhou, L., Blanco, A., Liu, S., Wei, F., Zhou, M., & Li, Z. (2021). Jointly learning to repair code and generate commit message. ArXiv , abs/2109.12296 . · arXiv
  12. Baillargeon, R. (2004). Infants' physical world. Current directions in psychological science, 13 (3), 89-94.
  13. Baker, C., Saxe, R., & Tenenbaum, J. (2011). Bayesian theory of mind: Modeling joint belief-desire attribution. In Proceedings of the annual meeting of the cognitive science society (Vol. 33). REFERENCES
  14. Baker, C. L., Saxe, R., & Tenenbaum, J. B. (2009). Action understanding as inverse planning. Cognition, 113 (3), 329-349.
  15. Baker, C. L., Tenenbaum, J. B., & Saxe, R. R. (2007). Goal inference as inverse planning. In Proceedings of the annual meeting of the cognitive science society (Vol. 29).
  16. Basso, A., & Capitani, E. (1985, May). Spared musical abilities in a conductor with global aphasia and ideomotor apraxia. Journal of Neurology, Neurosurgery, and Psychiatry, 48 (5), 407-412. Retrieved 2020-08-03, from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1028326/
  17. Battaglia, P. W., Hamrick, J. B., & Tenenbaum, J. B. (2013). Simulation as an engine of physical scene understanding. Proceedings of the National Academy of Sciences, 110 (45), 18327-18332.
  18. Bek, J., Blades, M., Siegal, M., & Varley, R. A. (2010, May). Language and spatial reorientation: evidence from severe aphasia. Journal of Experimental Psychology. Learning, Memory, and Cognition, 36 (3), 646-658. doi: 10.1037/a0018281 · DOI
  19. Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 acm conference on fairness, accountability, and transparency (pp. 610-623).
  20. Biernaskie, J. M., Walker, S. C., & Gegear, R. J. (2009). Bumblebees learn to forage like bayesians. The American Naturalist, 174 (3), 413-423.
  21. Biggio, L., Bendinelli, T., Neitz, A., Lucchi, A., & Parascandolo, G. (2021). Neural symbolic regression that scales. In International conference on machine learning (pp. 936-945).
  22. Bingham, E., Chen, J. P., Jankowiak, M., Obermeyer, F., Pradhan, N., Karaletsos, T., . . . Goodman, N. D. (2019). Pyro: Deep universal probabilistic programming. J. Mach. Learn. Res., 20 , 28:1-28:6. Retrieved from http://jmlr.org/papers/v20/18-403.html
  23. Blank, I. A., & Fedorenko, E. (2017, October). Domain-General Brain Regions Do Not Track Linguistic Input as Closely as Language-Selective Regions. Journal of Neuroscience, 37 (41), 9999-10011. Retrieved 2019-11- 06, from https://www.jneurosci.org/content/37/41/9999 doi: 10.1523/JNEUROSCI.3642-16.2017 · DOI
  24. Blank, I. A., Kanwisher, N., & Fedorenko, E. (2014, September). A functional dissociation between language and multiple-demand systems revealed in patterns of BOLD signal fluctuations. Journal of Neurophysiology, 112 (5), 1105-1118. doi: 10.1152/jn.00884.2013 · DOI · Paper page
  25. Bloom, P. (2002). How children learn the meanings of words. MIT press.
  26. Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., . . . others (2021). On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 . · arXiv
  27. Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., . . . Sifre, L. (2022, February). Improving language models by retrieving from trillions of tokens (No. arXiv:2112.04426). arXiv. · arXiv
  28. Bowers, M., Olausson, T. X., Wong, L., Grand, G., Tenenbaum, J. B., Ellis, K., & Solar-Lezama, A. (2023, jan). Top-down synthesis for library learning. Proc. ACM Program. Lang., 7 (POPL). Retrieved from https://doi.org/10.1145/3571234 doi: 10.1145/3571234 · DOI · Paper page
  29. Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., . . . Amodei, D. (2020, July). Language Models are Few-Shot Learners. arXiv:2005.14165 [cs] . Retrieved 2020-08-09, from http://arxiv.org/abs/2005.14165 (arXiv: 2005.14165) · arXiv
  30. Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., . . . others (2023). Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712 . · arXiv
  31. Cai, Q., & Yates, A. (2013). Large-scale semantic parsing via schema matching and lexicon extension. In Proceedings of the 51st annual meeting of the association for computational linguistics (volume 1: Long REFERENCES papers) (pp. 423-433).
  32. Caliskan, A., Bryson, J. J., & Narayanan, A. (2017). Semantics derived automatically from language corpora contain human-like biases. Science, 356 (6334), 183-186. Retrieved from https://www.science.org/ doi/abs/10.1126/science.aal4230 doi: 10.1126/science.aal4230 · DOI · Paper page
  33. Carey, S. (2009). The origin of concepts. New York: Oxford University Press.
  34. Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., . . . Riddell, A. (2017). Stan: A probabilistic programming language. Journal of statistical software, 76 (1).
  35. Caucheteux, C., & King, J.-R. (2022, February). Brains and algorithms partially converge in natural language processing. Communications Biology, 5 (1), 1-10. Retrieved 2022-07-05, from https:// www.nature.com/articles/s42003-022-03036-1 (Number: 1 Publisher: Nature Publishing Group) doi: 10.1038/s42003-022-03036-1 · DOI · Paper page
  36. Chakraborty, S., Ding, Y., Allamanis, M., & Ray, B. (2022). Codit: Code editing with tree-based neural models. IEEE Transactions on Software Engineering, 48 , 1385-1399.
  37. Chakraborty, S., & Ray, B. (2021). On multi-modal learning of editing source code. 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE), 443-455.
  38. Chater, N., & Manning, C. D. (2006). Probabilistic models of language processing and acquisition. Trends in cognitive sciences, 10 (7), 335-344.
  39. Chater, N., & Oaksford, M. (1999). Ten years of the rational analysis of cognition. Trends in cognitive sciences, 3 (2), 57-65.
  40. Chater, N., Zhu, J.-Q., Spicer, J., Sundh, J., León-Villagrá, P., & Sanborn, A. (2020). Probabilistic biases meet the bayesian brain. Current Directions in Psychological Science, 29 (5), 506-512.
  41. Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. d. O., Kaplan, J., . . . others (2021). Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 . · arXiv
  42. Clark, J. H. (1976). Hierarchical geometric models for visible surface algorithms. Communications of the ACM , 19 (10), 547-554.
  43. Cobbe, K., Kosaraju, V., Bavarian, M., Hilton, J., Nakano, R., Hesse, C., & Schulman, J. (2021). Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168 . · arXiv
  44. Collins, K. M., Wong, C., Feng, J., Wei, M., & Tenenbaum, J. B. (2022, May). Structured, flexible, and robust: Benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning tasks (No. arXiv:2205.05718). arXiv. doi: 10.48550/arXiv.2205.05718 · DOI · Paper page
  45. Colmerauer, A., & Roussel, P. (1996). The birth of prolog. In History of programming languages-ii (p. 331-367). New York, NY, USA: Association for Computing Machinery. Retrieved from https:// doi.org/10.1145/234286.1057820 · DOI
  46. Conwell, C., & Ullman, T. D. (2022). Testing relational understanding in text-guided image generation. arXiv preprint arXiv:2208.00005 . · arXiv
  47. Craik, K. J. W. (1967). The nature of explanation (Vol. 445). CUP Archive.
  48. Creswell, A., Shanahan, M., & Higgins, I. (2022, May). Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning (No. arXiv:2205.09712). arXiv. doi: 10.48550/arXiv.2205.09712 · DOI
  49. Csibra, G. (2008). Goal attribution to inanimate agents by 6.5-month-old infants. Cognition, 107 (2), 705-717.
  50. Csibra, G., Bíró, S., Koós, O., & Gergely, G. (2003). One-year-old infants use teleological representations of actions productively. Cognitive Science, 27 (1), 111-133.
  51. Cusumano-Towner, M., Bichsel, B., Gehr, T., Vechev, M., & Mansinghka, V. K. (2018). Incremental inference for probabilistic programs. In Proceedings of the 39th acm sigplan conference on programming language design and implementation (pp. 571-585).
  52. Cusumano-Towner, M., Lew, A. K., & Mansinghka, V. K. (2020). Automating involutive MCMC using probabilistic and differentiable programming. arXiv preprint arXiv:2007.09871 . · arXiv
  53. Cusumano-Towner, M. F., Radul, A., Wingate, D., & Mansinghka, V. K. (2017). Probabilistic programs for inferring the goals of autonomous agents. arXiv preprint arXiv:1704.04977 . · arXiv
  54. Cusumano-Towner, M. F., Saad, F. A., Lew, A. K., & Mansinghka, V. K. (2019). Gen: a general-purpose probabilistic programming system with programmable inference. In Proceedings of the 40th acm sigplan conference on programming language design and implementation (pp. 221-236).
  55. Dalvi, B., Tafjord, O., & Clark, P. (2022). Towards teachable reasoning systems: Using a dynamic memory of user feedback for continual system improvement. In Proceedings of the 2022 conference on empirical methods in natural language processing (pp. 9465-9480).
  56. Dasgupta, I., & Gershman, S. J. (2021). Memory as a computational resource. Trends in Cognitive Sciences, 25 (3), 240-251.
  57. Davidson, G., Gureckis, T. M., & Lake, B. (2022). Creativity, compositionality, and common sense in human goal generation. In Proceedings of the annual meeting of the cognitive science society (Vol. 44).
  58. de Avila Belbute-Peres, F., Smith, K., Allen, K., Tenenbaum, J., & Kolter, J. Z. (2018). End-to-end differentiable physics for learning and control. Advances in neural information processing systems, 31 .
  59. Dechter, E., Malmaud, J., Adams, R. P., & Tenenbaum, J. B. (2013). Bootstrap learning via modular concept discovery. In Proceedings of the international joint conference on artificial intelligence.
  60. Deen, B., Koldewyn, K., Kanwisher, N., & Saxe, R. (2015, November). Functional Organization of Social Perception and Cognition in the Superior Temporal Sulcus. Cerebral Cortex , 25 (11), 4596-4609. Retrieved 2022-07-05, from https://doi.org/10.1093/cercor/bhv111 doi: 10.1093/cercor/bhv111 · DOI · Paper page
  61. Deng, F., Zhi, Z., Lee, D., & Ahn, S. (2021). Generative scene graph networks. In International conference on learning representations.
  62. Deniz, F., Nunez-Elizalde, A. O., Huth, A. G., & Gallant, J. L. (2019, September). The Representation of Semantic Information Across Human Cerebral Cortex During Listening Versus Reading Is Invariant to Stimulus Modality. Journal of Neuroscience, 39 (39), 7722-7736. Retrieved 2020-03-11, from https:// www.jneurosci.org/content/39/39/7722 (Publisher: Society for Neuroscience Section: Research Articles) doi: 10.1523/JNEUROSCI.0675-19.2019 · DOI · Paper page
  63. De Raedt, L., Kimmig, A., & Toivonen, H. (2007). Problog: A probabilistic prolog and its application in link discovery. In Proceedings of the 20th international joint conference on artifical intelligence (p. 2468-2473). San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.
  64. Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 . · arXiv
  65. Ding, Y., Zhang, X., Paxton, C., & Zhang, S. (2023). Task and motion planning with large language models for object rearrangement. arXiv preprint arXiv:2303.06247 . · arXiv
  66. Dohan, D., Xu, W., Lewkowycz, A., Austin, J., Bieber, D., Lopes, R. G., . . . others (2022). Language model cascades. arXiv preprint arXiv:2207.10342 . · arXiv
  67. Dong, L., & Lapata, M. (2018). Coarse-to-fine decoding for neural semantic parsing. arXiv preprint arXiv:1805.04793 . · arXiv
  68. Dries, A., Kimmig, A., Davis, J., Belle, V., & De Raed, L. (2017). Solving probability problems in natural language. In Proceedings of the 26th international joint conference on artificial intelligence (p. 3981-3987). AAAI Press.
  69. Dumais, S. T., et al. (2004). Latent semantic analysis. Annu. Rev. Inf. Sci. Technol., 38 (1), 188-230.
  70. Dziri, N., Milton, S., Yu, M., Zaiane, O., & Reddy, S. (2022). On the origin of hallucinations in conversational models: Is it the datasets or the models? arXiv preprint arXiv:2204.07931 . · arXiv
  71. Edgington, D. (1992). Validity, uncertainty and vagueness. Analysis, 52 (4), 193-204.
  72. Elkind, D. (1962). Children's conceptions of brother and sister: Piaget replication study v. The Journal of genetic psychology, 100 (1), 129-136.
  73. Ellis, K., Wong, C., Nye, M., Sable-Meyer, M., Cary, L., Morales, L., . . . Tenenbaum, J. B. (2020). Dreamcoder: REFERENCES Growing generalizable, interpretable knowledge with wake-sleep bayesian program learning. arXiv preprint arXiv:2006.08381 . · arXiv
  74. Erez, T., Tassa, Y., & Todorov, E. (2015). Simulation tools for model-based robotics: Comparison of bullet, havok, mujoco, ode and physx. In 2015 ieee international conference on robotics and automation (icra) (pp. 4397-4404).
  75. Fang, H., Balakrishnan, A., Jhamtani, H., Bufe, J., Crawford, J., Krishnamurthy, J., . . . Klein, D. (2022). The whole truth and nothing but the truth: Faithful and controllable dialogue response generation with dataflow transduction and constrained decoding. arXiv preprint arXiv:2209.07800 . · arXiv
  76. Fedorenko, E., Behr, M. K., & Kanwisher, N. (2011, September). Functional specificity for high-level linguistic processing in the human brain. Proceedings of the National Academy of Sciences, 108 (39), 16428-16433. Retrieved 2020-02-27, from https://www.pnas.org/content/108/39/16428 doi: 10.1073/ pnas.1112937108 · DOI · Paper page
  77. Fedorenko, E., Blank, I., Siegelman, M., & Mineroff, Z. (2020, February). Lack of selectivity for syntax relative to word meanings throughout the language network. bioRxiv , 477851. Retrieved 2020-03-13, from https://www.biorxiv.org/content/10.1101/477851v2 (Publisher: Cold Spring Harbor Laboratory Section: New Results) doi: 10.1101/477851 · DOI
  78. Fedorenko, E., Hsieh, P.-J., Nieto-Castañón, A., Whitfield-Gabrieli, S., & Kanwisher, N. (2010, August). New method for fMRI investigations of language: defining ROIs functionally in individual subjects. Journal of Neurophysiology, 104 (2), 1177-1194. doi: 10.1152/jn.00032.2010 · DOI · Paper page
  79. Fedorenko, E., & Varley, R. A. (2016, April). Language and thought are not the same thing: evidence from neuroimaging and neurological patients: Language versus thought. Annals of the New York Academy of Sciences, 1369 (1), 132-153. Retrieved 2019-07-27, from http://doi.wiley.com/10.1111/nyas.13046 doi: 10.1111/nyas.13046 · DOI · Paper page
  80. Field, H. H. (1977). Logic, meaning, and conceptual role. The Journal of Philosophy, 74 (7), 379-409.
  81. Fikes, R. E., & Nilsson, N. J. (1971). Strips: A new approach to the application of theorem proving to problem solving. Artificial intelligence, 2 (3-4), 189-208.
  82. Fodor, J. A. (1975). The language of thought. Cambridge, MA: Harvard University Press.
  83. Fodor, J. A. (1983). The modularity of mind. MIT press.
  84. Fodor, J. A., & Pylyshyn, Z. W. (1988). Connectionism and cognitive architecture: A critical analysis. Cognition, 28 (1-2), 3-71.
  85. Frank, M. C., Goodman, N. D., & Tenenbaum, J. B. (2009). Using speakers' referential intentions to model early cross-situational word learning. Psychological science, 20 (5), 578-585.
  86. Fried, D., Aghajanyan, A., Lin, J., Wang, S. I., Wallace, E., Shi, F., . . . Lewis, M. (2022). Incoder: A generative model for code infilling and synthesis. ArXiv , abs/2204.05999 . · arXiv
  87. Gauthier, J., Levy, R., & Tenenbaum, J. B. (2018). Word learning and the acquisition of syntactic-semantic overhypotheses. arXiv preprint arXiv:1805.04988 . · arXiv
  88. Gehr, T., Misailovic, S., & Vechev, M. (2016). Psi: Exact symbolic inference for probabilistic programs. In Computer aided verification: 28th international conference, cav 2016, toronto, on, canada, july 17-23, 2016, proceedings, part i 28 (pp. 62-83).
  89. Gehr, T., Steffen, S., & Vechev, M. (2020). λpsi: Exact inference for higher-order probabilistic programs. In Proceedings of the 41st acm sigplan conference on programming language design and implementation (pp. 883-897).
  90. Gentner, D., & Stevens, A. L. (2014). Mental models. Psychology Press.
  91. Gershman, S., & Goodman, N. (2014). Amortized inference in probabilistic reasoning. In Proceedings of the annual meeting of the cognitive science society (Vol. 36).
  92. Gershman, S. J., Horvitz, E. J., & Tenenbaum, J. B. (2015). Computational rationality: A converging paradigm for intelligence in brains, minds, and machines. Science, 349 (6245), 273-278.
  93. Gerstenberg, T., & Goodman, N. (2012). Ping pong in church: Productive use of concepts in human probabilistic inference. In Proceedings of the annual meeting of the cognitive science society (Vol. 34).
  94. Gibson, E. (2014). Language for communication: Language as rational inference. In Proceedings of coling 2014, the 25th international conference on computational linguistics: Technical papers (pp. 781-782).
  95. Gibson, E., Futrell, R., Piantadosi, S. T., Dautriche, I., Mahowald, K., Bergen, L., & Levy, R. (2019). How efficiency shapes human language. Trends in cognitive sciences, 23 (5), 389-407.
  96. Gleitman, L. (1990). The structural sources of verb meanings. Language acquisition, 1 (1), 3-55.
  97. Gleitman, L. R., Cassidy, K., Nappa, R., Papafragou, A., & Trueswell, J. C. (2005). Hard words. Language learning and development, 1 (1), 23-64.
  98. Goldin-Meadow, S. (2012). 26. homesign: gesture to language. In Sign language (pp. 601-625).
  99. Goldstein, A., Zada, Z., Buchnik, E., Schain, M., Price, A., Aubrey, B., . . . Hasson, U. (2022, March). Shared computational principles for language processing in humans and deep language models. Nature Neuroscience, 25 (3), 369-380. Retrieved 2022-10-31, from https://www.nature.com/articles/s41593 -022-01026-4 (Number: 3 Publisher: Nature Publishing Group) doi: 10.1038/s41593-022-01026-4 · DOI · Paper page
  100. Goldwater, S., Griffiths, T. L., & Johnson, M. (2009). A bayesian framework for word segmentation: Exploring the effects of context. Cognition, 112 (1), 21-54.
  101. Golovneva, O., Chen, M., Poff, S., Corredor, M., Zettlemoyer, L., Fazel-Zarandi, M., & Celikyilmaz, A. (2022). Roscoe: A suite of metrics for scoring step-by-step reasoning. arXiv preprint arXiv:2212.07919 . · arXiv
  102. Goodman, N. D., & Frank, M. C. (2016). Pragmatic language interpretation as probabilistic inference. Trends in cognitive sciences, 20 (11), 818-829.
  103. Goodman, N. D., & Lassiter, D. (2015). Probabilistic semantics and pragmatics: Uncertainty in language and thought. The handbook of contemporary semantic theory, 2nd edition. Wiley-Blackwell .
  104. Goodman, N. D., Mansinghka, V. K., Roy, D. M., Bonawitz, K. A., & Tenenbaum, J. B. (2008). Church: a language for generative models. In D. A. McAllester & P. Myllymäki (Eds.), UAI 2008, proceedings of the 24th conference in uncertainty in artificial intelligence, helsinki, finland, july 9-12, 2008 (pp. 220-229). AUAI Press. Retrieved from https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu= 1&smnu=2&article_id=1346&proceeding_id=24
  105. Gopnik, A. (1996). The scientist as child. Philosophy of science, 63 (4), 485-514.
  106. Gothoskar, N., Cusumano-Towner, M., Zinberg, B., Ghavamizadeh, M., Pollok, F., Garrett, A., . . . Mans- inghka, V. (2021). 3dp3: 3d scene perception via probabilistic programming. Advances in Neural Information Processing Systems, 34 , 9600-9612.
  107. Graff, D. (2000). Shifting sands: An interest-relative theory of vagueness. Philosophical topics, 28 (1), 45-81.
  108. Griffiths, T. L., Chater, N., Kemp, C., Perfors, A., & Tenenbaum, J. B. (2010). Probabilistic models of cognition: Exploring representations and inductive biases. Trends in cognitive sciences, 14 (8), 357-364.
  109. Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007). Topics in semantic representation. Psychological review , 114 2 , 211-44.
  110. Griffiths, T. L., & Tenenbaum, J. B. (2006). Optimal predictions in everyday cognition. Psychological science, 17 (9), 767-773.
  111. Harman, G. (1982). Conceptual role semantics. Notre Dame Journal of Formal Logic, 23 (2), 242-256.
  112. Harris, Z. S. (1954). Distributional structure. Word . Retrieved from http://psycnet.apa.org/psycinfo/ 1956-02807-001
  113. Hase, P., Diab, M., Celikyilmaz, A., Li, X., Kozareva, Z., Stoyanov, V., . . . Iyer, S. (2021). Do language REFERENCES models have beliefs? methods for detecting, updating, and visualizing model beliefs. arXiv preprint arXiv:2111.13654 . · arXiv
  114. Heim, I., & Kratzer, A. (1998). Semantics in generative grammar (Vol. 1185). Blackwell Oxford.
  115. Hespos, S. J., & Baillargeon, R. (2008). Young infants' actions reveal their developing knowledge of support variables: Converging evidence for violation-of-expectation findings. Cognition, 107 (1), 304-316.
  116. Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995). The" wake-sleep" algorithm for unsupervised neural networks. Science, 268 (5214), 1158-1161.
  117. Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. (2013). Stochastic variational inference. Journal of Machine Learning Research.
  118. Holtzen, S., Van den Broeck, G., & Millstein, T. (2020). Scaling exact inference for discrete probabilistic programs. Proceedings of the ACM on Programming Languages, 4 (OOPSLA), 1-31.
  119. Hu, J., Small, H., Kean, H., Takahashi, A., Zekelman, L., Kleinman, D., . . . Fedorenko, E. (2021, September). The language network supports both lexical access and sentence generation during language production (Tech. Rep.). Retrieved 2021-09-13, from https://www.biorxiv.org/content/10.1101/2021.09.10 · DOI
  120. 459596v1 (Company: Cold Spring Harbor Laboratory Distributor: Cold Spring Harbor Laboratory Label: Cold Spring Harbor Laboratory Section: New Results Type: article) doi: 10.1101/2021.09.10 .459596 · DOI
  121. Hughes, N., Chang, Y., & Carlone, L. (2022). Hydra: A real-time spatial perception engine for 3d scene graph construction and optimization. arXiv preprint arXiv:2201.13360 . · arXiv
  122. Isomura, T., Parr, T., & Friston, K. (2019). Bayesian filtering with multiple internal models: toward a theory of social intelligence. Neural computation, 31 (12), 2390-2431.
  123. Ivanova, A. A. (2022). The role of language in broader human cognition: evidence from neuroscience (Unpublished doctoral dissertation). Massachusetts Institute of Technology.
  124. Ivanova, A. A., Mineroff, Z., Zimmerer, V., Kanwisher, N., Varley, R., & Fedorenko, E. (2021). The language network is recruited but not required for nonverbal event semantics. Neurobiology of Language, 2 (2), 176-201.
  125. Izacard, G., Lewis, P., Lomeli, M., Hosseini, L., Petroni, F., Schick, T., . . . Grave, E. (2022). Few-shot Learning with Retrieval Augmented Language Models. undefined . doi: 10.48550/arXiv.2208.03299 · DOI · Paper page
  126. Jackendoff, R. S. (1985). Semantics and cognition (Vol. 8). MIT press.
  127. Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., . . . Fung, P. (2022). Survey of hallucination in natural language generation. ACM Computing Surveys.
  128. Jia, R., & Liang, P. (2016). Data recombination for neural semantic parsing. arXiv preprint arXiv:1606.03622 . · arXiv
  129. Johnson, J., Hariharan, B., Van Der Maaten, L., Hoffman, J., Fei-Fei, L., Lawrence Zitnick, C., & Girshick, R. (2017). Inferring and executing programs for visual reasoning. In Proceedings of the ieee international conference on computer vision (pp. 2989-2998).
  130. Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D., Bernstein, M., & Fei-Fei, L. (2015). Image retrieval using scene graphs. In Proceedings of the ieee conference on computer vision and pattern recognition (pp. 3668-3678).
  131. Johnson, R. E., Linderman, S., Panier, T., Wee, C. L., Song, E., Herrera, K. J., . . . Engert, F. (2020). Probabilistic models of larval zebrafish behavior reveal structure on many scales. Current Biology, 30 (1), 70-82.
  132. Johnson-Laird, P. N. (1980). Mental models in cognitive science. Cognitive science, 4 (1), 71-115.
  133. Jones, D. (2010, October). Human kinship, from conceptual structure to grammar. Behavioral and Brain Sciences, 33 (5), 367-381. Retrieved 2022-08-09, from https://www.cambridge.org/core/product/ identifier/S0140525X10000890/type/journal_article doi: 10.1017/S0140525X10000890 · DOI
  134. Kaelbling, L. P., & Lozano-Pérez, T. (2011). Hierarchical task and motion planning in the now. In 2011 ieee international conference on robotics and automation (pp. 1470-1477).
  135. Kaelbling, L. P., & Lozano-Pérez, T. (2013). Integrated task and motion planning in belief space. The International Journal of Robotics Research, 32 (9-10), 1194-1227.
  136. Kandpal, N., Deng, H., Roberts, A., Wallace, E., & Raffel, C. (2022). Large language models struggle to learn long-tail knowledge. arXiv preprint arXiv:2211.08411 . · arXiv
  137. Karpas, E., Abend, O., Belinkov, Y., Lenz, B., Lieber, O., Ratner, N., . . . Tenenholtz, M. (2022, May). MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning (No. arXiv:2205.00445). arXiv. · arXiv
  138. Katz, Y., Goodman, N. D., Kersting, K., Kemp, C., & Tenenbaum, J. B. (2008). Modeling Semantic Cognition as Logical Dimensionality Reduction. Proceedings of the Annual Meeting of the Cognitive Science Society, 30(30), 6.
  139. Kemp, C., & Regier, T. (2012, May). Kinship Categories Across Languages Reflect General Communicative Principles. Science, 336 (6084), 1049-1054. Retrieved 2022-08-09, from https://doi.org/10.1126/ science.1218811 (Publisher: American Association for the Advancement of Science) doi: 10.1126/ science.1218811 · DOI · Paper page
  140. Khalvati, K., Kiani, R., & Rao, R. P. (2021). Bayesian inference with incomplete knowledge explains perceptual confidence and its deviations from accuracy. Nature communications, 12 (1), 5704.
  141. Klein, D., & Manning, C. D. (2003). Accurate unlexicalized parsing. In Proceedings of the 41st annual meeting of the association for computational linguistics (pp. 423-430).
  142. Klessinger, N., Szczerbinski, M., & Varley, R. A. (2007, January). Algebra in a man with severe aphasia. Neuropsychologia, 45 (8), 1642-1648. Retrieved 2022-06-15, from https://www.sciencedirect.com/ science/article/pii/S0028393207000280 doi: 10.1016/j.neuropsychologia.2007.01.005 · DOI
  143. Kojima, T., Gu, S. S., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022). Large language models are zero-shot reasoners. arXiv preprint arXiv:2205.11916 . · arXiv
  144. Krafft, P., Baker, C., Pentland, A., & Tenenbaum, J. (2016). Modeling human ad hoc coordination. In Proceedings of the aaai conference on artificial intelligence (Vol. 30).
  145. Kulkarni, T. D., Kohli, P., Tenenbaum, J. B., & Mansinghka, V. (2015). Picture: A probabilistic programming language for scene perception. In Proceedings of the ieee conference on computer vision and pattern recognition (pp. 4390-4399).
  146. Kwiatkowksi, T., Zettlemoyer, L., Goldwater, S., & Steedman, M. (2010). Inducing probabilistic ccg grammars from logical form with higher-order unification. In Proceedings of the 2010 conference on empirical methods in natural language processing (pp. 1223-1233).
  147. Kwiatkowski, T., Zettlemoyer, L., Goldwater, S., & Steedman, M. (2011). Lexical generalization in ccg grammar induction for semantic parsing. In Proceedings of the 2011 conference on empirical methods in natural language processing (pp. 1512-1523).
  148. Landauer, T. K., & Dumais, S. T. (1997). A solution to plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological review , 104 (2), 211.
  149. Langkilde, I., & Knight, K. (1998). Generation that exploits corpus-based statistical knowledge. In Coling 1998 volume 1: The 17th international conference on computational linguistics.
  150. Lassiter, D., & Goodman, N. D. (2017). Adjectival vagueness in a bayesian model of interpretation. Synthese, 194 (10), 3801-3836.
  151. Le, T. A., Baydin, A. G., & Wood, F. (2017). Inference compilation and universal probabilistic programming. In Artificial intelligence and statistics (pp. 1338-1348).
  152. Lecours, A. R., & Joanette, Y. (1980, May). Linguistic and other psychological aspects of paroxysmal aphasia. Brain and Language, 10 (1), 1-23. doi: 10.1016/0093-934x(80)90034-6 · DOI
  153. Lee, T. S., & Mumford, D. (2003). Hierarchical bayesian inference in the visual cortex. JOSA A, 20 (7), 1434-1448.
  154. Lerner, Y., Honey, C. J., Silbert, L. J., & Hasson, U. (2011, February). Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story. The Journal of Neuroscience, 31 (8), 2906- 2915. Retrieved 2019-12-28, from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3089381/ doi: REFERENCES 10.1523/JNEUROSCI.3684-10.2011 · DOI · Paper page
  155. Levin, B. (1993). English verb classes and alternations: A preliminary investigation. University of Chicago press.
  156. Lew, A., Agrawal, M., Sontag, D., & Mansinghka, V. (2021). Pclean: Bayesian data cleaning at scale with domain-specific probabilistic programming. In International conference on artificial intelligence and statistics (pp. 1927-1935).
  157. Lew, A. K., Matheos, G., Zhi-Xuan, T., Ghavamizadeh, M., Gothoskar, N., Russell, S., & Mansinghka, V. K. (2023). Smcp3: Sequential monte carlo with probabilistic program proposals. In International conference on artificial intelligence and statistics (pp. 7061-7088).
  158. Lew, A. K., Tessler, M. H., Mansinghka, V. K., & Tenenbaum, J. B. (2020). Leveraging unstructured statistical knowledge in a probabilistic language of thought. In Proceedings of the annual conference of the cognitive science society.
  159. Lew, A. K., Zhi-Xuan, T., Grand, G., & Mansinghka, V. K. (2023). Sequential monte carlo steering of large language models using probabilistic programs. arXiv preprint arXiv:2306.03081 . · arXiv
  160. Lewis, D. (1976). General semantics. In Montague grammar (pp. 1-50). Elsevier.
  161. Li, B. Z., Nye, M., & Andreas, J. (2021). Implicit representations of meaning in neural language models. arXiv preprint arXiv:2106.00737 . · arXiv
  162. Li, Y., Wang, S., & Nguyen, T. N. (2020). Dlfix: Context-based code transformation learning for automated program repair. 2020 IEEE/ACM 42nd International Conference on Software Engineering (ICSE), 602-614.
  163. Liang, P. (2016). Learning executable semantic parsers for natural language understanding. Communications of the ACM , 59 (9), 68-76.
  164. Liang, P., Daumé III, H., & Klein, D. (2008). Structure compilation: trading structure for features. In Proceedings of the 25th international conference on machine learning (pp. 592-599).
  165. Lieder, F., Hsu, M., & Griffiths, T. L. (2014). The high availability of extreme events serves resource-rational decision-making. In Proceedings of the annual meeting of the cognitive science society (Vol. 36).
  166. Linzen, T. (2020). How can we accelerate progress towards human-like linguistic generalization? arXiv preprint arXiv:2005.00955 . · arXiv
  167. Lipkin, B., Wong, L., Grand, G., & Tenenbaum, J. B. (2023). Evaluating statistical language models as pragmatic reasoners. arXiv preprint arXiv:2305.01020 . · arXiv
  168. Liu, B., Jiang, Y., Zhang, X., Liu, Q., Zhang, S., Biswas, J., & Stone, P. (2023). Llm+ p: Empowering large language models with optimal planning proficiency. arXiv preprint arXiv:2304.11477 . · arXiv
  169. Liu, H., Ning, R., Teng, Z., Liu, J., Zhou, Q., & Zhang, Y. (2023). Evaluating the logical reasoning ability of chatgpt and gpt-4. arXiv preprint arXiv:2304.03439 . · arXiv
  170. Liu, R., Wei, J., Gu, S. S., Wu, T.-Y., Vosoughi, S., Cui, C., . . . Dai, A. M. (2022). Mind's eye: Grounded language model reasoning through simulation. arXiv preprint arXiv:2210.05359 . · arXiv
  171. Lowie, R. H. (1930). The kinship terminology of the bannock indians. American Anthropologist, 32 (2), 294-299.
  172. Luria, A. R., Tsvetkova, L. S., & Futer, D. S. (1965, June). Aphasia in a composer (V. G. Shebalin). Journal of the Neurological Sciences, 2 (3), 288-292. doi: 10.1016/0022-510x(65)90113-9 · DOI · Paper page
  173. Lyu, Q., Havaldar, S., Stein, A., Zhang, L., Rao, D., Wong, E., . . . Callison-Burch, C. (2023). Faithful chain-of-thought reasoning. arXiv preprint arXiv:2301.13379 . · arXiv
  174. MacSweeney, M., Woll, B., Campbell, R., McGuire, P. K., David, A. S., Williams, S. C. R., . . . Brammer, M. J. (2002, July). Neural systems underlying British Sign Language and audio-visual English processing in native users. Brain, 125 (7), 1583-1593. Retrieved 2021-01-05, from https://doi.org/10.1093/brain/ awf153 doi: 10.1093/brain/awf153 · DOI · Paper page
  175. Mahowald, K., Ivanova, A. A., Blank, I. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2023). Dissociating language and thought in large language models: a cognitive perspective. arXiv preprint arXiv:2301.06627 . · arXiv
  176. Mansinghka, V., Selsam, D., & Perov, Y. (2014). Venture: a higher-order probabilistic programming platform REFERENCES with programmable inference. arXiv preprint arXiv:1404.0099 . · arXiv
  177. Mansinghka, V. K., Kulkarni, T. D., Perov, Y. N., & Tenenbaum, J. (2013). Approximate bayesian image interpretation using generative probabilistic graphics programs. Advances in Neural Information Processing Systems, 26 .
  178. Mansinghka, V. K., Schaechtle, U., Handa, S., Radul, A., Chen, Y., & Rinard, M. (2018). Probabilistic programming with programmable inference. In Proceedings of the 39th acm sigplan conference on programming language design and implementation (pp. 603-616).
  179. Marcus, G., Davis, E., & Aaronson, S. (2022). A very preliminary analysis of dall-e 2. arXiv preprint arXiv:2204.13807 . · arXiv
  180. Maynez, J., Narayan, S., Bohnet, B., & McDonald, R. (2020). On faithfulness and factuality in abstractive summarization. arXiv preprint arXiv:2005.00661 . · arXiv
  181. McCarthy, J. (1980). Circumscription-a form of non-monotonic reasoning. Artificial intelligence, 13 (1-2), 27-39.
  182. McDermott, D. (1982). A temporal logic for reasoning about processes and plans. Cognitive science, 6 (2), 101-155.
  183. McDermott, D. M. (2000). The 1998 ai planning systems competition. AI magazine, 21 (2), 35-35.
  184. Menenti, L., Gierhan, S. M. E., Segaert, K., & Hagoort, P. (2011, September). Shared language: overlap and segregation of the neuronal infrastructure for speaking and listening revealed by functional MRI. Psychological Science, 22 (9), 1173-1182. doi: 10.1177/0956797611418347 · DOI
  185. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems (pp. 3111-3119).
  186. Mitchell, A., & Jordan, F. M. (2021, June). The Ontogeny of Kinship Categorization. Journal of Cognition and Culture, 21 (1-2), 152-177. Retrieved 2022-08-09, from https://brill.com/view/journals/jocc/ 21/1-2/article-p152_8.xml (Publisher: Brill) doi: 10.1163/15685373-12340101 · DOI
  187. Mollica, F., Bacon, G., Zaslavsky, N., Xu, Y., Regier, T., & Kemp, C. (2021). The forms and meanings of grammatical markers support efficient communication. Proceedings of the National Academy of Sciences, 118 (49), e2025993118.
  188. Mollica, F., & Piantadosi, S. T. (2022, June). Logical word learning: The case of kinship. Psychonomic Bulletin & Review , 29 (3), 766-799. Retrieved 2022-08-09, from https://doi.org/10.3758/s13423-021-02017-5 doi: 10.3758/s13423-021-02017-5 · DOI
  189. Monti, M. M., Osherson, D. N., Martinez, M. J., & Parsons, L. M. (2007, September). Functional neuroanatomy of deductive inference: A language-independent distributed network. NeuroImage, 37 (3), 1005-1016. Retrieved 2020-04-16, from http://www.sciencedirect.com/science/article/pii/ S1053811907003436 doi: 10.1016/j.neuroimage.2007.04.069 · DOI
  190. Monti, M. M., Parsons, L. M., & Osherson, D. N. (2012, August). Thought beyond language: neural dissociation of algebra and natural language. Psychological Science, 23 (8), 914-922. doi: 10.1177/ 0956797612437427 · DOI · Paper page
  191. Mu, J., & Andreas, J. (2020). Compositional explanations of neurons. Advances in Neural Information Processing Systems, 33 , 17153-17163.
  192. Nersessian, N. J., et al. (2010). Mental modeling in conceptual change. International Journal on Humanistic Ideology, 3 (01), 11-48.
  193. Nye, M., Andreassen, A. J., Gur-Ari, G., Michalewski, H., Austin, J., Bieber, D., . . . others (2021). Show your work: Scratchpads for intermediate computation with language models. arXiv preprint arXiv:2112.00114 . · arXiv
  194. Oaksford, M., & Chater, N. (2007). Bayesian rationality: The probabilistic approach to human reasoning. Oxford University Press.
  195. Osgood, C. E. (1952). The nature and measurement of meaning. Psychological bulletin, 49 (3), 197.
  196. Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., . . . Lowe, R. (2022). Training language models to follow instructions with human feedback. arXiv. Retrieved from https://arxiv.org/ abs/2203.02155 doi: 10.48550/ARXIV.2203.02155 · DOI · Paper page
  197. Pan, L., Albalak, A., Wang, X., & Wang, W. Y. (2023). Logic-lm: Empowering large language models with symbolic solvers for faithful logical reasoning. arXiv preprint arXiv:2305.12295 . · arXiv
  198. Panthaplackel, S., Nie, P., Gligoric, M., Li, J. J., & Mooney, R. J. (2020). Learning to update natural language comments based on code changes. arXiv preprint arXiv:2004.12169 . · arXiv
  199. Paunov, A. M., Blank, I. A., & Fedorenko, E. (2019, April). Functionally distinct language and Theory of Mind networks are synchronized at rest and during language comprehension. Journal of Neurophysiology, 121 (4), 1244-1265. Retrieved 2019-07-10, from https://www.physiology.org/doi/10.1152/jn.00619 .2018 doi: 10.1152/jn.00619.2018 · DOI
  200. Paunov, A. M., Blank, I. A., Jouravlev, O., Mineroff, Z., Gallée, J., & Fedorenko, E. (2022, June). Differential Tracking of Linguistic vs. Mental State Content in Naturalistic Stimuli by Language and Theory of Mind (ToM) Brain Networks. Neurobiology of Language, 1-29. Retrieved 2022-07-05, from https://doi.org/10.1162/nol_a_00071 doi: 10.1162/nol_a_00071 · DOI

200 of 302 shown

Cited by

Sorted by citations

Authors
Wong, L., Grand, G., Lew, A. K., Goodman, N. D., Mansinghka, V. K., Andreas, J., & Tenenbaum, J. B.
Affiliations
  • Massachusetts Institute of Technology (US)
  • Stanford University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2306.12672
arXiv
2306.12672
OpenAlex
W4381827075
Cited by
36
References
0
Citations by year
2026: 5 · 2025: 10 · 2024: 14 · 2023: 7
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Science Foundation (2212310, 2141064, 1745302)
  • Defense Advanced Research Projects Agency
  • Quest for Intelligence, Massachusetts Institute of Technology
  • Office of Naval Research (FA9550)
  • Air Force Office of Scientific Research (FA9550-, FA9550-19-1-0269)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Logic, Reasoning, and Knowledge
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
large language models, probabilistic programming, world models, commonsense reasoning, Bayesian inference, context-sensitive translation, symbolic reasoning, physical reasoning, visual reasoning, social reasoning, cognitive models of language

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review