Openly accessible LLMs can help us to understand human cognition
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To avoid the issue of training away, we suggest using openly accessible models, which can be seen as static artifacts that are frozen with respect to any given benchmark [92].”
From Re-evaluating Theory of Mind evaluation in large language models (2025) · cites this paper as [92]
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
The Relation between Children's and Mothers’ Mental State Language and Theory-of-Mind Understanding
Ruffman, T., Slade, L., & Crowe, E. (2002) · Child Development · doi:10.1111/1467-8624.00435 · Cited by 885
Pragmatic Language Interpretation as Probabilistic Inference
Goodman, N. D., & Frank, M. C. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.08.005 · Cited by 594
Self-citationUsing cognitive psychology to understand GPT-3
Binz, M., & Schulz, E. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2218523120 · Cited by 559
Jones, M., & Love, B. C. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10003134 · Cited by 533
Toward a connectionist model of recursion in human linguistic performance
Christiansen, M. (1999) · Cognitive Science · doi:10.1016/s0364-0213(99)00003-8 · Cited by 406
The debate over understanding in AI’s large language models
Mitchell, M., & Krakauer, D. C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2215907120 · Cited by 340
Finding Alignments Between Interpretable Causal Variables and Distributed Neural RepresentationsPreprint
Geiger, A., Wu, Z., Potts, C., Icard, T., & Goodman, N. D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.02536 · Cited by 146
When Do You Need Billions of Words of Pretraining Data?
Zhang, Y., Warstadt, A., Li, X., & Bowman, S. R. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.90 · Cited by 85
Research works printed but not linked: 2
- Ma, W. J., Kording, K. P. & Goldreich, D. Bayesian Models of Perception and Action: An Introduction (MIT Press, 2023).
- Christiansen, M. H. & Chater, N. Cogn. Sci. 23, 157–205 (1999). · doi:10.1207/s15516709cog2302_2 · Paper page
Cited by
Dissociating language and thought in large language models
Mahowald, K., Ivanova, A. A., Blank, I. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.01.011 · Cited by 345
Testing theory of mind in large language models and humans
Strachan, J. W. A., Albergo, D., Borghini, G., Pansardi, O., Scaliti, E., Gupta, S., Saxena, K., Rufo, A., Panzeri, S., Manzi, G., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01882-z · Cited by 299
“As artificial intelligence (AI) continues to evolve, it also becomes increasingly important to heed calls for open science and open access to these models 32 .”
Re-evaluating Theory of Mind evaluation in large language models
Hu, J., Sosa, F., & Ullman, T. (2025) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2023.0499 · Cited by 10
Lin, Z. (2026) · Annual Review of Psychology · doi:10.1146/annurev-psych-100925-034807 · Cited by 4
Metadata
- Authors
- Frank, M. C.
- Affiliations
- Stanford University (US)
- Corresponding author
- Frank, Michael C.
- ORCID
- Frank, Michael C.
- Venue
- Nature Human Behaviour
- Published
- 2023-11-20
- Volume
- 7
- Issue
- 11
- Pages
- 1825-1827
- ISSN
- 2397-3374 (ISSN-L)
- OpenAlex
- W4388825532
- Cited by
- 18
- References
- 14
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 3
- FWCI
- 1.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Human Behaviour (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
- Keywords
- large language models, open access, human cognition, cognitive models, language emergence, reasoning, model systems, artificial intelligence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Openly accessible LLMs can help us to understand human cognition. https://app.cochat.ai/papers/10.1038/s41562-023-01732-4
- The paper
- Frank, M. C. (2023). Openly accessible LLMs can help us to understand human cognition. Nature Human Behaviour. https://doi.org/10.1038/s41562-023-01732-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.