Evaluating large language models in theory of mind tasks
Open accessThe DOI matches its Crossref record; 79 of the 80 references it cites were found in a registry or an index, and 1 are not checked yet; 24 of the 50 sources its claims cite were checked for support.
Abstract
Eleven large language models (LLMs) were assessed using 40 bespoke false-belief tasks, considered a gold standard in testing theory of mind (ToM) in humans. Each task included a false-belief scenario, three closely matched true-belief control scenarios, and the reversed versions of all four. An LLM had to solve all eight scenarios to solve a single task. Older models solved no tasks; Generative Pre-trained Transformer (GPT)-3-davinci-003 (from November 2022) and ChatGPT-3.5-turbo (from March 2023) solved 20% of the tasks; ChatGPT-4 (from June 2023) solved 75% of the tasks, matching the performance of 6-y-old children observed in past studies. We explore the potential interpretation of these results, including the intriguing possibility that ToM-like ability, previously considered unique to humans, may have emerged as an unintended by-product of LLMs’ improving language skills. Regardless of how we interpret these outcomes, they signify the advent of more powerful and socially skilled AI—with profound positive and negative implications.
Verified 2026-11-22 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
This paper tests whether large language models (LLMs) can solve classic false-belief theory-of-mind (ToM) tasks, using 40 bespoke tasks of two types and multiple controls. The main result is that performance improved with model scale, with ChatGPT-4 solving 75% of tasks, though the authors stop short of claiming this settles whether LLMs “really” have ToM.
Key findings
- Across 11 LLMs, performance improved over time: older models up to 2022 failed false-belief scenarios or controls in all tasks, GPT-3-davinci-002 solved 5%, GPT-3-davinci-003 and ChatGPT-3.5-turbo solved 20%, and ChatGPT-4 solved 75% of tasks.
- ChatGPT-4 performed especially well on the two task families: it solved 90% of Unexpected Contents tasks and 60% of Unexpected Transfer tasks.
- Performance on the two task types was strongly correlated, with reported correlation R = 0.98 and 95% CI [0.92, 0.99].
- In the sentence-by-sentence analyses, ChatGPT-4’s probability of the correct belief prediction updated as story information accumulated; for example, in the Unexpected Contents task, after the false label was revealed and Sam did not look inside, the model became certain Sam’s belief was false.
Methods
- The authors created 20 Unexpected Contents tasks and 20 Unexpected Transfer tasks, each with a false-belief scenario, three true-belief controls, and reversed versions of all four scenarios; solving one task required correctly answering 16 prompts across eight scenarios.
- They tested 11 LLMs: GPT-1, GPT-2, six GPT-3-family models, ChatGPT-3.5-turbo, ChatGPT-4, and Bloom.
- Each story was followed by prompts assessing both the actual state of affairs and the protagonist’s belief; responses were evaluated over many completions using API calls, with temperature = 0 for replicability in some demonstrations and 1,000 completions for probability estimates in others.
Limitations
- The paper states that results should be taken “with much skepticism,” and that failures do not necessarily prove lack of ToM, while successes do not automatically prove ToM either.
- It notes several evident confounds: models may rely on guessing, memorization, response patterns, or task-specific shortcuts rather than mental-state tracking.
- The paper also says that some answers were hard to score because models sometimes gave partially correct or context-dependent responses that did not fit the scoring key, which could underestimate performance.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
15 Valid · 5 Not valid · 8 Not checked · 100 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“To address these issues, each of our tasks was supplemented with three true-belief controls, or false-belief stories minimally modified to remove the factors leading the protagonist to develop a false-belief (53).”
§ Evaluating large language models in theory of mind tasks > Study 1.1: Unexpected Contents Task (aka Smarties Task) > Study 1.3: True-Belief Controls.
What the sources say
- Supportedcites [53] M. Huemer, The knowledge (“true belief”) error in 4-to 6-year-old children: When are agents aware of what they have in view? Cognition 230, 105255 (2023). 36088669 source
Section 2.1.2 (page unavailable) describes knowledge tasks with the same structure as a false-belief task, except that the protagonist is present when the object moves, preventing a false belief about its location. The cited paper thus supports the description of the controls; “three” refers to the citing authors’ own task design, not a number attributed to this source. (LLM, conf=0.88)
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“past research employing large language models (LLMs) showed that RoBERTa, early versions of GPT-3, and custom-trained question-answering models struggled with solving simple ToM tasks (24–27).”
§ Evaluating large language models in theory of mind tasks > Abstract
What the sources say
- Not matchedcites [24] M. Cohen, Exploring RoBERTa’s Theory of Mind through textual entailment. PhilArchive (2021). https://philarchive.org/rec/COHERT. Accessed 1 February 2023.
We don’t have this paper’s reference list.
- Partly supportedcites [25] A. Nematzadeh, K. Burns, E. Grant, A. Gopnik, T. L. Griffiths, “ Evaluating theory of mind in question answering” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, E. Riloff, Eds. (Association for Computational Linguistics, Brussels, Belgium, 2018), pp. 2392– 2400. sourceExperimental — accuracy not yet measured
Section 5.2 reports that the question-answering models tested failed on the ToM tasks, supporting that part of the citing sentence. The passages do not report tests of RoBERTa or early GPT-3, so this source does not support those model-specific claims. (LLM, conf=0.88)
- Partly supportedcites [26] M. Sap, R. LeBras, D. Fried, Y. Choi, Neural theory-of-mind? On the limits of social intelligence in large LMs. arXiv [Preprint] (2022). https://arxiv.org/abs/2210.13312 (Accessed 1 February 2023). sourceExperimental — accuracy not yet measured
Section 4.1 reports testing GPT-3-ADA, GPT-3-CURIE, and GPT-3-DAVINCI, and Section 4.2 says these models struggled with TOMI questions about mental states. The passages support the GPT-3 part of the claim, but do not establish the stated results for RoBERTa or custom-trained question-answering models. (LLM, conf=0.88)
- Partly supportedcites [27] S. Trott, C. Jones, T. Chang, J. Michaelov, B. Bergen, Do large language models know what humans know? arXiv [Preprint] (2022). https://arxiv.org/abs/2209.01515 (Accessed 1 February 2023). 37401923 sourceExperimental — accuracy not yet measured
Section 3.3 reports that the smallest GPT-3 models did not exceed chance performance on a false-belief task, supporting the claim for those models. It also reports substantially better performance by larger GPT-3 models. Our copy does not report results for RoBERTa or custom-trained question-answering models (searched those model terms). (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“We note that LLMs’ performance reported here is lower than that observed in the earlier versions of this study (50).”
§ Evaluating large language models in theory of mind tasks > Study 1.1: Unexpected Contents Task (aka Smarties Task) > Study 3: The Emergence of the Ability to Solve ToM Tasks.
What the sources say
- Supportedcites [50] M. Kosinski, Evaluating large language models in theory of mind tasks. arXiv [Preprint] (2023). https://arxiv.org/abs/2302.02083 (Accessed 1 September 2023). PMC11551352 39471222 source
Study 3 explicitly states that the LLMs’ performance reported there is lower than in earlier versions of the study. It attributes the difference to revised false-belief scenarios and the addition of true-belief controls. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“To effectively predict the next word in a sentence generated by a human, LLMs must model not only grammar and vocabulary but also the psychological processes humans use when generating language (35, 36).”
§ Evaluating large language models in theory of mind tasks > Conclusion
What the sources say
- Partly supportedcites [35] T. Hagendorff, S. Fabi, M. Kosinski, Human-like intuitive behavior and reasoning biases emerged in large language models but disappeared in ChatGPT. Nat. Comput. Sci. 3, 833– 838 (2023). 38177754 PMC10766525 sourceExperimental — accuracy not yet measured
The Main section describes LLMs predicting successive words and exhibiting human-like reasoning patterns. It does not say that effective prediction of human-generated language requires modeling the psychological processes by which humans produce it; the Main section also cautions that similar outputs need not reflect the same cognitive processes. (LLM, conf=0.79)
- Partly supportedcites [36] J. Digutsch, M. Kosinski, Overlap in meaning is a stronger predictor of semantic activation in GPT-3 than in humans. Sci. Rep. 13, 5035 (2023). 36977744 PMC10050205 sourceExperimental — accuracy not yet measured
The Introduction (page not available) says LLMs learn to predict missing words and discover linguistic rules and word associations. The Discussion (page not available) says models generating human-like language would benefit from possessing or simulating a mechanism akin to human semantic activation. It does not establish that modeling human psychological processes generally is necessary to predict the next word effectively. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“In the context of neural networks underlying connectionist AI, the Chinese room argument applies more appropriately to individual artificial neurons (71, 73).”
§ Evaluating large language models in theory of mind tasks > Discussion > Can LLMs be Credited with ToM?
What the sources say
- Not checked — no full text of the sourcecites [71] P. M. Churchland, P. S. Churchland, Could a machine think? Sci. Am. 262, 32– 39 (1990). 2294584 source
- Could not verifycites [73] J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. U.S.A. 79, 2554– 2558 (1982). 6953413 PMC346238 sourceExperimental — accuracy not yet measured
The Discussion says individual model neurons have elementary properties while computational abilities emerge collectively in the network. Our copy does not discuss the Chinese room argument or say that it applies more appropriately to individual neurons; searches for that argument and for related terms about understanding and semantics found no such passage. (LLM, conf=0.76)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
56 more claims
Create a free account to see all 128 claims and every source verdict.
- It may state two separate claims as one. 34
- Probably not a substantial claim. 47
- The quote only partly states this claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“On the one hand, these models are shaped by human training data and exhibit many human abilities, such as reasoning by analogy21, theory of mind22, and personality23, which makes them compelling proxies for studying human behavior and attitude change24,25.”
From Generative language models exhibit social identity biases (2024) · cites this paper as [22]
Experimental — accuracy not yet measured
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 1×
“In the context of neural networks underlying connectionist AI, the Chinese room argument applies more appropriately to individual artificial neurons ( 71 , 73 ).”
BackgroundMastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · cited 2×
“Yet, although AI outperforms humans in an ever - broadening range of tasks, from playing poker ( 20 ) and Go ( 21 ) to translating languages ( 22 ) and diagnosing skin cancer ( 23 ), it trails far behind when it comes to ToM.”
BackgroundMethodI.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290
Does the chimpanzee have a theory of mind?
Premack, D., & Woodruff, G. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00076512 · Cited by 8,743 · cited 1×
“Even the most intellectually and socially adept animals, such as the great apes, trail far behind humans when it comes to ToM ( 16 – 19 ).”
BackgroundDoes the autistic child have a “theory of mind” ?
Baron-Cohen, S., Leslie, A. M., & Frith, U. (1985) · Cognition · doi:10.1016/0010-0277(85)90022-8 · Cited by 8,599
Searle, J. R. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005756 · Cited by 6,954
Wimmer, H. (1983) · Cognition · doi:10.1016/0010-0277(83)90004-5 · Cited by 6,305 · cited 2×
“We used two types of false - belief tasks: Unexpected Contents ( 43 ), introduced in Study 1, and Unexpected Transfer ( 44 ), introduced in Study 2.”
MethodInfluentialMeta-Analysis of Theory-of-Mind Development: The Truth about False Belief
Wellman, H. M., Cross, D., & Watson, J. (2001) · Child Development · doi:10.1111/1467-8624.00304 · Cited by 4,476 · cited 1×
“Average children’s performance on false - belief tasks was reported after a meta - analysis of 178 studies (54).”
BackgroundTraining language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
The Singularity Is near: When Humans Transcend Biology
Mead, W. R., & Kurzweil, R. (2006) · Foreign Affairs · doi:10.2307/20031996 · Cited by 3,429
Do 15-month-old infants understand false beliefs?
Onishi, K. H., & Baillargeon, R. (2005) · Science · doi:10.1126/science.1107621 · Cited by 2,350
People thinking about thinking peopleThe role of the temporo-parietal junction in “theory of mind”
Saxe, R., & Kanwisher, N. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00230-1 · Cited by 2,316 · cited 1×
“LLMs trained to predict the next word in a sentence surprised their creators not only by their inclination to be racist and sexist ( 34 ) but also by their emergent reasoning and arithmetic skills ( 35 ), ability to translate between languages ( 22 ), and propensity to semantic priming ( 36 ).”
BackgroundReading literary fiction improves theory of mind
Kidd, D. C., & Castano, E. (2013) · Science · doi:10.1126/science.1239918 · Cited by 1,642 · cited 2×
“In humans, ToM development also seems to be supported by exposure to stories and situations involving people with differing mental states ( 38 – 41 , 57 ).”
BackgroundResultThree-year-olds’ difficulty with false belief: The case for a conceptual deficit
Perner, J., Leekam, S. R., & Wimmer, H. (1987) · British Journal of Developmental Psychology · doi:10.1111/j.2044-835x.1987.tb01048.x · Cited by 1,550 · cited 2×
“Thus, an LLM trained to generate and interpret human - like language would greatly benefit from possessing ToM.”
BackgroundEmergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264
Milligan, K., Astington, J. W., & Dack, L. A. (2007) · Child Development · doi:10.1111/j.1467-8624.2007.01018.x · Cited by 1,248 · cited 3×
“This ability—typically referred to as “theory of mind” (ToM)—is considered central to human social interactions ( 3 ), communication ( 4 ), empathy ( 5 ), self - consciousness ( 6 ), moral judgment ( 7 , 8 ), and even religious beliefs ( 9 ).”
BackgroundResultHallmarks of Brain Aging: Adaptive and Pathological Modification by Metabolic States
Mattson, M. P., & Arumugam, T. V. (2018) · Cell Metabolism · doi:10.1016/j.cmet.2018.05.011 · Cited by 1,242 · cited 1×
“As illustrated by aging and degenerative brain diseases, human brains maintain many mental abilities despite significant loss of neural mass and function ( 78 ).”
BackgroundThe grand challenges of Science Robotics
Yang, G.-Z., Bellingham, J., Dupont, P. E., Fischer, P., Floridi, L., Full, R., Jacobstein, N., Kumar, V., McNutt, M., Merrifield, R., et al. (2018) · Science Robotics · doi:10.1126/scirobotics.aar7650 · Cited by 1,177
Word embeddings quantify 100 years of gender and ethnic stereotypes
Garg, N., Schiebinger, L., Jurafsky, D., & Zou, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1720347115 · Cited by 1,065 · cited 1×
“LLMs trained to predict the next word in a sentence surprised their creators not only by their inclination to be racist and sexist ( 34 ) but also by their emergent reasoning and arithmetic skills ( 35 ), ability to translate between languages ( 22 ), and propensity to semantic priming ( 36 ).”
BackgroundThe Social Sense: Susceptibility to Others’ Beliefs in Human Infants and Adults
Kovács, Á. M., Téglás, E., & Endress, A. D. (2010) · Science · doi:10.1126/science.1190792 · Cited by 921 · cited 1×
“It develops early in human life ( 10 – 12 ) and is so critical that its dysfunctions characterize a multitude of psychiatric disorders, including autism, bipolar disorder, schizophrenia, and psychop-athy ( 13 – 15 ).”
BackgroundThe Relation between Children's and Mothers’ Mental State Language and Theory-of-Mind Understanding
Ruffman, T., Slade, L., & Crowe, E. (2002) · Child Development · doi:10.1111/1467-8624.00435 · Cited by 885 · cited 1×
“ToM has been shown to positively correlate with participating in family discussions ( 40 ) and the use of and familiarity with words describing mental states ( 38 , 41 ).”
BackgroundGreat apes anticipate that other individuals will act according to false beliefs
Krupenye, C., Kano, F., Hirata, S., Call, J., & Tomasello, M. (2016) · Science · doi:10.1126/science.aaf8110 · Cited by 848
(2013) · Medical Entomology and Zoology · Cited by 629
The neural basis of the interaction between theory of mind and moral judgment
Young, L., Cushman, F., Hauser, M., & Saxe, R. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0701408104 · Cited by 625 · cited 1×
“This ability—typically referred to as “theory of mind” (ToM)—is considered central to human social interactions ( 3 ), communication ( 4 ), empathy ( 5 ), self - consciousness ( 6 ), moral judgment ( 7 , 8 ), and even religious beliefs ( 9 ).”
BackgroundSuperhuman AI for multiplayer poker
Brown, N., & Sandholm, T. (2019) · Science · doi:10.1126/science.aay2400 · Cited by 592 · cited 1×
“Yet, although AI outperforms humans in an ever - broadening range of tasks, from playing poker ( 20 ) and Go ( 21 ) to translating languages ( 22 ) and diagnosing skin cancer ( 23 ), it trails far behind when it comes to ToM.”
BackgroundThe cultural evolution of mind reading
Heyes, C. M., & Frith, C. D. (2014) · Science · doi:10.1126/science.1243091 · Cited by 456
Shared computational principles for language processing in humans and deep language models
Goldstein, A., Zada, Z., Buchnik, E., Schain, M., Price, A., Aubrey, B., Nastase, S. A., Feder, A., Emanuel, D., Cohen, A., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01026-4 · Cited by 447 · cited 1×
“Studying AI can also advance psychological science ( 80 – 82 ).”
BackgroundDirect Fit to Nature: An Evolutionary Perspective on Biological and Artificial Neural Networks
Hasson, U., Nastase, S. A., & Goldstein, A. (2020) · Neuron · doi:10.1016/j.neuron.2019.12.002 · Cited by 387
Churchland, P. M., & Churchland, P. S. (1990) · Scientific American · doi:10.1038/scientificamerican0190-32 · Cited by 363 · cited 1×
“In the context of neural networks underlying connectionist AI, the Chinese room argument applies more appropriately to individual artificial neurons ( 71 , 73 ).”
BackgroundDogs recognize dog and human emotions
Albuquerque, N., Guo, K., Wilkinson, A., Savalli, C., Otta, E., & Mills, D. (2016) · Biology Letters · doi:10.1098/rsbl.2015.0883 · Cited by 347
Evaluating Large Language Models in Theory of Mind Tasks
Kosinski, M. (2023) · arXiv · doi:10.48550/arxiv.2302.02083 · Cited by 339
Impaired theory of mind for moral judgment in high-functioning autism
Moran, J. M., Young, L. L., Saxe, R., Lee, S. M., O'Young, D., Mavros, P. L., & Gabrieli, J. D. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1011734108 · Cited by 336 · cited 1×
“This ability—typically referred to as “theory of mind” (ToM)—is considered central to human social interactions ( 3 ), communication ( 4 ), empathy ( 5 ), self - consciousness ( 6 ), moral judgment ( 7 , 8 ), and even religious beliefs ( 9 ).”
BackgroundDevelopment of the social brain from age three to twelve years
Richardson, H., Lisandrelli, G., Riobueno-Naylor, A., & Saxe, R. (2018) · Nature Communications · doi:10.1038/s41467-018-03399-2 · Cited by 336
Emergence of a 'visual number sense' in hierarchical generative models
Stoianov, I., & Zorzi, M. (2012) · Nature Neuroscience · doi:10.1038/nn.2996 · Cited by 300 · cited 1×
“Models trained to process images, for example, spontaneously learned how to count ( 30 , 31 ) and differentially process central and peripheral image areas ( 32 ), as well as experience human - like optical illusions ( 33 ).”
Testing theory of mind in large language models and humans
Strachan, J. W. A., Albergo, D., Borghini, G., Pansardi, O., Scaliti, E., Gupta, S., Saxena, K., Rufo, A., Panzeri, S., Manzi, G., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01882-z · Cited by 299 · cited 1×
“58 and 59 ), others found that LLMs’ performance was inconsistent and brittle ( 26 , 60 , 61 ).”
BackgroundCognitive and neural foundations of religious belief
Kapogiannis, D., Barbey, A. K., Su, M., Zamboni, G., Krueger, F., & Grafman, J. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0811717106 · Cited by 291 · cited 1×
“This ability—typically referred to as “theory of mind” (ToM)—is considered central to human social interactions ( 3 ), communication ( 4 ), empathy ( 5 ), self - consciousness ( 6 ), moral judgment ( 7 , 8 ), and even religious beliefs ( 9 ).”
BackgroundWhat Do Theory-of-Mind Tasks Actually Measure? Theory and Practice
Quesque, F., & Rossetti, Y. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691619896607 · Cited by 287 · cited 1×
“This work evaluates the performance of recent LLMs on false - belief tasks considered a gold standard in assessing ToM in humans ( 42 ).”
BackgroundTheory of mind deficits in bipolar affective disorder
Kerr, N. (2003) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00008-3 · Cited by 279
Great apes use self-experience to anticipate an agent’s action in a false-belief test
Kano, F., Krupenye, C., Hirata, S., Tomonaga, M., & Call, J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1910095116 · Cited by 247 · cited 1×
“Even the most intellectually and socially adept animals, such as the great apes, trail far behind humans when it comes to ToM ( 16 – 19 ).”
BackgroundLanguage Promotes False-Belief Understanding: Evidence From Learners of a New Sign Language
Pyers, J. E., & Senghas, A. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02377.x · Cited by 245
Hagendorff, T., Fabi, S., & Kosinski, M. (2023) · Nature Computational Science · doi:10.1038/s43588-023-00527-x · Cited by 243 · cited 2×
“To effectively predict the next word in a sentence generated by a human, LLMs must model not only grammar and vocabulary but also the psychological processes humans use when generating language ( 35 , 36 ).”
BackgroundFANToM: A Benchmark for Stress-testing Machine Theory of Mind in InteractionsPreprint
Kim, H., Sclar, M., Zhou, X., et al. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2310.15421 · Cited by 227
Modern psychometrics. The science of psychological assessment
Ferguson, B. (1990) · Journal of Psychosomatic Research · doi:10.1016/0022-3999(90)90043-4 · Cited by 185
Chimpanzees know that others make inferences
Schmelz, M., Call, J., & Tomasello, M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1000469108 · Cited by 166
Mayer, A., & Träuble, B. E. (2013) · International Journal of Behavioral Development · doi:10.1177/0165025412454030 · Cited by 160 · cited 3×
“In humans, ToM development also seems to be supported by exposure to stories and situations involving people with differing mental states ( 38 – 41 , 57 ).”
BackgroundResultAffiliation, empathy, and the origins of theory of mind
Seyfarth, R. M., & Cheney, D. L. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1301223110 · Cited by 158 · cited 1×
“This ability—typically referred to as “theory of mind” (ToM)—is considered central to human social interactions ( 3 ), communication ( 4 ), empathy ( 5 ), self - consciousness ( 6 ), moral judgment ( 7 , 8 ), and even religious beliefs ( 9 ).”
BackgroundPsychopaths fail to automatically take the perspective of others
Drayton, L. A., Santos, L. R., & Baskin-sommers, A. R. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1721903115 · Cited by 150 · cited 1×
“It develops early in human life ( 10 – 12 ) and is so critical that its dysfunctions characterize a multitude of psychiatric disorders, including autism, bipolar disorder, schizophrenia, and psychop-athy ( 13 – 15 ).”
BackgroundTrue or false: Do 5-year-olds understand belief?
Fabricius, W. V., Boyer, T. W., Weimer, A. A., & Carroll, K. (2010) · Developmental Psychology · doi:10.1037/a0017648 · Cited by 140 · cited 2×
“Yet, ToM scholars have pointed out that false - belief tasks can be solved without ToM by simply assuming that the protagonist must be wrong (52).”
BackgroundEmergence in Cognitive Science
McClelland, J. L. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01116.x · Cited by 135
Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs
Sap, M., Le Bras, R., Fried, D., & Choi, Y. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.248 · Cited by 118
Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs
Sap, M., LeBras, R., Fried, D., & Choi, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.13312 · Cited by 118 · cited 1×
“58 and 59 ), others found that LLMs’ performance was inconsistent and brittle ( 26 , 60 , 61 ).”
BackgroundNasr, K., Viswanathan, P., & Nieder, A. (2019) · Science Advances · doi:10.1126/sciadv.aav7903 · Cited by 110 · cited 1×
“Models trained to process images, for example, spontaneously learned how to count ( 30 , 31 ) and differentially process central and peripheral image areas ( 32 ), as well as experience human - like optical illusions ( 33 ).”
BackgroundIllusory Motion Reproduced by Deep Neural Networks Trained for Prediction
Watanabe, E., Kitaoka, A., Sakamoto, K., Yasugi, M., & Tanaka, K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00345 · Cited by 101 · cited 1×
“Models trained to process images, for example, spontaneously learned how to count ( 30 , 31 ) and differentially process central and peripheral image areas ( 32 ), as well as experience human - like optical illusions ( 33 ).”
BackgroundDo Large Language Models Know What Humans Know?
Trott, S., Jones, C., Chang, T., Michaelov, J., & Bergen, B. (2023) · Cognitive Science · doi:10.1111/cogs.13309 · Cited by 99
Large Language Models Fail on Trivial Alterations to Theory-of-Mind Tasks
Ullman, T. (2023) · arXiv · doi:10.48550/arxiv.2302.08399 · Cited by 81
Goldstein, A., Grinstein-Dabush, A., Schain, M., Wang, H., Hong, Z., Aubrey, B., Nastase, S. A., Zada, Z., Ham, E., Feder, A., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-46631-y · Cited by 64
Evaluating Theory of Mind in Question Answering
Nematzadeh, A., Burns, K., Grant, E., Gopnik, A., & Griffiths, T. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1261 · Cited by 53
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal ViewPreprint
Cao, B., Lin, H.-Y., Han, X.-P., Liu, F.-C., & Sun, L. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2203.12258 · Cited by 50
Overlap in meaning is a stronger predictor of semantic activation in GPT-3 than in humans
Digutsch, J., & Kosinski, M. (2023) · Scientific Reports · doi:10.1038/s41598-023-32248-6 · Cited by 49 · cited 3×
“To effectively predict the next word in a sentence generated by a human, LLMs must model not only grammar and vocabulary but also the psychological processes humans use when generating language ( 35 , 36 ).”
BackgroundVisual behavior modelling for robotic theory of mind
Chen, B., Vondrick, C., & Lipson, H. (2021) · Scientific Reports · doi:10.1038/s41598-020-77918-x · Cited by 47 · cited 1×
“Unsurprisingly, equipping AI with ToM remains a vibrant area of research in computer science ( 28 ) and one of the grand challenges of our times ( 29 ).”
BackgroundPerspective‐Taking and Depth of Theory‐of‐Mind Reasoning in Sequential‐Move Games
Zhang, J., Hedden, T., & Chia, A. (2012) · Cognitive Science · doi:10.1111/j.1551-6709.2012.01238.x · Cited by 44 · cited 1×
“This ability—typically referred to as “theory of mind” (ToM)—is considered central to human social interactions ( 3 ), communication ( 4 ), empathy ( 5 ), self - consciousness ( 6 ), moral judgment ( 7 , 8 ), and even religious beliefs ( 9 ).”
BackgroundThought and thought experiments
Cole, D. J. (1984) · Philosophical Studies · doi:10.1007/bf00355448 · Cited by 43 · cited 1×
“False - belief tasks test respondents’ understanding that another individual may hold beliefs that the respondent knows to be false.”
Human rights for robots? A literature review
Gordon, J.-S., & Pasvenskiene, A. (2021) · AI and Ethics · doi:10.1007/s43681-021-00050-7 · Cited by 40 · cited 1×
“These perceptions may influence not only individual human–AI interactions but also AI’s societal role and legal status ( 79 ).”
BackgroundRust, J., Kosiński, M., & Stillwell, D. J. (2020) · Routledge eBooks · doi:10.4324/9781315637686 · Cited by 40
Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models
Shapira, N., Levy, M., Alavi, S. H., Zhou, X., Choi, Y., Goldberg, Y., Sap, M., & Shwartz, V. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.14763 · Cited by 37
Thinking Fast and Slow in Large Language Models
Hagendorff, T., Fabi, S., & Kosiński, M. (2022) · PubMed · doi:10.48550/arxiv.2212.05206 · Cited by 36 · cited 2×
“To effectively predict the next word in a sentence generated by a human, LLMs must model not only grammar and vocabulary but also the psychological processes humans use when generating language ( 35 , 36 ).”
BackgroundSelf-citationVerbal behavior and the future of social science.
Boyd, R. L., & Markowitz, D. M. (2025) · American Psychologist · doi:10.1037/amp0001319 · Cited by 36
Emergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks
Mohsenzadeh, Y., Mullin, C., Lahner, B., & Oliva, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-61409-0 · Cited by 31 · cited 1×
“Models trained to process images, for example, spontaneously learned how to count ( 30 , 31 ) and differentially process central and peripheral image areas ( 32 ), as well as experience human - like optical illusions ( 33 ).”
BackgroundHuemer, M., Schröder, L. M., Leikard, S. J., Gruber, S., Mangstl, A., & Perner, J. (2023) · Cognition · doi:10.1016/j.cognition.2022.105255 · Cited by 29 · cited 1×
“To address these issues, each of our tasks was supplemented with three true - belief controls, or false - belief stories minimally modified to remove the factors leading the protagonist to develop a false - belief ( 53 ).”
MethodFANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions
Kim, H., Sclar, M., Zhou, X., Bras, R., Kim, G., Choi, Y., & Sap, M. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.890 · Cited by 27
Understanding Social Reasoning in Language Models with Language Models
Gandhi, K., Fränken, J.-P., Gerstenberg, T., & Goodman, N. D. (2023) · arXiv · doi:10.48550/arxiv.2306.15448 · Cited by 23
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View
Cao, B., Lin, H., Han, X., Liu, F., & Sun, L. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.398 · Cited by 20
Pi, Z., Vadaparty, A., Bergen, B. K., & Jones, C. R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.14737 · Cited by 18
Data and Code for "Evaluating large language models in theory of mind tasks"Preprint
Kosinski, M. (2021) · OSF Preprints (OSF Preprints) · doi:10.17605/osf.io/csdhb · Cited by 1
Self-citationRobot: Mere Machine to Transcendent Mind
Cohen, E. A., & Moravec, H. P. (1999) · Foreign Affairs · doi:10.2307/20049291
OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.08774
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Workshop, B., :, Scao, T. L., Fan, A., Akiki, C., Pavlick, E., Ilić, S., Hesslow, D., Castagné, R., Luccioni, A. S., et al. (2022) · arXiv · doi:10.48550/arxiv.2211.05100
Research works printed but not linked: 4
- A. Radford, K. Narasimhan, T. Salimans, I. Sutskever, Improving language understanding by generative pre-training. OpenAI (2018). https://openai.com/index/language-unsupervised/. Accessed 1 August 2023.
- R. Alec, Language models are unsupervised multitask learners. OpenAI Blog 1 (2019). https://api.semanticscholar.org/CorpusID:160025533. Accessed 1 February 2023.
- A. Vaswani, “ Attention is all you need” in Proceedings of the 31st International Conference on Neural Information Processing Systems, I. Guyon, Eds. (Curran Associates Inc., 2017), pp. 6000– 6010.
- N. Block, Troubles with functionalism. Minn. Stud. Philos. Sci. 9 261– 325 (1978).
Cited by
Yenduri, G., Ramalingam, M., Selvi, G. C., Supriya, Y., Srivastava, G., Maddikunta, P. K. R., Raj, G. D., Jhaveri, R. H., Prabadevi, B., Wang, W., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3389497 · Cited by 596
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · doi:10.21203/rs.3.rs-2895792/v1 · Cited by 514
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · arXiv · doi:10.48550/arxiv.2302.03494 · Cited by 514
Yu, H. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1181712 · Cited by 409
“The large language model represented by Chat GPT exhibits the ability to think and answer questions like a human being, manifesting a creative capacity that was previously unavailable to artificial intelligence, marking a qualitative leap from quantitative change (Kosinski, 2023).”
MethodThe Potential of Generative AI for Personalized Persuasion at Scale
Matz, S., Teeny, J., Vaid, S. S., Peters, H., Harari, G. M., & Cerf, M. (2023) · doi:10.31234/osf.io/rn97c · Cited by 312
Metadata
- Authors
- Kosinski, M.
- Affiliations
- Graduate School of Business, Stanford University, Stanford, CA 94305
- ORCID
- Kosinski, Michal
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2024-10-29
- Volume
- 121
- Issue
- 45
- Pages
- e2405460121-e2405460121
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC11551352
- OpenAlex
- W4403863303
- Cited by
- 339
- References
- 68
- Citations by year
- 2026: 113 · 2025: 112 · 2024: 57
- FWCI
- 219.35
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Child and Animal Learning Development
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- large language models, theory of mind, false belief, false belief tasks, GPT-4, ChatGPT, child cognitive development
- MeSH terms
- Child, Female, Humans, Language, Male, Theory of Mind
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.