CoChat

Differential Tracking of Linguistic vs. Mental State Content in Naturalistic Stimuli by Language and Theory of Mind (ToM) Brain Networks

Open access
Paunov, Alexander M., Blank, Idan A., Jouravlev, Olessia, Mineroff, Zachary, Gallée, Jeanne, Fedorenko, Evelina · 2022 · Neurobiology of Language

Published version of a preprint

Cited by 38

The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.

Abstract

Language and social cognition, especially the ability to reason about mental states, known as theory of mind (ToM), are deeply related in development and everyday use. However, whether these cognitive faculties rely on distinct, overlapping, or the same mechanisms remains debated. Some evidence suggests that, by adulthood, language and ToM draw on largely distinct—though plausibly interacting—cortical networks. However, the broad topography of these networks is similar, and some have emphasized the importance of social content / communicative intent in the linguistic signal for eliciting responses in the language areas. Here, we combine the power of individual-subject functional localization with the naturalistic-cognition inter-subject correlation approach to illuminate the language–ToM relationship. Using functional magnetic resonance imaging (fMRI), we recorded neural activity as participants (n = 43) listened to stories and dialogues with mental state content (+linguistic, +ToM), viewed silent animations and live action films with mental state content but no language (−linguistic, +ToM), or listened to an expository text (+linguistic, −ToM). The ToM network robustly tracked stimuli rich in mental state information regardless of whether mental states were conveyed linguistically or non-linguistically, while tracking a +linguistic / −ToM stimulus only weakly. In contrast, the language network tracked linguistic stimuli more strongly than (a) non-linguistic stimuli, and than (b) the ToM network, and showed reliable tracking even for the linguistic condition devoid of mental state content. These findings suggest that in spite of their indisputably close links, language and ToM dissociate robustly in their neural substrates—and thus plausibly cognitive mechanisms—including during the processing of rich naturalistic materials.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1162/nol_a_00071

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 58 references

Research works printed but not linked: 105

  1. Amalric, 2018, Cortical circuits for mathematical knowledge: Evidence for a major subdivision within the brain’s semantic networks, Philosophical Transactions of the Royal Society B: Biological Sciences, 373, Article 20160515, 10.1098/rstb.2016.0515 · DOI
  2. Anderson, 2019, Multiple regions of a cortical network commonly encode the meaning of words in multiple grammatical positions of read sentences, Cerebral Cortex, 29, 2396, 10.1093/cercor/bhy110 · DOI
  3. Aronson, 1980, The social animal
  4. Ayyash, 2022, The universal language network: A cross-linguistic investigation spanning 45 languages and 11 language families, BioRxiv, 10.1101/2021.07.28.454040 · DOI · Paper page
  5. Baayen, 2008, Mixed-effects modeling with crossed random effects for subjects and items, Journal of Memory and Language, 59, 390, 10.1016/j.jml.2007.12.005 · DOI · Paper page
  6. Bahlmann, 2007, An fMRI study of canonical and noncanonical word order in German, Human Brain Mapping, 28, 940, 10.1002/hbm.20318 · DOI
  7. Barlow, 1995, The neuron doctrine in perception, 415
  8. Barr, 2013, Random effects structure for confirmatory hypothesis testing: Keep it maximal, Journal of Memory and Language, 68, 255, 10.1016/j.jml.2012.11.001 · DOI · Paper page
  9. Bautista, 2016, Neural responses to grammatically and lexically degraded speech, Language, Cognition and Neuroscience, 31, 567, 10.1080/23273798.2015.1123281 · DOI · Paper page
  10. Beckmann, 2005, Investigations into resting-state connectivity using independent component analysis, Philosophical Transactions of the Royal Society B: Biological Sciences, 360, 1001, 10.1098/rstb.2005.1634 · DOI · Paper page
  11. Benjamini, 2001, The control of the false discovery rate in multiple testing under dependency, The Annals of Statistics, 29, 1165, 10.1214/aos/1013699998 · DOI · Paper page
  12. Bischetti, 2019, Pragmatics and theory of mind in older adults’ humor comprehension, Current Psychology, 2019, 1, 10.1007/s12144-019-00295-w · DOI
  13. Blank, 2016, Syntactic processing is distributed across the language system, NeuroImage, 127, 307, 10.1016/j.neuroimage.2015.11.069 · DOI · Paper page
  14. Blank, 2017, Domain-general brain regions do not track linguistic input as closely as language-selective regions, Journal of Neuroscience, 37, 9999, 10.1523/JNEUROSCI.3642-16.2017 · DOI · Paper page
  15. Blank, 2020, No evidence for differences among language regions in their temporal receptive windows, NeuroImage, 219, Article 116925, 10.1016/j.neuroimage.2020.116925 · DOI · Paper page
  16. Bosco, 2018, Why pragmatics and theory of mind do not (completely) overlap, Frontiers in Psychology, 9, 1453, 10.3389/fpsyg.2018.01453 · DOI
  17. Braga, 2020, Situating the left-lateralized language network in the broader organization of multiple specialized large-scale distributed networks, Journal of Neurophysiology, 124, 1415, 10.1152/jn.00753.2019 · DOI · Paper page
  18. Brett, 2002, The problem of functional localization in the human brain, Nature Reviews Neuroscience, 3, 243, 10.1038/nrn756 · DOI · Paper page
  19. Bruneau, 2012, Distinct roles of the “shared pain” and “theory of mind” networks in processing others’ emotional suffering, Neuropsychologia, 50, 219, 10.1016/j.neuropsychologia.2011.11.008 · DOI
  20. Castelli, 2000, Movement and mind: A functional imaging study of perception and interpretation of complex intentional movement patterns, NeuroImage, 12, 314, 10.1006/nimg.2000.0612 · DOI · Paper page
  21. Chen, 2017, Is the statistic value all we should care about in neuroimaging?, NeuroImage, 147, 952, 10.1016/j.neuroimage.2016.09.066 · DOI · Paper page
  22. Cheney, 1990, Attending to behaviour versus attending to knowledge: Examining monkeys’ attribution of mental states, Animal Behaviour, 40, 742, 10.1016/S0003-3472(05)80703-1 · DOI · Paper page
  23. Cordes, 2001, Frequencies contributing to functional connectivity in the cerebral cortex in “resting-state” data, American Journal of Neuroradiology, 22, 1326
  24. Deen, 2015, Functional organization of social perception and cognition in the superior temporal sulcus, Cerebral Cortex, 25, 4596, 10.1093/cercor/bhv111 · DOI · Paper page
  25. Diachek, 2020, The domain-general multiple demand (MD) network does not support core aspects of language comprehension: A large-scale fMRI investigation, Journal of Neuroscience, 40, 4536, 10.1523/JNEUROSCI.2036-19.2020 · DOI · Paper page
  26. Dunbar, 2004, Gossip in evolutionary perspective, Review of General Psychology, 8, 100, 10.1037/1089-2680.8.2.100 · DOI · Paper page
  27. Fedorenko, 2014, The role of domain-general cognitive control in language comprehension, Frontiers in Psychology, 5, Article 335, 10.3389/fpsyg.2014.00335 · DOI · Paper page
  28. Fedorenko, 2021, The early origins and the growing popularity of the individual-subject analytic approach in human neuroscience, Current Opinion in Behavioral Sciences, 40, 105, 10.1016/j.cobeha.2021.02.023 · DOI · Paper page
  29. Fedorenko, 2012, Lexical and syntactic representations in the brain: An fMRI investigation with multi-voxel pattern analyses, Neuropsychologia, 50, 499, 10.1016/j.neuropsychologia.2011.09.014 · DOI · Paper page
  30. Fedorenko, 2016, Neural correlate of the construction of sentence meaning, Proceedings of the National Academy of Sciences, 113, E6256, 10.1073/pnas.1612132113 · DOI · Paper page
  31. Fedorenko, 2021, Similarity of computations across domains does not imply shared implementation: The case of language comprehension, Current Directions in Psychological Science, 30, 526, 10.1177/09637214211046955 · DOI · Paper page
  32. Fedorenko, 2016, Language and thought are not the same thing: Evidence from neuroimaging and neurological patients, Annals of the New York Academy of Sciences, 1369, 132, 10.1111/nyas.13046 · DOI · Paper page
  33. Feng, 2017, Effects of contextual relevance on pragmatic inference during conversation: An fMRI study, Brain and Language, 171, 52, 10.1016/j.bandl.2017.04.005 · DOI
  34. Feng, 2021, Understanding particularized and generalized conversational implicatures: Is theory-of-mind necessary?, Brain and Language, 212, Article 104878, 10.1016/j.bandl.2020.104878 · DOI
  35. Ferstl, 2002, What does the frontomedian cortex contribute to language processing: Coherence or theory of mind?, NeuroImage, 17, 1599, 10.1006/nimg.2002.1247 · DOI · Paper page
  36. Finlayson, 2011, Narrative is a key cognitive competency, 110
  37. Fodor, 1983, The modularity of mind, 10.7551/mitpress/4737.001.0001 · DOI · Paper page
  38. Foldiak, 1995, Sparse coding in the primate cortex, 895
  39. Frost, 2012, Measuring structural–functional correspondence: Spatial variability of specialised brain regions after macro-anatomical alignment, NeuroImage, 59, 1369, 10.1016/j.neuroimage.2011.08.035 · DOI · Paper page
  40. Futrell, 2021, The natural stories corpus: A reading-time corpus of English texts containing rare syntactic constructions, Language Resources & Evaluation, 55, 63, 10.1007/s10579-020-09503-7 · DOI · Paper page
  41. Gallivan, 2009, Is that within reach? fMRI reveals that the human superior parieto-occipital cortex encodes objects reachable by the hand, Journal of Neuroscience, 29, 4381, 10.1523/JNEUROSCI.0377-09.2009 · DOI · Paper page
  42. Grice, 1968, Utterer’s meaning, sentence-meaning, and word-meaning, 49, 10.1007/978-94-009-2727-8_2 · DOI · Paper page
  43. Grice, 1975, Logic and conversation, 41, 10.1163/9789004368811_003 · DOI · Paper page
  44. Grice, 1991, Meaning, 213
  45. Hagoort, 2014, Neuropragmatics, 667, 10.7551/mitpress/9504.003.0073 · DOI
  46. Hammer, 2011, Neural mechanisms of anaphoric reference revealed by fMRI, Frontiers in Psychology, 2, Article 32, 10.3389/fpsyg.2011.00032 · DOI
  47. Hasson, 2008, Enhanced intersubject correlations during movie viewing correlate with successful episodic encoding, Neuron, 57, 452, 10.1016/j.neuron.2007.12.009 · DOI · Paper page
  48. Hasson, 2010, Reliability of cortical activity during natural stimulation, Trends in Cognitive Sciences, 14, 40, 10.1016/j.tics.2009.10.011 · DOI · Paper page
  49. Ivanova, 2020, Effect of task on sentence processing
  50. Ivanova, 2020, Comprehension of computer code relies primarily on domain-general executive brain regions, Elife, 9, Article e58906, 10.7554/eLife.58906 · DOI · Paper page
  51. Jackendoff, 2009, Language, consciousness, culture: Essays on mental structure
  52. Jacoby, 2020, Discourse-level comprehension engages medial frontal theory of mind brain regions even for expository texts, Language, Cognition and Neuroscience, 35, 780, 10.1080/23273798.2018.1525494 · DOI · Paper page
  53. Jang, 2013, Everyday conversation requires cognitive inference: Neural bases of comprehending implicated meanings in conversations, NeuroImage, 81, 61, 10.1016/j.neuroimage.2013.05.027 · DOI
  54. Jenkins, 2014, The neural bases of directed and spontaneous mental state attributions to group agents, PLOS ONE, 9, Article e105341, 10.1371/journal.pone.0105341 · DOI
  55. Julian, 2012, An algorithmic method for functionally defining regions of interest in the ventral visual pathway, NeuroImage, 60, 2357, 10.1016/j.neuroimage.2012.02.055 · DOI · Paper page
  56. Kandylaki, 2015, Processing of false belief passages during natural story comprehension: An fMRI study, Human Brain Mapping, 36, 4231, 10.1002/hbm.22907 · DOI
  57. Kanwisher, 2010, Functional specificity in the human brain: A window into the functional architecture of the mind, Proceedings of the National Academy of Sciences, 107, 11163, 10.1073/pnas.1005062107 · DOI · Paper page
  58. Klepousniotou, 2014, Pathways to lexical ambiguity: fMRI evidence for bilateral fronto-parietal involvement in language processing, Brain and Language, 131, 56, 10.1016/j.bandl.2013.06.002 · DOI
  59. Koster-Hale, 2014, Thinking about seeing: Perceptual sources of knowledge are encoded in the theory of mind brain regions of sighted and blind adults, Cognition, 133, 65, 10.1016/j.cognition.2014.04.006 · DOI
  60. Kushner, 2003, Bad news (Episode 1, Season 1; Audio only) [HBO miniseries episode]
  61. Lecce, 2019, Interpreting physical and mental metaphors: Is theory of mind associated with pragmatics in middle childhood?, Journal of Child Language, 46, 393, 10.1017/S030500091800048X · DOI
  62. Mason, 2009, The role of the theory-of-mind cortical network in the comprehension of narratives, Language and Linguistics Compass, 3, 157, 10.1111/j.1749-818X.2008.00122.x · DOI · Paper page
  63. Mason, 2003, Ambiguity in the brain: What brain imaging reveals about the processing of syntactically ambiguous sentences, Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 1319, 10.1037/0278-7393.29.6.1319 · DOI · Paper page
  64. McMillan, 2012, fMRI evidence for strategic decision-making during resolution of pronoun reference, Neuropsychologia, 50, 674, 10.1016/j.neuropsychologia.2012.01.004 · DOI · Paper page
  65. Mellem, 2016, Sentence processing in anterior superior temporal cortex shows a social-emotional bias, Neuropsychologia, 89, 217, 10.1016/j.neuropsychologia.2016.06.019 · DOI · Paper page
  66. Morosan, 2001, Human primary auditory cortex: Cytoarchitectonic subdivisions and mapping into a spatial reference system, NeuroImage, 13, 684, 10.1006/nimg.2000.0715 · DOI · Paper page
  67. Nastase, 2020, Keep it real: Rethinking the primacy of experimental control in cognitive neuroscience, NeuroImage, 222, Article 117254, 10.1016/j.neuroimage.2020.117254 · DOI · Paper page
  68. Norman-Haignere, 2015, Distinct cortical pathways for music and speech revealed by hypothesis-free voxel decomposition, Neuron, 8, 1281, 10.1016/j.neuron.2015.11.035 · DOI · Paper page
  69. Nowak, 2011, SuperCooperators: Altruism, evolution, and why we need each other to succeed
  70. Oldfield, 1971, The assessment and analysis of handedness: The Edinburgh inventory, Neuropsychologia, 9, 97, 10.1016/0028-3932(71)90067-4 · DOI · Paper page
  71. Paunov, A. M. (2019). fMRI studies of the relationship between language and theory of mind in adult cognition[Unpublished doctoral dissertation]. Massachusetts Institute of Technology.
  72. Paunov, 2019, Functionally distinct language and theory of mind networks are synchronized at rest and during language comprehension, Journal of Neurophysiology, 121, 1244, 10.1152/jn.00619.2018 · DOI · Paper page
  73. Paunov, 2022, No evidence of theory of mind reasoning in the human language network
  74. Pritchett, 2018, High-level language processing regions are not engaged in action observation or imitation, Journal of Neurophysiology, 120, 2555, 10.1152/jn.00222.2018 · DOI · Paper page
  75. Redcay, 2016, Perceived communicative intent in gesture and language modulates the superior temporal sulcus, Human Brain Mapping, 37, 3444, 10.1002/hbm.23251 · DOI · Paper page
  76. Reddy, 2020, Syntactic representations in the human brain: Beyond effort-based metrics, BioRxiv, 10.1101/2020.06.16.155499 · DOI
  77. Reher, 2009, Partly cloudy
  78. Richardson, 2020, Reduced neural selectivity for mental states in deaf children with delayed exposure to sign language, Nature Communications, 11, Article 3246, 10.1038/s41467-020-17004-y · DOI
  79. Richardson, 2018, Development of the social brain from age three to twelve years, Nature Communications, 9, Article 1027, 10.1038/s41467-018-03399-2 · DOI · Paper page
  80. Rodd, 2005, The neural mechanisms of speech comprehension: fMRI studies of semantic ambiguity, Cerebral Cortex, 15, 1261, 10.1093/cercor/bhi009 · DOI · Paper page
  81. Ruby, 2003, What you believe versus what you think they believe: A neuroimaging study of conceptual perspective-taking, European Journal of Neuroscience, 17, 2475, 10.1046/j.1460-9568.2003.02673.x · DOI · Paper page
  82. Saur, 2010, Combining functional and anatomical connectivity reveals brain networks for auditory language comprehension, NeuroImage, 49, 3187, 10.1016/j.neuroimage.2009.11.009 · DOI · Paper page
  83. Saxe, 2006, Reading minds versus following rules: Dissociating theory of mind and executive control in the brain, Social Neuroscience, 1, 284, 10.1080/17470910601000446 · DOI · Paper page
  84. Shain, 2021, Robust effects of working memory demand during naturalistic language comprehension in language-selective cortex, BioRxiv, 10.1101/2021.09.18.460917 · DOI
  85. Simon, 1962, The architecture of complexity, Proceedings of the American Philosophical Society, 106, 467
  86. Snijders, 2009, Retrieval and unification of syntactic structure in sentence comprehension: An fMRI study using word-category ambiguity, Cerebral Cortex, 19, 1493, 10.1093/cercor/bhn187 · DOI · Paper page
  87. Sonkusare, 2019, Naturalistic stimuli in neuroscience: Critically acclaimed, Trends in Cognitive Sciences, 23, 699, 10.1016/j.tics.2019.05.004 · DOI · Paper page
  88. Sperber, 1986, Relevance: Communication and cognition
  89. Sperber, 2002, Pragmatics, modularity and mind-reading, Mind & Language, 17, 3, 10.1111/1468-0017.00186 · DOI · Paper page
  90. Spotorno, 2012, Neural evidence that utterance-processing entails mentalizing: The case of irony, NeuroImage, 63, 25, 10.1016/j.neuroimage.2012.06.046 · DOI · Paper page
  91. Tager-Flusberg, 2005, Language and communication in autism, 335, 10.1002/9780470939345 · DOI
  92. Tahmasebi, 2012, Is the link between anatomical structure and function equally strong at all cognitive levels of processing?, Cerebral Cortex, 22, 1593, 10.1093/cercor/bhr205 · DOI · Paper page
  93. Theiler, 1992, Testing for nonlinearity in time series: The method of surrogate data, Physica D: Nonlinear Phenomena, 58, 77, 10.1016/0167-2789(92)90102-S · DOI · Paper page
  94. Tzourio-Mazoyer, 2002, Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain, NeuroImage, 15, 273, 10.1006/nimg.2001.0978 · DOI · Paper page
  95. van Ackeren, 2012, Pragmatics in action: Indirect requests engage theory of mind areas and the cortical motor network, Journal of Cognitive Neuroscience, 24, 2237, 10.1162/jocn_a_00274 · DOI · Paper page
  96. Varley, 2000, Evidence for cognition without grammar from causal reasoning and “theory of mind” in an agrammatic aphasic patient, Current Biology, 10, 723, 10.1016/s0960-9822(00)00538-8 · DOI · Paper page
  97. Varley, 2001, Severe impairment in grammar does not preclude theory of mind, Neurocase, 7, 489, 10.1093/neucas/7.6.489 · DOI · Paper page
  98. Vogeley, 2001, Mind reading: Neural mechanisms of theory of mind and self-perspective, NeuroImage, 14, 170, 10.1006/nimg.2001.0789 · DOI · Paper page
  99. Wikipedia, .., Tree
  100. Wilkinson, 1998, Profiles of language and communication skills in autism, Mental Retardation and Developmental Disabilities Research Reviews, 4, 73, 10.1002/(SICI)1098-2779(1998)4:2<73::AID-MRDD3>3.0.CO;2-Y · DOI
  101. Willems, 2011, Communicating without a functioning language system: Implications for the role of language in mentalizing, Neuropsychologia, 49, 3130, 10.1016/j.neuropsychologia.2011.07.023 · DOI
  102. Willems, 2020, Narratives for neuroscience, Trends in Neurosciences, 43, 271, 10.1016/j.tins.2020.03.003 · DOI · Paper page
  103. Willems, 2014, On the other hand: Including left-handers in cognitive neuroscience and neurogenetics, Nature Reviews Neuroscience, 15, 193, 10.1038/nrn3679 · DOI · Paper page
  104. Wimmer, 1983, Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children’s understanding of deception, Cognition, 13, 103, 10.1016/0010-0277(83)90004-5 · DOI · Paper page
  105. Young, 2008, The neural basis of belief encoding and integration in moral judgment, NeuroImage, 40, 1912, 10.1016/j.neuroimage.2008.01.057 · DOI · Paper page

Cited by

See all 38

Metadata

Authors
Paunov, A. M., Blank, I. A., Jouravlev, O., Mineroff, Z., Gallée, J., & Fedorenko, E.
Venue
Neurobiology of Language
Publisher
MIT Press
Published
2022
Volume
3
Issue
3
Pages
413-440
ISSN
2641-4368 (ISSN-L)
OpenAlex
W4226300773
Cited by
38
References
58
FWCI
12.20
Type
journal article
Language
en
Open access
gold
Funders
  • National Institute on Deafness and Other Communication Disorders (DC016607, DC016950)
  • Simons Foundation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Differential Tracking of Linguistic vs. Mental State Content in Naturalistic Stimuli by Language and Theory of Mind (ToM) Brain Networks. https://app.cochat.ai/papers/10.1162/nol_a_00071
The paper
Paunov, A. M., Blank, I. A., Jouravlev, O., Mineroff, Z., Gallée, J., & Fedorenko, E. (2022). Differential Tracking of Linguistic vs. Mental State Content in Naturalistic Stimuli by Language and Theory of Mind (ToM) Brain Networks. Neurobiology of Language. https://doi.org/10.1162/nol_a_00071

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.