Using stochastic language models (SLM) to map lexical, syntactic, and phonological information processing in the brain
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Language comprehension involves the simultaneous processing of information at the phonological, syntactic, and lexical level. We track these three distinct streams of information in the brain by using stochastic measures derived from computational language models to detect neural correlates of phoneme, part-of-speech, and word processing in an fMRI experiment. Probabilistic language models have proven to be useful tools for studying how language is processed as a sequence of symbols unfolding in time. Conditional probabilities between sequences of words are at the basis of probabilistic measures such as surprisal and perplexity which have been successfully used as predictors of several behavioural and neural correlates of sentence processing. Here we computed perplexity from sequences of words and their parts of speech, and their phonemic transcriptions. Brain activity time-locked to each word is regressed on the three model-derived measures. We observe that the brain keeps track of the statistical structure of lexical, syntactic and phonological information in distinct areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Electrophysiology reveals semantic memory use in language comprehension.
Kutas, M., & Federmeier, K. D. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01560-6 · Cited by 2,124
The neurobiology of semantic memory
Binder, J. R., & Desai, R. H. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.10.001 · Cited by 2,114
Meta-analyzing left hemisphere language areas: phonology, semantics, and sentence processing.
Vigneau, M., Beaucousin, V., Hervé, P. Y., Duffau, H., Crivello, F., Houdé, O., Mazoyer, B., & Tzourio-Mazoyer, N. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.11.002 · Cited by 1,851
Predictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
On Broca, brain, and binding: A new framework
Hagoort, P. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.07.004 · Cited by 1,411
Language‐specific tuning of visual cortex? Functional properties of the Visual Word Form Area
Cohen, L., Lehéricy, S., Chochon, F., Lemer, C., Rivaud, S., & Dehaene, S. (2002) · Brain · doi:10.1093/brain/awf094 · Cited by 1,254
Cluster-extent based thresholding in fMRI analyses: Pitfalls and recommendations
Woo, C.-W., Krishnan, A., & Wager, T. D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.12.058 · Cited by 1,253
A probabilistic earley parser as a psycholinguistic model
Hale, J. (2001) · Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001 - NAACL '01 · doi:10.3115/1073336.1073357 · Cited by 1,150
Lesion analysis of the brain areas involved in language comprehension
Dronkers, N. F., Wilkins, D. P., Van Valin, R. D., Redfern, B. B., & Jaeger, J. J. (2004) · Cognition · doi:10.1016/j.cognition.2003.11.002 · Cited by 1,035
Cited by
The neural architecture of language: Integrative modeling converges on predictive processing
Schrimpf, M., Blank, I. A., Tuckute, G., Kauf, C., Hosseini, E. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2105646118 · Cited by 517
A hierarchy of linguistic predictions during natural language comprehension
Heilbron, M., Armeni, K., Schoffelen, J.-M., Hagoort, P., & de Lange, F. P. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2201968119 · Cited by 343
Evidence of a predictive coding hierarchy in the human brain listening to speech
Caucheteux, C., Gramfort, A., & King, J.-R. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01516-2 · Cited by 308
The language network as a natural kind within the broader landscape of the human brain
Fedorenko, E., Ivanova, A. A., & Regev, T. I. (2024) · Nature Reviews Neuroscience · doi:10.1038/s41583-024-00802-4 · Cited by 293
fMRI reveals language-specific predictive coding during naturalistic sentence comprehension
Shain, C., Blank, I. A., van Schijndel, M., Schuler, W., & Fedorenko, E. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107307 · Cited by 215
Hasson, U., Egidi, G., Marelli, M., & Willems, R. M. (2018) · Cognition · doi:10.1016/j.cognition.2018.06.018 · Cited by 157
Self-citationThe neural architecture of language: Integrative modeling converges on predictive processing
(2020) · doi:10.1101/2020.06.26.174482 · Cited by 129
Wehbe, L., Blank, I. A., Shain, C., Futrell, R., Levy, R., von der Malsburg, T., Smith, N., Gibson, E., & Fedorenko, E. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab065 · Cited by 72
Hosseini, E. A., Schrimpf, M., Zhang, Y., Bowman, S., Zaslavsky, N., & Fedorenko, E. (2024) · Neurobiology of Language · doi:10.1162/nol_a_00137 · Cited by 63
“…et al., 2018), magnetoencephalography (Brodbeck et al., 2022; Heilbron et al., 2022), fMRI (Brennan et al., 2016; Heilbron et al., 2022; Henderson et al., 2016; Lopopolo et al., 2017; Shain et al., 2020; Willems et al., 2016), or intracranially (Goldstein et al., 2022) during language processing.”
BackgroundA hierarchy of linguistic predictions during natural language comprehension
(2020) · doi:10.1101/2020.12.03.410399 · Cited by 63
Localizing syntactic predictions using recurrent neural network grammars
Brennan, J. R., Dyer, C., Kuncoro, A., & Hale, J. T. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107479 · Cited by 58
Predictive sentence comprehension during story-listening in autism spectrum disorder
Brennan, J. R., Lajiness-O'Neill, R., Bowyer, S., Kovelman, I., & Hale, J. T. (2019) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2018.1560483 · Cited by 19
Predictive Processing during a Naturalistic Statistical Learning Task in ASD
Wagley, N., Lajiness-O’Neill, R., Hay, J. S. F., Ugolini, M., Bowyer, S. M., Kovelman, I., & Brennan, J. R. (2020) · eneuro · doi:10.1523/eneuro.0069-19.2020 · Cited by 13
“…on adults at syntactic (Monsalve et al., 2012; Frank et al., 2013; Gwilliams and Marantz, 2015; Willems et al., 2016; Brennan et al., 2016a; Lopopolo et al., 2017; Gwilliams et al., 2018) and lexical or phonemic levels of processing (Gwilliams and Marantz, 2015; Lopopolo et al., 2017;…”
BackgroundInfluential
Metadata
- Authors
- Lopopolo, A., Frank, S. L., van den Bosch, A., & Willems, R. M.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-05-18
- Volume
- 12
- Issue
- 5
- Pages
- e0177794
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2616551000
- Cited by
- 84
- References
- 19
- FWCI
- 3.58
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.