The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Localizing syntactic predictions using recurrent neural network grammars
Open accessAbstract
Brain activity in numerous perisylvian brain regions is modulated by the expectedness of linguistic stimuli. We leverage recent advances in computational parsing models to test what representations guide the processes reflected by this activity. Recurrent Neural Network Grammars (RNNGs) are generative models of (tree, string) pairs that use neural networks to drive derivational choices. Parsing with them yields a variety of incremental complexity metrics that we evaluate against a publicly available fMRI data-set recorded while participants simply listen to an audiobook story. Surprisal, which captures a word's un-expectedness, correlates with a wide range of temporal and frontal regions when it is calculated based on word-sequence information using a top-performing LSTM neural network language model. The explicit encoding of hierarchy afforded by the RNNG additionally captures activity in left posterior temporal areas. A separate metric tracking the number of derivational steps taken between words correlates with activity in the left temporal lobe and inferior frontal gyrus. This pattern of results narrows down the kinds of linguistic representations at play during predictive processing across the brain's language network.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“it is sensitive to abstract hierarchical rules in isolated phrases and sentences [31, 108, 109, 110], in naturalistic narratives [111, 112, 113, 114], and in syntactically well-formed but semantically empty (”
From Dissociating language and thought in large language models (2024) · cites this paper as [112]
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,893
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075096.1075150 · Cited by 3,055
Integration of Visual and Linguistic Information in Spoken Language Comprehension
Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995) · Science · doi:10.1126/science.7777863 · Cited by 2,929
Statistical methods for speech recognition
Jelinek, F. (1997) · Journal of the American Statistical Association · doi:10.2307/2670189 · Cited by 2,376
Electrophysiology reveals semantic memory use in language comprehension.
Kutas, M., & Federmeier, K. D. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01560-6 · Cited by 2,124
Flagged first, then by citations
Research works printed but not linked: 1
- Bates, 2009, lme4: linear mixed-effects models using S4 classes, R package
Cited by
Sorted by citations
Dissociating language and thought in large language models
Mahowald, K., Ivanova, A. A., Blank, I. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.01.011 · Cited by 345
A hierarchy of linguistic predictions during natural language comprehension
Heilbron, M., Armeni, K., Schoffelen, J.-M., Hagoort, P., & de Lange, F. P. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2201968119 · Cited by 343
Brodbeck, C. J., & Simon, J. Z. (2020) · Current Opinion in Physiology · doi:10.1016/j.cophys.2020.07.014 · Cited by 127
Shared functional specialization in transformer-based language models and the human brain
Kumar, S., Sumers, T. R., Yamakoshi, T., Goldstein, A., Hasson, U., Norman, K. A., Griffiths, T. L., Hawkins, R. D., & Nastase, S. A. (2024) · Nature Communications · doi:10.1038/s41467-024-49173-5 · Cited by 108
Semantic encoding during language comprehension at single-cell resolution
Jamali, M., Grannan, B. L., Cai, J., Khanna, A. R., Muñoz, W., Caprara, I., Paulk, A. C., Cash, S. S., Fedorenko, E. G., & Williams, Z. M. (2024) · Nature · doi:10.1038/s41586-024-07643-2 · Cited by 76
Metadata
- Authors
- Brennan, J. R., Dyer, C., Kuncoro, A., & Hale, J. T.
- Affiliations
- University of Michigan (US)
- Google DeepMind (United Kingdom) (GB)
- University of Oxford (GB)
- University of Georgia (US)
- Corresponding author
- Brennan, Jonathan R.
- ORCID
- Brennan, Jonathan R.
- Venue
- Neuropsychologia
- Publisher
- Elsevier BV
- Published
- 2020-09
- Volume
- 146
- Pages
- 107479
- ISSN
- 0028-3932 (ISSN-L)
- OpenAlex
- W3024404575
- Cited by
- 58
- References
- 72
- Citations by year
- 2026: 9 · 2025: 14 · 2024: 12 · 2023: 14 · 2022: 4 · 2021: 2 · 2020: 3
- FWCI
- 3.09
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuropsychologia (acceptedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Social Sciences › Psychology › Developmental and Educational Psychology › Reading and Literacy Development
- Keywords
- syntactic analysis, predictive processing, language comprehension, functional MRI, inferior frontal gyrus, derivational complexity, linguistic representation
- MeSH terms
- Brain Mapping, Humans, Language, Linguistics, Magnetic Resonance Imaging, Temporal Lobe, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
