The ERP response to the amount of information conveyed by words in sentences
Open accessThe DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index.
Abstract
Reading times on words in a sentence depend on the amount of information the words convey, which can be estimated by probabilistic language models. We investigate whether event-related potentials (ERPs), too, are predicted by information measures. Three types of language models estimated four different information measures on each word of a sample of English sentences. Six different ERP deflections were extracted from the EEG signal of participants reading the same sentences. A comparison between the information measures and ERPs revealed a reliable correlation between N400 amplitude and word surprisal. Language models that make no use of syntactic structure fitted the data better than did a phrase-structure grammar, which did not account for unique variance in N400 amplitude. These findings suggest that different information measures quantify cognitively different processes and that readers do not make use of a sentence's hierarchical structure for generating expectations about the upcoming word.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328
SRILM - an extensible language modeling toolkit
Stolcke, A. (2002) · 7th International Conference on Spoken Language Processing (ICSLP 2002) · doi:10.21437/icslp.2002-303 · Cited by 4,326
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008
Towards a neural basis of auditory sentence processing
Friederici, A. D. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01839-8 · Cited by 2,231 · cited 4×
“For one, it has been claimed that an ELAN only appears in cases of outright syntactic violations (Friederici, 2002; Friederici & Weissenborn, 2007), whereas all our experimental sentences are grammatically correct.”
InfluentialBrain potentials during reading reflect word expectancy and semantic association
Kutas, M., & Hillyard, S. A. (1984) · Nature · doi:10.1038/307161a0 · Cited by 2,218
Expectation-based syntactic comprehension
Levy, R. (2008) · Cognition · doi:10.1016/j.cognition.2007.05.006 · Cited by 2,202
Electrophysiology reveals semantic memory use in language comprehension.
Kutas, M., & Federmeier, K. D. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01560-6 · Cited by 2,124
An empirical study of smoothing techniques for language modeling
Chen, S. F., & Goodman, J. (1999) · Computer Speech & Language · doi:10.1006/csla.1999.0128 · Cited by 2,066
Event-related brain potentials elicited by syntactic anomaly
Osterhout, L., & Holcomb, P. J. (1992) · Journal of Memory and Language · doi:10.1016/0749-596x(92)90039-z · Cited by 1,856
Proceedings of the 29th Annual Conference of the Cognitive Science Society
Rohde, H., Kehler, A., & Elman, J. L. (2007) · Cognitive Science · Cited by 1,788
DeLong, K. A., Urbach, T. P., & Kutas, M. (2005) · Nature Neuroscience · doi:10.1038/nn1504 · Cited by 1,240
A probabilistic earley parser as a psycholinguistic model
Hale, J. (2001) · Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001 - NAACL '01 · doi:10.3115/1073336.1073357 · Cited by 1,150 · cited 3×
“As such, syntactic reanalysis should co-occur with high surprisal and, indeed, surprisal has been shown to account for particular garden path phenomena (Brouwer, Fitz, & Hoeks, 2010; Hale, 2001).”
Neural mechanisms of language comprehension: Challenges to syntax
Kuperberg, G. R. (2007) · Brain Research · doi:10.1016/j.brainres.2006.12.063 · Cited by 1,041
Proceedings of the 35th Annual Conference of the Cognitive Science Society
Dale, R. A. C., Yu, C., Nagai, Y., Coco, M. I., & Kopp, S. (2013) · Cited by 1,006
Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics
Gimpel, K., Schneider, N., O’Connor, B., Das, D., Mills, D. Q., Eisenstein, J., Heilman, M., Yogatama, D., Flanigan, J., & Smith, N. A. (2011) · The Association for Computational Linguistics · Cited by 890
Syntactically Based Sentence Processing Classes: Evidence from Event-Related Brain Potentials
Neville, H., Nicol, J. L., Barss, A., Forster, K. I., & Garrett, M. F. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.2.151 · Cited by 886
Prediction during language comprehension: Benefits, costs, and ERP components
Van Petten, C., & Luka, B. J. (2012) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2011.09.015 · Cited by 777
(2009) · The MIT Press eBooks · doi:10.7551/mitpress/8029.001.0001 · Cited by 743
Proceedings of the 33rd Annual Conference of the Cognitive Science Society
Dziemianko, M., Keller, F., & Coco, M. I. (2011) · Cited by 737
Redundancy and reduction: Speakers manage syntactic information density
Florian Jaeger, T. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2010.02.002 · Cited by 733
The effect of word predictability on reading time is logarithmic
Smith, N. J., & Levy, R. (2013) · Cognition · doi:10.1016/j.cognition.2013.02.013 · Cited by 725
Osterhout, L., Holcomb, P. J., & Swinney, D. A. (1994) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.20.4.786 · Cited by 669
Brouwer, H., Fitz, H., & Hoeks, J. (2012) · Brain Research · doi:10.1016/j.brainres.2012.01.055 · Cited by 625
Data from eye-tracking corpora as evidence for theories of syntactic processing complexity
Demberg, V., & Keller, F. (2008) · Cognition · doi:10.1016/j.cognition.2008.07.008 · Cited by 570
Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing
Lapata, M., & Ng, H. T. (2008) · Cited by 567
Part-of-Speech Tagging Guidelines for the Penn Treebank Project (3rd Revision)
Santorini, B. (1990) · ScholarlyCommons (University of Pennsylvania) · Cited by 434
Repair, Revision, and Complexity in Syntactic Analysis: An Electrophysiological Differentiation
Kaan, E., & Swaab, T. Y. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321107855 · Cited by 425
Neural localization of semantic context effects in electromagnetic and hemodynamic studies
Van Petten, C., & Luka, B. J. (2006) · Brain and Language · doi:10.1016/j.bandl.2005.11.003 · Cited by 375
Seeing words in context: the interaction of lexical and sentence level information during reading
Hoeks, J. C. J., Stowe, L. A., & Doedens, G. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2003.10.022 · Cited by 363
Bybee, J., & McClelland, J. L. (2005) · The Linguistic Review · doi:10.1515/tlir.2005.22.2-4.381 · Cited by 362
An Alternative Family of Transformations
John, J. A., & Draper, N. R. (1980) · Applied Statistics · doi:10.2307/2986305 · Cited by 357
Bilinguals reading in their second language do not predict upcoming words as native readers do
Martin, C. D., Thierry, G., Kuipers, J.-R., Boutonnet, B., Foucart, A., & Costa, A. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2013.08.001 · Cited by 348
Isn't It Ironic? An Electrophysiological Exploration of Figurative Language Processing
Regel, S., Gunter, T. C., & Friederici, A. D. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21411 · Cited by 345
The linguistic processes underlying the P600
Gouvea, A. C., Phillips, C., Kazanina, N., & Poeppel, D. (2010) · Language and Cognitive Processes · doi:10.1080/01690960902965951 · Cited by 344
Probabilistic Top-Down Parsing and Language Modeling
Roark, B. (2001) · Computational Linguistics · doi:10.1162/089120101750300526 · Cited by 329
Switching Languages, Switching Palabras (Words): An Electrophysiological Study of Code Switching
Moreno, E. M., Federmeier, K. D., & Kutas, M. (2002) · Brain and Language · doi:10.1006/brln.2001.2588 · Cited by 305
Uncertainty About the Rest of the Sentence
Hale, J. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_64 · Cited by 296
Prediction during natural language comprehension
Willems, R. M., Frank, S. L., Nijhof, A. D., Hagoort, P., & van den Bosch, A. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv075 · Cited by 288
Self-citationThe Information Conveyed by Words in Sentences
Hale, J. (2003) · Journal of Psycholinguistic Research · doi:10.1023/a:1022492123056 · Cited by 283
Frequency and predictability effects on event-related potentials during reading
Dambacher, M., Kliegl, R., Hofmann, M., & Jacobs, A. M. (2006) · Brain Research · doi:10.1016/j.brainres.2006.02.010 · Cited by 281
On the early left-anterior negativity (ELAN) in syntax studies
Steinhauer, K., & Drury, J. E. (2012) · Brain and Language · doi:10.1016/j.bandl.2011.07.001 · Cited by 277
The role of structural prediction in rapid syntactic analysis
Lau, E., Stroud, C., Plesch, S., & Phillips, C. (2006) · Brain and Language · doi:10.1016/j.bandl.2006.02.003 · Cited by 272
Parsing costs as predictors of reading difficulty: An evaluation using the Potsdam Sentence Corpus
Boston, M. F., Hale, J., Kliegl, R., Patil, U., & Vasishth, S. (2008) · Journal of Eye Movement Research · doi:10.16910/jemr.2.1.1 · Cited by 270
Kuperberg, G. R., Kreher, D. A., Sitnikova, T., Caplan, D. N., & Holcomb, P. J. (2007) · Brain and Language · doi:10.1016/j.bandl.2005.12.006 · Cited by 269
Establishing reference in language comprehension: An electrophysiological perspective
Van Berkum, J. J. A., Koornneef, A. W., Otten, M., & Nieuwland, M. S. (2007) · Brain Research · doi:10.1016/j.brainres.2006.06.091 · Cited by 264
Mapping sentence form onto meaning: The syntax–semantic interface
Friederici, A. D., & Weissenborn, J. (2007) · Brain Research · doi:10.1016/j.brainres.2006.08.038 · Cited by 255
Sennrich, R. (2012) · The Association for Computational Linguistics · Cited by 219
Insensitivity of the Human Sentence-Processing System to Hierarchical Structure
Frank, S. L., & Bod, R. (2011) · Psychological Science · doi:10.1177/0956797611409589 · Cited by 217
Self-citationLexical integration: Sequential effects of syntactic and semantic information
Friederici, A. D., Steinhauer, K., & Frisch, S. (1999) · Memory & Cognition · doi:10.3758/bf03211539 · Cited by 207
Thornhill, D. E., & Van Petten, C. (2012) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2011.12.007 · Cited by 196
de Groot, A. D. (2014) · Acta Psychologica · doi:10.1016/j.actpsy.2014.02.001 · Cited by 188
How hierarchical is language use?
Frank, S. L., Bod, R., & Christiansen, M. H. (2012) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2012.1741 · Cited by 184
Self-citationIndividual differences and contextual bias in pronoun resolution: Evidence from ERPs
Nieuwland, M. S., & Van Berkum, J. J. A. (2006) · Brain Research · doi:10.1016/j.brainres.2006.08.022 · Cited by 177
Parallel processing and sentence comprehension difficulty
Boston, M. F., Hale, J., Vasishth, S., & Kliegl, R. M. (2011) · Language and Cognitive Processes · doi:10.1080/01690965.2010.492228 · Cited by 176
Roark, B., Bachrach, A., Cardenas, C., & Pallier, C. (2009) · Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing Volume 1 - EMNLP '09 · doi:10.3115/1699510.1699553 · Cited by 174
Simos, P. G., Basile, L., & Papanicolaou, A. C. (1997) · Brain Research · doi:10.1016/s0006-8993(97)00349-1 · Cited by 171
A Usage‐Based Approach to Recursion in Sentence Processing
Christiansen, M. H., & MacDonald, M. C. (2009) · Language Learning · doi:10.1111/j.1467-9922.2009.00538.x · Cited by 168
Wicha, N. Y. Y., Moreno, E. M., & Kutas, M. (2003) · Cortex · doi:10.1016/s0010-9452(08)70260-0 · Cited by 151
Kaan, E., & Swaab, T. Y. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(03)00175-7 · Cited by 142
Uncertainty Reduction as a Measure of Cognitive Load in Sentence Comprehension
Frank, S. L. (2013) · Topics in Cognitive Science · doi:10.1111/tops.12025 · Cited by 137
Self-citationLexical surprisal as a general predictor of reading time
Monsalve, I. F., Frank, S. L., & Vigliocco, G. (2012) · UCL Discovery (University College London) · Cited by 135
Self-citationEye typing in application: A comparison of two interfacing systems with ALS patients
Pannasch, S., Helmert, J. R., Malischke, S., Storch, A., & Velichkovsky, B. M. (2008) · Journal of Eye Movement Research · Cited by 117
What a Rational Parser Would Do
Hale, J. T. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01145.x · Cited by 106
Sequential vs. Hierarchical Syntactic Models of Human Incremental Sentence Processing
Fossum, V., & Lévy, R. (2012) · North American Chapter of the Association for Computational Linguistics · Cited by 101
Localization of Syntactic and Semantic Brain Responses using Magnetoencephalography
Service, E., Helenius, P., Maury, S., & Salmelin, R. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.7.1193 · Cited by 97
Word surprisal predicts N400 amplitude during reading
Frank, S. L., Otten, L. J., Galli, G., & Vigliocco, G. (2013) · UCL Discovery (University College London) · Cited by 95
Self-citationOptimal Processing Times in Reading: A Formal Model and Empirical Investigation
Smith, N. J., & Lévy, R. (2008) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 85
Syntactic and Semantic Factors in Processing Difficulty: An Integrated Measure
Mitchell, J., Lapata, M., Demberg, V., & Keller, F. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 85
Smith, N. J., & Lévy, R. (2011) · eScholarship (California Digital Library) · Cited by 79
Complexity Metrics in an Incremental Right-corner Parser
Wu, S., Bachrach, A., Cardenas, C., & Schuler, W. (2010) · Cited by 67
Wlotko, E. W., & Federmeier, K. D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00181 · Cited by 52
Early effects of word surprisal on pupil size during reading
Frank, S. L., & Thompson, R. L. (2012) · eScholarship (California Digital Library) · Cited by 40
Self-citationUsing Language Models and Latent Semantic Analysis to Characterise the N400m Neural Response
Parviz, M., Johnson, M., Johnson, B. W., & Brock, J. (2011) · Clinical EEG and Neuroscience · Cited by 38
Investigating the role of entropy in sentence processing
Linzen, T., & Jaeger, T. F. (2014) · Workshop on Cognitive Modeling and Computational Linguistics (CMCL) · doi:10.3115/v1/w14-2002 · Cited by 19
Modelling Reading Times in Bilingual Sentence Comprehension
Frank, S. L. (2014) · Cited by 6
Self-citation
Cited by
What do we mean by prediction in language comprehension?
Kuperberg, G. R., & Jaeger, T. F. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1102299 · Cited by 1,087
“…Arnon & Snider, 2010).2 There is also recent evidence suggesting that surprisal correlates with the amplitude of the N400 to words within sentences (Frank et al., 2015; see also Rabovsky & McRae, 2014, for discussion of relationships between surprisal and the N400 to words outside sentence…”
BackgroundPredicting while comprehending language: A theory and review.
Pickering, M. J., & Gambi, C. (2018) · Psychological Bulletin · doi:10.1037/bul0000158 · Cited by 518
The neural architecture of language: Integrative modeling converges on predictive processing
Schrimpf, M., Blank, I. A., Tuckute, G., Kauf, C., Hosseini, E. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2105646118 · Cited by 517
Shared computational principles for language processing in humans and deep language models
Goldstein, A., Zada, Z., Buchnik, E., Schain, M., Price, A., Aubrey, B., Nastase, S. A., Feder, A., Emanuel, D., Cohen, A., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01026-4 · Cited by 447
A hierarchy of linguistic predictions during natural language comprehension
Heilbron, M., Armeni, K., Schoffelen, J.-M., Hagoort, P., & de Lange, F. P. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2201968119 · Cited by 343
Metadata
- Authors
- Frank, S. L., Otten, L. J., Galli, G., & Vigliocco, G.
- Venue
- Brain and Language
- Publisher
- Elsevier BV
- Published
- 2015-01
- Volume
- 140
- Pages
- 1-11
- ISSN
- 0093-934X (ISSN-L)
- OpenAlex
- W2119728020
- Cited by
- 381
- References
- 81
- FWCI
- 6.47
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.