The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Prediction during language comprehension: what is next?
Open accessAbstract
Prediction is often regarded as an integral aspect of incremental language comprehension, but little is known about the cognitive architectures and mechanisms that support it. We review studies showing that listeners and readers use all manner of contextual information to generate multifaceted predictions about upcoming input. The nature of these predictions may vary between individuals owing to differences in language experience, among other factors. We then turn to unresolved questions which may guide the search for the underlying mechanisms. (i) Is prediction essential to language processing or an optional strategy? (ii) Are predictions generated from within the language system or by domain-general processes? (iii) What is the relationship between prediction and memory? (iv) Does prediction in comprehension require simulation via the production system? We discuss promising directions for making progress in answering these questions and for developing a mechanistic understanding of prediction in language.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A key mechanism proposed to support this transformation is the use of linguistic context across multiple hierarchical levels to facilitate the interpretation of incoming speech input (Kuperberg & Jaeger, 2016;Ryskin & Nieuwland, 2023).”
From Effects of bimodal divided attention on cortical representations of linguistic context during continuous speech perception in noise (2026) · cites this paper as Ryskin & Nieuwland, 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · cited 1×
“In addition, predictive processing has been a highly productive explanatory framework across domains of cognitive science [7,8].”
BackgroundRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
A capacity theory of comprehension: individual differences in working memory
Just, M. A., & Carpenter, P. A. (1992) · Psychological Review · doi:10.1037/0033-295x.99.1.122 · Cited by 4,153 · cited 1×
“Independently, aspects of cognitive control have long been proposed to be involved in language processing [200].”
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273
Frontal theta as a mechanism for cognitive control
Cavanagh, J. F., & Frank, M. J. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.012 · Cited by 2,726 · cited 3×
“This component has been linked to inhibitory control processes [159], and is potentially consistent with a role for cognitive control in prediction error signaling [135].”
BackgroundResultThe Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 1×
“However, in its unconstrained form, this proposal is computationally intractable [76,77].”
BackgroundCanonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 1×
“However, itisunclear towhatex-tentthesecomputationsoccurwithinlocalcircuits[182]orwhethertheyaremediatedbyahub[198]thatisresponsiblefor cognitive control across domains [199].”
Background“Cloze Procedure”: A New Tool for Measuring Readability
Taylor, W. L. (1953) · Journalism Quarterly · doi:10.1177/107769905303000401 · Cited by 2,332
People thinking about thinking peopleThe role of the temporo-parietal junction in “theory of mind”
Saxe, R., & Kanwisher, N. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00230-1 · Cited by 2,316 · cited 1×
“This flexibility may rely on interactions between the language network and the domain-general multipledemand network or further domain-specific networks such as the theory of mind network which is selectively engaged when humans reason about the mental states of others [149,150].”
BackgroundEvidence for a Frontoparietal Control System Revealed by Intrinsic Functional Connectivity
Vincent, J. L., Kahn, I., Snyder, A. Z., Raichle, M. E., & Buckner, R. L. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90355.2008 · Cited by 1,869 · cited 1×
“, [130,205]) which are engaged regardless of the substrate of information processing (although some functional biases, such as toward visual vs auditory modalities, may exist within the network [206,207]).”
BackgroundThe multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour
Duncan, J. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.004 · Cited by 1,846 · cited 1×
“Another sense of 'domain-general' refers to the engagement of cognitive processes, such as executive function and working memory (Box 5), which are often associated with increased mental effort regardless of the computational substrate [129] and can be functionally localized to a frontoparietal network in the brain (k…”
Friedman, N. P., & Miyake, A. (2017) · Cortex · doi:10.1016/j.cortex.2016.04.023 · Cited by 1,834 · cited 1×
“Cognitive control and associated terms such as executive function, working memory, and attention broadly refer to the ability to fl exibly process information in a task-relevant way (e.g., [129,203,204]).”
BackgroundAn integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Integration of word meaning and world knowledge in language comprehension
Hagoort, P., Hald, L., Bastiaansen, M., & Petersson, K. M. (2004) · Science · doi:10.1126/science.1095455 · Cited by 1,396 · cited 1×
“For instance, the larger narrative within which a sentence is embedded and world knowledge both affect what is predicted [46,47].”
BackgroundA probabilistic earley parser as a psycholinguistic model
Hale, J. (2001) · Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001 - NAACL '01 · doi:10.3115/1073336.1073357 · Cited by 1,150
What do we mean by prediction in language comprehension?
Kuperberg, G. R., & Jaeger, T. F. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1102299 · Cited by 1,087 · cited 3×
“Many current frameworks in the cognitive science of language view the prediction of upcoming linguistic content as part-and-parcel of the functioning of the human language system (e.g., [13,14,23,39,114]).”
BackgroundOn the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074
How Do Expectations Shape Perception?
de Lange, F. P., Heilbron, M., & Kok, P. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.06.002 · Cited by 975
Broad domain generality in focal regions of frontal and parietal cortex
Fedorenko, E., Duncan, J., & Kanwisher, N. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1315235110 · Cited by 952
Lieder, F., & Griffiths, T. L. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1900061x · Cited by 892 · cited 1×
“Resource-rational accounts propose that the mind and brain perform rational inferences within the constraints imposed by the biological and informational limits of human brains [78], but what these are, in particular with respect to language, remains to be determined.”
BackgroundPredicting pragmatic reasoning in language games
Frank, M. C., & Goodman, N. D. (2012) · Science · doi:10.1126/science.1218633 · Cited by 868 · cited 1×
“In addition, production, if it is to have the desired effect of communicating intended information, must entail considering how the listener will interpret what is said [171,172].”
BackgroundPredictive Processing: A Canonical Cortical Computation
Keller, G. B., & Mrsic-Flogel, T. D. (2018) · Neuron · doi:10.1016/j.neuron.2018.10.003 · Cited by 836 · cited 1×
“In one sense, prediction can be thought of as 'domain-general' because it is a 'canonical computation' of human cortex [121] that takes place in visual processing [122], sensorimotor learning [123], music [124], and social cognition [125], among many other domains.”
Contextual effects on word perception and eye movements during reading
Ehrlich, S. F., & Rayner, K. (1981) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(81)90220-6 · Cited by 796 · cited 2×
“'), it is identi fi ed more easily [15], it is read more quickly [16], and it elicits a smaller (negative) electrophysiological response in the 'N400' time-window [17] than when it is not expected given the context (e.g., 'The following is an example of a word, ... ').”
BackgroundHartshorne, J. K., & Germine, L. T. (2015) · Psychological Science · doi:10.1177/0956797614567339 · Cited by 788
The effect of word predictability on reading time is logarithmic
Smith, N. J., & Levy, R. (2013) · Cognition · doi:10.1016/j.cognition.2013.02.013 · Cited by 725
New method for fMRI investigations of language: defining ROIs functionally in individual subjects
Fedorenko, E., Hsieh, P.-J., Nieto-Castañón, A., Whitfield-Gabrieli, S., & Kanwisher, N. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00032.2010 · Cited by 686
Functional specificity for high-level linguistic processing in the human brain
Fedorenko, E., Behr, M. K., & Kanwisher, N. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1112937108 · Cited by 595 · cited 1×
“Unpredictable linguistic stimuli are known to evoke their largest responses in the language network – a set of frontal and temporal brain regions which respondmost strongly and selectively during language comprehension [127,128].”
BackgroundThe neural architecture of language: Integrative modeling converges on predictive processing
Schrimpf, M., Blank, I. A., Tuckute, G., Kauf, C., Hosseini, E. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2105646118 · Cited by 517
Theory of Mind: A Neural Prediction Problem
Koster-Hale, J., & Saxe, R. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.020 · Cited by 513
Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4652-10.2011 · Cited by 379 · cited 1×
“tent these computations occur within local circuits [182] or whether they are mediated by a hub [198] that is responsible for”
Coupled neural systems underlie the production and comprehension of naturalistic narrative speech
Silbert, L. J., Honey, C. J., Simony, E., Poeppel, D., & Hasson, U. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1323812111 · Cited by 352
Prior expectations induce prestimulus sensory templates
Kok, P., Mostert, P., & de Lange, F. P. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1705652114 · Cited by 340
Evaluating the neurophysiological evidence for predictive processing as a model of perception
Walsh, K. S., McGovern, D. P., Clark, A., & O'Connell, R. G. (2020) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14321 · Cited by 333 · cited 1×
“are consistent with predictive coding ([122,184,185]; comprehensively reviewed in [186]).”
BackgroundBrains and algorithms partially converge in natural language processing
Caucheteux, C., & King, J.-R. (2022) · Communications Biology · doi:10.1038/s42003-022-03036-1 · Cited by 318
Evidence of a predictive coding hierarchy in the human brain listening to speech
Caucheteux, C., Gramfort, A., & King, J.-R. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01516-2 · Cited by 308
fMRI reveals language-specific predictive coding during naturalistic sentence comprehension
Shain, C., Blank, I. A., van Schijndel, M., Schuler, W., & Fedorenko, E. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107307 · Cited by 215
Indirection and symbol-like processing in the prefrontal cortex and basal ganglia
Kriete, T., Noelle, D. C., Cohen, J. D., & O’Reilly, R. C. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1303547110 · Cited by 181
Hierarchy of prediction errors for auditory events in human temporal and frontal cortex
Dürschmid, S., Edwards, E., Reichert, C., Dewar, C., Hinrichs, H., Heinze, H.-J., Kirsch, H. E., Dalal, S. S., Deouell, L. Y., & Knight, R. T. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1525030113 · Cited by 161 · cited 1×
“are consistent with predictive coding ([122,184,185]; comprehensively reviewed in [186]).”
BackgroundThe P3b and P600(s): Positive contributions to language comprehension
Leckey, M., & Federmeier, K. D. (2020) · Psychophysiology · doi:10.1111/psyp.13351 · Cited by 160 · cited 1×
“…context but appear to contain an easily corrected error (e.g., 'He went to deposit his check at the pank') elicit a P600 ERP component [143,144] which is thought to be part of a larger family of P300 components that are involved in probabilistic error monitoring across domains and modalities [145].”
BackgroundMoran, R. J., Symmonds, M., Dolan, R. J., & Friston, K. J. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003422 · Cited by 136
Alpha and theta band dynamics related to sentential constraint and word expectancy
Rommers, J., Dickson, D. S., Norton, J. J. S., Wlotko, E. W., & Federmeier, K. D. (2017) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2016.1183799 · Cited by 109
Hu, J., Small, H., Kean, H., Takahashi, A., Zekelman, L., Kleinman, D., Ryan, E., Nieto-Castañón, A., Ferreira, V., & Fedorenko, E. (2023) · Cerebral Cortex · doi:10.1093/cercor/bhac350 · Cited by 73
Wehbe, L., Blank, I. A., Shain, C., Futrell, R., Levy, R., von der Malsburg, T., Smith, N., Gibson, E., & Fedorenko, E. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab065 · Cited by 72
Is prediction nothing more than multi-scale pattern completion of the future?
Falandays, J. B., Nguyen, B., & Spivey, M. J. (2021) · Brain Research · doi:10.1016/j.brainres.2021.147578 · Cited by 36
Dividing attention influences contextual facilitation and revision during language comprehension
Hubbard, R. J., & Federmeier, K. D. (2021) · Brain Research · doi:10.1016/j.brainres.2021.147466 · Cited by 35
Metadata
- Authors
- Ryskin, R., & Nieuwland, M. S.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2023-11
- Volume
- 27
- Issue
- 11
- Pages
- 1032-1052
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W4386616609
- Cited by
- 165
- References
- 47
- FWCI
- 7.12
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.