The effect of word predictability on reading time is logarithmic
Open accessAbstract
It is well known that real-time human language processing is highly incremental and context-driven, and that the strength of a comprehender's expectation for each word encountered is a key determinant of the difficulty of integrating that word into the preceding context. In reading, this differential difficulty is largely manifested in the amount of time taken to read each word. While numerous studies over the past thirty years have shown expectation-based effects on reading times driven by lexical, syntactic, semantic, pragmatic, and other information sources, there has been little progress in establishing the quantitative relationship between expectation (or prediction) and reading times. Here, by combining a state-of-the-art computational language model, two large behavioral data-sets, and non-parametric statistical techniques, we establish for the first time the quantitative form of this relationship, finding that it is logarithmic over six orders of magnitude in estimated predictability. This result is problematic for a number of established models of eye movement control in reading, but lends partial support to an optimal perceptual discrimination account of word recognition. We also present a novel model in which language processing is highly incremental well below the level of the individual word, and show that it predicts both the shape and time-course of this effect. At a more general level, this result provides challenges for both anticipatory processing and semantic integration accounts of lexical predictability effects. And finally, this result provides evidence that comprehenders are highly sensitive to relative differences in predictability - even for differences between highly unpredictable words - and thus helps bring theoretical unity to our understanding of the role of prediction at multiple levels of linguistic structure in real-time language comprehension.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A human's ease of processing a sentence is influenced by that sentence's probability.
“a human’s ease of processing a sentence is influenced by that sentence’s probability (66–68)”
From Embers of autoregression show how large language models are shaped by the problem they are trained to solve (2024) · cites this paper as [67]
The Discussion reports that word predictability affects word comprehension in context, and the paper relates that effect to reading time. It does not establish that the probability of an entire sentence affects how easily a human processes that sentence; its measured probabilities are for words in context. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328 · see citing works
Self-citationFoundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816 · see citing works
Mixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540 · see citing works
Generalized Additive Models: An Introduction With R
Chiang, A. Y. (2007) · Technometrics · doi:10.1198/tech.2007.s505 · Cited by 8,515 · see citing works
Eye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979 · see citing works
SRILM - an extensible language modeling toolkit
Stolcke, A. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.2002-303 · Cited by 4,385 · see citing works
Kutas, M., & Federmeier, K. D. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.131123 · Cited by 4,377 · see citing works
A distributed, developmental model of word recognition and naming.
Seidenberg, M. S., & McClelland, J. L. (1989) · Psychological Review · doi:10.1037/0033-295x.96.4.523 · Cited by 3,909 · see citing works
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764 · see citing works
The TRACE model of speech perception
McClelland, J. L., & Elman, J. L. (1986) · Cognitive Psychology · doi:10.1016/0010-0285(86)90015-0 · Cited by 2,940 · see citing works
Integration of Visual and Linguistic Information in Spoken Language Comprehension
Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995) · Science · doi:10.1126/science.7777863 · Cited by 2,929 · see citing works
Understanding normal and impaired word reading: Computational principles in quasi-regular domains.
Plaut, D. C., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996) · Psychological Review · doi:10.1037/0033-295x.103.1.56 · Cited by 2,698 · see citing works
Prediction and Entropy of Printed English
Shannon, C. E. (1951) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1951.tb01366.x · Cited by 2,686 · see citing works
“Cloze Procedure”: A New Tool for Measuring Readability
Taylor, W. L. (1953) · Journalism Quarterly · doi:10.1177/107769905303000401 · Cited by 2,332 · see citing works
The language-as-fixed-effect fallacy: A critique of language statistics in psychological research
Clark, H. H. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80014-3 · Cited by 2,226 · see citing works
Brain potentials during reading reflect word expectancy and semantic association
Marta Kutas, A., & Hillyard, S. A. (1984) · Nature · doi:10.1038/307161a0 · Cited by 2,220 · see citing works
Expectation-based syntactic comprehension
Lévy, R. (2007) · Cognition · doi:10.1016/j.cognition.2007.05.006 · Cited by 2,220 · see citing works
Interaction of information in word recognition.
Morton, J. (1969) · Psychological Review · doi:10.1037/h0027366 · Cited by 2,159 · see citing works
An empirical study of smoothing techniques for language modeling
Chen, S. F., & Goodman, J. (1999) · Computer Speech & Language · doi:10.1006/csla.1999.0128 · Cited by 2,100 · see citing works
Stable and Efficient Multiple Smoothing Parameter Estimation for Generalized Additive Models
Wood, S. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000980 · Cited by 2,046 · see citing works
Incremental interpretation at verbs: restricting the domain of subsequent reference.
Altmann, G., & Kamide, Y. (1999) · Cognition · doi:10.1016/s0010-0277(99)00059-1 · Cited by 1,615 · see citing works
Improved backing-off for M-gram language modeling
Kneser, R., & Ney, H. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1995.479394 · Cited by 1,471 · see citing works
Toward a model of eye movement control in reading.
Reichle, E. D., Pollatsek, A., Fisher, D. L., & Rayner, K. (1998) · Psychological Review · doi:10.1037/0033-295x.105.1.125 · Cited by 1,267 · see citing works
DeLong, K. A., Urbach, T. P., & Marta Kutas, A. (2005) · Nature Neuroscience · doi:10.1038/nn1504 · Cited by 1,236 · see citing works
The independence of syntactic processing
Ferreira, F., & Clifton, C. (1986) · Journal of Memory and Language · doi:10.1016/0749-596x(86)90006-9 · Cited by 1,151 · see citing works
A probabilistic earley parser as a psycholinguistic model
Hale, J. (2001) · Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001 - NAACL '01 · doi:10.3115/1073336.1073357 · Cited by 1,150 · see citing works
SWIFT: A Dynamical Model of Saccade Generation During Reading.
Engbert, R., Nuthmann, A., Richter, E. M., & Kliegl, R. M. (2005) · Psychological Review · doi:10.1037/0033-295x.112.4.777 · Cited by 1,101 · see citing works
Information theory of choice-reaction times
Laming, D. (1968) · Medical Entomology and Zoology · Cited by 952 · see citing works
Kamide, Y., Altmann, G., & Haywood, S. L. (2003) · Journal of Memory and Language · doi:10.1016/s0749-596x(03)00023-8 · Cited by 947 · see citing works
Anticipating Upcoming Words in Discourse: Evidence From ERPs and Reading Times.
Berkum, J. J. A. V., Brown, C. M., Zwitserlood, P., Kooijman, V., & Peter Hagoort, A. (2005) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.31.3.443 · Cited by 932 · see citing works
A Rose by Any Other Name: Long-Term Memory Structure and Sentence Processing
Federmeier, K. D., & Marta Kutas, A. (1999) · Journal of Memory and Language · doi:10.1006/jmla.1999.2660 · Cited by 910 · see citing works
Paradigms and processes in reading comprehension.
Just, M. A., Carpenter, P. A., & Woolley, J. D. (1982) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.111.2.228 · Cited by 875 · see citing works
Paradigms and processes in reading comprehension.
Just, M. A., Carpenter, P. A., & Woolley, J. D. (1982) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.111.2.228 · Cited by 830 · see citing works
Neural computation of log likelihood in control of saccadic eye movements
Carpenter, R. H. S., & Williams, M. L. L. (1995) · Nature · doi:10.1038/377059a0 · Cited by 823 · see citing works
Contextual effects on word perception and eye movements during reading
Ehrlich, S. F., & Rayner, K. (1981) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(81)90220-6 · Cited by 796 · see citing works
The Processing Nature of the N400: Evidence from Masked Priming
Brown, C. M., & Peter Hagoort, A. (1993) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1993.5.1.34 · Cited by 783 · see citing works
Aylett, M. P., & Turk, A. E. (2004) · Language and Speech · doi:10.1177/00238309040470010201 · Cited by 777 · see citing works
Modeling the Influence of Thematic Fit (and Other Constraints) in On-line Sentence Comprehension
McRae, K., Spivey-Knowlton, M. J., & Tanenhaus, M. K. (1998) · Journal of Memory and Language · doi:10.1006/jmla.1997.2543 · Cited by 742 · see citing works
Redundancy and reduction: Speakers manage syntactic information density
Jaeger, T. F. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2010.02.002 · Cited by 728 · see citing works
Models for choice-reaction time
Stone, M. (1960) · Psychometrika · doi:10.1007/bf02289729 · Cited by 696 · see citing works
Toward a strong phonological theory of visual word recognition: True issues and false trails.
Frost, R. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.123.1.71 · Cited by 696 · see citing works
Word lengths are optimized for efficient communication
Piantadosi, S. T., Tily, H., & Gibson, E. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012551108 · Cited by 695 · see citing works
Continuous attraction toward phonological competitors
Spivey, M. J., Grosjean, M., & Knoblich, G. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0503903102 · Cited by 659 · see citing works
Kliegl, R. M., Nuthmann, A., & Engbert, R. (2006) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.135.1.12 · Cited by 618 · see citing works
A representation of the hazard rate of elapsed time in macaque area LIP
Janssen, P., & Shadlen, M. N. (2005) · Nature Neuroscience · doi:10.1038/nn1386 · Cited by 601 · see citing works
Spivey, M. (2006) · doi:10.1093/acprof:oso/9780195170788.001.0001 · Cited by 599 · see citing works
Data from eye-tracking corpora as evidence for theories of syntactic processing complexity
Demberg, V., & Keller, F. (2008) · Cognition · doi:10.1016/j.cognition.2008.07.008 · Cited by 572 · see citing works
Effects of contextual constraint on eye movements in reading: A further examination
Rayner, K., & Well, A. D. (1996) · Psychonomic Bulletin & Review · doi:10.3758/bf03214555 · Cited by 542 · see citing works
Garman, M. (1990) · Cambridge University Press eBooks · doi:10.1017/cbo9781139165914.006 · Cited by 525 · see citing works
Contextual Diversity, Not Word Frequency, Determines Word-Naming and Lexical Decision Times
Adelman, J. S., Brown, G. D. A., & Quesada, J. F. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01787.x · Cited by 518 · see citing works
Speakers optimize information density through syntactic reduction
Lévy, R., & Jaeger, T. F. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0111 · Cited by 513 · see citing works
Visual duration threshold as a function of word-probability.
Howes, D. H., & Solomon, R. L. (1951) · Journal of Experimental Psychology · doi:10.1037/h0056020 · Cited by 479 · see citing works
Roles of word frequency and age of acquisition in word naming and lexical decision.
Morrison, C. M., & Ellis, A. W. (1995) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.21.1.116 · Cited by 431 · see citing works
The Bayesian reader: Explaining word recognition as an optimal Bayesian decision process.
Norris, D. G. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.327 · Cited by 416 · see citing works
Age of Acquisition Effects in Word Reading and Other Tasks
Zevin, J. D., & Seidenberg, M. S. (2002) · Journal of Memory and Language · doi:10.1006/jmla.2001.2834 · Cited by 374 · see citing works
Kamide, Y., Scheepers, C., & Altmann, G. (2003) · Journal of Psycholinguistic Research · doi:10.1023/a:1021933015362 · Cited by 344 · see citing works
Two routes or one in reading aloud? A connectionist dual-process model.
Zorzi, M., Houghton, G., & Butterworth, B. (1998) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.24.4.1131 · Cited by 339 · see citing works
Eye Movements Reveal the On-Line Computation of Lexical Probabilities During Reading
McDonald, S. A., & Shillcock, R. C. (2003) · Psychological Science · doi:10.1046/j.0956-7976.2003.psci_1480.x · Cited by 322 · see citing works
Knoeferle, P., Crocker, M. W., Scheepers, C., & Pickering, M. J. (2004) · Cognition · doi:10.1016/j.cognition.2004.03.002 · Cited by 293 · see citing works
The role of structural prediction in rapid syntactic analysis
Lau, E. F., Stroud, C., Plesch, S., & Phillips, C. (2006) · Brain and Language · doi:10.1016/j.bandl.2006.02.003 · Cited by 272 · see citing works
Parsing costs as predictors of reading difficulty: An evaluation using the Potsdam Sentence Corpus
Boston, M. F., Hale, J., Kliegl, R. M., Patil, U., & Vasishth, S. (2008) · Journal of Eye Movement Research · doi:10.16910/jemr.2.1.1 · Cited by 267 · see citing works
Syntactic prediction in language comprehension: Evidence from either...or.
Staub, A., & Clifton, C. (2006) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.32.2.425 · Cited by 252 · see citing works
Ni, W. (1996) · Language and Cognitive Processes · doi:10.1080/016909696387196 · Cited by 229 · see citing works
Serial Mechanisms in Lexical Access: The Rank Hypothesis.
Murray, W. S., & Forster, K. I. (2004) · Psychological Review · doi:10.1037/0033-295x.111.3.721 · Cited by 228 · see citing works
Effects of Contextual Predictability and Transitional Probability on Eye Movements During Reading.
Frisson, S., Rayner, K., & Pickering, M. J. (2005) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.31.5.862 · Cited by 219 · see citing works
A discourse on semantic priming
Foss, D. J. (1982) · Cognitive Psychology · doi:10.1016/0010-0285(82)90020-2 · Cited by 217 · see citing works
Effects of global and local context on lexical processing during language comprehension.
Hess, D. J., Foss, D. J., & Carroll, P. (1995) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.124.1.62 · Cited by 216 · see citing works
Dahan, D., & Tanenhaus, M. (2004) · Journal of Experimental Psychology. Learning, Memory and Cognition · doi:10.1037/0278-7393.30.2.498 · Cited by 214 · see citing works
Insensitivity of the Human Sentence-Processing System to Hierarchical Structure
Frank, S. L., & Bod, R. (2011) · Psychological Science · doi:10.1177/0956797611409589 · Cited by 207 · see citing works
McDonald, S. A., & Shillcock, R. C. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00237-2 · Cited by 204 · see citing works
Demythologizing the word frequency effect
Baayen, R. H. (2010) · The Mental Lexicon · doi:10.1075/ml.5.3.10baa · Cited by 185 · see citing works
Brian Roark, A., Bachrach, A., Cardenas, C., & Pallier, C. (2009) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1699510.1699553 · Cited by 176 · see citing works
New Methods in Reading Comprehension Research
Beatie, B. A., Kieras, D. E., & Just, M. A. (1986) · Modern Language Journal · doi:10.2307/326949 · Cited by 174 · see citing works
Entropy rate constancy in text
Genzel, D., & Charniak, E. (2001) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1073083.1073117 · Cited by 173 · see citing works
Wicha, N. Y. Y., Bates, E. A., Moreno, E. M., et al. (2003) · Neuroscience Letters · doi:10.1016/s0304-3940(03)00599-8 · Cited by 152 · see citing works
The processing of extraposed structures in English
Lévy, R., Fedorenko, E. G., Breen, M. E., & Gibson, E. A. F. (2011) · Cognition · doi:10.1016/j.cognition.2011.07.012 · Cited by 142 · see citing works
Predictions: a universal principle in the operation of the human brain
Bar, M. (2009) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2008.0321 · Cited by 139 · see citing works
Eye typing in application: A comparison of two interfacing systems with ALS patients
Pannasch, S., Helmert, J. R., Malischke, S., Storch, A., & Velichkovsky, B. M. (2008) · Journal of Eye Movement Research · Cited by 117 · see citing works
A Bit of Progress in Language Modeling Extended VersionPreprint
Goodman, J. (2001) · Cited by 114 · see citing works
Frequency and predictability effects in the Dundee Corpus: An eye movement analysis
Kennedy, A., Pynte, J., Murray, W. S., et al. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2012.676054 · Cited by 107 · see citing works
What determines the direction of microsaccades?
Hermens, F., & Walker, R. (2010) · Journal of Eye Movement Research · doi:10.16910/jemr.3.4.1 · Cited by 77 · see citing works
Sequential vs. Hierarchical Syntactic Models of Human Incremental Sentence Processing
Fossum, V., & Lévy, R. (2012) · Cited by 76 · see citing works
Putting it all together: A unified account of word recognition and reaction-time distributions.
Norris, D. G. (2009) · Psychological Review · doi:10.1037/a0014259 · Cited by 74 · see citing works
Optimal Processing Times in Reading: A Formal Model and Empirical Investigation
Smith, N. J., & Lévy, R. (2008) · eScholarship (California Digital Library) · Cited by 70 · see citing works
Self-citationPollatsek, A., Juhasz, B. J., Reichle, E. D., et al. (2008) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.34.3.726 · Cited by 67 · see citing works
Age of Acquisition, Ageing, and Verb Production: Normative and Experimental Data
Morrison, C. M., Hirsh, K. W., & Duggan, G. B. (2003) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/02724980244000594 · Cited by 64 · see citing works
Effects of sentence constraint on priming in natural language comprehension.
Traxler, M. J., & Foss, D. J. (2000) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.26.5.1266 · Cited by 49 · see citing works
Effects of sentence constraint on priming in natural language comprehension.
Traxler, M. J., & Foss, D. J. (2000) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.26.5.1266 · Cited by 39 · see citing works
Expectancy and stimulus frequency: A comparative analysis in rats and humans
Pang, K. C. H., Merkel, F., Egeth, H. E., & Olton, D. S. (1992) · Perception & Psychophysics · doi:10.3758/bf03211657 · Cited by 28 · see citing works
Anticipating by Pigeons Depends on Local Statistical Information in a Serial Response Time Task.
Froehlich, A. L., Herbranson, W. T., Loper, J. D., Wood, D. M., & Shimp, C. P. (2004) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.133.1.31 · Cited by 26 · see citing works
Time Course and Hazard Function: A Distributional Analysis of Fixation Duration in Reading
Feng, G. (2009) · Journal of Eye Movement Research · doi:10.16910/jemr.3.2.3 · Cited by 18 · see citing works
Demythologizing the word frequency effect
Baayen, R. H. (2012) · Benjamins current topics · doi:10.1075/bct.47.10baa · Cited by 8 · see citing works
Active prediction of syntactic information during sentence processing
Ilkin, Z., & Sturt, P. (2011) · Dialogue & Discourse · doi:10.5087/dad.2011.103 · Cited by 7 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Baayen RH Olsen S The directed compound graph of English: an exploration of lexical connectivity and its processing consequences New impulses in word-formation 2010b Vol. 17 383 402 Buske Hamburg
- Baayen RH Davidson DJ Bates DM Mixed-effects modeling with crossed random effects for subjects and items Journal of Memory and Language 2008a 59 4 390 412
- Hagoort P Baggio G Willems RM Gazzaniga MS Semantic unification The new cognitive neurosciences 2009 Vol. 4 819 836 MIT Press Boston, MA 4th ed
- Kennedy A Hill R Pynte J The Dundee corpus Proceedings of the 12th European conference on eye movement 2003
Cited by
Sorted by citations
How Efficiency Shapes Human Language
Gibson, E., Futrell, R., Piantadosi, S. P., Dautriche, I., Mahowald, K., Bergen, L., & Levy, R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.02.003 · Cited by 485 · see citing works
A hierarchy of linguistic predictions during natural language comprehension
Heilbron, M., Armeni, K., Schoffelen, J.-M., Hagoort, P., & de Lange, F. P. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2201968119 · Cited by 343 · see citing works
Prediction during natural language comprehension
Willems, R. M., Frank, S. L., Nijhof, A. D., Hagoort, P., & van den Bosch, A. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv075 · Cited by 288 · see citing works
Fedorenko, E., & Varley, R. (2016) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13046 · Cited by 247 · see citing works
fMRI reveals language-specific predictive coding during naturalistic sentence comprehension
Shain, C., Blank, I. A., van Schijndel, M., Schuler, W., & Fedorenko, E. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107307 · Cited by 215 · see citing works
Neural correlate of the construction of sentence meaning
Fedorenko, E., Scott, T. L., Brunner, P., Coon, W. G., Pritchett, B., Schalk, G., & Kanwisher, N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1612132113 · Cited by 199 · see citing works
A Systematic Assessment of Syntactic Generalization in Neural Language Models
Hu, J., Gauthier, J., Qian, P., Wilcox, E., & Levy, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.158 · Cited by 134 · see citing works
Ellis, N. C., O'Donnell, M. B., & Römer, U. (2014) · Cognitive Linguistics · doi:10.1515/cog-2013-0031 · Cited by 113 · see citing works
Oh, B.-D., & Schuler, W. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00548 · Cited by 107 · see citing works
McCoy, R. T., Yao, S., Friedman, D., Hardy, M. D., & Griffiths, T. L. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2322420121 · Cited by 96 · see citing works
When redundancy is useful: A Bayesian approach to “overinformative” referring expressions
Degen, J., Hawkins, R. D., Graf, C., Kreiss, E., & Goodman, N. D. (2020) · Psychological Review · doi:10.1037/rev0000186 · Cited by 90 · see citing works
Hosseini, E. A., Schrimpf, M., Zhang, Y., Bowman, S., Zaslavsky, N., & Fedorenko, E. (2024) · Neurobiology of Language · doi:10.1162/nol_a_00137 · Cited by 63 · see citing works
Is prediction nothing more than multi-scale pattern completion of the future?
Falandays, J. B., Nguyen, B., & Spivey, M. J. (2021) · Brain Research · doi:10.1016/j.brainres.2021.147578 · Cited by 36 · see citing works
Bigger is not always better: The importance of human-scale language modeling for psycholinguistics
Wilcox, E. G., Hu, M. Y., Mueller, A., Warstadt, A., Choshen, L., Zhuang, C., Williams, A., Cotterell, R., & Linzen, T. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104650 · Cited by 9 · see citing works
- Authors
- Smith, N. J., & Levy, R.
- Affiliations
- University of California San Diego (US)
- Corresponding author
- Smith, Nathaniel J.
- ORCID
- Smith, Nathaniel J.
- Venue
- Cognition
- Publisher
- Elsevier BV
- Published
- 2013-09
- Volume
- 128
- Issue
- 3
- Pages
- 302-319
- ISSN
- 0010-0277 (ISSN-L)
- PMC
- PMC3709001
- OpenAlex
- W2108010971
- Cited by
- 725
- References
- 93
- Citations by year
- 2026: 61 · 2025: 84 · 2024: 46 · 2023: 80 · 2022: 60 · 2021: 74 · 2020: 52 · 2019: 91 · 2018: 50 · 2017: 29 · 2016: 36 · 2015: 34 · 2014: 17 · 2013: 10
- FWCI
- 66.84
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Cognition (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- National Science Foundation (T32-DC000041, 0953870)
- European Commission (270273)
- National Institutes of Health (0953870, T32-MH20002, HD065829, DC000041)
- National Institute of Mental Health (T32MH020002)
- National Institute on Deafness and Other Communication Disorders (T32DC000041)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD065829)
- FP7 Information and Communication Technologies
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Reading and Literacy Development
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Keywords
- word predictability, reading time, lexical predictability, anticipatory processing, oculomotor control, word recognition, semantic integration, real-time language comprehension
- MeSH terms
- Adult, Attention, Humans, Language, Reaction Time, Reading, Time Factors, Vocabulary, Recognition, Psychology, Comprehension
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review