The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
Expectation-based syntactic comprehension
Open accessAbstract
This paper investigates the role of resource allocation as a source of processing difficulty in human sentence comprehension. The paper proposes a simple information-theoretic characterization of processing difficulty as the work incurred by resource reallocation during parallel, incremental, probabilistic disambiguation in sentence comprehension, and demonstrates its equivalence to the theory of Hale [Hale, J. (2001). A probabilistic Earley parser as a psycholinguistic model. In Proceedings of NAACL (Vol. 2, pp. 159-166)], in which the difficulty of a word is proportional to its surprisal (its negative log-probability) in the context within which it appears. This proposal subsumes and clarifies findings that high-constraint contexts can facilitate lexical processing, and connects these findings to well-known models of parallel constraint-based comprehension. In addition, the theory leads to a number of specific predictions about the role of expectation in syntactic comprehension, including the reversal of locality-based difficulty patterns in syntactically constrained contexts, and conditions under which increased ambiguity facilitates processing. The paper examines a range of established results bearing on these predictions, and shows that they are largely consistent with the surprisal theory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Reading Senseless Sentences: Brain Potentials Reflect Semantic Incongruity
Kutas, M., & Hillyard, S. A. (1980) · Science · doi:10.1126/science.7350657 · Cited by 4,888
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008
An Integrated Theory of the Mind.
Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., & Qin, Y. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1036 · Cited by 2,978
Integration of Visual and Linguistic Information in Spoken Language Comprehension
Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995) · Science · doi:10.1126/science.7777863 · Cited by 2,929
Linguistic complexity: locality of syntactic dependencies
Gibson, E. (1998) · Cognition · doi:10.1016/s0010-0277(98)00034-1 · Cited by 2,537
“Cloze Procedure”: A New Tool for Measuring Readability
Taylor, W. L. (1953) · Journalism Quarterly · doi:10.1177/107769905303000401 · Cited by 2,332
The lexical nature of syntactic ambiguity resolution
MacDonald, M. C., Pearlmutter, N. J., & Seidenberg, M. S. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.676 · Cited by 2,259
Brain potentials during reading reflect word expectancy and semantic association
Kutas, M., & Hillyard, S. A. (1984) · Nature · doi:10.1038/307161a0 · Cited by 2,218
Cairns, H. S., & Gernsbacher, M. A. (1996) · Language · doi:10.2307/416113 · Cited by 1,920
Generalized Phrase Structure Grammar.
Soames, S., Gazdar, G., Klein, E., Pullum, G., & Sag, I. (1989) · The Philosophical Review · doi:10.2307/2185122 · Cited by 1,829
Head-Driven Statistical Models for Natural Language Parsing
Collins, M. (2003) · Computational Linguistics · doi:10.1162/089120103322753356 · Cited by 1,826
Incremental interpretation at verbs: restricting the domain of subsequent reference
Altmann, G. T. M., & Kamide, Y. (1999) · Cognition · doi:10.1016/s0010-0277(99)00059-1 · Cited by 1,735
The Handbook of Psycholinguistics
(2017) · Wiley eBooks · doi:10.1002/9781118829516 · Cited by 1,583
The sausage machine: A new two-stage parsing model
Frazier, L., & Fodor, J. D. (1978) · Cognition · doi:10.1016/0010-0277(78)90002-1 · Cited by 1,400
Distributed representations, simple recurrent networks, and grammatical structure
Elman, J. L. (1991) · Machine Learning · doi:10.1007/bf00114844 · Cited by 1,354
Toward a model of eye movement control in reading.
Reichle, E. D., Pollatsek, A., Fisher, D. L., & Rayner, K. (1998) · Psychological Review · doi:10.1037//0033-295x.105.1.125 · Cited by 1,260
Individual differences in syntactic processing: The role of working memory
King, J., & Just, M. A. (1991) · Journal of Memory and Language · doi:10.1016/0749-596x(91)90027-h · Cited by 1,190
A probabilistic earley parser as a psycholinguistic model
Hale, J. (2001) · Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001 - NAACL '01 · doi:10.3115/1073336.1073357 · Cited by 1,150
SWIFT: A Dynamical Model of Saccade Generation During Reading.
Engbert, R., Nuthmann, A., Richter, E. M., & Kliegl, R. (2005) · Psychological Review · doi:10.1037/0033-295x.112.4.777 · Cited by 1,101
ON COMPREHENDING SENTENCES: SYNTACTIC PARSING STRATEGIES.
Frazier, L. (1979) · OpenCommons - UConn (University of Connecticut) · Cited by 1,047
The Dependency Locality Theory: A Distance-Based Theory of Linguistic Complexity
Gibson, E. (2001) · Image, Language, Brain · doi:10.7551/mitpress/3654.003.0008 · Cited by 937
A Rose by Any Other Name: Long-Term Memory Structure and Sentence Processing
Federmeier, K. D., & Kutas, M. (1999) · Journal of Memory and Language · doi:10.1006/jmla.1999.2660 · Cited by 905
Contextual effects on word perception and eye movements during reading
Ehrlich, S. F., & Rayner, K. (1981) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(81)90220-6 · Cited by 796
Modeling the Influence of Thematic Fit (and Other Constraints) in On-line Sentence Comprehension
McRae, K., Spivey-Knowlton, M. J., & Tanenhaus, M. K. (1998) · Journal of Memory and Language · doi:10.1006/jmla.1997.2543 · Cited by 742
A probabilistic model of lexical and syntactic access and disambiguation
Jurafsky, D. (1996) · Cognitive Science · doi:10.1016/s0364-0213(99)80005-6 · Cited by 714
Evidence against the context-freeness of natural language
Shieber, S. M. (1985) · Linguistics and Philosophy · doi:10.1007/bf00630917 · Cited by 655
Effects of contextual constraint on eye movements in reading: A further examination
Rayner, K., & Well, A. D. (1996) · Psychonomic Bulletin & Review · doi:10.3758/bf03214555 · Cited by 552
Bayesian Surprise Attracts Human Attention
Itti, L., & Baldi, P. (2005) · neural information processing systems · Cited by 533
Statistical parsing with a context-free grammar and word statistics
Eugene Charniak, D. (1997) · Cited by 521
Consequences of the Serial Nature of Linguistic Input for Sentenial Complexity
Grodner, D., & Gibson, E. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_7 · Cited by 455
Sentence Perception as an Interactive Parallel Process
Marslen-Wilson, W. D. (1975) · Science · doi:10.1126/science.189.4198.226 · Cited by 441
Backpropagation: Theory, architectures, and applications
Biron, P. V. (1997) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199701)48:1<88::aid-asi10>3.0.co;2-# · Cited by 435
(2003) · The MIT Press eBooks · doi:10.7551/mitpress/5582.001.0001 · Cited by 426
Toward a connectionist model of recursion in human linguistic performance
Christiansen, M. (1999) · Cognitive Science · doi:10.1016/s0364-0213(99)00003-8 · Cited by 406
(2013) · doi:10.4324/9780203763247 · Cited by 400
PCFG models of linguistic tree representations
Johnson, M. (1998) · OLAC - Open Language Archives Community · doi:10.5555/972764.972768 · Cited by 397
Probabilistic Modeling in Psycholinguistics: Linguistic Comprehension and Production
Jurafsky, D. (2003) · Probabilistic Linguistics · doi:10.7551/mitpress/5582.003.0006 · Cited by 357
Using the Web to Obtain Frequencies for Unseen Bigrams
Keller, F., & Lapata, M. (2003) · Computational Linguistics · doi:10.1162/089120103322711604 · Cited by 350
Rayner, K., Ashby, J., Pollatsek, A., & Reichle, E. D. (2004) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.30.4.720 · Cited by 349
Backpropagation: the basic theory
Rumelhart, D. E., Durbin, R. M., Golden, R. M., & Chauvin, Y. (1995) · Cited by 338
An Efficient Probabilistic Context-Free Parsing Algorithm that Computes Prefix Probabilities
Stolcke, A. (1994) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9411029 · Cited by 336
Probabilistic Top-Down Parsing and Language Modeling
Roark, B. (2001) · Computational Linguistics · doi:10.1162/089120101750300526 · Cited by 329
Eye Movements Reveal the On-Line Computation of Lexical Probabilities During Reading
McDonald, S. A., & Shillcock, R. C. (2003) · Psychological Science · doi:10.1046/j.0956-7976.2003.psci_1480.x · Cited by 325
Mitchell, D. C., Cuetos, F., Corley, M. M. B., & Brysbaert, M. (1995) · Journal of Psycholinguistic Research · doi:10.1007/bf02143162 · Cited by 322
The role of discourse context in the processing of a flexible word-order language
KAISER, E., & TRUESWELL, J. (2004) · Cognition · doi:10.1016/j.cognition.2004.01.002 · Cited by 314
Linguistic Structure in Language Processing
(1989) · Studies in Theoretical Psycholinguistics · doi:10.1007/978-94-009-2729-2 · Cited by 312
Comprehending Sentences with Long-Distance Dependencies
Clifton, C., & Frazier, L. (1989) · Studies in Theoretical Psycholinguistics · doi:10.1007/978-94-009-2729-2_8 · Cited by 306
Effects of noun phrase type on sentence complexity
Gordon, P. C., Hendrick, R., & Johnson, M. (2004) · Journal of Memory and Language · doi:10.1016/j.jml.2004.02.003 · Cited by 298
Uncertainty About the Rest of the Sentence
Hale, J. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_64 · Cited by 296
Immediate-head parsing for language models
Charniak, E. (2001) · Proceedings of the 39th Annual Meeting on Association for Computational Linguistics - ACL '01 · doi:10.3115/1073012.1073029 · Cited by 293
Spivey, M. J., & Tanenhaus, M. K. (1998) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.24.6.1521 · Cited by 289
The Information Conveyed by Words in Sentences
Hale, J. (2003) · Journal of Psycholinguistic Research · doi:10.1023/a:1022492123056 · Cited by 283
Argument-head distance and processing complexity: Explaining both locality and antilocality effects
Vasishth, S., & Lewis, R. L. (2006) · Language · doi:10.1353/lan.2006.0236 · Cited by 279
Recovery from misanalyses of garden-path sentences
Ferreira, F., & Henderson, J. M. (1991) · Journal of Memory and Language · doi:10.1016/0749-596x(91)90034-h · Cited by 266
Adjunct Attachment Is Not a Form of Lexical Ambiguity Resolution
Traxler, M. J., Pickering, M. J., & Clifton, C. (1998) · Journal of Memory and Language · doi:10.1006/jmla.1998.2600 · Cited by 265
Effects of merely local syntactic coherence on sentence processing
Tabor, W., Galantucci, B., & Richardson, D. (2004) · Journal of Memory and Language · doi:10.1016/j.jml.2004.01.001 · Cited by 261
A computational theory of human linguistic processing: memory limitations and processing breakdown
Gibson, E. A. F. (1991) · Cited by 249
Locality and Parsing Complexity
Konieczny, L. (2000) · Journal of Psycholinguistic Research · doi:10.1023/a:1026528912821 · Cited by 245
Reanalysis in Sentence Processing
(1998) · Studies in Theoretical Psycholinguistics · doi:10.1007/978-94-015-9070-9 · Cited by 238
Natural Language Parsing as Statistical Pattern Recognition
Magerman, D. M. (1994) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9405009 · Cited by 220
Phonological typicality influences on-line sentence comprehension
Farmer, T. A., Christiansen, M. H., & Monaghan, P. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0602173103 · Cited by 219
Effects of Contextual Predictability and Transitional Probability on Eye Movements During Reading.
Frisson, S., Rayner, K., & Pickering, M. J. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.5.862 · Cited by 219
McDonald, S. A., & Shillcock, R. C. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00237-2 · Cited by 210
Tabor, W., Juliano, C., & Tanenhaus, M. K. (1997) · Language and Cognitive Processes · doi:10.1080/016909697386853 · Cited by 198
A statistical parser for Czech
Collins, M., Ramshaw, L., Hajič, J., & Tillmann, C. (1999) · Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics - · doi:10.3115/1034678.1034754 · Cited by 193
Relations, Objects, and the Composition of Analogies
Gentner, D., & Kurtz, K. J. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_60 · Cited by 186
The Interaction of Lexical and Syntactic Ambiguity
Macdonald, M. C. (1993) · Journal of Memory and Language · doi:10.1006/jmla.1993.1035 · Cited by 181
Reanalysis in Sentence Processing: Evidence against Current Constraint-Based and Two-Stage Models
van Gompel, R. P. G., Pickering, M. J., & Traxler, M. J. (2001) · Journal of Memory and Language · doi:10.1006/jmla.2001.2773 · Cited by 176
Reading relative clauses in English
Gibson, E., Desmet, T., Grodner, D., Watson, D., & Ko, K. (2005) · cogl · doi:10.1515/cogl.2005.16.2.313 · Cited by 171
Evidence for Self-Organized Sentence Processing: Digging-In Effects.
Tabor, W., & Hutchins, S. (2004) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.30.2.431 · Cited by 154
Frankenfield, G. (1997) · Language · doi:10.2307/417362 · Cited by 135
Evidence against competition during syntactic ambiguity resolution
van Gompel, R. P. G., Pickering, M. J., Pearson, J., & Liversedge, S. P. (2005) · Journal of Memory and Language · doi:10.1016/j.jml.2004.11.003 · Cited by 133
Dynamical Models of Sentence Processing
Tabor, W., & Tanenhaus, M. K. (1999) · Cognitive Science · doi:10.1016/s0364-0213(99)00013-0 · Cited by 133
(2001) · The MIT Press eBooks · doi:10.7551/mitpress/3654.001.0001 · Cited by 132
The complexity of the vocabulary of Bambara
Culy, C. (1985) · Linguistics and Philosophy · doi:10.1007/bf00630918 · Cited by 126
Wide-Coverage Probabilistic Sentence Processing
Crocker, M. W., & Brants, T. (2000) · Journal of Psycholinguistic Research · doi:10.1023/a:1026560822390 · Cited by 123
Parsing in Different Languages
Cuetos, F., Mitchell, D., Corley, M. M. B., Carreiras, M., García‐Albea, J. E., & Sabastián-Gallés, N. (1996) · doi:10.4324/9780203773970-11 · Cited by 117
Computation of the probability of initial substring generation by stochastic context-free grammars
Jelinek, F., & Lafferty, J. (1991) · doi:10.5555/971764.971768 · Cited by 114
A Bayesian Model Predicts Human Parse Preference and Reading Times in Sentence Processing
Narayanan, S., & Jurafsky, D. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0012 · Cited by 113
Probabilistic parsing for German using sister-head dependencies
Dubey, A., & Keller, F. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075096.1075109 · Cited by 108
Distinguishing Serial and Parallel Parsing
Gibson, E. A. F., & Pearlmutter, N. J. (2000) · Journal of Psycholinguistic Research · doi:10.1023/a:1005153330168 · Cited by 101
A computational model of language performance
Bod, R. (1992) · International Conference on Computational Linguistics · doi:10.3115/993079.993082 · Cited by 100
A connectionist model of sentence comprehension and production
Rohde, D. L. T., & Plaut, D. C. (2002) · Cited by 93
Probabilistic representation of formal languages
Booth, T. L. (1969) · Annual Symposium on Switching & Automata Theory · doi:10.1109/swat.1969.17 · Cited by 93
Language Processing in Spanish
Carreiras, M. (2013) · Psychology Press eBooks · doi:10.4324/9780203773970 · Cited by 70
Absence of real evidence against competition during syntactic ambiguity resolution
Green, M. J., & Mitchell, D. C. (2006) · Journal of Memory and Language · doi:10.1016/j.jml.2006.03.003 · Cited by 65
An On‐Line Study of Japanese Nesting Complexity
Nakatani, K., & Gibson, E. A. F. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01067.x · Cited by 63
Studien zur performanzorientierten Linguistik: Aspekte der Relativsatzextraposition im Deutschen
Uszkoreit, H., Brants, T., Duchier, D., Krenn, B., Konieczny, L., Oepen, S., & Skut, W. (1998) · Kognitionswissenschaft · doi:10.1007/s001970050065 · Cited by 60
Nakatani, K., & Gibson, E. A. F. (2008) · Linguistics · doi:10.1515/ling.2008.003 · Cited by 58
The Psychological Reality of Local Coherences in Sentence Processing
Krause, C. M. (2005) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 27
Cited by
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
SPICE: Semantic Propositional Image Caption Evaluation
Anderson, P., Fernando, B., Johnson, M., & Gould, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_24 · Cited by 1,986
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712
An integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
What do we mean by prediction in language comprehension?
Kuperberg, G. R., & Jaeger, T. F. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1102299 · Cited by 1,087
“Further evidence for probabilistic prediction comes from a series of recent studies reporting a correlation between the surprisal of words and (a) their processing times (Hale, 2001; Levy, 2008) and (b) neural activity associated with processing them (Frank, Otten, Galli, & Vigliocco, 2015).”
BackgroundInfluential
Metadata
- Authors
- Levy, R.
- Venue
- Cognition
- Publisher
- Elsevier BV
- Published
- 2008-03
- Volume
- 106
- Issue
- 3
- Pages
- 1126-1177
- ISSN
- 0010-0277 (ISSN-L)
- OpenAlex
- W2164418233
- Cited by
- 2,202
- References
- 92
- FWCI
- 21.50
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.