The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Uncertainty About the Rest of the Sentence
Open accessAbstract
A word‐by‐word human sentence processing complexity metric is presented. This metric formalizes the intuition that comprehenders have more trouble on words contributing larger amounts of information about the syntactic structure of the sentence as a whole. The formalization is in terms of the conditional entropy of grammatical continuations, given the words that have been heard so far. To calculate the predictions of this metric, Wilson and Carroll's (1954) original entropy reduction idea is extended to infinite languages. This is demonstrated with a mildly context‐sensitive language that includes relative clauses formed on a variety of grammatical relations across the Accessibility Hierarchy of Keenan and Comrie (1977). Predictions are derived that correlate significantly with repetition accuracy results obtained in a sentence‐memory experiment (Keenan & Hawkins, 1987).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Chomsky, N. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262527347.001.0001 · Cited by 8,244
(1967) · Medical Entomology and Zoology · Cited by 7,532
Head-driven phrase structure grammar
Sag, I. A., & Pollard, C. (1994) · Medical Entomology and Zoology · Cited by 3,889
Kayne, R. S. (1994) · Cited by 3,104
Three models for the description of language
Chomsky, N. (1956) · IEEE Transactions on Information Theory · doi:10.1109/tit.1956.1056813 · Cited by 2,796
The Mental Representation of Grammatical Relations
Baltin, M., & Bresnan, J. (1985) · Language · doi:10.2307/414493 · Cited by 2,783
Prediction and Entropy of Printed English
Shannon, C. E. (1951) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1951.tb01366.x · Cited by 2,686
The teacher's word book of 30,000 words.
Witty, P. (1945) · Journal of Consulting Psychology · doi:10.1037/h0050354 · Cited by 2,661
The Teacher's Word Book of 30, 000 Words
Thorndike, E. L., & Lorge, I. D. (2018) · Cited by 2,656
Linguistic complexity: locality of syntactic dependencies
Gibson, E. (1998) · Cognition · doi:10.1016/s0010-0277(98)00034-1 · Cited by 2,537 · cited 1×
“Much work (Bever, 1970; Gibson, 1998; Wanner & Maratsos, 1978) has focused on relativization from Subject and Object, but of course, there are other grammatical relations, some of which support relativization in particular languages.”
Background“Cloze Procedure”: A New Tool for Measuring Readability
Taylor, W. L. (1953) · Journalism Quarterly · doi:10.1177/107769905303000401 · Cited by 2,332
Noun Phrase Accessibility and Universal Grammar
(2014) · Universal Grammar (RLE Linguistics A: General Linguistics) · doi:10.4324/9781315880259-11 · Cited by 2,146
Cognition and the Development of Language
Bloom, L., & Hayes, J. R. (1974) · Language · doi:10.2307/412449 · Cited by 2,081
Handbook of mathematical psychology: I.
Luce, R. D., Bush, R. R., & Galanter, E. (1963) · Wiley eBooks · Cited by 1,999
Handbook Of Mathematical Psychology
Galanter, & Eugène (1963) · Cited by 1,956
Linguistic theory and psychological reality
Berman, R. A. (1979) · Lingua · doi:10.1016/0024-3841(79)90058-5 · Cited by 1,349
Loftus, E. F., Norman, D. A., & Rumelhart, D. E. (1975) · The American Journal of Psychology · doi:10.2307/1421908 · Cited by 1,292
The cognitive basis for linguistic structures1
Bever, T. G. (2013) · Language Down the Garden Path · doi:10.1093/acprof:oso/9780199677139.003.0001 · Cited by 1,288
A Performance Theory of Order and Constituency
Hawkins, J. A. (1995) · Cambridge University Press eBooks · doi:10.1017/cbo9780511554285 · Cited by 1,180
An Activation‐Based Model of Sentence Processing as Skilled Memory Retrieval
Lewis, R. L., & Vasishth, S. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_25 · Cited by 1,035
Chomsky, N. (1977) · Medical Entomology and Zoology · Cited by 1,012
The Dependency Locality Theory: A Distance-Based Theory of Linguistic Complexity
Gibson, E. (2001) · Image, Language, Brain · doi:10.7551/mitpress/3654.003.0008 · Cited by 937
(1963) · Cited by 855
Joshi, A. K., Levy, L. S., & Takahashi, M. (1975) · Journal of Computer and System Sciences · doi:10.1016/s0022-0000(75)80019-5 · Cited by 770
A Performance Theory of Order and Constituency
Covington, M. A., & Hawkins, J. A. (1999) · Language · doi:10.2307/417736 · Cited by 761
Linguistic Theory and Psychological Reality
Roeper, T., Halle, M., Bresnan, J., & Miller, G. A. (1982) · Language · doi:10.2307/414117 · Cited by 753
The Penn Treebank: annotating predicate argument structure
Marcus, M., Kim, G., Marcinkiewicz, M. A., MacIntyre, R., Bies, A., Ferguson, M., Katz, K., & Schasberger, B. (1994) · Proceedings of the workshop on Human Language Technology - HLT '94 · doi:10.3115/1075812.1075835 · Cited by 742
A probabilistic model of lexical and syntactic access and disambiguation
Jurafsky, D. (1996) · Cognitive Science · doi:10.1016/s0364-0213(99)80005-6 · Cited by 714
Perspectives on Sentence Processing
Altmann, G. T. M. (1995) · Language and Speech · doi:10.1177/002383099503800206 · Cited by 624
English relative clause constructions
SAG, I. A. (1997) · Journal of Linguistics · doi:10.1017/s002222679700652x · Cited by 569
Joshi, A. K. (1985) · Natural Language Parsing · doi:10.1017/cbo9780511597855.007 · Cited by 560
A model and an hypothesis for language structure
Yngve, V. H. (1960) · Cited by 522
Schachter, P. (1973) · Language · doi:10.2307/412101 · Cited by 443
On multiple context-free grammars
Seki, H., Matsumura, T., Fujii, M., & Kasami, T. (1991) · Theoretical Computer Science · doi:10.1016/0304-3975(91)90374-b · Cited by 392
An ATN approach to comprehension
Wanner, H. E., & Maratsos, M. P. (1978) · Medical Entomology and Zoology · Cited by 368
Readings in natural language processing
(1989) · Journal of Pragmatics · doi:10.1016/0378-2166(89)90051-9 · Cited by 309
The Information Conveyed by Words in Sentences
Hale, J. (2003) · Journal of Psycholinguistic Research · doi:10.1023/a:1022492123056 · Cited by 283
Self-citationCharacterizing mildly context-sensitive grammar formalisms
Weir, D. J., & Joshi, A. K. (1988) · Scholarly Commons (University of Pennsylvania) · Cited by 281
Speech Production and the Predictability of Words in Context
Goldman-Eisler, F. (1958) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470215808416261 · Cited by 273
Essays on the Representational and Derivational Nature of Grammar: The Diversity of Wh-Constructions
Aoun, J. E., & Li, Y.-H. A. (2003) · The MIT Press eBooks · doi:10.7551/mitpress/2832.001.0001 · Cited by 273
Effects of merely local syntactic coherence on sentence processing
Tabor, W., Galantucci, B., & Richardson, D. (2004) · Journal of Memory and Language · doi:10.1016/j.jml.2004.01.001 · Cited by 261
A computational theory of human linguistic processing: memory limitations and processing breakdown
Gibson, E. A. F. (1991) · Cited by 249
On the generative power of transformational grammars
Peters, P. (1973) · Information Sciences · doi:10.1016/0020-0255(73)90027-3 · Cited by 242
Ambiguity in sentence processing
Altmann, G. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01153-x · Cited by 218
The structure of shared forests in ambiguous parsing
Billot, S., & Lang, B. (1989) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/981623.981641 · Cited by 182
Essays on the Representational and Derivational Nature of Grammar: The Diversity of Wh-Constructions
Aoun, J., & Li, P. (2003) · Thammasat University Digital Collections · Cited by 167
(2015) · Encyclopedia of Computational Neuroscience · doi:10.1007/978-1-4614-6675-8_100494 · Cited by 162
Deterministic Techniques for Efficient Non-Deterministic Parsers
Lang, B. (1974) · Lecture notes in computer science · doi:10.1007/978-3-662-21545-6_18 · Cited by 141
Augmented transition networks as psychological models of sentence comprehension
Kaplan, R. M. (1972) · Artificial Intelligence · doi:10.1016/0004-3702(72)90043-4 · Cited by 130
A Bayesian Model Predicts Human Parse Preference and Reading Times in Sentence Processing
Narayanan, S., & Jurafsky, D. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0012 · Cited by 123
Advances in neural information processing systems 12: Proceedings of the 1999 conference
(2001) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(01)90031-8 · Cited by 113
Incremental Processing and Acceptability
Morrill, G. V. (2000) · Computational Linguistics · doi:10.1162/089120100561728 · Cited by 105
A connectionist model of sentence comprehension and production
Rohde, D. L. T., & Plaut, D. C. (2002) · Cited by 93
How Children’s Relatives Solve a Problem for Minimalism
McDaniel, D., McKee, C., & Bernstein, J. B. (1998) · Language · doi:10.1353/lan.1998.0177 · Cited by 84
Varieties of crossing dependencies: structure dependence and mild context sensitivity
Stabler, E. P. (2004) · Cognitive Science · doi:10.1207/s15516709cog2805_4 · Cited by 80
Variations on incremental interpretation
Shieber, S. M., & Johnson, M. (1993) · Journal of Psycholinguistic Research · doi:10.1007/bf01067835 · Cited by 49
Lang, B. (1988) · International Conference on Computational Linguistics · doi:10.3115/991635.991710 · Cited by 39
Restricting grammatical complexity
Frank, R. (2004) · Cognitive Science · doi:10.1207/s15516709cog2805_3 · Cited by 35
Cited by
Expectation-based syntactic comprehension
Levy, R. (2008) · Cognition · doi:10.1016/j.cognition.2007.05.006 · Cited by 2,202
An integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
The Now-or-Never bottleneck: A fundamental constraint on language
Christiansen, M. H., & Chater, N. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1500031x · Cited by 733
How language production shapes language form and comprehension
MacDonald, M. C. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00226 · Cited by 595
The ERP response to the amount of information conveyed by words in sentences
Frank, S. L., Otten, L. J., Galli, G., & Vigliocco, G. (2015) · Brain and Language · doi:10.1016/j.bandl.2014.10.006 · Cited by 381
Metadata
- Authors
- Hale, J.
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 2006-07
- Volume
- 30
- Issue
- 4
- Pages
- 643-672
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W2129056111
- Cited by
- 296
- References
- 59
- FWCI
- 3.38
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.