The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Probabilistic Modeling in Psycholinguistics: Linguistic Comprehension and Production
Abstract
It must certainly be accounted a paradox that probabilistic modeling is simultaneously one of the oldest and one of the newest areas in psycholinguistics. Much research in linguistics and psycholinguistics in the 1950s was statistical and probabilistic. But this research disappeared throughout the 60’s, 70’s, and 80’s. In a highly unscientific survey (conducted by myself) of six college textbooks and handbooks in psycholinguistics published in the last 10 years, not a single one of them mentions the word ‘probability’ in the index. This omission is astonishing when we consider that the input to language comprehension is noisy, ambiguous, and unsegmented. In order to deal with these problems, computational models of speech processing, by contrast, have had to rely on probabilistic models for over 30 years. Computational techniques for processing of text, an input medium which is much less noisy than speech, rely just as heavily on probability theory. Just to pick an arbitrary indicator, 77% of the papers in the year 2000 annual conference of the Association for Computational Linguistics relied on probabilistic models of language processing or learning. Probability theory is certainly the best normative model for solving problems of decisionmaking under uncertainty. But perhaps it is a good normative model, but a bad descriptive one. Despite the fact that probability theory was originally invented as a cognitive model of human reasoning under uncertainty, perhaps people do not use probabilistic reasoning in cognitive tasks like language production and comprehension. Perhaps human language processing is simply a non-optimal, non-rational process? In the last decade or so, there is an emerging consensus that human cognition is in fact rational, and relies on probabilistic processing. The seminal work of Anderson (1990) gave Bayesian underpinnings to cognitive models of memory, categorization, and causation. Probabilistic models have cropped up in many areas of cognition; one area in which there are a number of recent probabilistic models is categorization (Rehder 1999; Glymour and Cheng 1998; Tenenbaum 2000; Tenenbaum and Griffiths 2001b; Tenenbaum and Griffiths 2001a), Probabilistic models are also now finally being applied in psycholinguistics, drawing from early Bayesian-esque precursers in perception such as the Luce (1959) choice rule and the work of Massaro. What does it mean to claim that human language processing is probabilistic? This claim has implications for language comprehension, production and learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1988) · Cited by 16,582
(1967) · Medical Entomology and Zoology · Cited by 7,532
Statistical learning by 8-month-old infants
Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996) · Science · doi:10.1126/science.274.5294.1926 · Cited by 5,659
A theory of lexical access in speech production
Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99001776 · Cited by 5,136
Jurafsky, D. S., & Martin, J. (2000) · Cited by 4,132
Self-citationA spreading-activation theory of retrieval in sentence production.
Dell, G. S. (1986) · Psychological Review · doi:10.1037//0033-295x.93.3.283 · Cited by 3,236
The Mental Representation of Grammatical Relations
Baltin, M., & Bresnan, J. (1985) · Language · doi:10.2307/414493 · Cited by 2,783
Linguistic complexity: locality of syntactic dependencies
Gibson, E. (1998) · Cognition · doi:10.1016/s0010-0277(98)00034-1 · Cited by 2,537
Pfanzagl, J., & Luce, R. D. (1962) · Econometrica · doi:10.2307/1911299 · Cited by 2,469
(1998) · Springer eBooks · doi:10.1007/978-94-011-5014-9 · Cited by 2,418
The lexical nature of syntactic ambiguity resolution
MacDonald, M. C., Pearlmutter, N. J., & Seidenberg, M. S. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.676 · Cited by 2,259
Frequency and the Emergence of Linguistic Structure
(2001) · Typological Studies in Language · doi:10.1075/tsl.45 · Cited by 2,230
The Adaptive Character of Thought
Massaro, D. W., Friedman, D., & Anderson, J. R. (1991) · The American Journal of Psychology · doi:10.2307/1423253 · Cited by 2,174
Interaction of information in word recognition.
Morton, J. (1969) · Psychological Review · doi:10.1037/h0027366 · Cited by 2,151
SWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134
Raaijmakers, J. G., & Shiffrin, R. M. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.93 · Cited by 1,696
A retrieval model for both recognition and recall.
Gillund, G., & Shiffrin, R. M. (1984) · Psychological Review · doi:10.1037//0033-295x.91.1.1 · Cited by 1,517
Lexical access in aphasic and nonaphasic speakers.
Dell, G. S., Schwartz, M. F., Martin, N., Saffran, E. M., & Gagnon, D. A. (1997) · Psychological Review · doi:10.1037//0033-295x.104.4.801 · Cited by 1,494
Exemplar dynamics: Word frequency, lenition and contrast
Pierrehumbert, J. B. (2001) · Typological Studies in Language · doi:10.1075/tsl.45.08pie · Cited by 1,479
Word Segmentation: The Role of Distributional Cues
Saffran, J. R., Newport, E. L., & Aslin, R. N. (1996) · Journal of Memory and Language · doi:10.1006/jmla.1996.0032 · Cited by 1,405
The cognitive basis for linguistic structures1
Bever, T. G. (2013) · Language Down the Garden Path · doi:10.1093/acprof:oso/9780199677139.003.0001 · Cited by 1,288
Balota, D. A., & Chumbley, J. I. (1984) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.10.3.340 · Cited by 1,269
Burchfield, R. (1985) · Journal of English Linguistics · doi:10.1177/007542428501800107 · Cited by 1,246
Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution
Trueswell, J. C., Tanenhaus, M. K., & Garnsey, S. M. (1994) · Journal of Memory and Language · doi:10.1006/jmla.1994.1014 · Cited by 1,175
A probabilistic earley parser as a psycholinguistic model
Hale, J. (2001) · Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001 - NAACL '01 · doi:10.3115/1073336.1073357 · Cited by 1,150
Lexical access and naming time
Forster, K. I., & Chambers, S. M. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80042-8 · Cited by 1,132
(1989) · Cited by 1,105
A stochastic parts program and noun phrase parser for unrestricted text
Church, K. W. (1988) · Proceedings of the second conference on Applied natural language processing - · doi:10.3115/974235.974260 · Cited by 957
Generalization, similarity, and Bayesian inference
Tenenbaum, J. B., & Griffiths, T. L. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01000061 · Cited by 854
Response Latencies in Naming Objects
Oldfield, R. C., & Wingfield, A. (1965) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470216508416445 · Cited by 811
Spoken word recognition processes and the gating paradigm
Grosjean, F. (1980) · Perception & Psychophysics · doi:10.3758/bf03204386 · Cited by 792
Trueswell, J. C., Tanenhaus, M. K., & Kello, C. T. (1993) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.19.3.528 · Cited by 791
Probabilistic relations between words: Evidence from reduction in lexical production
Jurafsky, D., Bell, A., Gregory, M., & Raymond, W. D. (2001) · Typological Studies in Language · doi:10.1075/tsl.45.13jur · Cited by 762
Self-citationApplications of Information Theory to Psychology
Garner, W. R. (1959) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-195911000-00013 · Cited by 755
Modeling the Influence of Thematic Fit (and Other Constraints) in On-line Sentence Comprehension
McRae, K., Spivey-Knowlton, M. J., & Tanenhaus, M. K. (1998) · Journal of Memory and Language · doi:10.1006/jmla.1997.2543 · Cited by 742
A probabilistic model of lexical and syntactic access and disambiguation
Jurafsky, D. (1996) · Cognitive Science · doi:10.1016/s0364-0213(99)80005-6 · Cited by 714
Self-citationThe effect of usage on degrees of constituency: the reduction of don't in English
Bybee, J., & Scheibman, J. (1999) · Linguistics · doi:10.1515/ling.37.4.575 · Cited by 661
Garnsey, S. M., Pearlmutter, N. J., Myers, E., & Lotocky, M. A. (1997) · Journal of Memory and Language · doi:10.1006/jmla.1997.2512 · Cited by 645
Functionalism and the competition model
Bates, E. A., & MacWhinney, B. (1989) · Cited by 611
Homographic entries in the internal lexicon
Rubenstein, H., Garfield, L., & Millikan, J. A. (1970) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(70)80091-3 · Cited by 554
Distributional regularity and phonotactic constraints are useful for segmentation
Brent, M. R., & Cartwright, T. A. (1996) · Cognition · doi:10.1016/s0010-0277(96)00719-6 · Cited by 514
Cue validity and sentence interpretation in English, German, and Italian
MacWhinney, B., Bates, E., & Kliegl, R. (1984) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(84)90093-8 · Cited by 498
Models for Free Recall and Recognition
Kintsch, W. (1970) · Models of Human Memory · doi:10.1016/b978-0-12-521350-9.50016-4 · Cited by 477
Visual duration threshold as a function of word-probability.
Howes, D. H., & Solomon, R. L. (1951) · Journal of Experimental Psychology · doi:10.1037/h0056020 · Cited by 476
Effects of Frequency and Vocabulary Type on Phonological Speech Errors
Dell, G. S. (1990) · Language and Cognitive Processes · doi:10.1080/01690969008407066 · Cited by 452
Jescheniak, J. D., & Levelt, W. J. M. (1994) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.20.4.824 · Cited by 443
Causes and Consequences of Word Structure
Hay, J. (2004) · Routledge eBooks · doi:10.4324/9780203495131 · Cited by 402
Word—nonword classification time
Whaley, C. P. (1978) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(78)90110-x · Cited by 398
Probabilistic constraints and syntactic ambiguity resolution
MacDonald, M. C. (1994) · Language and Cognitive Processes · doi:10.1080/01690969408402115 · Cited by 379
Frequency Effects and the Representational Status of Regular Inflections
Alegre, M., & Gordon, P. (1999) · Journal of Memory and Language · doi:10.1006/jmla.1998.2607 · Cited by 343
An Efficient Probabilistic Context-Free Parsing Algorithm that Computes Prefix Probabilities
Stolcke, A. (1994) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9411029 · Cited by 336
A Probabilistic Constraints Approach to Language Acquisition and Processing
Seidenberg, M. S., & MacDonald, M. C. (1999) · Cognitive Science · doi:10.1207/s15516709cog2304_8 · Cited by 335
Stallings, L. M., MacDonald, M. C., & O'Seaghdha, P. G. (1998) · Journal of Memory and Language · doi:10.1006/jmla.1998.2586 · Cited by 301
Resolving attachment ambiguities with multiple constraints
Spivey-Knowlton, M., & Sedivy, J. C. (1995) · Cognition · doi:10.1016/0010-0277(94)00647-4 · Cited by 299
Spivey, M. J., & Tanenhaus, M. K. (1998) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.24.6.1521 · Cited by 289
The Role of Lexical Frequency in Syntactic Ambiguity Resolution
Trueswell, J. C. (1996) · Journal of Memory and Language · doi:10.1006/jmla.1996.0030 · Cited by 277
The Effects of Collocational Strength and Contextual Predictability in Lexical Production
Gregory, M., Raymond, W. D., Bell, A., Fosler‐Lussier, E., & Jurafsky, D. S. (1999) · Cited by 267
Self-citationThe Use of Predictive Dependencies in Language Learning
Saffran, J. R. (2001) · Journal of Memory and Language · doi:10.1006/jmla.2000.2759 · Cited by 267
Activation and selection processes in the recognition of ambiguous words.
Simpson, G. B., & Burgess, C. (1985) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.11.1.28 · Cited by 263
A computational theory of human linguistic processing: memory limitations and processing breakdown
Gibson, E. A. F. (1991) · Cited by 249
Garden Path Phenomena and the Grammatical Basis of Language Processing
Pritchett, B. L. (1988) · Language · doi:10.2307/414532 · Cited by 227
Ambiguity Resolution in Sentence Processing: Evidence against Frequency-Based Accounts
Pickering, M. J., Traxler, M. J., & Crocker, M. W. (2000) · Journal of Memory and Language · doi:10.1006/jmla.2000.2708 · Cited by 212
Word-Frequency Effect and Errors in the Perception of Speech
Savin, H. B. (1963) · The Journal of the Acoustical Society of America · doi:10.1121/1.1918432 · Cited by 208
Tabor, W., Juliano, C., & Tanenhaus, M. K. (1997) · Language and Cognitive Processes · doi:10.1080/016909697386853 · Cited by 198
On the Relation between the Intelligibility and Frequency of Occurrence of English Words
Howes, D. (1957) · The Journal of the Acoustical Society of America · doi:10.1121/1.1908862 · Cited by 191
The Interaction of Lexical and Syntactic Ambiguity
Macdonald, M. C. (1993) · Journal of Memory and Language · doi:10.1006/jmla.1993.1035 · Cited by 181
Bayesian Modeling of Human Concept Learning
Tenenbaum, J. B. (1998) · neural information processing systems · Cited by 178
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-27555-6 · Cited by 177
Krug, M. (1998) · Journal of English Linguistics · doi:10.1177/007542429802600402 · Cited by 172
Effects of Frequency on Identification and Naming of Objects
Wingfield, A. (1968) · The American Journal of Psychology · doi:10.2307/1421267 · Cited by 172
Jurafsky, D. S. (1992) · Defense Technical Information Center (DTIC) · doi:10.21236/ada604298 · Cited by 168
Self-citationVerb frame preferences: Descriptive norms
Connine, C. M., Ferreira, F., Jones, C., Clifton, C., & Frazier, L. (1984) · Journal of Psycholinguistic Research · doi:10.1007/bf01076840 · Cited by 153
Lexical expectations in sentence comprehension
Clifton, C., Frazier, L., & Connine, C. M. (1984) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(84)90426-2 · Cited by 151
Spivey-Knowlton, M. J., Trueswell, J. C., & Tanenhaus, M. K. (1993) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/h0078826 · Cited by 145
Wide-Coverage Probabilistic Sentence Processing
Crocker, M. W., & Brants, T. (2000) · Journal of Psycholinguistic Research · doi:10.1023/a:1026560822390 · Cited by 143
INSIGHTS INTO SPOKEN LANGUAGE GLEANED FROM PHONETIC TRANSCRIPTION OF THE SWITCHBOARD CORPUS
Greenberg, S., Hollenback, J., & Ellis, D. P. W. (1996) · Cited by 138
A Bayesian Model Predicts Human Parse Preference and Reading Times in Sentence Processing
Narayanan, S., & Jurafsky, D. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0012 · Cited by 123
Self-citationParsing in Different Languages
Cuetos, F., Mitchell, D., Corley, M. M. B., Carreiras, M., García‐Albea, J. E., & Sabastián-Gallés, N. (1996) · doi:10.4324/9780203773970-11 · Cited by 117
Computation of the probability of initial substring generation by stochastic context-free grammars
Jelinek, F., & Lafferty, J. (1991) · doi:10.5555/971764.971768 · Cited by 114
de Jong, N. H., Feldman, L. B., Schreuder, R., Pastizzo, M. J., & Baayen, R. H. (2002) · Brain and Language · doi:10.1006/brln.2001.2547 · Cited by 113
Verb sense and verb subcategorization probabilities
Roland, D., & Jurafsky, D. S. (2002) · Natural language processing · doi:10.1075/nlp.4.17rol · Cited by 109
Self-citationThe relationship between the frequency and the processing complexity of linguistic structure
Gibson, E. A. F., Schütze, C. T., & Salomon, A. (1996) · Journal of Psycholinguistic Research · doi:10.1007/bf01708420 · Cited by 106
Competition and recency in a hybrid network model of syntactic disambiguation
Stevenson, S. (1994) · Journal of Psycholinguistic Research · doi:10.1007/bf02145044 · Cited by 93
Probabilistic representation of formal languages
Booth, T. L. (1969) · Annual Symposium on Switching & Automata Theory · doi:10.1109/swat.1969.17 · Cited by 93
Levels of Representation and Units of Access Relevant to Agrammatism
Kegl, J. A. (1995) · Brain and Language · doi:10.1006/brln.1995.1044 · Cited by 88
Dutch Inflection: The Rules that Prove the Exception
Baayen, R. H., Schreuder, R., de Jong, N. H., & Krott, A. (2002) · Studies in theoretical psycholinguistics · doi:10.1007/978-94-010-0355-1_3 · Cited by 87
Sentence memory: Storage vs. computation of frequent sentences
Bod, R. (2001) · UvA-DARE (University of Amsterdam) · Cited by 85
The development of sentence comprehension strategies in English and Dutch
McDonald, J. L. (1986) · Journal of Experimental Child Psychology · doi:10.1016/0022-0965(86)90043-3 · Cited by 83
The role of the lemma in form variation
Jurafsky, D. S., Bell, A., & Girand, C. (2002) · doi:10.1515/9783110197105.1.3 · Cited by 81
Self-citationHow verb subcategorization frequencies are affected by corpus choice
Roland, D., & Jurafsky, D. S. (1998) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/980691.980753 · Cited by 72
Self-citationPragmatics and Computational Linguistics
Jurafsky, D. S. (2006) · Wiley eBooks · doi:10.1002/9780470756959.ch26 · Cited by 71
Self-citationBrants, T. (1999) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/977035.977052 · Cited by 71
Jennings, F., Randall, B., & TYLER, L. K. (1997) · Language and Cognitive Processes · doi:10.1080/016909697386817 · Cited by 59
(1994) · Cited by 54
Lexical Structure and Parsing Complexity
Merlo, S. S. P. (1997) · Language and Cognitive Processes · doi:10.1080/016909697386880 · Cited by 47
Crosslinguistic studies of sentence production
Bates, E., & Devescovi, A. (1989) · Cited by 44
Tanenhaus, M. K., Spivey-Knowlton, M. J., & Hanna, J. E. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511527210.005 · Cited by 38
Causal Mechanism and Probability: A Normative Approach
Glymour, C., & Cheng, P. W. (2018) · doi:10.1184/r1/6491081 · Cited by 38
A corpus-based analysis of verb continuation frequencies for syntactic processing
Merlo, P. (1994) · Journal of Psycholinguistic Research · doi:10.1007/bf02146684 · Cited by 35
Guin, J. D. (1980) · PubMed · Cited by 32
Verb subcategorization frequency differences between business-news and balanced corpora
Roland, D., Jurafsky, D. S., Menn, L., Gahl, S., Elder, E., & Riddoch, C. (2000) · doi:10.3115/1117729.1117734 · Cited by 25
Self-citationModeling the Use of Frequency and Contextual Biases in Sentence Processing
Pearlmutter, N. J., Daugherty, K. G., MacDonald, M. C., & Seidenberg, M. S. (2019) · Routledge eBooks · doi:10.4324/9781315789354-121 · Cited by 14
Cited by
Expectation-based syntactic comprehension
Levy, R. (2008) · Cognition · doi:10.1016/j.cognition.2007.05.006 · Cited by 2,202
Language Is a Complex Adaptive System: Position Paper
The “Five Graces Group”, Beckner, C., Blythe, R., Bybee, J., Christiansen, M. H., Croft, W., Ellis, N. C., Holland, J., Ke, J., Larsen‐Freeman, D., et al. (2009) · Language Learning · doi:10.1111/j.1467-9922.2009.00533.x · Cited by 1,147
AT THE INTERFACE: DYNAMIC INTERACTIONS OF EXPLICIT AND IMPLICIT LANGUAGE KNOWLEDGE
Ellis, N. C. (2005) · Studies in Second Language Acquisition · doi:10.1017/s027226310505014x · Cited by 893
An Academic Formulas List: New Methods in Phraseology Research
Simpson-Vlach, R., & Ellis, N. C. (2010) · Applied Linguistics · doi:10.1093/applin/amp058 · Cited by 863
More than words: Frequency effects for multi-word phrases
Arnon, I., & Snider, N. (2010) · Journal of Memory and Language · doi:10.1016/j.jml.2009.09.005 · Cited by 791
Metadata
- Authors
- Jurafsky, D.
- Venue
- Probabilistic Linguistics
- Publisher
- The MIT Press
- Published
- 2003-04-08
- Pages
- 39-96
- OpenAlex
- W196301953
- Cited by
- 357
- References
- 102
- FWCI
- 6.58
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.