Probabilistic models of language processing and acquisition

Chater, Nick; Manning, Christopher D.

doi:10.1016/j.tics.2006.05.006

Cited by 414Language Development and DisordersNatural Language Processing TechniquesNeurobiology of Language and Bilingualism

Probabilistic models of language processing and acquisition

Chater, Nick, Manning, Christopher D.·2006·Trends in Cognitive Sciences

DOI 10.1016/j.tics.2006.05.006

Open this paper in CoChat — free account

Abstract

Probabilistic methods are providing new explanatory approaches to fundamental cognitive science questions of how humans structure, process and acquire language. This review examines probabilistic models defined over traditional symbolic structures. Language comprehension and production involve probabilistic inference in such models; and acquisition involves choosing the best model, given innate constraints and linguistic and other input. Probabilistic models can account for the learning and processing of language, while maintaining the sophistication of symbolic models. A recent burgeoning of theoretical developments and online corpus creation has enabled large models to be tested, revealing probabilistic constraints in processing, undermining acquisition arguments based on a perceived poverty of the stimulus, and suggesting fruitful links with probabilistic theories of categorization and ambiguity resolution in perception.

Integrity signals

Registry

Crossref · 10.1016/j.tics.2006.05.006

Cites

87 of 87 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Bayesian models of cognition have primarily flourished as explanations of the complex dependency of behavior on the environment in domains including intuitive physics, causal learning, perception, motor control, and language.
“Bayesian models of cognition have primarily flourished as explanations of the complex dependency of behavior on the environment in domains including intuitive physics, causal learning, perception, motor control, and language [1-10]”
From Bayesian Brains without Probabilities (2016) · cites this paper as [6]
Language interpretation is a high-level cognitive task which shows a good correspondence to Bayesian models.
“Language interpretation is a high-level cognitive task which shows a good correspondence to Bayesian models [5,6].”
From Bayesian Brains without Probabilities (2016) · cites this paper as [6]

A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · see citing works
ASPECTS OF THE THEORY OF SYNTAX
Chomsky, N. (1964) · doi:10.21236/ad0616323 · Cited by 13,587 · see citing works
Finding structure in time
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212 · see citing works
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816 · see citing works
Self-citation
Lectures on Government and Binding
Chomsky, N. (1993) · Mouton eBooks · doi:10.1515/9783110884166 · Cited by 8,557 · see citing works
A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge.
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282 · see citing works
Finding scientific topics
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049 · see citing works
Lectures on government and binding . By Noam Chomsky. (Studies in generative grammar, 9.) Dordrecht, Holland, & Cinnaminson, NJ: Foris, 1981. Pp. 371. Cloth f 90.00, paper f 50.00. - Some concepts and consequences of the theory of government and binding . By Noam Chomsky. (Linguistic Inquiry monographs, 6.) Cambridge, MA: MIT Press, 1982. Pp. 110. Cloth $20.00, paper $7.95.
Williams, E. (1984) · Language · doi:10.2307/413646 · Cited by 5,165 · see citing works
Constructing a language: a usage-based theory of language acquisition
(2003) · Choice Reviews Online · doi:10.5860/choice.41-1385 · Cited by 4,455 · see citing works
Language identification in the limit
Gold, E. M. (1967) · Information and Control · doi:10.1016/s0019-9958(67)91165-5 · Cited by 3,572 · see citing works
The TRACE model of speech perception
McClelland, J. L., & Elman, J. L. (1986) · Cognitive Psychology · doi:10.1016/0010-0285(86)90015-0 · Cited by 2,940 · see citing works
Integration of Visual and Linguistic Information in Spoken Language Comprehension
Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995) · Science · doi:10.1126/science.7777863 · Cited by 2,929 · see citing works
The motor theory of speech perception revised
Liberman, A. M., & Mattingly, I. G. (1985) · Cognition · doi:10.1016/0010-0277(85)90021-6 · Cited by 2,865 · see citing works
Prediction and Entropy of Printed English
Shannon, C. E. (1951) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1951.tb01366.x · Cited by 2,686 · see citing works
Toward a mechanistic psychology of dialogue.
Pickering, M. J., & Garrod, S. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000056 · Cited by 2,678 · see citing works
Head-Driven Statistical Models for Natural Language Parsing
Collins, M. (2003) · Computational Linguistics · doi:10.1162/089120103322753356 · Cited by 1,848 · see citing works
The sausage machine: A new two-stage parsing model
Frazier, L., & Fodor, J. D. (1978) · Cognition · doi:10.1016/0010-0277(78)90002-1 · Cited by 1,348 · see citing works
Rule Learning by Seven-Month-Old Infants
Marcus, G., Vijayan, S., Rao, S. B., & Vishton, P. M. (1999) · Science · doi:10.1126/science.283.5398.77 · Cited by 1,246 · see citing works
Words and rules: the ingredients of language
(2000) · Choice Reviews Online · doi:10.5860/choice.37-5964 · Cited by 1,230 · see citing works
Empirical Tests of the Gradual Learning Algorithm
Boersma, P., & Hayes, B. (2001) · Linguistic Inquiry · doi:10.1162/002438901554586 · Cited by 1,119 · see citing works
Empirical assessment of stimulus poverty arguments
Pullum, G. K., & Scholz, B. C. (2002) · The Linguistic Review · doi:10.1515/tlir.19.1-2.9 · Cited by 923 · see citing works
Theory-based Bayesian models of inductive learning and reasoning
Tenenbaum, J. B., Griffiths, T. L., & Kemp, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.009 · Cited by 880 · see citing works
Bayesian decision theory in sensorimotor control
Kording, K. P., & Wolpert, D. M. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.003 · Cited by 866 · see citing works
Vision as Bayesian inference: analysis by synthesis?
Yuille, A., & Kersten, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.002 · Cited by 849 · see citing works
The Psychology of Language
Clair, R. S., Fodor, J. A., Bever, T. G., & Garrett, M. F. (1974) · Modern Language Journal · doi:10.2307/325153 · Cited by 793 · see citing works
Unsupervised Learning of the Morphology of a Natural Language
Goldsmith, J. (2001) · Computational Linguistics · doi:10.1162/089120101750300490 · Cited by 790 · see citing works
Rules vs. analogy in English past tenses: a computational/experimental study
Albright, A., & Hayes, B. (2003) · Cognition · doi:10.1016/s0010-0277(03)00146-x · Cited by 777 · see citing works
Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial GrammarsPreprint
Zettlemoyer, L., & Collins, M. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.1420 · Cited by 765 · see citing works
Merging information in speech recognition: Feedback is never necessary
Norris, D. G., McQueen, J. M., & Cutler, A. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00003241 · Cited by 761 · see citing works
Learning at a distance I. Statistical learning of non-adjacent dependencies.
Newport, E., & Aslin, R. (2004) · Cognitive Psychology · doi:10.1016/s0010-0285(03)00128-2 · Cited by 735 · see citing works
A Probabilistic Model of Lexical and Syntactic Access and Disambiguation
Jurafsky, D. S. (1996) · Cognitive Science · doi:10.1207/s15516709cog2002_1 · Cited by 658 · see citing works
Applications of stochastic context-free grammars using the Inside-Outside algorithm
Lari, K., & Young, S. J. (1991) · Computer Speech & Language · doi:10.1016/0885-2308(91)90009-f · Cited by 639 · see citing works
Words and rules
Pinker, S. A. (1998) · Lingua · doi:10.1016/s0024-3841(98)00035-7 · Cited by 562 · see citing works
Formal models of language learning
Pinker, S. A. (1979) · Cognition · doi:10.1016/0010-0277(79)90001-5 · Cited by 547 · see citing works
Distributional Information: A Powerful Cue for Acquiring Syntactic Categories
Redington, M., Chater, N., & Finch, S. (1998) · Cognitive Science · doi:10.1207/s15516709cog2204_2 · Cited by 535 · see citing works
Statistical parsing with a context-free grammar and word statistics
Charniak, E. (1997) · Cited by 530 · see citing works
Distributional regularity and phonotactic constraints are useful for segmentation
Brent, M. R., & Cartwright, T. A. (1996) · Cognition · doi:10.1016/s0010-0277(96)00719-6 · Cited by 514 · cited 1× · see citing works
“Some theorists focus on applying probability to learning parameters of Chomskyan Universal Grammar [54,55]; others focus on learning relatively simple aspects of language, such as syntactic or semantic categories, or approximate morphological decomposition, with relatively weak prior assumptions [44, 56 ,57].”
Sociolinguistics : an international handbook of the science of language and society
Ammon, U., Dittmar, N., & Mattheier, K. J. (1987) · Cited by 510 · see citing works
Integrating Topics and Syntax
Griffiths, T. L., Steyvers, M., Blei, D. M., & Tenenbaum, J. B. (2004) · Cited by 499 · see citing works
Memory-Based Language Processing
Daelemans, W. M. P., & van den Bosch, A. P. J. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511486579 · Cited by 466 · see citing works
Consequences of the Serial Nature of Linguistic Input for Sentenial Complexity
Grodner, D. J., & Gibson, E. A. F. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_7 · Cited by 456 · see citing works
Corpus-based induction of syntactic structure
Klein, D., & Manning, C. D. (2004) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1218955.1219016 · Cited by 450 · see citing works
Self-citation
Probabilistic Linguistics
(2003) · The MIT Press eBooks · doi:10.7551/mitpress/5582.001.0001 · Cited by 426 · see citing works
The Bayesian reader: Explaining word recognition as an optimal Bayesian decision process.
Norris, D. G. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.327 · Cited by 416 · see citing works
Language, brain, and cognitive development : essays in honor of Jacques Mehler
Emmanuel Dupoux, A. (2001) · Cited by 408 · see citing works
Words and Rules: The Ingredients of Language
Algeo, J. T. (2000) · Journal of English Linguistics · doi:10.1177/00754240022005117 · Cited by 389 · see citing works
The estimation of stochastic context-free grammars using the Inside-Outside algorithm
Lari, K., & Young, S. J. (1990) · Computer Speech & Language · doi:10.1016/0885-2308(90)90022-x · Cited by 380 · see citing works
Handbook of pragmatics
Östman, J., & Verschueren, J. (1995) · John Benjamins eBooks · Cited by 375 · see citing works
The Computational Nature of Language Learning and Evolution
Niyogi, P. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/2024.001.0001 · Cited by 361 · see citing works
Language Acquisition and Use: Learning and Applying Probabilistic Constraints
Seidenberg, M. S. (1997) · Science · doi:10.1126/science.275.5306.1599 · Cited by 338 · see citing works
A Probabilistic Constraints Approach to Language Acquisition and Processing
Seidenberg, M. S., & MacDonald, M. C. (1999) · Cognitive Science · doi:10.1207/s15516709cog2304_8 · Cited by 335 · see citing works
Shifting paradigms: gradient structure in morphology
HAY, J., & Baayen, R. H. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.04.002 · Cited by 334 · see citing works
Eye Movements Reveal the On-Line Computation of Lexical Probabilities During Reading
McDonald, S. A., & Shillcock, R. C. (2003) · Psychological Science · doi:10.1046/j.0956-7976.2003.psci_1480.x · Cited by 322 · see citing works
Selectional constraints: an information-theoretic model and its computational realization
Resnik, P. (1996) · Cognition · doi:10.1016/s0010-0277(96)00722-6 · Cited by 318 · see citing works
The Information Conveyed by Words in Sentences
Hale, J. (2003) · Journal of Psycholinguistic Research · doi:10.1023/a:1022492123056 · Cited by 284 · see citing works
Empirical re-assessment of stimulus poverty arguments
Legate, J. A., & Yang, C. D. (2002) · The Linguistic Review · doi:10.1515/tlir.19.1-2.151 · Cited by 278 · see citing works
Rational Models of Cognition
Chater, N., & Oaksford, M. (2005) · Encyclopedia of Cognitive Science · doi:10.1002/0470018860.s00603 · Cited by 253 · see citing works
Self-citation
Semantic density and past-tense formation in three Germanic languages
Baayen, R. H., & Martı́n, F. M. D. P. (2005) · Language · doi:10.1353/lan.2005.0112 · Cited by 250 · see citing works
A generative constituent-context model for improved grammar induction
Klein, D., & Manning, C. D. (2001) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1073083.1073106 · Cited by 248 · see citing works
Self-citation
The Balancing Act: Combining Symbolic and Statistical Approaches to Language
Klavans, J. L., & Resnik, P. (1996) · Cited by 231 · see citing works
Filling gaps: Decision principles and structure in sentence comprehension
Frazier, L. Q. (1983) · Cognition · doi:10.1016/0010-0277(83)90022-7 · Cited by 219 · see citing works
Ambiguity Resolution in Sentence Processing: Evidence against Frequency-Based Accounts
Pickering, M. J., Traxler, M. J., & Crocker, M. W. (2000) · Journal of Memory and Language · doi:10.1006/jmla.2000.2708 · Cited by 212 · see citing works
Combining distributional and morphological information for part of speech induction
Clark, A. (2003) · doi:10.3115/1067807.1067817 · Cited by 207 · see citing works
Probabilistic Syntax
Manning, C. D. (2003) · The MIT Press eBooks · doi:10.7551/mitpress/5582.003.0011 · Cited by 184 · see citing works
Self-citation
Rationality In An Uncertain World
Chater, N., & Oaksford, M. (2004) · Routledge eBooks · doi:10.4324/9780203345955 · Cited by 173 · see citing works
Self-citation
Rational Models of Cognition
Jaeger, D., & Jung, R. (2015) · Encyclopedia of Computational Neuroscience · doi:10.1007/978-1-4614-6675-8_100494 · Cited by 168 · see citing works
Distributional part-of-speech tagging
Schütze, H. (1995) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/976973.976994 · Cited by 162 · see citing works
German Inflection: Single Route or Dual Route?
Hahn, U., & Nakisa, R. C. (2000) · Cognitive Psychology · doi:10.1006/cogp.2000.0737 · Cited by 150 · see citing works
Do Infants Learn Grammar with Algebra or Statistics?
Seidenberg, M. S., & Elman, J. L. (1999) · Science · doi:10.1126/science.284.5413.433f · Cited by 150 · see citing works
Wide-Coverage Probabilistic Sentence Processing
Crocker, M. W., & Brants, T. (2000) · Journal of Psycholinguistic Research · doi:10.1023/a:1026560822390 · Cited by 123 · see citing works
A Bayesian Model Predicts Human Parse Preference and Reading Times in Sentence Processing
Narayanan, S., & Jurafsky, D. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0012 · Cited by 112 · see citing works
The Balancing act
Bunkley Anita, R. (1976) · Cited by 111 · see citing works
Relative clause attachment in Dutch: On-line comprehension corresponds to corpus frequencies when lexical variables are taken into account
Desmet, T., Baecke, C. D., Drieghe, D., Brysbaert, M., & Vonk, W. (2005) · Language and Cognitive Processes · doi:10.1080/01690960400023485 · Cited by 84 · see citing works
Rationality in an Uncertain World
(2005) · Nomos eBooks · doi:10.5771/9783845271224 · Cited by 84 · see citing works
The interaction of top–down and bottom–up statistics in the resolution of syntactic category ambiguity☆
Gibson, E. A. F. (2006) · Journal of Memory and Language · doi:10.1016/j.jml.2005.12.005 · Cited by 71 · see citing works
Pragmatics and Computational Linguistics
Jurafsky, D. S. (2006) · doi:10.1002/9780470756959.ch26 · Cited by 70 · see citing works
Stochastic HPSG Parse Disambiguation using the Redwoods Corpus
Toutanova, K., Manning, C. D., Flickinger, D., & Oepen, S. (2005) · Research on Language and Computation · doi:10.1007/s11168-005-1288-y · Cited by 61 · see citing works
Self-citation
Disambiguation preferences and corpus frequencies in noun phrase conjunction
Desmet, T. (2003) · Journal of Memory and Language · doi:10.1016/s0749-596x(03)00025-1 · Cited by 49 · see citing works
NIMH: Caught in the Line of Fire Without a General
Marshall, E. (1995) · Science · doi:10.1126/science.7732368 · Cited by 46 · see citing works
Exploiting a verb lexicon in automatic semantic role labelling
Swier, R., & Stevenson, S. (2005) · doi:10.3115/1220575.1220686 · Cited by 36 · see citing works
The Balancing Act
(1996) · The MIT Press eBooks · doi:10.7551/mitpress/1507.001.0001 · Cited by 31 · see citing works
Do infants learn grammar with algebra or statistics? [5] (multiple letters)
Seidenberg, M. S., Elman, J. L., Negishi, M., Eimas, P. D., & Marcus, G. (1999) · Science · Cited by 29 · see citing works
Probabilistic Models of Grammar: Phonology as Information Minimization
Goldsmith, J. (2002) · Cited by 28 · see citing works
A Procedure for Grammatical Inference.
Horning, J. J. (1971) · IFIP Congress · Cited by 25 · see citing works
Statistical models of syntax learning and use
Johnson, M. S., & Riezler, S. (2002) · Cognitive Science · doi:10.1207/s15516709cog2603_2 · Cited by 20 · see citing works
Word Learning as Bayesian Inference: Evidence from Preschoolers
Tenenbaums, J. B., & Xu, F. (2005) · eScholarship (California Digital Library) · Cited by 20 · see citing works
What can be learned from positive data? Insights from an ‘ideal learner’. Commentary on ‘A Multiple process solution to the logical problem of language acquisition’ by Brian MacWhinney
Chater, N. (2004) · Journal of Child Language · doi:10.1017/s0305000904006348 · Cited by 11 · see citing works
Self-citation

Flagged first, then by citations

3 of the 90 references couldn’t be matched to a known paper.

Sorted by citations

Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · see citing works
How to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815 · see citing works
Predictive coding: an account of the mirror neuron system
Kilner, J. M., Friston, K. J., & Frith, C. D. (2007) · Cognitive Processing · doi:10.1007/s10339-007-0170-2 · Cited by 1,134 · see citing works
What do we mean by prediction in language comprehension?
Kuperberg, G. R., & Jaeger, T. F. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1102299 · Cited by 1,087 · see citing works
Active perception: sensorimotor circuits as a cortical basis for language
Friedemann Pulvermüller, A., & Fadiga, L. (2010) · Nature reviews. Neuroscience · doi:10.1038/nrn2811 · Cited by 1,043 · see citing works
Theory-based Bayesian models of inductive learning and reasoning
Tenenbaum, J. B., Griffiths, T. L., & Kemp, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.009 · Cited by 880 · see citing works
Vision as Bayesian inference: analysis by synthesis?
Yuille, A., & Kersten, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.002 · Cited by 849 · see citing works
The propositional nature of human associative learning
Mitchell, C. J., Houwer, J. D., & Lovibond, P. F. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09000855 · Cited by 749 · see citing works
A Hierarchy of Time-Scales and the Brain
Kiebel, S. J., Daunizeau, J., & Friston, K. J. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000209 · Cited by 694 · see citing works
Bayesian Fundamentalism or Enlightenment? On the explanatory status and theoretical contributions of Bayesian models of cognition
Jones, M., & Love, B. C. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10003134 · Cited by 533 · see citing works
Probabilistic models of cognition: Conceptual foundations
Chater, N., Tenenbaum, J. B., & Yuille, A. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.007 · Cited by 546 · see citing works
Bayesian Models of Cognition
Griffiths, T. L., Kemp, C., & Tenenbaum, J. B. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816772.006 · Cited by 514 · see citing works
Moving beyond assumptions to understand abundance distributions across the ranges of species
Sagarin, R. D., Gaines, S. D., & Gaylord, B. (2006) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2006.06.008 · Cited by 508 · see citing works
Untitled work
Vul (2014) · doi:10.1111/cogs.12101 · Cited by 502 · see citing works
Theory-based causal induction.
Griffiths, T. L., & Tenenbaum, J. B. (2009) · Psychological Review · doi:10.1037/a0017201 · Cited by 388 · see citing works
Précis of Bayesian Rationality: The Probabilistic Approach to Human Reasoning
Oaksford, M., & Nick Chater, A. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09000284 · Cited by 332 · see citing works
Cognitive Network Science: A Review of Research on Cognition through the Lens of Network Representations, Processes, and Dynamics
Siew, C. S. Q., Wulff, D. U., Beckage, N., & Kenett, Y. N. (2019) · Complexity · doi:10.1155/2019/2108423 · Cited by 327 · see citing works
Bayesian Brains without Probabilities
Sanborn, A. N., & Chater, N. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.10.003 · Cited by 307 · see citing works
The Dynamics of Second Language Emergence: Cycles of Language Use, Language Change, and Language Acquisition
Ellis, N. C. (2008) · Modern Language Journal · doi:10.1111/j.1540-4781.2008.00716.x · Cited by 297 · see citing works
The mirror-neuron system: a Bayesian perspective
Kilner, J. M., Friston, K. J., & Frith, C. (2007) · Neuroreport · doi:10.1097/wnr.0b013e3281139ed0 · Cited by 287 · see citing works
The learnability of abstract syntactic principles
Perfors, A., Tenenbaum, J. B., & Regier, T. (2010) · Cognition · doi:10.1016/j.cognition.2010.11.001 · Cited by 288 · see citing works
Statistical Learning Is Related to Reading Ability in Children and Adults
Arciuli, J., & Simpson, I. C. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01200.x · Cited by 277 · see citing works
On the Supposed Evidence for Libertarian Paternalism
Gigerenzer, G. (2015) · Review of Philosophy and Psychology · doi:10.1007/s13164-015-0248-1 · Cited by 247 · see citing works
Early Anticipation Lies behind the Speed of Response in Conversation
Magyari, L., Bastiaansen, M. C. M., de Ruiter, J. P., & Levinson, S. C. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00673 · Cited by 247 · see citing works
Grammaticality, Acceptability, and Probability: A Probabilistic View of Linguistic Knowledge
Lau, J. H., Clark, A., & Lappin, S. (2016) · Cognitive Science · doi:10.1111/cogs.12414 · Cited by 247 · see citing works
Input and first language acquisition: Evaluating the role of frequency
Lieven, E. (2010) · Lingua · doi:10.1016/j.lingua.2010.06.005 · Cited by 228 · see citing works
The Surfeit of the Stimulus: Analytic Biases Filter Lexical Statistics in Turkish Laryngeal Alternations
Becker, M., Ketrez, F. N., & Nevins, A. I. (2011) · Language · doi:10.1353/lan.2011.0016 · Cited by 224 · see citing works
Toward a computational framework for cognitive biology: Unifying approaches from cognitive neuroscience and comparative cognition
Fitch, W. T. (2014) · Physics of Life Reviews · doi:10.1016/j.plrev.2014.04.005 · Cited by 221 · see citing works
Artificial grammar learning meets formal language theory: an overview
Fitch, W. T., & Friederici, A. D. (2012) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2012.0103 · Cited by 201 · see citing works
Comprehensible Predictive Models for Business Processes1
Breuker, D., Matzner, M., Delfmann, P., & Becker, J. (2016) · MIS Quarterly · doi:10.25300/misq/2016/40.4.10 · Cited by 190 · see citing works
Information‐theoretical Complexity Metrics
Hale, J. (2016) · Language and Linguistics Compass · doi:10.1111/lnc3.12196 · Cited by 186 · see citing works
Brain embodiment of syntax and grammar: Discrete combinatorial mechanisms spelt out in neuronal circuits
Pulvermüller, F. (2010) · Brain and Language · doi:10.1016/j.bandl.2009.08.002 · Cited by 182 · see citing works
Goal-directed decision making as probabilistic inference: A computational framework and potential neural correlates.
Solway, A., & Botvinick, M. (2012) · Psychological Review · doi:10.1037/a0026435 · Cited by 180 · see citing works
Usage-based approaches to second language acquisition
Wulff, S., & Ellis, N. C. (2018) · Studies in bilingualism · doi:10.1075/sibil.54.03wul · Cited by 181 · see citing works
The Centrality of Metrical Structure in Signaling Information Structure: A Probabilistic Perspective
Calhoun, S. (2010) · Language · doi:10.1353/lan.0.0197 · Cited by 176 · see citing works
Human Sensorimotor Communication: A Theory of Signaling in Online Social Interactions
Pezzulo, G., Donnarumma, F., & Dindo, H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079876 · Cited by 176 · see citing works
Tools from evolutionary biology shed new light on the diversification of languages
Levinson, S. C., & Gray, R. D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.01.007 · Cited by 174 · see citing works
The Role of L1 Transfer in the Interpretation of Articles with Definite Plurals in L2 English
Ionin, T., & Montrul, S. (2010) · Language Learning · doi:10.1111/j.1467-9922.2010.00577.x · Cited by 166 · see citing works
Statistical learning in typically developing children: the role of age and speed of stimulus presentation.
Arciuli, J., & Simpson, I. C. (2011) · Developmental Science · doi:10.1111/j.1467-7687.2009.00937.x · Cited by 181 · see citing works
What you learn is what you see: using eye movements to study infant cross‐situational word learning
Yu, C., & Smith, L. B. (2010) · Developmental Science · doi:10.1111/j.1467-7687.2010.00958.x · Cited by 161 · see citing works
AN EMERGENTIST PERSPECTIVE ON HERITAGE LANGUAGE ACQUISITION
O'Grady, W. D., Kwak, H.-Y., Lee, O.-S., & Lee, M. (2011) · Studies in Second Language Acquisition · doi:10.1017/s0272263110000744 · Cited by 150 · see citing works
Cognitive Neuroscience of Natural Language Use
Kristensen, L. B., & Wallentin, M. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781107323667 · Cited by 142 · see citing works
Optimizing the Input: Frequency and Sampling in Usage‐Based and Form‐Focused Learning
Ellis, N. C. (2009) · doi:10.1002/9781444315783.ch9 · Cited by 132 · see citing works
Bayesian models of cognition
Nick Chater, A., Oaksford, M., Hahn, U., & Heit, E. (2010) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.79 · Cited by 129 · see citing works
Frequency in Language
Divjak, D. (2019) · Elsevier eBooks · doi:10.1016/b978-0-323-95504-1.01134-0 · Cited by 132 · see citing works
Bayesian networks, Bayesian learning and cognitive development
Alison Gopnik, C., & Tenenbaum, J. B. (2007) · Developmental Science · doi:10.1111/j.1467-7687.2007.00584.x · Cited by 128 · see citing works
Bayesian intractability is not an ailment that approximation can cure
Kwisthout, J., Wareham, T., & van Rooij, I. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01182.x · Cited by 122 · see citing works
Bayes and Blickets: Effects of Knowledge on Causal Induction in Children and Adults
Griffiths, T. L., Sobel, D. M., Tenenbaum, J. B., & Alison Gopnik, C. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01203.x · Cited by 117 · see citing works
Harmonic biases in child learners: In support of language universals
Culbertson, J., & Newport, E. (2015) · Cognition · doi:10.1016/j.cognition.2015.02.007 · Cited by 101 · see citing works
Frequency in Language
Divjak, D. (2019) · doi:10.1017/9781316084410 · Cited by 83 · see citing works
Probabilistic Semantics and Pragmatics Uncertainty in Language and Thought
Goodman, N. D., & Lassiter, D. (2015) · Wiley eBooks · doi:10.1002/9781118882139.ch21 · Cited by 115 · see citing works
A Hierarchical Generative Framework of Language Processing: Linking Language Perception, Interpretation, and Production Abnormalities in Schizophrenia
Brown, M., & Kuperberg, G. R. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00643 · Cited by 108 · see citing works
Composition is the Core Driver of the Language-selective Network
Mollica, F., Diachek, E., Mineroff, Z., Kean, H., Siegelman, M., Piantadosi, S. T., Futrell, R., Qian, P., & Fedorenko, E. G. (2020) · Neurobiology of Language · doi:10.1162/nol_a_00005 · Cited by 108 · see citing works
The emergentist program
O'Grady, W. D. (2007) · Lingua · doi:10.1016/j.lingua.2006.12.001 · Cited by 105 · see citing works
Perception and hierarchical dynamics
Kiebel, S. J. (2009) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.020.2009 · Cited by 106 · see citing works
Cognitive Science: An Introduction to the Science of the Mind
Bermúdez, J. L. (2020) · Cited by 98 · see citing works
Faster Teaching via POMDP Planning
Rafferty, A. N., Brunskill, E., Griffiths, T. L., & Shafto, P. (2015) · Cognitive Science · doi:10.1111/cogs.12290 · Cited by 97 · see citing works
The Bayesian sampler: Generic Bayesian inference causes incoherence in human probability judgments.
Zhu, J.-Q., Sanborn, A. N., & Nick Chater, A. (2020) · Psychological Review · doi:10.1037/rev0000190 · Cited by 95 · see citing works
Exploring social-indexical knowledge: A long past but a short history
Foulkes, P. (2010) · Laboratory Phonology Journal of the Association for Laboratory Phonology · doi:10.1515/labphon.2010.003 · Cited by 91 · see citing works
Optimality and heuristics in perceptual neuroscience
Gardner, J. L. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0340-4 · Cited by 89 · see citing works
Learning Abstract Concept Embeddings from Multi-Modal Data: Since You Probably Can't See What I Mean
Hill, F., & Korhonen, A. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1032 · Cited by 87 · see citing works
What’s in a name? Intolerance of uncertainty, other uncertainty-relevant constructs, and their differential relations to worry and generalized anxiety disorder*
Koerner, N., Mejia, T., & Kusec, A. (2017) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1211172 · Cited by 81 · see citing works
Faster Teaching by POMDP Planning
Rafferty, A. N., Brunskill, E., Griffiths, T. L., & Shafto, P. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21869-9_37 · Cited by 83 · see citing works
Constructing grammar: a computational model of the emergence of early constructions
Feldman, J. A., & Chang, N. (2008) · Cited by 80 · see citing works
Building machines that learn and think with people
Collins, K. M., Sucholutsky, I., Bhatt, U., Chandra, K., Wong, L., Lee, M., Zhang, C. E., Zhi‐Xuan, T., Ho, M. K., Mansinghka, V. K., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01991-9 · Cited by 93 · see citing works
Natural frequencies improve Bayesian reasoning in simple and complex inference tasks
Hoffrage, U., Krauß, S., Martignon, L. F., & Gigerenzer, G. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01473 · Cited by 79 · see citing works
Comparisons Inform Me Who I Am: A General Comparative-Processing Model of Self-Perception
Nexhmedin Morina, B. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620966788 · Cited by 73 · see citing works
Mind, rationality, and cognition: An interdisciplinary debate
Nick Chater, A., Felin, T., Funder, D. C., Gigerenzer, G., Koenderink, J. J., Krueger, J. I., Noble, D., Nordli, S. A., Oaksford, M., Schwartz, B. N., et al. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1333-5 · Cited by 80 · see citing works
Chinese Kindergartners Learn to Read Characters Analytically
Yin, L., & McBride, C. A. (2015) · Psychological Science · doi:10.1177/0956797614567203 · Cited by 77 · see citing works
The anchor integration model: A descriptive model of anchoring effects
Turner, B. M., & Schley, D. R. (2016) · Cognitive Psychology · doi:10.1016/j.cogpsych.2016.07.003 · Cited by 76 · see citing works
A Probabilistic Model of Semantic Plausibility in Sentence Processing
Padó, U., Crocker, M. W., & Keller, F. (2009) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01033.x · Cited by 75 · see citing works
The illusion of language acquisition
O'Grady, W. D. (2013) · Linguistic Approaches to Bilingualism · doi:10.1075/lab.3.3.01ogr · Cited by 74 · see citing works
Using Category Structures to Test Iterated Learning as a Method for Identifying Inductive Biases
Griffiths, T. L., Christian, B., & Kalish, M. L. (2008) · Cognitive Science · doi:10.1080/03640210701801974 · Cited by 70 · see citing works
Pour une phonologie de corpus
Laks, B. (2008) · Journal of French Language Studies · doi:10.1017/s0959269507003146 · Cited by 69 · see citing works
Contribution of language studies to the understanding of cognitive impairment and its progression over time in Parkinson’s disease
Auclair‐Ouellet, N., LIEBERMAN, P. H., & Monchi, O. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.07.014 · Cited by 69 · see citing works
Modeling language and cognition with deep unsupervised learning: a tutorial overview
Zorzi, M., Testolin, A., & Stoianov, I. P. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00515 · Cited by 67 · see citing works
9. How recursive is language? A Bayesian exploration
Perfors, A., Tenenbaum, J. B., Gibson, E. A. F., & Regier, T. (2010) · Mouton eBooks · doi:10.1515/9783110219258.159 · Cited by 66 · see citing works
Probabilistic Type Theory and Natural Language Semantics
Cooper, R., Dobnik, S., Lappin, S., & Larsson, S. (2015) · Linguistic Issues in Language Technology · doi:10.33011/lilt.v10i.1357 · Cited by 64 · see citing works
Situated sentence processing: The coordinated interplay account and a neurobehavioral model
Crocker, M. W., Knoeferle, P., & Mayberry, M. R. (2009) · Brain and Language · doi:10.1016/j.bandl.2009.03.004 · Cited by 66 · see citing works
Three ideal observer models for rule learning in simple languages.
Frank, M. C., & Tenenbaum, J. (2011) · Cognition · doi:10.1016/j.cognition.2010.10.005 · Cited by 64 · see citing works
Representation of Language
Rey, G. (2020) · doi:10.1093/oso/9780198855637.001.0001 · Cited by 62 · see citing works
Cognitive Biases, Linguistic Universals, and Constraint‐Based Grammar Learning
Culbertson, J., Smolensky, P., & Wilson, C. J. N. (2013) · Topics in Cognitive Science · doi:10.1111/tops.12027 · Cited by 61 · see citing works
The Emergence of Sociophonetic Structure
Foulkes, P., & Hay, J. B. (2015) · doi:10.1002/9781118346136.ch13 · Cited by 61 · see citing works
Sociolinguistic interaction and identity construction: The view from game‐theoretic pragmatics
Burnett, H. (2017) · Journal of Sociolinguistics · doi:10.1111/josl.12229 · Cited by 65 · see citing works
What Computational Linguists Can Learn from Psychologists (and Vice Versa)
Krahmer, E. (2010) · Computational Linguistics · doi:10.1162/coli.2010.36.2.36201 · Cited by 58 · see citing works
Bridging the gap between theory and practice of approximate Bayesian inference
Kwisthout, J., & van Rooij, I. (2013) · Cognitive Systems Research · doi:10.1016/j.cogsys.2012.12.008 · Cited by 56 · see citing works
Usage-based approaches to aphasia
Gahl, S., & Menn, L. (2016) · Aphasiology · doi:10.1080/02687038.2016.1140120 · Cited by 57 · see citing works
The Bayesian boom: good thing or bad?
Hahn, U. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00765 · Cited by 71 · see citing works
Statistical learning is lasting and consistent over time
Arciuli, J., & Simpson, I. C. (2012) · Neuroscience Letters · doi:10.1016/j.neulet.2012.04.045 · Cited by 56 · see citing works
Rule-based and word-level statistics-based processing of language: insights from neuroscience
Ding, N., Melloni, L., Tian, X., & Poeppel, D. (2016) · Language Cognition and Neuroscience · doi:10.1080/23273798.2016.1215477 · Cited by 54 · see citing works
The probabilistic mind:
Nick Chater, A., & Oaksford, M. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199216093.003.0001 · Cited by 53 · see citing works
Why is there variation rather than nothing?
Laks, B. (2013) · Language Sciences · doi:10.1016/j.langsci.2013.02.009 · Cited by 51 · see citing works
Frequency-specific brain dynamics related to prediction during language comprehension
Armeni, K., Willems, R. M., van den Bosch, A. P. J., & Schoffelen, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.04.083 · Cited by 45 · see citing works
Subjective Probability as Sampling Propensity
Icard, T. (2015) · Review of Philosophy and Psychology · doi:10.1007/s13164-015-0283-y · Cited by 50 · see citing works
Connectionist perspectives on language learning, representation and processing
Joanisse, M. F., & McClelland, J. L. (2015) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1340 · Cited by 49 · see citing works
Time perception: The surprising effects of surprising stimuli.
Matthews, W. J. (2014) · Journal of Experimental Psychology General · doi:10.1037/xge0000041 · Cited by 46 · see citing works
Chapter 19. Conclusion: Cognitive Linguistics, Second Language Acquisition and L2 Instruction—Issues for Research
Robinson, P., & Ellis, N. (2008) · Routledge eBooks · doi:10.4324/9780203938560-28 · Cited by 60 · see citing works
Learning Words in Space and Time
Spencer, J. P., Perone, S., Smith, L. B., & Samuelson, L. K. (2011) · Psychological Science · doi:10.1177/0956797611413934 · Cited by 42 · see citing works
Probabilistic models of cognition: where next?
Nick Chater, A., Tenenbaum, J. B., & Yuille, A. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.008 · Cited by 42 · see citing works
Significance testing as perverse probabilistic reasoning
Westover, M. B., Westover, K. D., & Bianchi, M. T. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-20 · Cited by 40 · see citing works

Authors: Chater, N., & Manning, C. D.
Affiliations: Stanford University (US)
Corresponding author: Manning, Christopher D.
ORCID: Manning, Christopher D.
Venue: Trends in Cognitive Sciences
Publisher: Elsevier BV
Published: 2006-07
Volume: 10
Issue: 7
Pages: 335-344
ISSN: 1364-6613 (ISSN-L)
DOI: 10.1016/j.tics.2006.05.006
OpenAlex: W2162693531
Semantic Scholar: c351bcc20d0da75f23daaf20846cad0b93c4f36b
Cited by: 411
References: 90
Citations by year: 2026: 12 · 2025: 9 · 2024: 36 · 2023: 10 · 2022: 12 · 2021: 9 · 2020: 35 · 2019: 53 · 2018: 14 · 2017: 9 · 2016: 21 · 2015: 30 · 2014: 19 · 2013: 18 · 2012: 19
FWCI: 4.10
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Trends in Cognitive Sciences (publishedVersion)
PubMed (publishedVersion)
UCL Discovery (University College London) (submittedVersion)
Funders: Economic and Social Research Council (RES-538-28-1001)
Topics: Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
Keywords: probabilistic models, language acquisition, language comprehension, language production, probabilistic inference, symbolic models, poverty of the stimulus, ambiguity resolution, categorization, online corpora
MeSH terms: Brain, Cognition, Concept Formation, Humans, Language Development, Phonetics, Probability Theory, Psycholinguistics, Reading, Semantics, Speech Perception, Models, Statistical, Comprehension, Uncertainty

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Probabilistic models of language processing and acquisition

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks