Distributional Information: A Powerful Cue for Acquiring Syntactic Categories
Open accessThe DOI matches its Crossref record; 101 of the 103 references it cites were found in a registry or an index.
Abstract
Many theorists have dismissed a priori the idea that distributional information could play a significant role in syntactic category acquisition. We demonstrate empirically that such information provides a powerful cue to syntactic category membership, which can be exploited by a variety of simple, psychologically plausible mechanisms. We present a range of results using a large corpus of child‐directed speech and explore their psychological implications. While our results show that a considerable amount of information concerning the syntactic categories can be obtained from distributional information alone, we stress that many other sources of information may also be potential contributors to the identification of syntactic classes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Such distributional information can be potent in the acquisition of both the grammatical and the semantic properties of the slot-filler (Elman, 1990;Redington, Chater, & Finch, 1998).”
From Effects of Availability, Contingency, and Formulaicity on the Accuracy of English Grammatical Morphemes in Second Language Writing (2022) · cites this paper as Redington, Chater, & Finch, 1998
Citations
Cites
ASPECTS OF THE THEORY OF SYNTAX
Chomsky, N. (1964) · doi:10.21236/ad0616323 · Cited by 13,587
- STATISTICAL PACKAGE FOR SOCIAL SCIENCES
(2014) · Statistical Methods in Psychiatry Research and SPSS · doi:10.1201/b17560-26 · Cited by 12,056
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Chomsky (1959) · doi:10.2307/411334 · Cited by 3,425
Principles of Numerical Taxonomy
(2013) · Personality Structure and Measurement (Psychology Revivals) · doi:10.4324/9780203766804-11 · Cited by 2,990
Smith, T. L., & Chomsky, N. (1982) · The Philosophical Review · doi:10.2307/2184681 · Cited by 2,808
Chomsky, N. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00001515 · Cited by 2,650
Cognitive Development and Acquisition of Language
(1973) · Elsevier eBooks · doi:10.1016/c2009-0-22101-5 · Cited by 2,193
Learning and development in neural networks: the importance of starting small
Elman, J. L. (1993) · Cognition · doi:10.1016/0010-0277(93)90058-4 · Cited by 1,988
Advances in Neural Information Processing Systems 5
Zemel, R. S., Williams, C. K. I., & Mozer, M. C. (1993) · Cited by 1,896
Language Learnability and Language Development
Bialystok, E., & Pinker, S. (1986) · The Modern Language Journal · doi:10.2307/327334 · Cited by 1,816
Producing high-dimensional semantic spaces from lexical co-occurrence
Lund, K., & Burgess, C. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204766 · Cited by 1,811
The Structural Sources of Verb Meanings
Gleitman, L. (1990) · Language Acquisition · doi:10.1207/s15327817la0101_2 · Cited by 1,783
Language Learnability and Language Development
Pye, C., & Pinker, S. (1985) · Language · doi:10.2307/414499 · Cited by 1,665
Talking to Children: Language Input and Acquisition
Farwell, C. B., Snow, C. E., & Ferguson, C. A. (1979) · Language · doi:10.2307/412603 · Cited by 1,574
Current Issues in Linguistic Theory
Chomsky, N. (1975) · Mouton eBooks · doi:10.1515/9783110867565 · Cited by 1,532
The ontogenesis of speech acts
Bruner, J. S. (1975) · Journal of Child Language · doi:10.1017/s0305000900000866 · Cited by 1,474
Studies of child language development
Ferguson, C. A., & Slobin, D. I. (1973) · Max Planck Digital Library · Cited by 1,370
Distributed representations, simple recurrent networks, and grammatical structure
Elman, J. L. (1991) · Machine Learning · doi:10.1007/bf00114844 · Cited by 1,354
MOTHERS' SPEECH TO CHILDREN LEARNING LANGUAGE
Snow, C. E. (1972) · Child Development · doi:10.1111/j.1467-8624.1972.tb01123.x · Cited by 1,141
Proceedings of the 35th Annual Meeting of the Cognitive Science Society
Culbertson, J., & Wilson, C. (2013) · Cited by 1,139
Infants′ Detection of the Sound Patterns of Words in Fluent Speech
Jusczyk, P. W., & Aslin, R. N. (1995) · Cognitive Psychology · doi:10.1006/cogp.1995.1010 · Cited by 1,061
Linguistic Categorization: Prototypes in Linguistic Theory
Taylor, J. R. (1989) · Cited by 1,052
Infants' Preference for the Predominant Stress Patterns of English Words
Jusczyk, P. W., Cutler, A., & Redanz, N. J. (1993) · Child Development · doi:10.1111/j.1467-8624.1993.tb02935.x · Cited by 982
Infants' Preference for the Predominant Stress Patterns of English Words
Jusczyk, P. W., Cutler, A., & Redanz, N. J. (1993) · Child Development · doi:10.2307/1131210 · Cited by 981
A stochastic parts program and noun phrase parser for unrestricted text
Church, K. W. (1988) · Proceedings of the second conference on Applied natural language processing - · doi:10.3115/974235.974260 · Cited by 957
The Discovery of Spoken Language
Jusczyk, P. W. (2000) · The MIT Press eBooks · doi:10.7551/mitpress/2447.001.0001 · Cited by 936
Principles of Numerical Taxonomy
Long, C. A., Sokal, R. R., & Sneath, P. H. A. (1965) · Journal of Mammalogy · doi:10.2307/1377831 · Cited by 927
Transformational Grammar: A First Course
Radford, A. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511840425 · Cited by 878
The child language data exchange system
MacWhinney, B., & Snow, C. (1985) · Journal of Child Language · doi:10.1017/s0305000900006449 · Cited by 861
First Verbs: A Case Study of Early Grammatical Development
Tomasello, M. (1992) · Cambridge University Press eBooks · doi:10.1017/cbo9780511527678 · Cited by 837
Eugene Charniak, D. (1994) · Medical Entomology and Zoology · Cited by 811
The Logical Problem of Language Acquisition
Culicover, P. W., Baker, C. L., & McCarthy, J. J. (1984) · Language · doi:10.2307/414192 · Cited by 762
The Psycho-Biology of Language
Tinker, M. A., & Zipf, G. K. (1936) · The American Journal of Psychology · doi:10.2307/1415586 · Cited by 728
Joos, M. (1936) · Language · doi:10.1017/408930 · Cited by 726
Moore, R. K. (1986) · Cited by 628
Linguistics: The Cambridge Survey
(1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620577 · Cited by 627
Ritter, H., & Kohonen, T. (1989) · Biological Cybernetics · doi:10.1007/bf00203171 · Cited by 621
Statistical Inference Based on Ranks
Hora, S. C., & Hettmansperger, T. P. (1986) · Technometrics · doi:10.2307/1270456 · Cited by 613
Developmental and stylistic variation in the composition of early vocabulary
Bates, E., Marchman, V., Thal, D., Fenson, L., Dale, P., Reznick, J. S., Reilly, J., & Hartung, J. (1994) · Journal of Child Language · doi:10.1017/s0305000900008680 · Cited by 559
Clauses are perceptual units for young infants
Hirsh-Pasek, K., Kemler Nelson, D. G., Jusczyk, P. W., Cassidy, K. W., Druss, B., & Kennedy, L. (1987) · Cognition · doi:10.1016/s0010-0277(87)80002-1 · Cited by 551
Mother, Id rather do it myself: Some effects and non-effects of maternal speech style
Newport, E. L., Gleitman, H., & Gleitman, L. R. (1977) · Cited by 550
Distributional regularity and phonotactic constraints are useful for segmentation
Brent, M. R., & Cartwright, T. A. (1996) · Cognition · doi:10.1016/s0010-0277(96)00719-6 · Cited by 514 · cited 1×
“The first, derived from signal detection theory, is becoming standard in this area (Brent & Cartwright, 1997; Christiansen, Allen & Seidenberg, in press).”
BackgroundFernald, A. (1992) · The Adapted Mind · doi:10.1093/oso/9780195060232.003.0011 · Cited by 493
A Corpus of English Conversation
Svartvik, J., & Quirk, R. (1980) · Medical Entomology and Zoology · Cited by 464
Finite State Automata and Simple Recurrent Networks
Cleeremans, A., Servan-Schreiber, D., & McClelland, J. L. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.372 · Cited by 458
The Discovery of Spoken Language
Demuth, K. (1998) · Language and Speech · doi:10.1177/002383099804100106 · Cited by 433
The Child's Construction of Language
Deutsch, W., & der Wissenschaften, M.-P.-G. Z. F. (1982) · Cited by 424
Robust part-of-speech tagging using a hidden Markov model
Kupiec, J. (1992) · Computer Speech & Language · doi:10.1016/0885-2308(92)90019-z · Cited by 416
Toward a connectionist model of recursion in human linguistic performance
Christiansen, M. (1999) · Cognitive Science · doi:10.1016/s0364-0213(99)00003-8 · Cited by 406
Self-citationStatistical Language Learning.
SW, & Charniak, E. (1994) · Journal of the American Statistical Association · doi:10.2307/2291039 · Cited by 365
Learning to Segment Speech Using Multiple Cues: A Connectionist Model
Christiansen, M. H., Allen, J., & Seidenberg, M. S. (1998) · Language and Cognitive Processes · doi:10.1080/016909698386528 · Cited by 356
Using sound to solve syntactic problems: The role of phonology in grammatical category assignments.
Kelly, M. H. (1992) · Psychological Review · doi:10.1037//0033-295x.99.2.349 · Cited by 322
Fries, C. C. (1952) · MPG.PuRe (Max Planck Society) · Cited by 319
Harris, Z. S. (1970) · Papers in Structural and Transformational Linguistics · doi:10.1007/978-94-017-6059-1_2 · Cited by 300
Facilitating children's syntax acquisition.
Nelson, K. E. (1977) · Developmental Psychology · doi:10.1037//0012-1649.13.2.101 · Cited by 261
Harris, Z. S. (1955) · Language · doi:10.2307/411036 · Cited by 256 · cited 2×
“These procedures were useful heuristic guides rather than algorithms (though see Harris, 1955).”
MethodThe verbal environment of the language-learning child
Broen, P. A. (1972) · Medical Entomology and Zoology · Cited by 246
Maratsos, M. P. (1980) · Medical Entomology and Zoology · Cited by 245
Mechanisms of Implicit Learning: Connectionist Models of Sequence Processing
Cleeremans, A. (1993) · The MIT Press eBooks · doi:10.7551/mitpress/4528.001.0001 · Cited by 231
The Computational Analysis of English: A Corpus-Based Approach
Francis, W. N., Garside, R., Leech, G., & Sampson, G. (1989) · Language · doi:10.2307/415358 · Cited by 216
The Computational Analysis of English: A Corpus-Based Approach
Chapelle, C., Garside, R., Leech, G., & Sampson, G. (1988) · TESOL Quarterly · doi:10.2307/3587270 · Cited by 211
Schütze, H. (1992) · neural information processing systems · Cited by 205
Cartwright, T. A., & Brent, M. R. (1997) · Cognition · doi:10.1016/s0010-0277(96)00793-7 · Cited by 196
The role of constituent structure in the induction of an artificial language
Morgan, J. L., & Newport, E. L. (1981) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(81)90312-1 · Cited by 188
Language Acquisition : Core Readings
Bloom, P. (1993) · Medical Entomology and Zoology · Cited by 187
Phonological information for grammatical category assignments
Cassidy, K. W., & Kelly, M. H. (1991) · Journal of Memory and Language · doi:10.1016/0749-596x(91)90041-h · Cited by 184
Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society
(2019) · Routledge eBooks · doi:10.4324/9781315789422 · Cited by 184
Kelly, M. H., & Bock, J. K. (1988) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.14.3.389 · Cited by 176
Where learning begins: initial representations for language learning
Gleitman, L. R., Gleitman, H., Landau, B., & Wanner, E. (1988) · Linguistics: The Cambridge Survey · doi:10.1017/cbo9780511621062.007 · Cited by 168
Categories and Processes in Language Acquisition
MacWhinney, B. (1988) · Language and Speech · doi:10.1177/002383098803100407 · Cited by 140
Connectionist models of memory and language
Levy, J. P. (1995) · UCL Press eBooks · Cited by 115
Levy, Y. (1983) · Cognition · doi:10.1016/0010-0277(83)90034-3 · Cited by 112
Bowerman, M. F. (1973) · Elsevier eBooks · doi:10.1016/b978-0-12-505850-6.50015-3 · Cited by 111
Connectionist and Statistical Approaches to Language Acquisition: A Distributional Perspective
Redington, M., & Chater, N. (1998) · Language and Cognitive Processes · doi:10.1080/016909698386500 · Cited by 107
Self-citationOaksford, M., & Brown, G. (1994) · BIROn (Birkbeck, University of London) · Cited by 104
Kelly, M. H., & Bock, J. K. (1988) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.14.3.389 · Cited by 103
Two-Sample Inference Based on One-Sample Sign Statistics
Hettmansperger, T. P. (1984) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347662 · Cited by 94
Deducing linguistic structure from the statistics of large corpora
Brill, E., Magerman, D. M., Marcus, M. P., & Santorini, B. (1990) · DARPA Workshop on Speech and Natural Language (HLT) · doi:10.3115/116580.116670 · Cited by 67
Finch, S. (1995) · ERA · Cited by 60
Self-citationSpeech timing of grammatical categories
Sorensen, J. M., Cooper, W. E., & Paccia, J. M. (1978) · Cognition · doi:10.1016/0010-0277(78)90019-7 · Cited by 58
A psychological investigation of French speakers' skill with grammatical gender
Tucker, G. R., Lambert, W. E., Rigault, A., & Segalowitz, N. S. (1968) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(68)80007-6 · Cited by 55
Probabilistic and distributional approaches to language acquisition
Redington, M., & Chater, N. (1997) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(97)01081-4 · Cited by 55
Self-citationProceedings of the 30th meeting of the Cognitive Science Society
Moat, H. S., Corley, M. M. B., & Hartsuiker, R. J. (2008) · Cited by 55
Language Acquisition Through Language Use: The Functional Sources of Children's Early Utterances
Ninio, A., & Snow, C. E. (2026) · Routledge eBooks · doi:10.4324/9781042010677-2 · Cited by 55
Shillcock, R. C., Lindsey, G., Levy, J., & Chater, N. (1992) · eScholarship (California Digital Library) · Cited by 53
Self-citationThe discovery of segments in natural language
Wolff, J. G. (1977) · British Journal of Psychology · doi:10.1111/j.2044-8295.1977.tb01563.x · Cited by 52
Grammatical Word Classes: A Learning Process and its Simulation
Kiss, G. (1973) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60064-x · Cited by 48
The Verbal Environment of the Language-Learning Child. ASHA Monographs, No. 17.
Broen, P. A. (1972) · Cited by 35
How to get from words to sentences
Maratsos, M. P. (2013) · Taylor and Francis · Cited by 31
Bottom-up connectionist modelling of speech
Cairns, P. A., Shillcock, R. C., Chater, N., & Levy, J. P. (1995) · Cited by 22
Self-citationAn application of cluster detection to text and picture processing
Rosenfeld, A., Huang, H. K., & Schneider, V. B. (1969) · IEEE Transactions on Information Theory · doi:10.1109/tit.1969.1054378 · Cited by 21
Distributional Bootstrapping: From Word Class to Proto-Sentence
Finch, S., & Chater, N. (2019) · Routledge eBooks · doi:10.4324/9781315789354-52 · Cited by 20
Self-citationDiscovering the lexical features of a language
Brill, E. (1991) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/981344.981392 · Cited by 20
Learning ″Semantotopic Maps″ from Context
Ritter, H. J., & Kohonen, T. (1990) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 18
FREQUENCY, CONCEPTUAL STRUCTURE AND PATTERN RECOGNITION
Wolff, J. G. (1976) · British Journal of Psychology · doi:10.1111/j.2044-8295.1976.tb01524.x · Cited by 16
Algebraic learning of statistical associations for language acquisition
Tishby, N., & Gorin, A. L. (1994) · Computer Speech & Language · doi:10.1006/csla.1994.1003 · Cited by 9
Early acquisition of syntactic categories: A formal model
Cartwright, T. A., & Brent, M. R. (1997) · Cited by 7
A statistical analysis of an idealised phonological transcription of the London-Lund corpus
Shillcock, R. C., Hicks, J., Cairns, P. A., Levy, J., & Chater, N. (1995) · Cited by 4
Self-citation
Research works printed but not linked: 27
- Brill E., 1990, DARPA Speech and Natural Language Workshop
- Chater N., 1995, Connectionist Models of Memory and Language, 207
- Chater N., 1992, Proceedings of the 14th Meeting of the Cognitive Science Society, 402
- Conkey P.(1991).Sequence prediction using recurrent neural networks.MSc Thesis Department of Artificial Intelligence University of Edinburgh.
- Finch S. P., 1991, A hybrid approach to the automatic learning of linguistic categories, AISB Quarterly, 78, 16
- Finch S. P., 1992, Proceedings of the 14th Annual Conference of the Cognitive Science Society of America, 820
- Finch S. P., 1993, Neurodynamics and Psychology
- Gleitman L., 1994, Language Acquisition: Core Readings
- Ingram D., 1989, First Language Acquisition: Method, Description & Explanation
- Kuczaj S. A., 1982, Language Development, Volume 1: Syntax and Semantics
- Lehiste I., 1970, Suprasegmentals
- Liberman M., 1977, On the stress and linguistic rhythm, Linguistic Inquiry, 8, 249
- MacWhinney B., 1989, The CHILDES Project: Computational Tools for Analyzing Talk
- Maratsos M., 1979, Perspectives in Psycholinguistics
- Maratsos M., 1988, Categories and Processes in Language Acquisition
- Maratsos M., 1980, Children's Language
- Marcus M., 1991, Proceedings of the 1991 Spring Symposium on the Machine Learning of Natural Language and Ontology
- Mintz T. H., 1995, Proceedings of the 25th Annual Meeting of the North Eastern Linguistics Society
- Ninio A., 1988, Categories and Processes in Language Acquisition
- Redington F. M., 1993, Proceedings of the 15th Annual Meeting of the Cognitive Science Society, 848
- Schlesinger I. M., 1988, Categories and Processes in Language Acquisition
- Scholtes J. C.(1991a).Kohonen's self‐organising map applied towards natural language processing.Proceedings of the CUNY 1991 Conference on Human Sentence Processing.
- Scholtes J. C.(1991b).Using extended feature maps in a language acquisition model.Proceedings of the 2nd Australian Conference on Neural Networks.
- Shillcock R. C., 1992, Proceedings of the 14th Annual Meeting of the Cognitive Science Society, 408
- Snow C. E., 1988, The Emergent Lexicon
- Weckerly J., 1992, Proceedings of the 14th Meeting of the Cognitive Science Society, 414
- Wolff J. G., 1988, Categories and Processes in Language Acquisition
Cited by
Topics in semantic representation
Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.211 · Cited by 1,122
“The model performs about as well as a standard hidden Markov model—which is a state-of-the-art method—at identifying syntactic classes, and it outperforms distributional clustering (Redington et al., 1998) in this task (Griffiths et al.”
MethodWord learning as Bayesian inference.
Xu, F., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.245 · Cited by 1,033
“Regier (2003) suggested an alternative way in which mutual exclusivity could enter into a Bayesian analysis, via an alternative formulation of the likelihood.”
BackgroundChang, F., Dell, G. S., & Bock, K. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.234 · Cited by 984
Extracting semantic representations from word co-occurrence statistics: A computational study
Bullinaria, J. A., & Levy, J. P. (2007) · Behavior Research Methods · doi:10.3758/bf03193020 · Cited by 805
“This work was continued by Redington, Chater & Finch (1998) using the CHILDES corpus of child-directed speech.”
MethodThe Now-or-Never bottleneck: A fundamental constraint on language
Christiansen, M. H., & Chater, N. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1500031x · Cited by 733
Self-citation
Metadata
- Authors
- Redington, M., Chater, N., & Finch, S.
- Affiliations
- University of Warwick (GB)
- Corresponding author
- Redington, Martin
- ORCID
- Chater, Nick
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 1998-10
- Volume
- 22
- Issue
- 4
- Pages
- 425-469
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W2051123508
- Semantic Scholar
- fd63e4f9e2497daa2c6a3f6b08445c2ef69fa901
- Cited by
- 535
- References
- 103
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 10 · 2023: 8 · 2022: 29 · 2021: 13 · 2020: 16 · 2019: 29 · 2018: 16 · 2017: 19 · 2016: 24 · 2015: 21 · 2014: 17 · 2013: 16 · 2012: 61
- FWCI
- 12.94
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cognitive Science (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- University of Warwick
- University of California, San Diego
- Economic and Social Research Council
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Keywords
- distributional information, child-directed speech, syntactic bootstrapping, syntactic categories, language acquisition, distributional cues
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.