Distributional Information: A Powerful Cue for Acquiring Syntactic Categories
Open accessThe DOI matches its Crossref record; 101 of the 103 references it cites were found in a registry or an index.
Abstract
Many theorists have dismissed a priori the idea that distributional information could play a significant role in syntactic category acquisition. We demonstrate empirically that such information provides a powerful cue to syntactic category membership, which can be exploited by a variety of simple, psychologically plausible mechanisms. We present a range of results using a large corpus of child‐directed speech and explore their psychological implications. While our results show that a considerable amount of information concerning the syntactic categories can be obtained from distributional information alone, we stress that many other sources of information may also be potential contributors to the identification of syntactic classes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Such distributional information can be potent in the acquisition of both the grammatical and the semantic properties of the slot-filler (Elman, 1990;Redington, Chater, & Finch, 1998).”
From Effects of Availability, Contingency, and Formulaicity on the Accuracy of English Grammatical Morphemes in Second Language Writing (2022) · cites this paper as Redington, Chater, & Finch, 1998
Citations
Cites
ASPECTS OF THE THEORY OF SYNTAX
Chomsky, N. (1964) · doi:10.21236/ad0616323 · Cited by 13,587
- STATISTICAL PACKAGE FOR SOCIAL SCIENCES
(2014) · Statistical Methods in Psychiatry Research and SPSS · doi:10.1201/b17560-26 · Cited by 12,056
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Chomsky (1959) · doi:10.2307/411334 · Cited by 3,425
Principles of Numerical Taxonomy
(2013) · Personality Structure and Measurement (Psychology Revivals) · doi:10.4324/9780203766804-11 · Cited by 2,990
Smith, T. L., & Chomsky, N. (1982) · The Philosophical Review · doi:10.2307/2184681 · Cited by 2,808
Chomsky, N. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00001515 · Cited by 2,650
Cognitive Development and Acquisition of Language
(1973) · Elsevier eBooks · doi:10.1016/c2009-0-22101-5 · Cited by 2,193
Learning and development in neural networks: the importance of starting small
Elman, J. L. (1993) · Cognition · doi:10.1016/0010-0277(93)90058-4 · Cited by 1,988
Research works printed but not linked: 27
- Brill E., 1990, DARPA Speech and Natural Language Workshop
- Chater N., 1995, Connectionist Models of Memory and Language, 207
- Chater N., 1992, Proceedings of the 14th Meeting of the Cognitive Science Society, 402
- Conkey P.(1991).Sequence prediction using recurrent neural networks.MSc Thesis Department of Artificial Intelligence University of Edinburgh.
- Finch S. P., 1991, A hybrid approach to the automatic learning of linguistic categories, AISB Quarterly, 78, 16
- Finch S. P., 1992, Proceedings of the 14th Annual Conference of the Cognitive Science Society of America, 820
- Finch S. P., 1993, Neurodynamics and Psychology
- Gleitman L., 1994, Language Acquisition: Core Readings
- Ingram D., 1989, First Language Acquisition: Method, Description & Explanation
- Kuczaj S. A., 1982, Language Development, Volume 1: Syntax and Semantics
- Lehiste I., 1970, Suprasegmentals
- Liberman M., 1977, On the stress and linguistic rhythm, Linguistic Inquiry, 8, 249
- MacWhinney B., 1989, The CHILDES Project: Computational Tools for Analyzing Talk
- Maratsos M., 1979, Perspectives in Psycholinguistics
- Maratsos M., 1988, Categories and Processes in Language Acquisition
- Maratsos M., 1980, Children's Language
- Marcus M., 1991, Proceedings of the 1991 Spring Symposium on the Machine Learning of Natural Language and Ontology
- Mintz T. H., 1995, Proceedings of the 25th Annual Meeting of the North Eastern Linguistics Society
- Ninio A., 1988, Categories and Processes in Language Acquisition
- Redington F. M., 1993, Proceedings of the 15th Annual Meeting of the Cognitive Science Society, 848
- Schlesinger I. M., 1988, Categories and Processes in Language Acquisition
- Scholtes J. C.(1991a).Kohonen's self‐organising map applied towards natural language processing.Proceedings of the CUNY 1991 Conference on Human Sentence Processing.
- Scholtes J. C.(1991b).Using extended feature maps in a language acquisition model.Proceedings of the 2nd Australian Conference on Neural Networks.
- Shillcock R. C., 1992, Proceedings of the 14th Annual Meeting of the Cognitive Science Society, 408
- Snow C. E., 1988, The Emergent Lexicon
- Weckerly J., 1992, Proceedings of the 14th Meeting of the Cognitive Science Society, 414
- Wolff J. G., 1988, Categories and Processes in Language Acquisition
Cited by
Items 401–500 of 522
Types of Negative Concord systems
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0004 · Cited by 1
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0017 · Cited by 1
Huebner, P. A., & Willits, J. A. (2023) · Machine Learning with Applications · doi:10.1016/j.mlwa.2023.100478 · Cited by 3
chapter 5 Evolingo The Nature of the Language Faculty
HAUSER, M. D. (2009) · Oxford University Press eBooks · doi:10.1093/oso/9780199544660.003.0006 · Cited by 7
Chapter 15Innate Learning and Beyond
Gelman, R. (2009) · Oxford University Press eBooks · doi:10.1093/oso/9780199544660.003.0018 · Cited by 1
chapter 13 The Brain Differentiates Hierarchical and Probabilistic Grammars
Friederici, A. D. (2009) · Oxford University Press eBooks · doi:10.1093/oso/9780199544660.003.0015 · Cited by 1
Child-Directed Speech in Noise: Testing Signal- and Code-Based Phonetic Enhancement
Smith, N. A., Hammans, C. A., Vallier, T. J., & McMurray, B. (2023) · Journal of Speech Language and Hearing Research · doi:10.1044/2023_jslhr-23-00033 · Cited by 4
Linguistic markedness and category learning
Haskell, T. R., Mansfield, C. D., & Brewer, K. M. (2010) · Language and Cognitive Processes · doi:10.1080/01690965.2010.503438 · Cited by 1
“Similarly, researchers investigating the learning of grammatical categories have appealed to statistical category learning mechanisms that could also be applied to other sorts of categories (e.g., Cartwright & Brent, 1997; Redington et al., 1998).”
BackgroundSyntactic Category Learning as Iterative Prototype-Driven Clustering
Kodner, J. (2018) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/r5tq5zq4 · Cited by 1
“This is an implicit assumption of n-gram tagging models (Clark, 2003; Brown et al., 1992) for POS tagging, and the feasibility of distributional contexts for distinguishing between syntactic categories has been explicitly studied in cognitive (Redington et al., 1998).”
BackgroundMethodCognitive Processes and Language Use
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.003 · Cited by 1
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0013 · Cited by 1
Drienkó, L. (2024) · Linguistics Beyond and Within (LingBaW) · doi:10.31743/lingbaw.18008 · Cited by 3
“Kiss (1973) introduced a word categorisation model using cluster analysis, expanded by Redington et al. (1998).”
Categorizing local contexts as a step in grammatical category induction
Dickinson, M., & Jochim, C. (2009) · doi:10.3115/1572461.1572468 · Cited by 1
“In human category acquisition, the immediate lo-cal context of a word has proven to be a reliable indicator of its grammatical category, or part of speech (e.g., Mintz, 2002, 2003; Redington et al., 1998).”
BackgroundSimulating the Noun-Verb Asymmetry in the Productivity of Children's Speech
Freudenthal, D., Pine, J. M., & Gobet, F. R. (2007) · Brunel University Research Archive (BURA) (Brunel University London) · Cited by 1
Towards a Quatitative Corpus-based Evaluation Measure for Syntactic Theories
Chang, F., Lieven, E., & Tomasello, M. (2005) · eScholarship (California Digital Library) · Cited by 1
Does kinship terminology provide evidence for or against universal grammar?
Behme, C. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10001913 · Cited by 1
Natural Sampling of Stimuli in (Artificial) Grammar Learning
Poletiek, F. H. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511614576.018 · Cited by 1
Discovering Syntactic Hierarchies
Savova, V., Roy, D. M., Schmidt, L. A., et al. (2007) · eScholarship (California Digital Library) · Cited by 1
Thacker, J. M. (2018) · Libraries and Cultural Resources (University of Calgary) · doi:10.11575/prism/34517 · Cited by 1
Lidz, J. L., & Perkins, L. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn403 · Cited by 7
Artificial Language LearningPreprint
Culbertson, J. (2023) · doi:10.31234/osf.io/vg4mk · Cited by 1
Exploring The Facilitating Effect Of Diminutives On The Acquisition of Serbian Noun Morphology
Ševa, N. (2006) · Stirling Online Research Repository (University of Stirling) · Cited by 5
Dillon, D. (2008) · ResearchOnline at James Cook University (James Cook University) · doi:10.25903/ag1p-tb39
An extension and implementation of a computational theory of language
Arunachalam, T. (2011) · Tuwhera (Auckland University of Technology)
Unsupervised Syntactic Category Learning from Child-Directed Speech
Wichrowska, O. N. (2010) · DSpace@MIT (Massachusetts Institute of Technology)
Grammatical categories and the nature-nurture debate
Feijóo, S. (2011) · Rivista Italiana di Filosofia del Linguaggio · doi:10.4396/93
Simple recurrent networks and random indexing
Sakurai, A., & Hyodo, D. (2004) · International Conference on Neural Information Processing · doi:10.1109/iconip.2002.1202126
Bayesian models of syntactic category acquisition
Frank, S. (2013) · ERA
A self-organizing two-stream model of language comprehension
Negishi, M., Bullock, D., & Cohen, M. M. (2003) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1999.831503
“[16] showed that distribution analysis can be used to self-organize syntactic categories from a corpus of children-directed speech.”
BackgroundGraph-based model for lexical category acquisition
Zhang, B., Wang, X., & Fang, G. (2012) · doi:10.1109/isra.2012.6219167
“Grouping of words into categories is useful and can serve as the starting step in many applications, such as word prediction, parsing, syntax acquisition, construction of thesauri, ontology en-hancement, discovery of verb sub-categorization frames, etc.”
BackgroundLexical category based computational model of syntax acquisition
Zhang, B., & Wang, X. (2012) · IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC) · doi:10.1109/icnidc.2012.6418833
The SOC framework and short-term memory
Murray, D. J. (2002) · Behavioral and Brain Sciences · doi:10.1017/s0140525x02400064
Is syntax a representation in itself?
Rivera‐Gaxiola, M., & Silva‐Pereyra, J. (2002) · Behavioral and Brain Sciences · doi:10.1017/s0140525x02450066
Dirichlet Process Mixture Models for lexical category acquisition
Zhang, B., Wang, X., & Fang, G. (2011) · IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS) · doi:10.1109/ccis.2011.6045045
Bell, P. (2012) · Spectrum Research Repository (Concordia University) · Cited by 1
Computational Modeling of Various Cognitive Functionalities and Domains
Sun, R. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816772.010
Semi-supervised Incremental Model for Lexical Category Acquisition
Zhang, B., & Wang, X. (2012) · Advances in intelligent systems and computing · doi:10.1007/978-3-642-33030-8_12
Acquisition of functional categories
Wang, H. (2012) · University of Southern California Digital Library · doi:10.25549/usctheses-c3-80709 · Cited by 2
Stenquist, N. A. (2015) · ScholarsArchive (Brigham Young University) · Cited by 2
Characterizing the Difference Between Learning about Adjacent and Non-adjacent Dependencies.
Wang, F., & Mintz, T. H. (2015) · Cognitive Science
Schema Theorem in Language Acquisition: A Rags to Riches Story
McLennan, S., Lunch, L., & Theorem, S. (2000)
Modeling cultural evolution Language acquisition as multiple-cue integration
Christiansen, M. H. (2013)
Yatbaz, M. A., Cirik, V., Küntay, A. C., & Yüret, D. (2016) · International Conference on Computational Linguistics
Assessing the Efficacy of Transitional Probabilities for Learning Syntactic Categories
Conwell, E., & Balas, B. (2007) · eScholarship (California Digital Library)
Using Linguistic Knowledge to Automatically Learn Monotonicity Properties
Morales, M. R. (2016) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Systemic systematic functional grammar and the study of Meaning
Caffarel, A. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199544004.013.0031 · Cited by 2
Abbas, J. M. (2017) · European Journal of Language and Literature · doi:10.26417/15gma849
Distributional learning and lexical category acquisition: What makes words easy to categorize?
Cassani, G., Grimm, R., Gillis, S. A., & Daelemans, W. M. P. (2017) · eScholarship (California Digital Library)
Nouvelles technologies et standards méthodologiques en linguistique
Kilani-Schoch, M., Surcouf, C., & Xanthos, A. (2016) · Cahiers du Centre de Linguistique et des Sciences du Langage · doi:10.26034/la.cdclsl.2016.503
Cross-linguistically Small World Networks are Ubiquitous in Child-directed Speech
Moran, S., Pajovic, D., & Stoll, S. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4zy5yfaceff7
Prefabricated input in language acquisition: the syntax of storybooks
Breustedt, B. (2008) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-5489
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.004
Lester, N., Bickel, B., Moran, S., & Stoll, S. (2019) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-186985
Saviciute, E. (2020) · University of Liverpool · doi:10.17638/03086113 · Cited by 2
Categorial Type Logic meets Dependency Grammar to annotate an Italian corpus
Bernardi, R., Bolognesi, A., Tamburini, F., et al. (2004) · Institutional Research Information System (Università degli Studi di Trento)
Learning Pronoun Case from Distributional Cues: Flexible Frames for Case Acquisition
Ma, X., Chodorow, M. S., & Valian, V. V. (2020) · Workshop on Cognitive Modeling and Computational Linguistics (CMCL) · doi:10.18653/v1/2020.cmcl-1.9 · Cited by 1
“Redington et al. (1998) demonstrated that the context of a target word, including the previous words and following words, can be used to cluster the target word into different grammatical categories.”
BackgroundExploring recurrent frames in written Chinese
Hsu, C.-C. (2020) · Corpora · doi:10.3366/cor.2020.0201
Argument Structure and Linguistic Productivity
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.007
A Dynamic Network Model of Parts of Speech
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.008 · Cited by 1
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.002 · Cited by 1
Encoding Asymmetries of Grammatical Categories
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.011
Syntactic Coherence in Word Embedding Spaces
Ravindran, R. P., & Murthy, K. N. (2021) · International Journal of Semantic Computing · doi:10.1142/s1793351x21500057
Cluster damage robustness analysis and space independent community detection in complex networks
Gegov, E. (2012) · Brunel University Research Archive (BURA) (Brunel University London)
Word Learning by Adults with Learning Disability: Effect of Grammatical Class.
Bahl, M. (2010) · UA Campus Repository (The University of Arizona)
(2010) · Wiley eBooks · doi:10.1002/9781444324044.refs
Semantic Similarity and Paraphrase Identification for Malayalam Using Deep Autoencoders
Praveena, R., Kumar, M. A., & Soman, K. P. (2021) · Signals and communication technology · doi:10.1007/978-3-030-79778-2_5
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.016
(2016) · Language Learning · doi:10.1111/lang.11_12177
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.015
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.001
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.013
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.009
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.010
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.005 · Cited by 1
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.012
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.006
Diessel, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108671040.014
Hudson, R. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199544004.013.0033
Rowland, C. F. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/u2ecp
Mirković, J., Yee, M., Kennedy, M., & Hayiou‐Thomas, M. E. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/y8xwm · Cited by 1
(2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.002.0007
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0008
(2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.002.0008
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0011
The flexibility of negative features
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0005
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0015
Intermezzo The landscape of polarity-sensitive elements: Convergence vs divergence
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0009
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0012
Diachronic developments in the domain of negation and Negative Concord
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0006
Conclusions and open questions
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0016
Negative indefinites and split-scope readings
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0007
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0014
Outline: The pluriform landscape of negative dependencies
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0002
Strong vs weak Negative Polarity Items
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0010
(2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.002.0004
Introduction: Negation and negative dependencies
Zeijlstra, H. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198833239.003.0001 · Cited by 16
(2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199544004.002.0003
(2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199544004.002.0007
(2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199544004.002.0002
Metadata
- Authors
- Redington, M., Chater, N., & Finch, S.
- Affiliations
- University of Warwick (GB)
- Corresponding author
- Redington, Martin
- ORCID
- Chater, Nick
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 1998-10
- Volume
- 22
- Issue
- 4
- Pages
- 425-469
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W2051123508
- Semantic Scholar
- fd63e4f9e2497daa2c6a3f6b08445c2ef69fa901
- Cited by
- 535
- References
- 103
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 10 · 2023: 8 · 2022: 29 · 2021: 13 · 2020: 16 · 2019: 29 · 2018: 16 · 2017: 19 · 2016: 24 · 2015: 21 · 2014: 17 · 2013: 16 · 2012: 61
- FWCI
- 12.94
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cognitive Science (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- University of Warwick
- University of California, San Diego
- Economic and Social Research Council
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Keywords
- distributional information, child-directed speech, syntactic bootstrapping, syntactic categories, language acquisition, distributional cues
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.