The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Unsupervised learning of natural languages
Open accessAbstract
We address the problem, fundamental to linguistics, bioinformatics, and certain other disciplines, of using corpora of raw symbolic sequential data to infer underlying rules that govern their production. Given a corpus of strings (such as text, transcribed speech, chromosome or protein sequence data, sheet music, etc.), our unsupervised algorithm recursively distills from it hierarchically structured patterns. The adios(automatic distillation of structure) algorithm relies on a statistical method for pattern extraction and on structured generalization, two processes that have been implicated in language acquisition. It has been evaluated on artificial context-free grammars with thousands of rules, on natural languages as diverse as English and Chinese, and on protein data correlating sequence with function. This unsupervised algorithm is capable of learning complex syntax, generating grammatical novel sentences, and proving useful in other fields that call for structure discovery from raw data, such as bioinformatics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to automata theory, languages and computation
(1981) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(81)90068-9 · Cited by 10,699
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
(1995) · Cited by 6,864
Statistical learning by 8-month-old infants
Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996) · Science · doi:10.1126/science.274.5294.1926 · Cited by 5,659
A universal algorithm for sequential data compression
Ziv, J., & Lempel, A. (1977) · IEEE Transactions on Information Theory · doi:10.1109/tit.1977.1055714 · Cited by 5,456
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Knowledge of Language: Its Nature, Origin, and Use.
Hornstein, N., & Chomsky, N. (1988) · The Philosophical Review · doi:10.2307/2185417 · Cited by 4,650
Foundations of Language: Brain, Meaning, Grammar, Evolution
Jackendoff, R. (2002) · doi:10.1093/acprof:oso/9780198270126.001.0001 · Cited by 3,244
Formulaic Language and the Lexicon
Wray, A. (2002) · doi:10.1017/cbo9780511519772 · Cited by 2,873
Baker, C. F., Fillmore, C. J., & Lowe, J. B. (1998) · Proceedings of the 36th annual meeting on Association for Computational Linguistics - · doi:10.3115/980845.980860 · Cited by 2,518
Cited by
The myth of language universals: Language diversity and its importance for cognitive science
Evans, N., & Levinson, S. C. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999094x · Cited by 2,623
The Oxford Handbook of Linguistic Analysis
(2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199544004.001.0001 · Cited by 639
The Cartography of Syntactic Structures
Cinque, G., & Rizzi, L. (2012) · The Oxford Handbook of Linguistic Analysis · doi:10.1093/oxfordhb/9780199544004.013.0003 · Cited by 639
Social Feedback to Infants’ Babbling Facilitates Rapid Phonological Learning
Goldstein, M. H., & Schwade, J. A. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02117.x · Cited by 620
Acoustic sequences in non‐human animals: a tutorial review and prospectus
Kershenbaum, A., Blumstein, D. T., Roch, M. A., Akçay, Ç., Backus, G., Bee, M. A., Bohn, K., Cao, Y., Carter, G., Cäsar, C., et al. (2016) · Biological Reviews · doi:10.1111/brv.12160 · Cited by 337
Self-citation
Metadata
- Authors
- Solan, Z., Horn, D., Ruppin, E., & Edelman, S.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2005-08-08
- Volume
- 102
- Issue
- 33
- Pages
- 11629-11634
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2143296986
- Cited by
- 346
- References
- 72
- FWCI
- 23.02
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Unsupervised learning of natural languages. https://app.cochat.ai/papers/10.1073/pnas.0409746102
- The paper
- Solan, Z., Horn, D., Ruppin, E., & Edelman, S. (2005). Unsupervised learning of natural languages. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.0409746102
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
