The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
An Efficient, Probabilistically Sound Algorithm for Segmentation and Word Discovery
Open accessAbstract
This paper presents a model-based, unsupervised algorithm for recovering word boundaries in a natural-language text from which they have been deleted. The algorithm is derived from a probability model of the source that generated the text. The fundamental structure of the model is specified abstractly so that the detailed component models of phonology, word-order, and word frequency can be replaced in a modular fashion. The model yields a language-independent, prior probability distribution on all possible sequences of all possible words over a given alphabet, based on the assumption that the input was generated by concatenating words from a fixed but unknown lexicon. The model is unusual in that it treats the generation of a complete corpus, regardless of length, as a single event in the probability space. Accordingly, the algorithm does not estimate a probability distribution on words; instead, it attempts to calculate the prior probabilities of various word sequences that could underlie the observed text. Experiments on phonemic transcripts of spontaneous speech by parents to young children suggest that our algorithm is more effective than other proposed algorithms, at least when utterance boundaries are given and the text includes a substantial number of short utterances.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
An Introduction to Kolmogorov Complexity and Its Applications
Li, M., & Vitányi, P. (2019) · Texts in Computer Science · doi:10.1007/978-3-030-11298-1 · Cited by 3,681
Statistical Methods for Speech Recognition
Sun, D. X., & Jelinek, F. (1999) · Journal of the American Statistical Association · doi:10.2307/2670189 · Cited by 1,946
Stochastic Complexity in Statistical Inquiry
Rissanen, J. (1998) · WORLD SCIENTIFIC eBooks · doi:10.1142/0822 · Cited by 1,539
Word Segmentation: The Role of Distributional Cues
Saffran, J. R., Newport, E. L., & Aslin, R. N. (1996) · Journal of Memory and Language · doi:10.1006/jmla.1996.0032 · Cited by 1,405 · cited 2×
“Saffran, Newport, and Aslin (1996) suggest that children may segment utterances at low points of the transitional probability between adjacent syllables—that is, when a syllable occurs that is surprising given its predecessor.”
An Information Measure for Classification
Wallace, C. S., & Boulton, D. M. (1968) · The Computer Journal · doi:10.1093/comjnl/11.2.185 · Cited by 933
The child language data exchange system
MacWhinney, B., & Snow, C. (1985) · Journal of Child Language · doi:10.1017/s0305000900006449 · Cited by 861
Witten, I. H., & Bell, T. C. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.87000 · Cited by 729
The Psycho-Biology of Language
Tinker, M. A., & Zipf, G. K. (1936) · The American Journal of Psychology · doi:10.2307/1415586 · Cited by 728
Cited by
Event perception: a mind-brain perspective
Zacks, J. M., Speer, N. K., Swallow, K. M., Braver, T. S., & Reynolds, J. R. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.2.273 · Cited by 1,148
Event structure in perception and conception.
Zacks, J. M., & Tversky, B. (2001) · Psychological Bulletin · doi:10.1037//0033-2909.127.1.3 · Cited by 1,198
The role of exposure to isolated words in early vocabulary development
Brent, M. R., & Siskind, J. M. (2001) · Cognition · doi:10.1016/s0010-0277(01)00122-6 · Cited by 542
Self-citationLearning words from sights and sounds: A computational model
Roy, D. K., & Pentland, A. P. (2002) · Cognitive Science · doi:10.1207/s15516709cog2601_4 · Cited by 521
A Bayesian framework for word segmentation: Exploring the effects of context
Goldwater, S., Griffiths, T. L., & Johnson, M. (2009) · Cognition · doi:10.1016/j.cognition.2009.03.008 · Cited by 431
Mommy and Me: Familiar Names Help Launch Babies Into Speech-Stream Segmentation
Bortfeld, H., Morgan, J. L., Golinkoff, R. M., & Rathbun, K. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.01531.x · Cited by 427
Integration of Multiple Speech Segmentation Cues: A Hierarchical Framework.
Mattys, S. L., White, L., & Melhorn, J. F. (2005) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.134.4.477 · Cited by 385
Unsupervised discovery of morphemes
Creutz, M., & Lagus, K. (2002) · Proceedings of the ACL-02 workshop on Morphological and phonological learning - · doi:10.3115/1118647.1118650 · Cited by 377
Unsupervised Pattern Discovery in Speech
Park, A. S., & Glass, J. R. (2008) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2007.909282 · Cited by 351
Unsupervised models for morpheme segmentation and morphology learning
Creutz, M., & Lagus, K. (2007) · ACM Transactions on Speech and Language Processing · doi:10.1145/1187415.1187418 · Cited by 334
Contextual dependencies in unsupervised word segmentation
Goldwater, S., Griffiths, T. L., & Johnson, M. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220260 · Cited by 305
3 Parts and wholes: Implicative patterns in inflectional paradigms
Ackerman, F., Blevins, J. P., & Malouf, R. (2009) · Analogy in Grammar · doi:10.1093/acprof:oso/9780199547548.003.0003 · Cited by 302
Adaptor Grammars: A Framework for Specifying Compositional Nonparametric Bayesian Models
Johnson, M., Griffiths, T. L., & Goldwater, S. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0085 · Cited by 268
A computational model of event segmentation from perceptual prediction
Reynolds, J. R., Zacks, J. M., & Braver, T. S. (2007) · Cognitive Science · doi:10.1080/15326900701399913 · Cited by 172
Speech segmentation and word discovery: a computational perspective
Brent, M. R. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01350-9 · Cited by 163
Self-citationSymbol emergence in robotics: a survey
Taniguchi, T., Nagai, T., Nakamura, T., Iwahashi, N., Ogata, T., & Asoh, H. (2016) · Advanced Robotics · doi:10.1080/01691864.2016.1164622 · Cited by 150
Morph-based speech recognition and modeling of out-of-vocabulary words across languages
Creutz, M., Hirsimäki, T., Kurimo, M., Puurula, A., Pylkkönen, J., Siivola, V., Varjokallio, M., Arisoy, E., Saraçlar, M., & Stolcke, A. (2007) · ACM Transactions on Speech and Language Processing · doi:10.1145/1322391.1322394 · Cited by 127
Unlimited vocabulary speech recognition with morph language models applied to Finnish
Hirsimäki, T., Creutz, M., Siivola, V., Kurimo, M., Virpioja, S., & Pylkkönen, J. (2006) · Computer Speech & Language · doi:10.1016/j.csl.2005.07.002 · Cited by 124
Word Segmentation on Discovered Phone Units With Dynamic Programming and Self-Supervised Scoring
Kamper, H. (2023) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2022.3229264 · Cited by 24
“I specifically consider results on the Brent corpus [48], a standard benchmark for symbolic word segmentation.”
Background
Metadata
- Authors
- Brent, M. R.
- Venue
- Machine Learning
- Published
- 1999-02
- Volume
- 34
- Issue
- 1-3
- Pages
- 71-105
- ISSN
- 0885-6125 (ISSN-L)
- 1573-0565
- OpenAlex
- W2074546930
- Cited by
- 351
- References
- 31
- FWCI
- 9.36
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.