The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Contextual dependencies in unsupervised word segmentation
Open accessAbstract
Developing better methods for segmenting continuous text into words is important for improving the processing of Asian languages, and may shed light on how humans learn to segment speech. We propose two new Bayesian word segmentation methods that assume unigram and bigram models of word dependencies respectively. The bigram model greatly outperforms the unigram model (and previous probabilistic models), demonstrating the importance of such dependencies for word segmentation. We also show that previous probabilistic models rely crucially on sub-optimal search procedures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems
Antoniak, C. E. (1974) · The Annals of Statistics · doi:10.1214/aos/1176342871 · Cited by 1,972
Word Segmentation: The Role of Distributional Cues
Saffran, J. R., Newport, E. L., & Aslin, R. N. (1996) · Journal of Memory and Language · doi:10.1006/jmla.1996.0032 · Cited by 1,405 · cited 1×
“Statistics that have been proposed for measuring these differences include “successor frequency” (Harris, 1954), “transitional probabilities” (Saffran et al., 1996), mutual information (Sun et al.”
BackgroundMarkov Chain Monte Carlo in Practice.
Kass, R. E., Gilks, W. R., Richardson, S., & Spiegelhalter, D. J. (1997) · Journal of the American Statistical Association · doi:10.2307/2965438 · Cited by 1,380
Exchangeability and related topics
Aldous, D. J. (1985) · Lecture Notes in Mathematics · doi:10.1007/bfb0099421 · Cited by 1,345
The child language data exchange system
MacWhinney, B., & Snow, C. (1985) · Journal of Child Language · doi:10.1017/s0305000900006449 · Cited by 861
An Efficient, Probabilistically Sound Algorithm for Segmentation and Word Discovery
Brent, M. R. (1999) · Machine Learning · doi:10.1023/a:1007541817488 · Cited by 351
A Statistical Model for Word Discovery in Transcribed Speech
Venkataraman, A. (2001) · International Conference on Computational Logic · doi:10.1162/089120101317066113 · Cited by 138
Cited by
The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchies
Blei, D. M., Griffiths, T. L., & Jordan, M. I. (2010) · Journal of the ACM · doi:10.1145/1667053.1667056 · Cited by 646
Self-citationCollective knowledge systems: Where the Social Web meets the Semantic Web
Gruber, T. (2008) · Journal of Web Semantics · doi:10.1016/j.websem.2007.11.011 · Cited by 606
A Bayesian framework for word segmentation: Exploring the effects of context
Goldwater, S., Griffiths, T. L., & Johnson, M. (2009) · Cognition · doi:10.1016/j.cognition.2009.03.008 · Cited by 431
Self-citationUnsupervised Pattern Discovery in Speech
Park, A. S., & Glass, J. R. (2008) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2007.909282 · Cited by 351
Hierarchical Bayesian nonparametric models with applications
Teh, Y. W., & Jordan, M. I. (2010) · Bayesian Nonparametrics · doi:10.1017/cbo9780511802478.006 · Cited by 319
Metadata
- Authors
- Goldwater, S., Griffiths, T. L., & Johnson, M.
- Venue
- Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06
- Published
- 2006
- Pages
- 673-680
- OpenAlex
- W2122228338
- Cited by
- 305
- References
- 13
- FWCI
- 15.13
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Contextual dependencies in unsupervised word segmentation. https://app.cochat.ai/papers/10.3115/1220175.1220260
- The paper
- Goldwater, S., Griffiths, T. L., & Johnson, M. (2006). Contextual dependencies in unsupervised word segmentation. Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06. https://doi.org/10.3115/1220175.1220260
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.