The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Unsupervised Multilingual Sentence Boundary Detection
Open accessAbstract
In this article, we present a language-independent, unsupervised approach to sentence boundary detection. It is based on the assumption that a large number of ambiguities in the determination of sentence boundaries can be eliminated once abbreviations have been identified. Instead of relying on orthographic clues, the proposed system is able to detect abbreviations with high accuracy using three criteria that only require information about the candidate type itself and are independent of context: Abbreviations can be defined as a very tight collocation consisting of a truncated word and a final period, abbreviations are usually short, and abbreviations sometimes contain internal periods. We also show the potential of collocational evidence for two other important subtasks of sentence boundary disambiguation, namely, the detection of initials and ordinal numbers. The proposed system has been tested extensively on eleven different languages and on different text genres. It achieves good results without any further amendments or language-specific resources. We evaluate its performance against three different baselines and compare it to other systems for sentence boundary detection proposed in the literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Accurate methods for the statistics of surprise and coincidence
Dunning, T. E. (1993) · doi:10.5555/972450.972454 · Cited by 2,647
FREQUENCY ANALYSIS OF ENGLISH USAGE: LEXICON AND GRAMMAR
Francis, W. N., Kučera, H., & Mackie, A. W. (1983) · Medical Entomology and Zoology · Cited by 2,310
De Roeck, A. (1995) · Handbook of Pragmatics · doi:10.1075/hop.m.comm2 · Cited by 1,715
A Synopsis of Linguistic Theory, 1930-1955
Firth, J. R. (1957) · Medical Entomology and Zoology · Cited by 1,675
Brill, E. (1995) · Cited by 1,520
A maximum entropy approach to identifying sentence boundaries
Reynar, J. C., & Ratnaparkhi, A. (1997) · Proceedings of the fifth conference on Applied natural language processing - · doi:10.3115/974557.974561 · Cited by 391
(2021) · BRILL eBooks · doi:10.1163/9789004333901_017 · Cited by 210
Adaptive multilingual sentence boundary disambiguation
Palmer, D. D., & Hearst, M. A. (1997) · doi:10.5555/972695.972697 · Cited by 151
Cited by
Topic Modeling in Management Research: Rendering New Theory from Textual Data
Hannigan, T. R., Haans, R. F. J., Vakili, K., Tchalian, H., Glaser, V. L., Wang, M. S., Kaplan, S., & Jennings, P. D. (2019) · Academy of Management Annals · doi:10.5465/annals.2017.0099 · Cited by 621
Swain, M. C., & Cole, J. M. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00207 · Cited by 598
Identifying Customer Needs from User-Generated Content
Timoshenko, A., & Hauser, J. R. (2019) · Marketing Science · doi:10.1287/mksc.2018.1123 · Cited by 513
Information Extraction over Structured Data: Question Answering with Freebase
Yao, X., & Van Durme, B. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1090 · Cited by 490
Learning multilingual named entity recognition from Wikipedia
Nothman, J., Ringland, N., Radford, W., Murphy, T., & Curran, J. R. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2012.03.006 · Cited by 360
Metadata
- Authors
- Kiss, T., & Strunk, J.
- Venue
- Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2006-12
- Volume
- 32
- Issue
- 4
- Pages
- 485-525
- ISSN
- 0891-2017 (ISSN-L)
- 1530-9312
- OpenAlex
- W2121764873
- Cited by
- 414
- References
- 12
- FWCI
- 8.42
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Unsupervised Multilingual Sentence Boundary Detection. https://app.cochat.ai/papers/10.1162/coli.2006.32.4.485
- The paper
- Kiss, T., & Strunk, J. (2006). Unsupervised Multilingual Sentence Boundary Detection. Computational Linguistics. https://doi.org/10.1162/coli.2006.32.4.485
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.