OntoNotes: the 90% solution
Open accessAbstract
We describe the OntoNotes methodology and its result, a large multilingual richly-annotated corpus constructed at 90% interannotator agreement. An initial portion (300K words of English newswire and 250K words of Chinese newswire) will be made available to the community during 2007.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Much of the broader sequence labeling datasets that are publicly available to NLP researchers focus on the task of Named Entity Recognition (NER).
“Much of the broader sequence labeling datasets that are publicly available to NLP researchers focus on the task of Named Entity Recognition (NER).”
From QueryNER: Segmentation of E-commerce Queries (2024) · cites this paper as Hovy et al. 2006
Cited by
Sorted by citations
Vinyals, O., Kaiser, L., Koo, T., Petrov, S., Sutskever, I., & Hinton, G. (2014) · arXiv · doi:10.48550/arxiv.1412.7449 · Cited by 464 · see citing works
Tenney, I., Wexler, J., Bastings, J., Bolukbasi, T., Coenen, A., Gehrmann, S., Jiang, E., Pushkarna, M., Radebaugh, C., Reif, E., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.15 · Cited by 138 · see citing works
“trained on OntoNotes (Hovy et al., 2006), and load the Winogender (Rudinger et al.”
MethodMedSTS: a resource for clinical semantic textual similarity
Wang, Y., Afzal, N., Fu, S., Wang, L., Shen, F., Rastegar-Mojarad, M., & Liu, H. (2020) · Language Resources and Evaluation · doi:10.1007/s10579-018-9431-1 · Cited by 124 · see citing works
SemGloVe: Semantic Co-Occurrences for GloVe From BERT
Gan, L., Teng, Z., Zhang, Y., Zhu, L., Wu, F., & Yang, Y. (2022) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2022.3197316 · Cited by 22 · see citing works
QueryNER: Segmentation of E-commerce Queries
Palen-Michel, C., Liang, L., Wu, Z., & Lignos, C. (2024) · arXiv · doi:10.48550/arxiv.2405.09507 · Cited by 1 · see citing works
- Authors
- Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., & Weischedel, R.
- Affiliations
- University of Southern California (US)
- University of Pennsylvania (US)
- University of Colorado Boulder (US)
- Venue
- Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers on XX - NAACL '06
- Published
- 2006
- Pages
- 57-60
- OpenAlex
- W2088911157
- Cited by
- 806
- References
- 0
- Citations by year
- 2026: 11 · 2025: 16 · 2024: 15 · 2023: 18 · 2022: 25 · 2021: 67 · 2020: 60 · 2019: 36 · 2018: 49 · 2017: 44 · 2016: 68 · 2015: 69 · 2014: 51 · 2013: 51 · 2012: 45
- FWCI
- 23.70
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) (publishedVersion)
- Funders
- Defense Advanced Research Projects Agency (HR0011-06-C-0022)
- Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Keywords
- OntoNotes, multilingual corpora, inter-annotator agreement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
