The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Learning multilingual named entity recognition from Wikipedia
Open accessAbstract
We automatically create enormous, free and multilingual silver-standard training annotations for named entity recognition (ner) by exploiting the text and structure of Wikipedia. Most ner systems rely on statistical models of annotated data to identify and classify names of people, locations and organisations in text. This dependence on expensive annotation is the knowledge bottleneck our work overcomes. We first classify each Wikipedia article into named entity (ne) types, training and evaluating on 7200 manually-labelled Wikipedia articles across nine languages. Our cross-lingual approach achieves up to 95% accuracy. We transform the links between articles into ne annotations by projecting the target [email protected]?s classifications onto the anchor text. This approach yields reasonable annotations, but does not immediately compete with existing gold-standard data. By inferring additional links and heuristically tweaking the Wikipedia corpora, we better align our automatic annotations to gold standards. We annotate millions of words in nine languages, evaluating English, German, Spanish, Dutch and Russian Wikipedia-trained models against conll shared task data and other gold-standard corpora. Our approach outperforms other approaches to automatic ne annotation (Richman and Schone, 2008 [61], Mika et al., 2008 [46]) competes with gold-standard training when tested on an evaluation corpus from a different source; and performs 10% better than newswire-trained models on manually-annotated Wikipedia text.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
NLTK: the Natural Language Toolkit
Loper, E., & Bird, S. (2002) · Proceedings of the ACL-02 Workshop on Effective tools and methodologies for teaching natural language processing and computational linguistics - · doi:10.3115/1118108.1118117 · Cited by 3,218
Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788
Yago: a core of semantic knowledge
Suchanek, F. M., Kasneci, G., & Weikum, G. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242667 · Cited by 2,512
A survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507
NLTK: The Natural Language Toolkit
Loper, E., & Bird, S. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0205028 · Cited by 1,844
Design challenges and misconceptions in named entity recognition
Ratinov, L., & Roth, D. (2009) · Proceedings of the Thirteenth Conference on Computational Natural Language Learning - CoNLL '09 · doi:10.3115/1596374.1596399 · Cited by 1,448
Unsupervised named-entity extraction from the Web: An experimental study
Etzioni, O., Cafarella, M., Downey, D., Popescu, A.-M., Shaked, T., Soderland, S., Weld, D. S., & Yates, A. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.03.001 · Cited by 1,124
Large-Scale Named Entity Disambiguation Based on Wikipedia Data
Cucerzan, S. (2007) · Cited by 1,061
Wikify!: linking documents to encyclopedic knowledge
Mihalcea, R., & Csomai, A. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321475 · Cited by 909
YAGO: A Large Ontology from Wikipedia and WordNet
Suchanek, F. M., Kasneci, G., & Weikum, G. (2008) · Journal of Web Semantics · doi:10.1016/j.websem.2008.06.001 · Cited by 904
Using Encyclopedic Knowledge for Named Entity Disambiguation
Bunescu, R., & PAŞCA, M. A. (2006) · Cited by 809
An Algorithm that Learns What's in a Name
Bikel, D. M., Schwartz, R., & Weischedel, R. M. (1999) · Machine Learning · doi:10.1023/a:1007558221122 · Cited by 776
WikiRelate! computing semantic relatedness using wikipedia
Strube, M., & Ponzetto, S. P. (2006) · MADOC (University of Mannheim) · Cited by 744
Penn, T. (1999) · Medical Entomology and Zoology · Cited by 652
Introduction to the CoNLL-2002 shared task: language-independent named entity recognition
Tjong Kim Sang, E. F. (2002) · proceeding of the 6th conference on Natural language learning - COLING-02 · doi:10.3115/1118853.1118877 · Cited by 519
Inducing multilingual text analysis tools via robust projection across aligned corpora
Yarowsky, D., Ngai, G., & Wicentowski, R. (2001) · Proceedings of the first international conference on Human language technology research - HLT '01 · doi:10.3115/1072133.1072187 · Cited by 482
BabelNet: Building a Very Large Multilingual Semantic Network
Roberto Navigli, A., & Ponzetto, S. P. (2010) · MADOC (University of Mannheim) · Cited by 466
(2020) · The BNC Handbook · doi:10.1515/9780748628889-004 · Cited by 436
Named Entity recognition without gazetteers
Mikheev, A., Moens, M., & Grover, C. (1999) · Proceedings of the ninth conference on European chapter of the Association for Computational Linguistics - · doi:10.3115/977035.977037 · Cited by 433
Unsupervised Multilingual Sentence Boundary Detection
Kiss, T., & Strunk, J. (2006) · Computational Linguistics · doi:10.1162/coli.2006.32.4.485 · Cited by 414
Gabrilovich, E., & Markovitch, S. (2006) · Cited by 402
Computer Intensive Methods for Testing Hypotheses.
Hollas, E. A., & Noreen, E. W. (1990) · The Statistician · doi:10.2307/2348203 · Cited by 395
Autonomously semantifying wikipedia
Wu, F., & Weld, D. S. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321449 · Cited by 375
LIBLINEAR: A Library for Large Linear Classification
FanRong-En, ChangKai-Wei, HsiehCho-Jui, WangXiang-Rui, & LinChih-Jen (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1442794 · Cited by 328
Language independent NER using a maximum entropy tagger
Curran, J. R., & Clark, S. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119200 · Cited by 251
Self-citationMeasuring article quality in wikipedia: models and evaluation
Hu, M., Lim, E.-P., Sun, A., Lauw, H. W., & Vuong, B.-Q. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321476 · Cited by 242
Unsupervised Named-Entity Recognition: Generating Gazetteers and Resolving Ambiguity
Nadeau, D., Turney, P. D., & Matwin, S. (2006) · Lecture Notes in Computer Science · doi:10.1007/11766247_23 · Cited by 230
Extended Named Entity Hierarchy
Sekine, S., Sudo, K., & Nobata, C. (2002) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/26uien2xmdj7 · Cited by 226
A high-performance semi-supervised learning method for text chunking
Ando, R. K., & Zhang, T. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219841 · Cited by 223
Computer-Intensive Methods for Testing Hypotheses.
Buckland, S. T., & Noreen, E. W. (1990) · Biometrics · doi:10.2307/2531461 · Cited by 202
Automatic Assignment of Wikipedia Encyclopedic Entries to WordNet Synsets
Ruiz-Casado, M., Alfonseca, E., & Castells, P. (2005) · Lecture notes in computer science · doi:10.1007/11495772_59 · Cited by 142
Semi-Supervised Sequential Labeling and Segmentation Using Giga-Word Scale Unlabeled Data
Suzuki, J., & Isozaki, H. (2008) · Cited by 131
A Wikipedia-Based Multilingual Retrieval Model
Potthast, M., Stein, B., & Anderka, M. (2008) · Springer eBooks · doi:10.1007/978-3-540-78646-7_51 · Cited by 129
Detecting errors in part-of-speech annotation
Dickinson, M., & Meurers, D. (2003) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/1067807.1067823 · Cited by 122
Named entity recognition in Wikipedia
Balasuriya, D., Ringland, N., Nothman, J., Murphy, T., & Curran, J. R. (2009) · doi:10.3115/1699765.1699767 · Cited by 120
Self-citationToral, A., & Muñoz, R. (2006) · Cited by 115
Identifying Document Topics Using the Wikipedia Category Network
Schönhofen, P. (2006) · IEEE/WIC/ACM International Conference on Web Intelligence · doi:10.1109/wi.2006.92 · Cited by 110
A simple semi-supervised algorithm for named entity recognition
Liao, W., & Veeramachaneni, S. (2009) · doi:10.3115/1621829.1621837 · Cited by 105
Training and Evaluating a German Named Entity Recognizer with Semantic Generalization.
Faruqui, M., & Padó, S. (2010) · KONVENS · Cited by 102
Transforming Wikipedia into Named Entity Training Data
Nothman, J., Curran, J., & Murphy, T. (2008) · Cited by 101
Self-citationInformation arbitrage across multi-lingual Wikipedia
Adar, E., Skinner, M., & Weld, D. S. (2009) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1498759.1498813 · Cited by 97
WikiNet: A Very Large Scale Multi-Lingual Concept Network
Năstase, V., Strube, M., Börschinger, B., Zirn, C., & Elghafari, A. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2j7ygzb3nhhr · Cited by 85
Active Learning with Amazon Mechanical Turk
Laws, F., Scheible, C., & Schütze, H. (2011) · Cited by 73
Domain adaptive bootstrapping for named entity recognition
Wu, D., Lee, W. S., Ye, N., & Chieu, H. L. (2009) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1699648.1699699 · Cited by 60
Analysing Wikipedia and gold-standard corpora for NER training
Nothman, J., Murphy, T., & Curran, J. R. (2009) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/1609067.1609135 · Cited by 59
Self-citationAugmenting Wikipedia with Named Entity Tags.
Dakka, W., & Cucerzan, S. (2008) · Cited by 56
Building a Multilingual Named Entity-Annotated Corpus Using Annotation Projection
Ehrmann, M., Turchi, M., & Steinberger, R. (2011) · Cited by 56
Annotating Large Email Datasets for Named Entity Recognition with
Lawson, N., Eustice, K., Perkowitz, M., & Yetisgen-Yildiz, M. (2010) · Cited by 51
Wentland, W., Knopp, J., Silberer, C., & Härtung, M. (2008) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3b6w8a3vhm72 · Cited by 51
Automatic acquisition of named entity tagged corpus from world wide web
An, J., Lee, S., & Lee, G. G. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075178.1075207 · Cited by 38
Learning to Tag and Tagging to Learn: A Case Study on Wikipedia
Mika, P., Ciaramita, M., Zaragoza, H., & Atserias, J. (2008) · IEEE Intelligent Systems · doi:10.1109/mis.2008.85 · Cited by 36
Learning from Partially Annotated Sequences
Fernandes, E. R., & Brefeld, U. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23780-5_36 · Cited by 33
Generating Chinese named entity data from parallel corpora
Fu, R., Qin, B., & Liu, T. (2014) · Frontiers of Computer Science · doi:10.1007/s11704-014-3127-5 · Cited by 28
Learning Named Entity Recognition from Wikipedia
Nothman, J. (2008) · Cited by 12
Self-citationClassifying Wikipedia entities into fine-grained classes
Tkachenko, M., Ulanov, A., & Simanovsky, A. (2011) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew.2011.5767662 · Cited by 8
Web 2.0, Language Resources and standards to automatically build a multilingual Named Entity Lexicon
Toral, A., Ferrández, S., Monachini, M., & Muñoz, R. (2011) · Language Resources and Evaluation · doi:10.1007/s10579-011-9148-x · Cited by 6
Training a Named Entity Recognizer on the Web
Urbansky, D., Thom, J. A., Schuster, D., & Schill, A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24434-6_7 · Cited by 4
Cited by
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages
Qi, P., Zhang, Y., Zhang, Y., Bolton, J., & Manning, C. D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.18653/v1/2020.acl-demos.14 · Cited by 1,431
Knowledge graph refinement: A survey of approaches and evaluation methods
Paulheim, H. (2016) · Semantic Web · doi:10.3233/sw-160218 · Cited by 849
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages
Qi, P., Zhang, Y., Zhang, Y., Bolton, J., & Manning, C. D. (2020) · arXiv · doi:10.48550/arxiv.2003.07082 · Cited by 476
Cross-lingual Name Tagging and Linking for 282 Languages
Pan, X., Zhang, B., May, J., Nothman, J., Knight, K., & Ji, H. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1178 · Cited by 312
Self-citation
Metadata
- Authors
- Nothman, J., Ringland, N., Radford, W., Murphy, T., & Curran, J. R.
- Venue
- Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2013-01
- Volume
- 194
- Pages
- 151-175
- ISSN
- 0004-3702 (ISSN-L)
- OpenAlex
- W2120844411
- Cited by
- 360
- References
- 58
- FWCI
- 16.46
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.