The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Evaluating Entity Linking with Wikipedia
Open accessAbstract
Named Entity Linking (nel) grounds entity mentions to their corresponding node in a Knowledge Base (kb). Recently, a number of systems have been proposed for linking entity mentions in text to Wikipedia pages. Such systems typically search for candidate entities and then disambiguate them, returning either the best candidate or nil. However, comparison has focused on disambiguation accuracy, making it difficult to determine how search impacts performance. Furthermore, important approaches from the literature have not been systematically compared on standard data sets. We reimplement three seminal nel systems and present a detailed evaluation of search strategies. Our experiments find that coreference and acronym handling lead to substantial improvement, and search strategies account for much of the variation between systems. This is an interesting finding, because these aspects of the problem have often been neglected in the literature, which has focused largely on complex candidate ranking algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788
Fellegi, I. P., & Sunter, A. B. (1969) · Journal of the American Statistical Association · doi:10.1080/01621459.1969.10501049 · Cited by 2,475
DBpedia - A crystallization point for the Web of Data
Bizer, C., Lehmann, J., Kobilarov, G., Auer, S., Becker, C., Cyganiak, R., & Hellmann, S. (2009) · Journal of Web Semantics · doi:10.1016/j.websem.2009.07.002 · Cited by 2,137
Training linear SVMs in linear time
Joachims, T. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150429 · Cited by 1,920
Word sense disambiguation: A survey
Navigli, R. (2009) · ACM Computing Surveys · doi:10.1145/1459352.1459355 · Cited by 1,819
Learning to link with wikipedia
Milne, D., & Witten, I. H. (2008) · Proceedings of the 17th ACM conference on Information and knowledge management · doi:10.1145/1458082.1458150 · Cited by 1,237
Efficient clustering of high-dimensional data sets with application to reference matching
McCallum, A., Nigam, K., & Ungar, L. H. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347123 · Cited by 1,096
Large-Scale Named Entity Disambiguation Based on Wikipedia Data
Cucerzan, S. (2007) · Cited by 1,061
Robust Disambiguation of Named Entities in Text
Hoffart, J., Yosef, M. A., Bordino, I., Fürstenau, H., Pinkal, M., Spaniol, M., Taneva, B., Thater, S., & Weikum, G. (2011) · Cited by 925
Wikify!: linking documents to encyclopedic knowledge
Mihalcea, R., & Csomai, A. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321475 · Cited by 909
YAGO: A Large Ontology from Wikipedia and WordNet
Suchanek, F. M., Kasneci, G., & Weikum, G. (2008) · Journal of Web Semantics · doi:10.1016/j.websem.2008.06.001 · Cited by 904
Using Encyclopedic Knowledge for Named Entity Disambiguation
Bunescu, R., & PAŞCA, M. A. (2006) · Cited by 809
TAGME: on-the-fly annotation of short text fragments (by wikipedia entities)
Ferragina, P., & Scaiella, U. (2010) · Proceedings of the 19th ACM international conference on Information and knowledge management · doi:10.1145/1871437.1871689 · Cited by 743
Local and global algorithms for disambiguation to Wikipedia
Ratinov, L. (2024) · TIB Data Manager · doi:10.57702/yvubzlq1 · Cited by 596
BabelNet: Building a Very Large Multilingual Semantic Network
Roberto Navigli, A., & Ponzetto, S. P. (2010) · MADOC (University of Mannheim) · Cited by 466
Collective annotation of Wikipedia entities in web text
Kulkarni, S., Singh, A. K., Ramakrishnan, G., & Chakrabarti, S. (2009) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557073 · Cited by 437
Autonomously semantifying wikipedia
Wu, F., & Weld, D. S. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321449 · Cited by 375
Collective entity linking in web text
Han, X., Sun, L., & Zhao, J. (2011) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2009916.2010019 · Cited by 355
Overview of BioCreative II gene normalization
Morgan, A. A., Lu, Z., Wang, X., Cohen, A. M., Fluck, J., Ruch, P., Divoli, A., Fundel, K., Leaman, R., Hakenberg, J., et al. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s3 · Cited by 327
Entity Disambiguation for Knowledge Base Population
Dredze, M. H., McNamee, P., Rao, D., Gerber, A., & Finin, T. (2010) · doi:10.13016/m29w0934d · Cited by 326
Linguistically motivated large-scale NLP with C&C and boxer
Curran, J., Clark, S. C., & Bos, J. (2007) · doi:10.3115/1557769.1557781 · Cited by 258
Self-citationLearning to Simplify Sentences with Quasi-Synchronous Grammar and Integer Programming
Woodsend, K., & Lapata, M. (2011) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 210
Overview of BioCreAtIvE task 1B: normalized gene lists
Hirschman, L., Colosimo, M., Morgan, A., & Yeh, A. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-s1-s11 · Cited by 164
Learning to Link Entities with Knowledge Base
Zheng, Z., Li, F., Huang, M., & Zhu, X. (2010) · Cited by 155
Automatically generating Wikipedia articles: a structure-aware approach
Sauper, C., & Barzilay, R. (2009) · doi:10.3115/1687878.1687909 · Cited by 141
Taxonomy induction based on a collaboratively built knowledge repository
Ponzetto, S. P., & Strube, M. (2011) · Artificial Intelligence · doi:10.1016/j.artint.2011.01.003 · Cited by 103
Work on Statistical Methods for Word Sense Disambiguation
Gale, W. A., Church, K., & Yarowsky, D. (1992) · Cited by 89
Graph-Based Named Entity Linking with Wikipedia
Hachey, B., Radford, W., & Curran, J. R. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24434-6_16 · Cited by 63
Self-citationAnalysing Wikipedia and gold-standard corpora for NER training
Nothman, J., Murphy, T., & Curran, J. R. (2009) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/1609067.1609135 · Cited by 59
Self-citationWinkler, W. E. (2001) · Wiley eBooks · doi:10.1002/9780470057339.var022 · Cited by 51
Web people search: results of the first evaluation and the plan for the second
Artiles, J., Sekine, S., & Gonzalo, J. A. (2008) · International World Wide Web Conference (WWW) · doi:10.1145/1367497.1367661 · Cited by 39
Automating Financial Surveillance
Milosavljevic, M., Delort, J.-Y., Hachey, B., et al. (2010) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-642-12630-7_38 · Cited by 8
Self-citation
Cited by
Knowledge vault: a web-scale approach to probabilistic knowledge fusion
Dong, X., Gabrilovich, E., Heitz, G., Horn, W., Lao, N., Murphy, K., Strohmann, T., Sun, S., & Zhang, W. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623623 · Cited by 1,533
Entity Linking with a Knowledge Base: Issues, Techniques, and Solutions
Shen, W., Wang, J., & Han, J. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2327028 · Cited by 761
Entity Linking meets Word Sense Disambiguation: a Unified Approach
Moro, A., Raganato, A., & Navigli, R. (2014) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00179 · Cited by 743
Open-World Knowledge Graph Completion
Shi, B., & Weninger, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11535 · Cited by 283
ProjE: Embedding Projection for Knowledge Graph Completion
Shi, B., & Weninger, T. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10677 · Cited by 218
Metadata
- Authors
- Hachey, B., Radford, W., Nothman, J., Honnibal, M., & Curran, J. R.
- Venue
- Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2013-01
- Volume
- 194
- Pages
- 130-150
- ISSN
- 0004-3702 (ISSN-L)
- OpenAlex
- W2135451108
- Cited by
- 259
- References
- 33
- FWCI
- 24.38
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.