The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Analysis of named entity recognition and linking for tweets
Open accessAbstract
Applying natural language processing for mining and intelligent information access to tweets (a form of microblog) is a challenging, emerging research area. Unlike carefully authored news text and other longer content, tweets pose a number of new challenges, due to their short, noisy, context-dependent, and dynamic nature. Information extraction from tweets is typically performed in a pipeline, comprising consecutive stages of language identification, tokenisation, part-of-speech tagging, named entity recognition and entity disambiguation (e.g. with respect to DBpedia). In this work, we describe a new Twitter entity disambiguation dataset, and conduct an empirical analysis of named entity recognition and disambiguation, investigating how robust a number of state-of-the-art systems are on such noisy texts, what the main sources of error are, and which problems should be further investigated to improve the state of the art.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Incorporating non-local information into information extraction systems by Gibbs sampling
Finkel, J. R., Grenager, T., & Manning, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219885 · Cited by 3,008
Feature-rich part-of-speech tagging with a cyclic dependency network
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073478 · Cited by 2,844
Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788
A survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507
N-gram-based text categorization
Cavnar, W. B., & Trenkle, J. M. (1994) · Cited by 2,060
Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition
Sang, E. T. K. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0209010 · Cited by 1,560
Design challenges and misconceptions in named entity recognition
Ratinov, L., & Roth, D. (2009) · Proceedings of the Thirteenth Conference on Computational Natural Language Learning - CoNLL '09 · doi:10.3115/1596374.1596399 · Cited by 1,448
Message Understanding Conference-6: a brief history
Grishman, R., & Sundheim, B. (1996) · Proceedings of the 16th conference on Computational linguistics - · doi:10.3115/992628.992709 · Cited by 1,408
Named Entity Recognition in Tweets: An Experimental Study
Ritter, A., Clark, S., & Etzioni, O. (2011) · Cited by 1,181
DBpedia spotlight: shedding light on the web of documents
Mendes, P. N., Jakob, M., García-Silva, A., & Bizer, C. (2011) · Proceedings of the 7th International Conference on Semantic Systems · doi:10.1145/2063518.2063519 · Cited by 1,180
Large-Scale Named Entity Disambiguation Based on Wikipedia Data
Cucerzan, S. (2007) · Cited by 1,061
Amazon Mechanical Turk: Gold Mine or Coal Mine?
Fort, K., Adda, G., & Cohen, K. B. (2011) · Computational Linguistics · doi:10.1162/coli_a_00057 · Cited by 761
Brickley, D. (2004) · Medical Entomology and Zoology · Cited by 601
langid.py: An Off-the-shelf Language Identification Tool
Lui, M., & Baldwin, T. (2012) · Cited by 471
Demartini, G., Difallah, D. E., & Cudré-Mauroux, P. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187900 · Cited by 448
(2011) · Cited by 446
2016 IEEE 16th International Conference on Data Mining (ICDM)
(2016) · doi:10.1109/icdm38702.2016 · Cited by 347
Normalization of non-standard words
Sproat, R., Black, A. W., Chen, S., Kumar, S., Ostendorf, M., & Richards, C. D. (2001) · Computer Speech & Language · doi:10.1006/csla.2001.0169 · Cited by 342
Adding semantics to microblog posts
Meij, E., Weerkamp, W., & de Rijke, M. (2012) · Proceedings of the fifth ACM international conference on Web search and data mining · doi:10.1145/2124295.2124364 · Cited by 291
Annotating named entities in Twitter data with crowdsourcing
Finin, T., Murnane, W., Karandikar, A., Keller, N., Martineau, J., & Dredze, M. H. (2010) · doi:10.13016/m21j97c2p · Cited by 276
Semantic Enrichment of Twitter Posts for User Profile Construction on the Social Web
Abel, F., Gao, Q., Houben, G.-J., & Tao, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21064-8_26 · Cited by 267
Twitter Part-of-Speech Tagging for All: Overcoming Sparse and Noisy Data
Derczynski, L., Ritter, A., Clark, S., & Bontcheva, K. (2013) · Cited by 245
Self-citationEmpirical Methods in Information Extraction
Cardie, C. (1997) · Cited by 227
Corpus Annotation through Crowdsourcing: Towards Best Practice Guidelines
Sabou, M., Bontcheva, K., Derczynski, L., & Scharl, A. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/569wpuc5pjnt · Cited by 217
Self-citationAutomatically Constructing a Normalisation Dictionary for Microblogs
Han, B., Cook, P. F., & Baldwin, T. (2012) · Cited by 178
Entity Linking: Finding Extracted Entities in a Knowledge Base
Rao, D., McNamee, P., & Dredze, M. (2013) · Theory and Applications of Natural Language Processing · doi:10.1007/978-3-642-28569-1_5 · Cited by 178
Introduction to information extraction
Appelt, D. E. (1999) · AI Communications · doi:10.5555/1216155.1216161 · Cited by 168
The ML-Model for Multi-layer Social Networks
Magnani, M., & Rossi, L. (2011) · 2011 International Conference on Advances in Social Networks Analysis and Mining · doi:10.1109/asonam.2011.114 · Cited by 160
A Comparison of Knowledge Extraction Tools for the Semantic Web
Aldo Gangemi, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38288-8_24 · Cited by 146
Microblog language identification: overcoming the limitations of short, unedited and idiomatic text
Carter, S., Weerkamp, W., & Tsagkias, M. (2012) · Language Resources and Evaluation · doi:10.1007/s10579-012-9195-y · Cited by 139
Hepple, M. (2000) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1075218.1075254 · Cited by 121
Crowdsourcing research opportunities: lessons from natural language processing
Sabou, M., Bontcheva, K., & Scharl, A. (2012) · International Conference on Knowledge Management and Knowledge Technologies · doi:10.1145/2362456.2362479 · Cited by 111
Self-citationJoint Inference of Named Entity Recognition and Normalization for Tweets
Liu, X., Zhou, M., Zhou, X., Fu, Z., & Wei, F. (2012) · Cited by 105
NERD: A Framework for Unifying Named Entity Recognition and Disambiguation Extraction Tools
Rizzo, G., & Raphaël Troncy, A. (2012) · PORTO@Iris · Cited by 101
Self-citationMicroblog-genre noise and impact on semantic annotation accuracy
Derczynski, L., Maynard, D., Aswani, N., & Bontcheva, K. (2013) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/2481492.2481495 · Cited by 95
Self-citationTrendminer: An Architecture for Real Time Analysis of Social Media Text
Preoțiuc-Pietro, D., Samangooei, S., Cohn, T., Gibbins, N. M., & Niranjan, M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i3.14348 · Cited by 75
Crowdsourcing and annotating NER for Twitter #drift
Fromreide, H., Hovy, D., & Søgaard, A. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3mepts35xng8 · Cited by 48
Mendes, P. N., Passant, A., Kapanipathi, P., & Sheth, A. (2010) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat.2010.314 · Cited by 46
Evaluation of Named Entity Extraction Systems
Marrero, M., Sánchez-Cuadrado, S., Morato, J., & Andreadakis, G. (2009) · Cited by 46
Making sense of microposts (#MSM2013) concept extraction challenge
Basave, A. E. C., Varga, A. E., Rowe, M., Stanković, M., & Dadzie, A. (2013) · Aston Publications Explorer (Aston University) · Cited by 46
Learning with the Web: Spotting named entities on the intersection of NERD and machine learning
van Erp, M., Rizzo, G. F., & Raphaël Troncy, A. (2013) · VU Research Portal · Cited by 41
Self-citationSøgaard, A., Johannsen, A., Plank, B., Hovy, D., & Martínez Alonso, H. (2014) · Proceedings of the Eighteenth Conference on Computational Natural Language Learning · doi:10.3115/v1/w14-1601 · Cited by 39
Crowdsourcing Named Entity Recognition and Entity Linking Corpora
Bontcheva, K., Derczynski, L., & Roberts, I. G. (2017) · Springer eBooks · doi:10.1007/978-94-024-0881-2_32 · Cited by 36
Self-citationEntity Disambiguation with Freebase
Zheng, Z., Si, X., Li, F., Chang, E. Y., & Zhu, X. (2012) · doi:10.5555/2457524.2457667 · Cited by 34
Entity Disambiguation with Freebase
Zheng, Z., Si, X., Li, F., Chang, E. Y., & Zhu, X. (2012) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat.2012.26 · Cited by 30
Derczynski, L., & Bontcheva, K. (2014) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-4014 · Cited by 9
Self-citationReliably Evaluating Summaries of Twitter Timelines
Rout, D., Bontcheva, K., & Hepple, M. (2013) · National Conference on Artificial Intelligence · Cited by 9
Self-citation
Cited by
Results of the WNUT2017 Shared Task on Novel and Emerging Entity Recognition
Derczynski, L., Nichols, E., van Erp, M., & Limsopatham, N. (2017) · Proceedings of the 3rd Workshop on Noisy User-generated Text · doi:10.18653/v1/w17-4418 · Cited by 361
Self-citationDirections in abusive language training data, a systematic review: Garbage in, garbage out
Vidgen, B., & Derczynski, L. (2020) · PLOS ONE · doi:10.1371/journal.pone.0243300 · Cited by 318
Self-citationRecent Named Entity Recognition and Classification techniques: A systematic review
Goyal, A., Gupta, V., & Kumar, M. (2018) · Computer Science Review · doi:10.1016/j.cosrev.2018.06.001 · Cited by 309
Yu, J., Jiang, J., Yang, L., & Xia, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.306 · Cited by 281
Machine learning algorithms for social media analysis: A survey
T.K., B., Annavarapu, C. S. R., & Bablani, A. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100395 · Cited by 276
Metadata
- Authors
- Derczynski, L., Maynard, D., Rizzo, G., van Erp, M., Gorrell, G., Troncy, R., Petrak, J., & Bontcheva, K.
- Venue
- Information Processing & Management
- Publisher
- Elsevier BV
- Published
- 2015-03
- Volume
- 51
- Issue
- 2
- Pages
- 32-49
- ISSN
- 0020-0271 (ISSN-L)
- 0306-4573
- OpenAlex
- W2143933463
- Cited by
- 340
- References
- 49
- FWCI
- 37.96
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.