The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Fine-Grained Entity Recognition
Open accessAbstract
Entity Recognition (ER) is a key component of relation extraction systems and many other natural-language processing applications. Unfortunately, most ER systems are restricted to produce labels from to a small set of entity classes, e.g., person, organization, location or miscellaneous. In order to intelligently understand text and extract a wide range of information, it is useful to more precisely determine the semantic classes of entities mentioned in unstructured text. This paper defines a fine-grained set of 112 tags, formulates the tagging problem as multi-class, multi-label classification, describes an unsupervised method for collecting training data, and presents the FIGER implementation. Experiments show that the system accurately predicts the tags for entities. Moreover, it provides useful information for a relation extraction system, increasing the F1 score by 93%. We make FIGER and its data available as a resource for future work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
ML-KNN: A lazy learning approach to multi-label learning
Zhang, M.-L., & Zhou, Z.-H. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.12.019 · Cited by 3,552
Incorporating non-local information into information extraction systems by Gibbs sampling
Finkel, J. R., Grenager, T., & Manning, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219885 · Cited by 3,008
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008
(1992) · doi:10.5555/176313.176316 · Cited by 2,892
Feature-rich part-of-speech tagging with a cyclic dependency network
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073478 · Cited by 2,844
Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788
Distant supervision for relation extraction without labeled data
Mintz, M., Bills, S., Snow, R., & Jurafsky, D. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - ACL-IJCNLP '09 · doi:10.3115/1690219.1690287 · Cited by 2,752
Generating Typed Dependency Parses from Phrase Structure Parses
de Marneffe, M.-C., MacCartney, B., & Manning, C. D. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3wtkaidk6ea8 · Cited by 2,258
Toward an architecture for never-ending language learning
Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E., & Mitchell, T. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7519 · Cited by 2,000 · cited 4×
“All rights reserved. organization standard, they still fail to distinguish entity classes which are common when extracting hundreds or thousands of different relations (Hoffmann, Zhang, and Weld 2010; Carlson et al. 2010).”
BackgroundMethodInfluentialHead-Driven Statistical Models for Natural Language Parsing
Collins, M. (2003) · Computational Linguistics · doi:10.1162/089120103322753356 · Cited by 1,826
Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition
Sang, E. T. K. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0209010 · Cited by 1,560
Named Entity Recognition in Tweets: An Experimental Study
Ritter, A., Clark, S., & Etzioni, O. (2011) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 1,496
Design challenges and misconceptions in named entity recognition
Ratinov, L., & Roth, D. (2009) · Proceedings of the Thirteenth Conference on Computational Natural Language Learning - CoNLL '09 · doi:10.3115/1596374.1596399 · Cited by 1,448
Tsoumakas, G., Katakis, I., & Vlahavas, I. (2009) · Data Mining and Knowledge Discovery Handbook · doi:10.1007/978-0-387-09823-4_34 · Cited by 1,410
Open information extraction from the web
Banko, M., Cafarella, M., Soderland, S. G., Broadhead, M., & Etzioni, O. (2007) · International Joint Conference on Artificial Intelligence · Cited by 1,398
Modeling Relations and Their Mentions without Labeled Text
Riedel, S., Yao, L., & McCallum, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15939-8_10 · Cited by 1,270
Learning to link with wikipedia
Milne, D., & Witten, I. H. (2008) · Proceedings of the 17th ACM conference on Information and knowledge management · doi:10.1145/1458082.1458150 · Cited by 1,237
Identifying Relations for Open Information Extraction
Fader, A., Soderland, S. G., & Etzioni, O. (2011) · Cited by 1,144
Large-Scale Named Entity Disambiguation Based on Wikipedia Data
Cucerzan, S. (2007) · Cited by 1,061
The Automatic Content Extraction (ACE) Program – Tasks, Data, and Evaluation
Doddington, G. R., Mitchell, A., Przybocki, M. A., Ramshaw, L., Strassel, S. M., & Weischedel, R. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4o6ysc5sicba · Cited by 1,029
Open information extraction from the web
Etzioni, O., Banko, M., Soderland, S., & Weld, D. S. (2008) · Communications of the ACM · doi:10.1145/1409360.1409378 · Cited by 1,012
Self-citationKnowledge-Based Weak Supervision for Information Extraction of Overlapping Relations
Hoffmann, R., Zhang, C., Ling, X., Zettlemoyer, L., & Weld, D. S. (2011) · Cited by 874
Self-citationUnsupervised Models for Named Entity Classification
Collins, M., & Singer, Y. (1999) · Cited by 819
Using Encyclopedic Knowledge for Named Entity Disambiguation
Bunescu, R., & PAŞCA, M. A. (2006) · Cited by 809
Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., & Weischedel, R. (2006) · Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers on XX - NAACL '06 · doi:10.3115/1614049.1614064 · Cited by 806 · cited 4×
“, Ontonotes (Hovy et al. 2006)) use more, but still fail to make enough distinctions to provide the most useful features for a relation extraction system.”
BackgroundMethodInfluentialTAGME: on-the-fly annotation of short text fragments (by wikipedia entities)
Ferragina, P., & Scaiella, U. (2010) · Proceedings of the 19th ACM international conference on Information and knowledge management · doi:10.1145/1871437.1871689 · Cited by 743
Local and global algorithms for disambiguation to Wikipedia
Ratinov, L. (2024) · TIB Data Manager · doi:10.57702/yvubzlq1 · Cited by 596
New York Times Annotated Corpus
Sandhaus, E., & Linguistic Data Consortium (2012) · TIB Data Manager · doi:10.57702/qbrk4fuh · Cited by 586
Constructing biological knowledge bases by extracting information from text sources.
Craven, M. W., & Kumlien, J. (1999) · PubMed · Cited by 582
Semi-Supervised Learning for Natural Language
Liang, P. (2005) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 299
Name Tagging with Word Clusters and Discriminative Training
Miller, S. L., Guinness, J., & Zamanian, A. (2004) · Cited by 259
Fine grained classification of named entities
Fleischman, M., & Hovy, E. (2002) · Proceedings of the 19th international conference on Computational linguistics - · doi:10.3115/1072228.1072358 · Cited by 186
TAGME: on-the-fly annotation of short text fragments (by Wikipedia entities)Preprint
Ferragina, P., & Scaiella, U. (2010) · arXiv (Cornell University) · Cited by 143
Learning 5000 Relational Extractors
Hoffmann, R., Zhang, C., & Weld, D. S. (2010) · Cited by 119
Self-citationNadeau, D. (2007) · uO Research (University of Ottawa) · doi:10.20381/ruor-19854 · Cited by 107
Transforming Wikipedia into Named Entity Training Data
Nothman, J., Curran, J., & Murphy, T. (2008) · Cited by 101
WikiNet: A Very Large Scale Multi-Lingual Concept Network
Năstase, V., Strube, M., Börschinger, B., Zirn, C., & Elghafari, A. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2j7ygzb3nhhr · Cited by 85
Fine-Grained Named Entity Recognition Using Conditional Random Fields for Question Answering
Lee, C., Hwang, Y.-G., Oh, H.-J., et al. (2006) · Lecture notes in computer science · doi:10.1007/11880592_49 · Cited by 71
Extended Named Entity Ontology with Attribute Information
Sekine, S. (2008) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/56bcet4s8aza · Cited by 52
Structured generative models for unsupervised named-entity clustering
Elsner, M., Eugene Charniak, D., & Johnson, M. (2009) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1620754.1620778 · Cited by 44
Instance-based ontology population exploiting named-entity substitution
Giuliano, C., & Gliozzo, A. (2008) · International Conference on Computational Linguistics · doi:10.3115/1599081.1599115 · Cited by 39
Assessing the Challenge of Fine-Grained Named Entity Recognition and Classification
Ekbal, A., Sourjikova, E., Frank, A., & Ponzetto, S. P. (2010) · Cited by 33
Cited by
Hogan, A., Blomqvist, E., Cochez, M., D’amato, C., Melo, G. D., Gutierrez, C., Kirrane, S., Gayo, J. E. L., Navigli, R., Neumaier, S., et al. (2022) · ACM Computing Surveys · doi:10.1145/3447772 · Cited by 1,904
A Survey on Deep Learning for Named Entity Recognition
Li, J., Sun, A., Han, J., & Li, C. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2981314 · Cited by 1,567
Entity Linking with a Knowledge Base: Issues, Techniques, and Solutions
Shen, W., Wang, J., & Han, J. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2327028 · Cited by 761
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters
Wang, R., Tang, D., Duan, N., Wei, Z., Huang, X., Ji, J., Cao, G., Jiang, D., & Zhou, M. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.121 · Cited by 456
Zhang, J., & El-Gohary, N. M. (2016) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000346 · Cited by 414
Metadata
- Authors
- Ling, X., & Weld, D.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2021-09-20
- Volume
- 26
- Issue
- 1
- Pages
- 94-100
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2406945108
- Cited by
- 476
- References
- 44
- FWCI
- 18.51
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.