The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
CoType: Joint Extraction of Typed Entities and Relations with Knowledge Bases
Open accessAbstract
Extracting entities and relations for types of interest from text is important for understanding massive text corpora. Traditionally, systems of entity relation extraction have relied on human-annotated corpora for training and adopted an incremental pipeline. Such systems require additional human expertise to be ported to a new domain, and are vulnerable to errors cascading down the pipeline. In this paper, we investigate joint extraction of typed entities and relations with labeled data heuristically obtained from knowledge bases (i.e., distant supervision). As our algorithm for type labeling via distant supervision is context-agnostic, noisy training data poses unique challenges for the task. We propose a novel domain-independent framework, called CoType, that runs a data-driven text segmentation algorithm to extract entity mentions, and jointly embeds entity mentions, relation mentions, text features and type labels into two low-dimensional spaces (for entity and relation mentions respectively), where, in each space, objects whose types are close will also have similar representations. CoType, then using these learned embeddings, estimates the types of test (unlinkable) mentions. We formulate a joint optimization problem to learn embeddings from text corpora and knowledge bases, adopting a novel partial-label loss function for noisy labeled data and introducing an object "translation" function to capture the cross-constraints of entities and relations on each other. Experiments on three public datasets demonstrate the effectiveness of CoType across different domains (e.g., news, biomedical), with an average of 25% improvement in F1 score compared to the next best method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
DeepWalk: online learning of social representations
Perozzi, B., Al-Rfou, R., & Skiena, S. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623732 · Cited by 10,123
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., & McClosky, D. (2014) · Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.3115/v1/p14-5010 · Cited by 7,037
(2013) · Cited by 5,726
LINE: Large-scale Information Network Embedding
Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., & Mei, Q. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741093 · Cited by 5,416 · cited 5×
“resent relation mention z i 2Z L and text feature f j 2Fz in the d-dimensional relation embedding space. Similar to the distributional hypothesis [30] in text corpora, we apply second-order proximity [50] to model the idea that objects with similar distribution over neighbors are similar to each other as follows. ZF =…”
BackgroundMethodInfluentialSelf-citationFreebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
Locality Preserving Projections
He, X., & Niyogi, P. (2003) · Cited by 4,119
Incorporating non-local information into information extraction systems by Gibbs sampling
Finkel, J. R., Grenager, T., & Manning, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219885 · Cited by 3,008
Distant supervision for relation extraction without labeled data
Mintz, M., Bills, S., Snow, R., & Jurafsky, D. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - ACL-IJCNLP '09 · doi:10.3115/1690219.1690287 · Cited by 2,752
A survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507 · cited 3×
“Most existing work follows an incremental diagram—they first perform entity recognition and typing [34, 40] to extract typed entity mentions, and then solve relation extraction [2, 17] to identify relation mentions of target types.”
BackgroundKnowledge vault: a web-scale approach to probabilistic knowledge fusion
Dong, X., Gabrilovich, E., Heitz, G., Horn, W., Lao, N., Murphy, K., Strohmann, T., Sun, S., & Zhang, W. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623623 · Cited by 1,533 · cited 1×
“, as primitives in information extraction, knowledge base population [10, 52], and question-answering systems [48, 3].”
BackgroundPegasos: primal estimated sub-gradient solver for SVM
Shalev-Shwartz, S., Singer, Y., Srebro, N., & Cotter, A. (2011) · Mathematical Programming · doi:10.1007/s10107-010-0420-4 · Cited by 1,477
Design challenges and misconceptions in named entity recognition
Ratinov, L., & Roth, D. (2009) · Proceedings of the Thirteenth Conference on Computational Natural Language Learning - CoNLL '09 · doi:10.3115/1596374.1596399 · Cited by 1,448
Modeling Relations and Their Mentions without Labeled Text
Riedel, S., Yao, L., & McCallum, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15939-8_10 · Cited by 1,270
DBpedia spotlight: shedding light on the web of documents
Mendes, P. N., Jakob, M., García-Silva, A., & Bizer, C. (2011) · Proceedings of the 7th International Conference on Semantic Systems · doi:10.1145/2063518.2063519 · Cited by 1,180
Robust Disambiguation of Named Entities in Text
Hoffart, J., Yosef, M. A., Bordino, I., Fürstenau, H., Pinkal, M., Spaniol, M., Taneva, B., Thater, S., & Weikum, G. (2011) · Cited by 925
Knowledge-Based Weak Supervision for Information Extraction of Overlapping Relations
Hoffmann, R., Zhang, C., Ling, X., Zettlemoyer, L., & Weld, D. S. (2011) · Cited by 874
Dependency tree kernels for relation extraction
Culotta, A., & Sorensen, J. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1219009 · Cited by 814
Exploring various knowledge in relation extraction
GuoDong, Z., Jian, S., Jie, Z., & Min, Z. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219893 · Cited by 764
Representing Text for Joint Embedding of Text and Knowledge Bases
Toutanova, K., Chen, D., Pantel, P., Poon, H., Choudhury, P., & Gamon, M. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1174 · Cited by 750
Web-scale information extraction in knowitall: (preliminary results)
Etzioni, O., Cafarella, M., Downey, D., Kok, S., Popescu, A.-M., Shaked, T., Soderland, S., Weld, D. S., & Yates, A. (2004) · Proceedings of the 13th international conference on World Wide Web · doi:10.1145/988672.988687 · Cited by 747
Multi-instance Multi-label Learning for Relation Extraction
Surdeanu, M., Tibshirani, J., Nallapati, R. M., & Manning, C. D. (2012) · Cited by 643
Incremental Joint Extraction of Entity Mentions and Relations
Li, Q., & Ji, H. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1038 · Cited by 535
Self-citationSubsequence Kernels for Relation Extraction
Mooney, R. J., & Bunescu, R. (2005) · neural information processing systems · Cited by 493
BioInfer: a corpus for information extraction in the biomedical domain
Pyysalo, S., Ginter, F., Heimonen, J., Björne, J., Boberg, J., Järvinen, J., & Salakoski, T. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-50 · Cited by 485
Fine-Grained Entity Recognition
Ling, X., & Weld, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8122 · Cited by 476
Cour, T., Sapp, B., & Taskar, B. (2011) · ScholarlyCommons (University of Pennsylvania) · Cited by 377
Modeling Joint Entity and Relation Extraction with Table Representation
Miwa, M., & Sasaki, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1200 · Cited by 369
Knowledge base completion via search-based question answering
West, R., Gabrilovich, E., Murphy, K., Sun, S., Gupta, R., & Lin, D. (2014) · Proceedings of the 23rd international conference on World wide web · doi:10.1145/2566486.2568032 · Cited by 305
Finding the right facts in the crowd: factoid question answering over social media
Bian, J., Liu, Y., Agichtein, E., & Zha, H. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367561 · Cited by 276
Learning to Extract Relations from the Web using Minimal Supervision
Bunescu, R., & Mooney, R. J. (2007) · Cited by 261
Scalable topical phrase mining from text corpora
El-Kishky, A., Song, Y., Wang, C., Voss, C. R., & Han, J. (2014) · Proceedings of the VLDB Endowment · doi:10.14778/2735508.2735519 · Cited by 211
Self-citationImproved Relation Extraction with Feature-Rich Compositional Embedding Models
Gormley, M. R., Yu, M., & Dredze, M. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1205 · Cited by 191
Mining Quality Phrases from Massive Text Corpora
Liu, J., Shang, J., Wang, C., Ren, X., & Han, J. (2015) · Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2723372.2751523 · Cited by 190
Self-citationLabel Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embedding
Ren, X., He, W., Qu, M., Voss, C. R., Ji, H., & Han, J. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939822 · Cited by 162
Self-citationHYENA: Hierarchical Type Classification for Entity Names
Yosef, M. A., Bauer, S., Hoffart, J., Spaniol, M., & Weikum, G. (2012) · HAL · Cited by 150
ClusType: Effective Entity Recognition and Typing by Relation Phrase-Based Clustering
Ren, X., El-Kishky, A., Wang, C., Tao, F., Voss, C. R., & Han, J. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783362 · Cited by 123
Self-citationImproved Pattern Learning for Bootstrapped Entity Extraction
Gupta, S., & Manning, C. D. (2014) · Conference on Computational Natural Language Learning · doi:10.3115/v1/w14-1611 · Cited by 121
Embedding Methods for Fine Grained Entity Type Classification
Yogatama, D., Gillick, D., & Lazic, N. (2015) · doi:10.3115/v1/p15-2048 · Cited by 119
Open Domain Question Answering via Semantic Enrichment
Sun, H., Ma, H., Yih, W.-T., Tsai, C.-T., Liu, J., & Chang, M.-W. (2015) · International World Wide Web Conference (WWW) · doi:10.1145/2736277.2741651 · Cited by 114
A Word Embedding Approach to Predicting the Compositionality of Multiword Expressions
Salehi, B., Cook, P. F., & Baldwin, T. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1099 · Cited by 107
Joint inference of entities, relations, and coreference
Singh, S., Riedel, S., Martin, B., Zheng, J., & McCallum, A. (2013) · Automated Knowledge Base Construction · doi:10.1145/2509558.2509559 · Cited by 104
Context-Dependent Fine-Grained Entity Type TaggingPreprint
Gillick, D., Lazic, N., Ganchev, K., Kirchner, J., & Huynh, D. F. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1820 · Cited by 99
No Noun Phrase Left Behind: Detecting and Typing Unlinkable Entities
Lin, T., & Etzioni, O. (2012) · Cited by 98
Exploiting Background Knowledge for Relation Extraction
Chan, Y. S., & Roth, D. (2010) · Cited by 88
Extracting Relations between Non-Standard Entities using Distant Supervision and Imitation Learning
Augenstein, I., Vlachos, A., & Maynard, D. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1086 · Cited by 32
Mining for unambiguous instances to adapt part-of-speech taggers to new domains
Hovy, D., Plank, B., Alonso, H. M., & Søgaard, A. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1135 · Cited by 7
Cited by
Hogan, A., Blomqvist, E., Cochez, M., D’amato, C., Melo, G. D., Gutierrez, C., Kirrane, S., Gayo, J. E. L., Navigli, R., Neumaier, S., et al. (2022) · ACM Computing Surveys · doi:10.1145/3447772 · Cited by 1,904
Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme
Zheng, S., Wang, F., Bao, H., Hao, Y., Zhou, P., & Xu, B. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1113 · Cited by 787
A Novel Cascade Binary Tagging Framework for Relational Triple Extraction
Wei, Z., Su, J., Wang, Y., Tian, Y., & Chang, Y. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.136 · Cited by 649
PTR: Prompt Tuning with Rules for Text Classification
Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M. (2021) · arXiv · doi:10.48550/arxiv.2105.11259 · Cited by 478
GraphRel: Modeling Text as Relational Graphs for Joint Entity and Relation Extraction
Fu, T.-J., Li, P.-H., & Ma, W.-Y. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1136 · Cited by 447
Metadata
- Authors
- Ren, X., Wu, Z., He, W., Qu, M., Voss, C. R., Ji, H., Abdelzaher, T. F., & Han, J.
- Venue
- Proceedings of the 26th International Conference on World Wide Web
- Published
- 2017-04-03
- Pages
- 1015-1024
- OpenAlex
- W2539469848
- Cited by
- 265
- References
- 47
- FWCI
- 15.75
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.