The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Joint entity recognition and relation extraction as a multi-head selection problem
Open accessAbstract
Abstract State-of-the-art models for joint entity recognition and relation extraction strongly rely on external natural language processing (NLP) tools such as POS (part-of-speech) taggers and dependency parsers. Thus, the performance of such joint models depends on the quality of the features obtained from these NLP tools. However, these features are not always accurate for various languages and contexts. In this paper, we propose a joint neural model which performs entity recognition and relation extraction simultaneously, without the need of any manually extracted features or the use of any external tool. Specifically, we model the entity recognition task using a CRF (Conditional Random Fields) layer and the relation extraction task as a multi-head selection problem (i.e., potentially identify multiple relations for each entity). We present an extensive experimental setup, to demonstrate the effectiveness of our method using datasets from various contexts (i.e., news, biomedical, real estate) and languages (i.e., English, Dutch). Our model outperforms the previous neural models that use automatically extracted features, while it performs within a reasonable margin of feature-based neural models, or even beats them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567
A survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507
Reasoning With Neural Tensor Networks for Knowledge Base Completion
Socher, R., Chen, D., Manning, C. D., & Ng, A. Y. (2013) · Cited by 1,667
Relation Classification via Convolutional Deep Neural Network
Zeng, D., Liu, K., Lai, S., Zhou, G., & Zhao, J. (2015) · Cited by 1,467
Proceedings of the 26th International Conference on Neural Information Processing Systems
Burges, C. J. C., Bottou, L., Welling, M., Zoubin Ghahramani, A., & Weinberger, K. Q. (2013) · Cited by 1,323
End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures
Miwa, M., & Bansal, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1105 · Cited by 1,322
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,259
Support vector machine learning for interdependent and structured output spaces
Tsochantaridis, I., Hofmann, T., Joachims, T., & Altun, Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015341 · Cited by 1,243
Taskar, B., Guestrin, C., & Koller, D. (2003) · Cited by 1,206
The Automatic Content Extraction (ACE) Program – Tasks, Data, and Evaluation
Doddington, G. R., Mitchell, A., Przybocki, M. A., Ramshaw, L., Strassel, S. M., & Weischedel, R. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4o6ysc5sicba · Cited by 1,029
Dependency tree kernels for relation extraction
Culotta, A., & Sorensen, J. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1219009 · Cited by 814
Edmonds, J. (1967) · Journal of Research of the National Bureau of Standards Section B Mathematics and Mathematical Physics · doi:10.6028/jres.071b.032 · Cited by 731
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence
Chen, Y., Diethe, T., & Flach, P. A. (2016) · National Conference on Artificial Intelligence · Cited by 680
Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Paths
Xu, Y., Mou, L., Li, G., Chen, Y., Peng, H., & Jin, Z. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1206 · Cited by 653
Kambhatla, N. (2004) · Proceedings of the ACL 2004 on Interactive poster and demonstration sessions - · doi:10.3115/1219044.1219066 · Cited by 607
Kernel methods for relation extraction
Zelenko, D., Aone, C., & Richardella, A. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118703 · Cited by 573
RelEx—Relation extraction using dependency parse trees
Fundel, K., Küffner, R., & Zimmer, R. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btl616 · Cited by 563
Incremental Joint Extraction of Entity Mentions and Relations
Li, Q., & Ji, H. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1038 · Cited by 535
Silberer, C., & Lapata, M. (2012) · The Association for Computational Linguistics · Cited by 520
Classifying Relations by Ranking with Convolutional Neural Networks
dos Santos, C., Xiang, B., & Zhou, B. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1061 · Cited by 498
Gurulingappa, H., Rajput, A. M., Roberts, A., Fluck, J., Hofmann-Apitius, M., & Toldo, L. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2012.04.008 · Cited by 446
A Linear Programming Formulation for Global Inference in Natural Language Tasks
Roth, D., & Yih, W.-T. (2004) · Cited by 441
Distributional Semantics Resources for Biomedical Text Processing
Pyysalo, S., Ginter, F., Moen, H., Salakoski, T., & Ananiadou, S. (2013) · Research Explorer (The University of Manchester) · Cited by 429
Tsujii, J., & Hajič, J. (2014) · International Conference on Computational Linguistics · Cited by 375
Modeling Joint Entity and Relation Extraction with Table Representation
Miwa, M., & Sasaki, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1200 · Cited by 369
Table Filling Multi-Task Recurrent Neural Network for Joint Entity and Relation Extraction
Gupta, P., Schütze, H., & Andrassy, B. (2016) · International Conference on Computational Linguistics · Cited by 324
Going out on a limb: Joint Extraction of Entity Mentions and Relations without Dependency Trees
Katiyar, A., & Cardie, C. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1085 · Cited by 279
Relation Classification via Recurrent Neural Network
Zhang, D., & Wang, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.01006 · Cited by 264
Joint entity and relation extraction based on a hybrid neural network
Zheng, S., Hao, Y., Lu, D., Bao, H., Xu, J., Hao, H., & Xu, B. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.075 · Cited by 251
Proceedings of the 5th International Workshop on Semantic Evaluation
Silberer, C., & Ponzetto, S. P. (2010) · Cited by 247
Proceedings of the 17th International Conference on Neural Information Processing Systems
Saul, L. K., Weiss, Y., & Bottou, L. (2004) · Cited by 241
A neural joint model for entity and relation extraction from biomedical text
Li, F., Zhang, M., Fu, G., & Ji, D. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1609-9 · Cited by 238
Bon-EV: an improved multiple testing procedure for controlling false discovery rates
Li, D., Xie, Z., Zand, M., Fogg, T., & Dye, T. (2017) · BMC Bioinformatics · doi:10.1186/s12859-016-1414-x · Cited by 230
Joint Inference for Fine-grained Opinion Extraction
Yang, B., & Cardie, C. (2013) · Cited by 222
Extraction of potential adverse drug events from medical case reports
Gurulingappa, H., Mateen‐Rajpu, A., & Toldo, L. (2012) · Journal of Biomedical Semantics · doi:10.1186/2041-1480-3-15 · Cited by 211
A Review of Relation Extraction
Yang, Y., Xun, H., & You, H. (2013) · Shuju fenxi yu zhishi faxian · doi:10.11925/infotech.1003-3513.2013.11.05 · Cited by 193
Combining Recurrent and Convolutional Neural Networks for Relation Classification
Vu, N. T., Adel, H., Gupta, P., & Schütze, H. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1065 · Cited by 190
Classifying Relations by Ranking with Convolutional Neural NetworksPreprint
dos Santos, C. N., Xiang, B., & Zhou, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06580 · Cited by 185
Proceedings of Coling: The 20th International Conference on Computational Linguistics
Smith, B., & Fellbaum, C. (2004) · Cited by 118
Global Normalization of Convolutional Neural Networks for Joint Entity and Relation Classification
Adel, H., & Schütze, H. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1181 · Cited by 97
Dependency Parsing as Head Selection
Zhang, X., Cheng, J., & Lapata, M. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1063 · Cited by 96
Joint Entity and Relation Extraction Using Card-Pyramid Parsing
Kate, R. J., & Mooney, R. J. (2010) · Cited by 82
Joint models for extracting adverse drug events from biomedical text
Li, F., Zhang, Y., Zhang, M., & Ji, D. (2016) · International Joint Conference on Artificial Intelligence · Cited by 51
Bekoulis, G., Deleu, J., Demeester, T., & Develder, C. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.02.031 · Cited by 32
Self-citation(2015) · doi:10.4230/oasics.slate.2021.8 · Cited by 1
Cited by
Structured information extraction from scientific text with large language models
Dagdelen, J., Dunn, A., Lee, S., Walker, N., Rosen, A. S., Ceder, G., Persson, K. A., & Jain, A. (2024) · Nature Communications · doi:10.1038/s41467-024-45563-x · Cited by 771
Knowledge Graphs: Opportunities and Challenges
Peng, C., Xia, F., Naseriparsa, M., & Osborne, F. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10465-9 · Cited by 717
TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking
Wang, Y., Yu, B., Zhang, Y., Liu, T., Zhu, H., & Sun, L. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.138 · Cited by 457
A Comprehensive Survey on Automatic Knowledge Graph Construction
Zhong, L., Wu, J., Li, Q., Peng, H., & Wu, X. (2024) · ACM Computing Surveys · doi:10.1145/3618295 · Cited by 382
Christopoulou, F., Tran, T. T., Sahu, S. K., Miwa, M., & Ananiadou, S. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz101 · Cited by 113
Metadata
- Authors
- Bekoulis, G., Deleu, J., Demeester, T., & Develder, C.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2018-12
- Volume
- 114
- Pages
- 34-45
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2799125718
- Cited by
- 436
- References
- 59
- FWCI
- 22.63
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.