The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Cross-Sentence N-ary Relation Extraction with Graph LSTMs
Open accessAbstract
Past work in relation extraction has focused on binary relations in single sentences. Recent NLP inroads in high-value domains have sparked interest in the more general setting of extracting n-ary relations that span multiple sentences. In this paper, we explore a general relation extraction framework based on graph long short-term memory networks (graph LSTMs) that can be easily extended to cross-sentence n-ary relation extraction. The graph formulation provides a unified way of exploring different LSTM approaches and incorporating various intra-sentential and inter-sentential dependencies, such as sequential, syntactic, and discourse relations. A robust contextual representation is learned for the entities, which serves as input to the relation classifier. This simplifies handling of relations with arbitrary arity, and enables multi-task learning with related relations. We evaluate this framework in two important precision medicine settings, demonstrating its effectiveness with both conventional supervised learning and distant supervision. Cross-sentence extraction produced larger knowledge bases. and multi-task learning significantly improved extraction accuracy. A thorough analysis of various LSTM approaches yielded useful insight the impact of linguistic analysis on extraction accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., & McClosky, D. (2014) · Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.3115/v1/p14-5010 · Cited by 7,037
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S., Socher, R., & Manning, C. D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1150 · Cited by 3,081
Distant supervision for relation extraction without labeled data
Mintz, M., Bills, S., Snow, R., & Jurafsky, D. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - ACL-IJCNLP '09 · doi:10.3115/1690219.1690287 · Cited by 2,752
Baker, C. F., Fillmore, C. J., & Lowe, J. B. (1998) · Proceedings of the 36th annual meeting on Association for Computational Linguistics - · doi:10.3115/980845.980860 · Cited by 2,518
The Proposition Bank: An Annotated Corpus of Semantic Roles
Palmer, M., Gildea, D., & Kingsbury, P. (2005) · Computational Linguistics · doi:10.1162/0891201053630264 · Cited by 2,273
Generating Typed Dependency Parses from Phrase Structure Parses
de Marneffe, M.-C., MacCartney, B., & Manning, C. D. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3wtkaidk6ea8 · Cited by 2,258
Static Analysis of Shape in TensorFlow Programs
The Theano Development Team, Al‐Rfou, R., Alain, G., Almahairi, A., Angermueller, C., Bahdanau, D., Ballas, N., Bastien, F., Bayer, J., Belikov, A., et al. (2016) · arXiv (Cornell University) · doi:10.4230/lipics.ecoop.2020.15 · Cited by 1,589
Relation Classification via Convolutional Deep Neural Network
Zeng, D., Liu, K., Lai, S., Zhou, G., & Zhao, J. (2015) · Cited by 1,467
End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures
Miwa, M., & Bansal, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1105 · Cited by 1,322
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,259
Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks
Zeng, D., Liu, K., Chen, Y., & Zhao, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1203 · Cited by 1,149
Caruana, R. (1998) · Cited by 1,110
A shortest path dependency kernel for relation extraction
Bunescu, R. C., & Mooney, R. J. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220666 · Cited by 955
Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping
Caruana, R., Lawrence, S., & Giles, C. L. (2000) · Cited by 906
Exploring various knowledge in relation extraction
GuoDong, Z., Jian, S., Jie, Z., & Min, Z. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219893 · Cited by 764
Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Paths
Xu, Y., Mou, L., Li, G., Chen, Y., Peng, H., & Jin, Z. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1206 · Cited by 653
Kambhatla, N. (2004) · Proceedings of the ACL 2004 on Interactive poster and demonstration sessions - · doi:10.3115/1219044.1219066 · Cited by 607
Overview of BioNLP'09 shared task on event extraction
Kim, J.-D., Ohta, T., Pyysalo, S., Kano, Y., & Tsujii, J. (2009) · Proceedings of the Workshop on BioNLP Shared Task - BioNLP '09 · doi:10.3115/1572340.1572342 · Cited by 588
Constructing biological knowledge bases by extracting information from text sources.
Craven, M. W., & Kumlien, J. (1999) · PubMed · Cited by 582
Classifying Relations by Ranking with Convolutional Neural Networks
dos Santos, C., Xiang, B., & Zhou, B. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1061 · Cited by 498
Subsequence Kernels for Relation Extraction
Mooney, R. J., & Bunescu, R. (2005) · neural information processing systems · Cited by 493
Relation Classification via Multi-Level Attention CNNs
Wang, L., Cao, Z., de Melo, G., & Liu, Z. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1123 · Cited by 487
Bidirectional Long Short-Term Memory Networks for Relation Classification
Zhang, S., Zheng, D., Hu, X., & Yang, M. Y. (2015) · Institutional Repositories DataBase (IRDB) · Cited by 400
Semantic Object Parsing with Graph LSTM
Liang, X., Shen, X., Feng, J., Lin, L., & Yan, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_8 · Cited by 352
Semantic Relation Classification via Convolutional Neural Networks with Simple Negative Sampling
Xu, K., Feng, Y., Huang, S., & Zhao, D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1062 · Cited by 268
Distant Supervision for Relation Extraction beyond the Sentence Boundary
Quirk, C., & Poon, H. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1110 · Cited by 248
Self-citationPeng, N., & Dredze, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2025 · Cited by 230
Self-citationBidirectional Recurrent Convolutional Neural Network for Relation Classification
Cai, R., Zhang, X., & Wang, H. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1072 · Cited by 216
Combining linguistic and statistical analysis to extract relations from web documents
Suchanek, F. M., Ifrim, G., & Weikum, G. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150492 · Cited by 182
Neural Semantic Role Labeling with Dependency Path Embeddings
Roth, M., & Lapata, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1113 · Cited by 170
Improved Relation Classification by Deep Recurrent Neural Networks with Data Augmentation
Xu, Y., Jia, R., Mou, L., Li, G., Chen, Y., Lu, Y., & Jin, Z. G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.03651 · Cited by 161
Chinchor, N. A. (1998) · Cited by 155
Database of Genomic Biomarkers for Cancer Drugs and Clinical Targetability in Solid Tumors
Dienstmann, R., Jang, I. S., Bot, B. M., Friend, S. H., & Guinney, J. (2015) · Cancer Discovery · doi:10.1158/2159-8290.cd-14-1118 · Cited by 143
The CoNLL-2015 Shared Task on Shallow Discourse Parsing
Xue, N., Ng, H. T., Pradhan, S., Prasad, R., Bryant, C., & Rutherford, A. (2015) · doi:10.18653/v1/k15-2001 · Cited by 130
Semantic Role Labeling with Neural Network Factors
FitzGerald, N., Täckström, O., Ganchev, K., & Das, D. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1112 · Cited by 127
Beyond NomBank: A Study of Implicit Arguments for Nominal Predicates
Gerber, M. S., & Chai, J. Y. (2010) · Cited by 111
Exploiting Background Knowledge for Relation Extraction
Chan, Y. S., & Roth, D. (2010) · Cited by 88
Employing Word Representations and Regularization for Domain Adaptation of Relation Extraction
Nguyen, T. H., & Grishman, R. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-2012 · Cited by 81
Literome: PubMed-scale genomic knowledge base in the cloud
Poon, H., Quirk, C., DeZiel, C., & Heckerman, D. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu383 · Cited by 73
Self-citationCoreference based event-argument relation extraction on biomedical text
Yoshikawa, K., Riedel, S., Hirao, T., Asahara, M., & Matsumoto, Y. (2011) · Journal of Biomedical Semantics · doi:10.1186/2041-1480-2-s5-s6 · Cited by 50
DISTANT SUPERVISION FOR CANCER PATHWAY EXTRACTION FROM TEXT
Poon, H., Toutanova, K., & Quirk, C. (2014) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789814644730_0013 · Cited by 44
Self-citationEvent Extraction Using Distant Supervision
Reschke, K. S., Jankowiak, M., Surdeanu, M., Manning, C. D., & Jurafsky, D. S. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4czcapr6ez74 · Cited by 37
MSR SPLAT, a language analysis toolkit
Quirk, C., Choudhury, P., Gao, J., Suzuki, H., Toutanova, K., Gamon, M., Yih, W.-T., Cherry, C. A., & Vanderwende, L. (2012) · Cited by 32
Self-citationHong, L., Krause, S., Xu, F., Moro, A., Uszkoreit, H., & Roberto Navigli, A. (2015) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0005187303170324 · Cited by 14
Cited by
Graph neural networks: A review of methods and applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2020) · AI Open · doi:10.1016/j.aiopen.2021.01.001 · Cited by 6,880
DeepGCNs: Can GCNs Go As Deep As CNNs?
Li, G., Muller, M., Thabet, A., & Ghanem, B. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00936 · Cited by 1,400
Luan, Y., He, L., Ostendorf, M., & Hajishirzi, H. (2018) · arXiv · doi:10.48550/arxiv.1808.09602 · Cited by 714
Entity, Relation, and Event Extraction with Contextualized Span Representations
Wadden, D., Wennberg, U., Luan, Y., & Hajishirzi, H. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1585 · Cited by 564
DocRED: A Large-Scale Document-Level Relation Extraction Dataset
Yao, Y., Ye, D., Li, P., Han, X., Lin, Y., Liu, Z., Liu, Z., Huang, L., Zhou, J., & Sun, M. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1074 · Cited by 550
Metadata
- Authors
- Peng, N., Poon, H., Quirk, C., Toutanova, K., & Yih, W.-T.
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2017-12
- Volume
- 5
- Pages
- 101-115
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W2963020213
- Cited by
- 443
- References
- 51
- FWCI
- 28.70
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.