Modeling Relation Paths for Knowledge Graph Completion
The DOI matches its Crossref record; 55 of the 57 references it cites were found in a registry or an index.
Abstract
Knowledge graphs (KG) often encounter knowledge incompleteness. The path reasoning that predicts the unknown path relation between pairwise entities based on existing facts is one of the most promising approaches to the knowledge graph completion. However, most conventional path reasoning methods exclusively consider the entity description included in fact triples, ignoring both the type information of entities and the interaction between different semantic representations. In this study, we propose a novel method, Type-aware Attentive Path Reasoning (TAPR), to complete the knowledge graph by simultaneously considering KG structural information, textual information, and type information. More specifically, we first leverage types to enrich the representational learning of entities and relationships. Next, we describe a type-level attention to select the most relevant type of given entity in a specific triple without any predefined rules or patterns to reduce the impact of noisy types. After learning the distributed representation of all paths, path-level attention assigns different weights to paths, from which relations among entity pairs are calculated. We conduct a series of experiments on a real-world dataset to demonstrate the effectiveness of TAPR. Experimental results show that our method significantly outperforms all baselines on link prediction and entity prediction tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Therefore, YOLOv8 is the newest and most effective object detector based on convolution layers [37,38].”
From Vehicle Detection and Classification via YOLOv8 and Deep Belief Network over Aerial Image Sequences (2023) · cites this paper as [38]
Citations
Cites
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015
Berners-Lee, T., Hendler, J., & Lassila, O. (2001) · Scientific American · doi:10.1038/scientificamerican0501-34 · Cited by 8,651
(2013) · Cited by 5,726
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
Knowledge Graph Embedding by Translating on Hyperplanes
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8870 · Cited by 3,915
Learning Entity and Relation Embeddings for Knowledge Graph Completion
Lin, Y., Liu, Z., Sun, M., Liu, Y., & Zhu, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9491 · Cited by 3,749
Wikidata: a free collaborative knowledgebase
Vrandečić, D., & Krötzsch, M. (2014) · Communications of the ACM · doi:10.1145/2629489 · Cited by 3,342
Knowledge Graph Embedding: A Survey of Approaches and Applications
Wang, Q., Mao, Z., Wang, B., & Guo, L. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2754499 · Cited by 2,654
Yago: a core of semantic knowledge
Suchanek, F. M., Kasneci, G., & Weikum, G. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242667 · Cited by 2,512
DBpedia: A Nucleus for a Web of Open Data
Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., & Ives, Z. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-76298-0_52 · Cited by 2,454
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Yang, B., Yih, W.-T., He, X., Gao, J., & Deng, L. (2014) · arXiv · doi:10.48550/arxiv.1412.6575 · Cited by 2,252
Toward an architecture for never-ending language learning
Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E., & Mitchell, T. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7519 · Cited by 2,000
A Review of Relational Machine Learning for Knowledge Graphs
Nickel, M., Murphy, K., Tresp, V., & Gabrilovich, E. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2483592 · Cited by 1,638
GraRep: Learning Graph Representations with Global Structural Information
Cao, S., Lu, W., & Xu, Q. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806512 · Cited by 1,571
Knowledge vault: a web-scale approach to probabilistic knowledge fusion
Dong, X., Gabrilovich, E., Heitz, G., Horn, W., Lao, N., Murphy, K., Strohmann, T., Sun, S., & Zhang, W. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623623 · Cited by 1,533
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 1,532
DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning
Xiong, W., Hoang, T., & Wang, W. Y. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1060 · Cited by 812
Representing Text for Joint Embedding of Text and Knowledge Bases
Toutanova, K., Chen, D., Pantel, P., Poon, H., Choudhury, P., & Gamon, M. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1174 · Cited by 750
Bordes, A., Glorot, X., Weston, J., & Bengio, Y. (2014) · Machine Learning · doi:10.1007/s10994-013-5363-6 · Cited by 675
Modeling Relation Paths for Representation Learning of Knowledge Bases
Lin, Y., Liu, Z., Luan, H., Sun, M., Rao, S., & Liu, S. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1082 · Cited by 657
Relational retrieval using a combination of path-constrained random walks
Lao, N., & Cohen, W. W. (2010) · Machine Learning · doi:10.1007/s10994-010-5205-8 · Cited by 614
Information Extraction over Structured Data: Question Answering with Freebase
Yao, X., & Van Durme, B. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1090 · Cited by 490
Random Walk Inference and Learning in A Large Scale Knowledge Base
Lao, N., Mitchell, T. M., & Cohen, W. W. (2018) · Figshare · doi:10.1184/r1/6476267 · Cited by 482
Knowledge Graph Completion with Adaptive Sparse Transfer Matrix
Ji, G., Liu, K., He, S., & Zhao, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10089 · Cited by 425
An Adaptation of the Vector-Space Model for Ontology-Based Information Retrieval
Castells, P., Fernandez, M., & Vallet, D. (2007) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.22 · Cited by 412
Representation learning of knowledge graphs with hierarchical types
Xie, R., Liu, Z., & Sun, M. (2016) · International Joint Conference on Artificial Intelligence · Cited by 394
Das, R., Dhuliawala, S., Zaheer, M., Vilnis, L., Durugkar, I., Krishnamurthy, A., Smola, A. J., & McCallum, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.05851 · Cited by 374
On the thresholds of knowledge
Lenat, D. B., & Feigenbaum, E. A. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90055-o · Cited by 327
Knowledge base completion via search-based question answering
West, R., Gabrilovich, E., Murphy, K., Sun, S., Gupta, R., & Lin, D. (2014) · Proceedings of the 23rd international conference on World wide web · doi:10.1145/2566486.2568032 · Cited by 305
Text-enhanced representation learning for knowledge graph
Wang, Z., & Li, J. (2016) · International Joint Conference on Artificial Intelligence · Cited by 240
The singularity is not near: slowing growth of Wikipedia
Suh, B., Convertino, G., Chi, E. H., & Pirolli, P. (2009) · Proceedings of the 5th International Symposium on Wikis and Open Collaboration · doi:10.1145/1641309.1641322 · Cited by 238
Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks
Das, R., Neelakantan, A., Belanger, D., & McCallum, A. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1013 · Cited by 231
Compositional Vector Space Models for Knowledge Base Completion
Neelakantan, A., Roth, B., & McCallum, A. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1016 · Cited by 230
Modelling Relational Data using Bayesian Clustered Tensor Factorization
Sutskever, I., Salakhutdinov, R., & Tenenbaum, J. B. (2009) · Cited by 229
Knowledge graph completion via complex tensor factorization
(2017) · arXiv (Cornell University) · doi:10.5555/3122009.3208011 · Cited by 211
From information to knowledge: harvesting entities and relationships from web sources
Weikum, G., & Theobald, M. (2010) · Proceedings of the twenty-ninth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems · doi:10.1145/1807085.1807097 · Cited by 141
Variational Knowledge Graph Reasoning
Chen, W., Xiong, W., Yan, X., & Wang, W. Y. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1165 · Cited by 108
Incorporating Relation Paths in Neural Relation Extraction
Zeng, W., Lin, Y., Liu, Z., & Sun, M. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1186 · Cited by 93
Tensor Factorization for Multi-relational Learning
Nickel, M., & Tresp, V. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40994-3_40 · Cited by 90
Learning beyond Datasets: Knowledge Graph Augmented Neural Networks for Natural Language Processing
Annervaz, K. M., Chowdhury, S. B. R., & Dukkipati, A. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1029 · Cited by 75
Knowledge Base Completion via Coupled Path Ranking
Wang, Q., Liu, J., Luo, Y., Wang, B., & Lin, C.-Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1124 · Cited by 74
(2014) · Cited by 66
Inside YAGO2s: a transparent information extraction architecture
Biega, J., Kuzey, E., & Suchanek, F. M. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2487788.2487935 · Cited by 62
CBN: Constructing a clinical Bayesian network based on data from the electronic medical record
Shen, Y., Zhang, L., Zhang, J., Yang, M., Tang, B., Li, Y., & Lei, K. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.10.007 · Cited by 54
Self-citationLearning beyond Datasets: Knowledge Graph Augmented Neural Networks for Natural Language ProcessingPreprint
Annervaz, K. M., Chowdhury, S. B. R., & Dukkipati, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05930 · Cited by 52
Automatically structuring domain knowledge from text: An overview of current research
Clark, M., Kim, Y., Kruschwitz, U., Song, D., Albakour, D., Dignum, S., Beresi, U. C., Fasli, M., & Roeck, A. N. D. (2011) · Information Processing & Management · doi:10.1016/j.ipm.2011.07.002 · Cited by 50
Content-Based Recommendations via DBpedia and Freebase: A Case Study in the Music Domain
Nguyen, P. T., Tomeo, P., Noia, T. D., & Sciascio, E. D. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25007-6_35 · Cited by 30
Knowledge Base Completion by Variational Bayesian Neural Tensor Decomposition
He, L., Liu, B., Li, G., Sheng, Y., Wang, Y., & Xu, Z. (2018) · Cognitive Computation · doi:10.1007/s12559-018-9565-x · Cited by 26
Path-based reasoning with constrained type attention for knowledge graph completion
Lei, K., Zhang, J., Xie, Y., Wen, D., Chen, D., Yang, M., & Shen, Y. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04181-1 · Cited by 18
Self-citationAttentive Path Combination for Knowledge Graph Completion.
Jiang, X., Wang, Q., Qi, B., Qiu, Y., Li, P., & Wang, B. (2017) · Asian Conference on Machine Learning · Cited by 14
Attention-Aware Path-Based Relation Extraction for Medical Knowledge Graph
Wen, D., Liu, Y., Yuan, K., Si, S., & Shen, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-73830-7_32 · Cited by 13
Self-citationGastroenterology Ontology Construction Using Synonym Identification and Relation Extraction
Shen, Y., Li, Y., Deng, Y., Zhang, J., Yang, M., Chen, J., Si, S., & Lei, K. (2018) · IEEE Access · doi:10.1109/access.2018.2862885 · Cited by 8
Self-citationKnowledge Representation and Reasoning with Deep Neural Networks
Neelakantan, A. (2017) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/10578133.0 · Cited by 7
Accurate fact harvesting from natural language text in wikipedia with Lector
Cannaviccio, M., Barbosa, D., & Merialdo, P. (2016) · doi:10.1145/2932194.2932203 · Cited by 7
Research works printed but not linked: 2
- xie, 2016, Representation learning of knowledge graphs with hierarchical types, Proc 25th Int Joint Conf Artif Intell, 2965
- deaton, 2005, The comprehensive terrorism knowledge base in CYC, Proc Int Conf Intell Anal, 1
Cited by
Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence
Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10179-8 · Cited by 2,495
“Following that, we come to the idea of responsible artificial intelligence, which is an AI that takes into account societal values as well as moral and ethical issues to improve the usability of AI models in real-world applications [27, 28].”
BackgroundMedical image analysis using deep learning algorithms
Li, M., Jiang, Y., Zhang, Y., & Zhu, H. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1273253 · Cited by 505
“It is also important to engage with stakeholders, including patients, regulatory bodies, and legal experts, to ensure that the development and use of these technologies is safe, ethical, and compliant with relevant laws and regulations (100).”
BackgroundFew-NERD: A Few-shot Named Entity Recognition Dataset
Ding, N., Xu, G., Chen, Y., Wang, X., Han, X., Xie, P., Zheng, H., & Liu, Z. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.248 · Cited by 212
“As a pivotal task of information extraction, NER is essential for a wide range of technologies (Cui et al., 2017; Li et al., 2019b; Ding et al., 2019; Shen et al., 2020).”
BackgroundSelf-citationTransforming Conversations with AI—A Comprehensive Study of ChatGPT
Bansal, G., Chamola, V., Hussain, A., Guizani, M., & Niyato, D. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10236-2 · Cited by 164
“By training on this vast amount of text data, ChatGPT acquires a broad understanding of language, including grammar, factual information, and contextual patterns [60, 61].”
Knowledge Graph Contrastive Learning Based on Relation-Symmetrical Structure
Liang, K., Liu, Y., Zhou, S., Tu, W., Wen, Y., Yang, X., Dong, X., & Liu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3282989 · Cited by 139
“Recent existing KGE models can be roughly categorized into three types [10], [10], [11], [31], [32], [33], [34].”
Method
Metadata
- Authors
- Shen, Y., Ding, N., Zheng, H.-T., Li, Y., & Yang, M.
- Affiliations
- Sun Yat-sen University (CN)
- Tsinghua Shenzhen International Graduate School (CN)
- Chinese Academy of Sciences (CN)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2021-11-01
- Volume
- 33
- Issue
- 11
- Pages
- 3607-3617
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W3003507729
- Cited by
- 153
- References
- 57
- Citations by year
- 2026: 9 · 2025: 20 · 2024: 31 · 2023: 74 · 2022: 13 · 2021: 6
- FWCI
- 9.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- Funders
- National Natural Science Foundation of China (61602013, 61773229)
- Shenzhen Fundamental Research Program (JCYJ20170818091546869)
- Basic Scientific Research Program of Shenzhen City (JCYJ20160331184440545)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Keywords
- knowledge graph completion, path reasoning, entity types, link prediction, entity prediction, knowledge graph incompleteness, entity representation learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.