Neural, symbolic and neural-symbolic reasoning on knowledge graphs
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As the most influential multi-modal KG survey, [15] focuses more on construction and applications than reasoning over them.”
From A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multi-Modal (2024) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
Modeling Relational Data with Graph Convolutional Networks
Schlichtkrull, M., Kipf, T. N., Bloem, P., van den Berg, R., Titov, I., & Welling, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93417-4_38 · Cited by 5,570
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852 · cited 2×
“In this survey, we discuss how the above two principles are performed and intertwined for reasoning over knowledge graphs (KGs) such as Freebase (Bollacker et al., 2008), DBpedia (Lehmann et al., 2015), YAGO (Suchanek et al., 2007) and NELL (Carlson et al., 2010), which are composed by a large number of (head, relatio…”
BackgroundGreedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · cited 1×
“Deep learning is a representative model of connectionism (Bengio et al., 2007; Hinton et al., 2006).”
BackgroundKnowledge Graph Embedding by Translating on Hyperplanes
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8870 · Cited by 3,915 · cited 4×
“P Q (Bordes et al., 2013) force h þ r to be close to t TransH (Wang et al., 2014) project entities into the relation-speci fi c hyperplane TransR (Lin et al., 2015) project entities and relations in separate spaces TransD (Ji et al., 2015) determine the project matrices by both entities and relations TransG (Xiao et al…”
BackgroundMethodInfluentialSelf-citationLearning Entity and Relation Embeddings for Knowledge Graph Completion
Lin, Y., Liu, Z., Sun, M., Liu, Y., & Zhu, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9491 · Cited by 3,749 · cited 2×
“Translation-based models usually learn embeddings by translating a head entity to a tail entity through the relation.”
BackgroundA Survey on Knowledge Graphs: Representation, Acquisition, and Applications
Ji, S., Pan, S., Cambria, E., Marttinen, P., & Yu, P. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3070843 · Cited by 2,947
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676
Knowledge Graph Embedding: A Survey of Approaches and Applications
Wang, Q., Mao, Z., Wang, B., & Guo, L. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2754499 · Cited by 2,654 · cited 1×
“Despite the abundant surveys about knowledge graph embedding (Ji et al., 2020; Rossi et al., 2020; Wang et al., 2017), acquisition and applications (Ji et al., 2020), question answering (Fu et al., 2020; Wu et al., 2019) and reasoning (Chen et al., 2020b), none of them explicitly sort out the…”
BackgroundEmbedding Entities and Relations for Learning and Inference in Knowledge Bases
Yang, B., Yih, W.-T., He, X., Gao, J., & Deng, L. (2014) · arXiv · doi:10.48550/arxiv.1412.6575 · Cited by 2,252 · cited 6×
“To reduce the computational cost, DisMult (Yang et al., 2015) is proposed to use the diagonal matrix with the diagonal vector indicating the embedding of the relation r to reduce the number of parameters.”
BackgroundMethodInfluentialA View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants
Neal, R. M., & Hinton, G. E. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_12 · Cited by 2,187 · cited 2×
“These hybrid methods generally fall into two categories: the neural-enhanced symbolic reasoning which only targets at parsing the questions, or the end-to-end reasoning which parses the questions and retrieves the answers simultaneously.”
BackgroundComplex Embeddings for Simple Link Prediction
Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., & Bouchard, G. (2016) · arXiv · doi:10.48550/arxiv.1606.06357 · Cited by 2,100
Haveliwala, T. H. (2002) · Proceedings of the 11th international conference on World Wide Web · doi:10.1145/511446.511513 · Cited by 1,567
RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space
Sun, Z., Deng, Z.-H., Nie, J.-Y., & Tang, J. (2019) · arXiv · doi:10.48550/arxiv.1902.10197 · Cited by 1,414
The Expression of a Tensor or a Polyadic as a Sum of Products
Hitchcock, F. L. (1927) · Journal of Mathematics and Physics · doi:10.1002/sapm192761164 · Cited by 1,345
A review: Knowledge reasoning over knowledge graph
Chen, X., Jia, S., & Xiang, Y. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112948 · Cited by 1,035 · cited 2×
“…across research communities as it achieved superior performances on many tasks in different fi elds such as image classi fi cation in computer vision (Chen et al., 2020a; He et al., 2016, 2020), language modeling in natural language processing (Brown et al., 2020; Devlin et al., 2018), and link…”
BackgroundA Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network
Nguyen, D. Q., Nguyen, T. D., Nguyen, D. Q., & Phung, D. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2053 · Cited by 923
End-to-End Structure-Aware Convolutional Networks for Knowledge Base Completion
Shang, C., Tang, Y., Huang, J., Bi, J., He, X., & Zhou, B. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013060 · Cited by 725
Open Domain Question Answering Using Early Fusion of Knowledge Bases and Text
Sun, H., Dhingra, B., Zaheer, M., Mazaitis, K., Salakhutdinov, R., & Cohen, W. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1455 · Cited by 716
Knowledge Graph Embedding for Link Prediction
Rossi, A., Barbosa, D., Firmani, D., Matinata, A., & Merialdo, P. (2021) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3424672 · Cited by 601 · cited 2×
“More details of knowledge graph embeddings can be found in (Ji et al., 2020; Rossi et al., 2020).”
BackgroundComposition-based Multi-Relational Graph Convolutional Networks
Vashishth, S., Sanyal, S., Nitin, V., & Talukdar, P. (2019) · arXiv · doi:10.48550/arxiv.1911.03082 · Cited by 581 · cited 3×
“…use relation-aware GCN as the encoder and DisMult as the decoder M-GNN (Wang et al., 2019b) replace the mean aggregator in R-GCN with a MLP CompGCN (Vashishth et al., 2020b) incorporate entity and relation embeddings into the aggregator function KBGAT (Nathani et al., 2019) incorporate a triplet…”
MethodHolographic embeddings of knowledge graphs
Nickel, M., Rosasco, L., & Poggio, T. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10314 · Cited by 559
SimplE Embedding for Link Prediction in Knowledge Graphs
Kazemi, S. M., & Poole, D. (2018) · arXiv · doi:10.48550/arxiv.1802.04868 · Cited by 476 · cited 4×
“P Q (Bordes et al., 2013) force h þ r to be close to t TransH (Wang et al., 2014) project entities into the relation-speci fi c hyperplane TransR (Lin et al., 2015) project entities and relations in separate spaces TransD (Ji et al., 2015) determine the project matrices by both entities and relations TransG (Xiao et al…”
MethodInfluentialLearning Explanatory Rules from Noisy Data
Evans, R., & Grefenstette, E. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5714 · Cited by 426
Cognitive Graph for Multi-Hop Reading Comprehension at Scale
Ding, M., Zhou, C., Chen, Q., Yang, H., & Tang, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1259 · Cited by 222 · cited 2×
“Recently for question answering upon text corpus, neural-symbolic models incorporating human cognition have shown their superiority on reasoning capacity (Ding et al., 2019), as they consistently perform well with the increase of the hops in questions.”
BackgroundEmbedding Logical Queries on Knowledge Graphs
Hamilton, W. L., Bajaj, P., Zitnik, M., Jurafsky, D., & Leskovec, J. (2018) · arXiv · doi:10.48550/arxiv.1806.01445 · Cited by 176
Garcez, A. D., Gori, M., Lamb, L. C., Serafini, L., Spranger, M., & Tran, S. N. (2019) · arXiv · doi:10.48550/arxiv.1905.06088 · Cited by 175 · cited 2×
“…problem of combining symbolism and connectionism has been researched since the 1980s (Gallant, 1988, 1993; Shavlik et al., 1991; Towell and Shavlik, 1994a, 1994b), and has drawn much attention recent years (Besold et al., 2017; de Penning et al., 2011; Garcez et al., 2012, 2019; Lamb et al., 2020).”
BackgroundFaithful Embeddings for Knowledge Base Queries
Sun, H., Arnold, A. O., Bedrax-Weiss, T., Pereira, F., & Cohen, W. W. (2020) · arXiv · doi:10.48550/arxiv.2004.03658 · Cited by 51
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Research works printed but not linked: 34
- Bryant, 1986, Graph-based algorithms for boolean function manipulation, Comput. IEEE Trans., 100, 677, 10.1109/TC.1986.1676819 · DOI · Paper page
- Chen, 2016, Scalekb: scalable learning and inference over large knowledge bases, VLDB J., 25, 893, 10.1007/s00778-016-0444-3 · DOI
- Clark, 1989, The cn2 induction algorithm, Mach. Learn., 3, 261, 10.1023/A:1022641700528 · doi:10.1023/a:1022641700528 · Paper page
- Cui, 2017, Learning question answering over qa corpora and knowledge bases, Proc. VLDB Endow., 10, 565, 10.14778/3055540.3055549 · DOI · Paper page
- Cussens, 2001, Parameter estimation in stochastic logic programs, Mach. Learn., 44, 245, 10.1023/A:1010924021315 · DOI
- de Penning, 2011, A neural-symbolic cognitive agent for online learning and reasoning, vol. 2, 1653
- Dhingra, 2002, vol. 10640, 2020
- Galárraga, 2015, Fast rule mining in ontological knowledge bases with amie, VLDB J., 24, 707, 10.1007/s00778-015-0394-1 · DOI · Paper page
- Gallant, 1988, Connectionist expert systems, Commun. ACM, 31, 152, 10.1145/42372.42377 · DOI · Paper page
- Gormley, 2015, Approximation-aware dependency parsing by belief propagation, Trans. Assoc. Comput. Linguistics (TACL), 3, 489, 10.1162/tacl_a_00153 · DOI
- Hinton, 2006, A fast learning algorithm for deep belief nets, Neural Comput., 18, 1527, 10.1162/neco.2006.18.7.1527 · DOI · Paper page
- Jha, 2012, Probabilistic databases with markoviews, Proc. VLDB Endowment, 5, 10.14778/2350229.2350236 · DOI
- Ji, 2015, Knowledge graph embedding via dynamic mapping matrix, vol. 1, 687
- Jiang, 2019, Adaptive convolution for multi-relational learning, vol. 1, 978
- Klein, 2003, Accurate unlexicalized parsing, vol. 1, 423
- Lao, 2010, Relational retrieval using a combination of path-constrained random walks, Mach. Learn., 81, 53, 10.1007/s10994-010-5205-8 · DOI · Paper page
- Lehmann, 2015, vol. 6, 167
- Li, 2006, One-shot learning of object categories, IEEE Trans. Pattern Anal. Mach. Intell., 28, 594, 10.1109/TPAMI.2006.79 · DOI · Paper page
- Liu, 2017, Analogical inference for multi-relational embeddings, vol. 70, 2168
- Neelakantan, 2015, Compositional vector space models for knowledge base inference, vol. 1, 156
- Nickel, 2011, A three-way model for collective learning on multi-relational data, vol. 11, 809
- G. Niu, B. Li, Y. Zhang, Y. Sheng, C. Shi, J. Li, and S. Pu. Joint Semantics and Data-Driven Path Representation for Knowledge Graph Inference. ArXiv, abs/2010.02602, 2020. · arXiv
- Pedoe, 2010, True knowledge: open-domain question answering using structured knowledge and inference, AI Mag., 31, 80
- Plotkin, 1970, A note on inductive generalization, Mach. Intell., 5, 153
- Plotkin, 1971, A further note on inductive generalization, Mach. Intell., 6, 248
- Shavlik, 1991, Symbolic and neural learning algorithms: an experimental comparison, Mach. Learn., 6, 111, 10.1023/A:1022602303196 · doi:10.1023/a:1022602303196 · Paper page
- Towell, 1994, Knowledge-based artificial neural networks, Artif. Intell., 70, 119, 10.1016/0004-3702(94)90105-8 · DOI · Paper page
- Towell, 1994, Refining symbolic knowledge using neural networks, Mach. Learn.: Multistrategy Approach, 4, 405
- Trouillon, 2016, Complex embeddings for simple link prediction, Proc. 33nd Int. Conf. Mach. Learn., 48, 2071
- Vu, 2019, A capsule network-based embedding model for knowledge graph completion and search personalization, vol. 1, 2180
- Yang, 2015, S-MART: novel tree-based structured learning algorithms applied to tweet entity linking, vol. 1, 504
- Yang, 2017, Differentiable learning of logical rules for knowledge base reasoning, vol. 30, 2319
- You, 2020, Graph contrastive learning with augmentations, Adv. Neural Inf. Process. Syst., 33
- Zheng, 2018, Question answering over knowledge graphs: question understanding via template decomposition, Proc. VLDB Endowment, 11, 1373, 10.14778/3236187.3236192 · DOI
Cited by
Unifying Large Language Models and Knowledge Graphs: A Roadmap
Pan, S., Luo, L., Wang, Y., Chen, C., Wang, J., & Wu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3352100 · Cited by 1,376
“Besides, they are renowned for their symbolic reasoning ability [22], which generates interpretable results.”
BackgroundA Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multi-Modal
Liang, K., Meng, L., Liu, M., Liu, Y., Tu, W., Wang, S., Zhou, S., Liu, X., Sun, F., & He, K. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3417451 · Cited by 553
On the Evolution of Knowledge Graphs: A Survey and Perspective
Jiang, X., Xu, C., Shen, Y., Sun, X., Tang, L., Wang, S., Chen, Z., Wang, Y., & Guo, J. (2023) · arXiv · doi:10.48550/arxiv.2310.04835 · Cited by 42
Metadata
- Authors
- Zhang, J., Chen, B., Zhang, L., Ke, X., & Ding, H.
- Venue
- AI Open
- Publisher
- Elsevier BV
- Published
- 2021
- Volume
- 2
- Pages
- 14-35
- ISSN
- 2666-6510
- Cited by
- 114
- References
- 39
- Language
- en
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor, 91 d)
- Funders
- National Natural Science Foundation of China
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.