Cited by 212Advanced Graph Neural NetworksTopic ModelingRecommender Systems and Techniques

A Survey on Knowledge Graph Embeddings for Link Prediction

Open access
Wang, Meihong, Qiu, Linling, Wang, Xiaoli·2021·Symmetry

Abstract

Knowledge graphs (KGs) have been widely used in the field of artificial intelligence, such as in information retrieval, natural language processing, recommendation systems, etc. However, the open nature of KGs often implies that they are incomplete, having self-defects. This creates the need to build a more complete knowledge graph for enhancing the practical utilization of KGs. Link prediction is a fundamental task in knowledge graph completion that utilizes existing relations to infer new relations so as to build a more complete knowledge graph. Numerous methods have been proposed to perform the link-prediction task based on various representation techniques. Among them, KG-embedding models have significantly advanced the state of the art in the past few years. In this paper, we provide a comprehensive survey on KG-embedding models for link prediction in knowledge graphs. We first provide a theoretical analysis and comparison of existing methods proposed to date for generating KG embedding. Then, we investigate several representative models that are classified into five categories. Finally, we conducted experiments on two benchmark datasets to report comprehensive findings and provide some new insights into the strengths and weaknesses of existing models.

AI snapshot

Written from the paper’s full text.

TL;DR

This survey reviews knowledge graph embedding (KGE) models for link prediction, categorizing them into translation-distance-based, semantic-matching-based, and neural-network-based approaches and analyzing representative models along five main lines. It reports unified experiments on FB15k and FB15k-237, finding that neural-network-based models and models using additional information tend to perform best, with RotatE and HypER among the top performers.

Key findings

  • The survey classifies KGE models into three main categories—translation-distance-based, semantic-matching-based, and neural-network-based—and further organizes representative models along five main lines: CNN, context information, tensor/matrix production, GCN, and TransE extensions.
  • In the reported experiments, RotatE and HypER outperform the other models. On FB15k-237, HAKE reaches MRR 0.3523 and Hits@10 0.5488; RotatE reaches MRR 0.3432 and Hits@10 0.5370; SACN reaches MRR 0.3400 and Hits@10 0.5154; HypER reaches MRR 0.3335 and Hits@10 0.5080. On FB15k, RotatE reaches MRR 0.7905 and Hits@10 0.8797; HypER reaches MRR 0.7668 and Hits@10 0.8799; RW-LMLM reaches MRR 0.7466 and Hits@10 0.8648.
  • Training time varies substantially: Bilinear+TR_bilinear has the shortest reported time at 1.8083 h, while ConvE takes 50.8799 h, LiteralE-ConvE takes 60.1813 h, DistMult takes 31.5515 h, and ComplEx takes 38.1560 h. Neural-network-based models generally have relatively low time efficiency due to more parameters.
  • The paper concludes that models using additional information (e.g., node attributes, node types, relation types, prior knowledge) and neural-network structures have better performance, while conventional translation models (TransE) and semantic models (DistMult, ComplEx) perform less well.

Methods

  • Design: a survey with theoretical analysis and comparison of existing KGE methods for link prediction, classifying models into three categories and five finer-grained main lines.
  • Data and experiments: link-prediction experiments were conducted in a unified environment using a T640 Dell server, Ubuntu 16.04, an NVIDIA-SMI 418.67 GPU, and PyTorch, with original code and settings. Two benchmark datasets were used: FB15k (14,951 entities, 1345 relations, 592,213 triples) and FB15k-237 (14,541 entities, 237 relations, 310,116 triples).
  • Implemented models: SACN, HypER, Bilinear+TR, RW-LMLM, LiteralE, SimplE, HAKE, RotatE, ConvE, DistMult, and ComplEx. Evaluation metrics include mean rank, mean reciprocal rank (MRR), and Hits@n.

Limitations

  • The paper states that it only focused on link prediction of KGE; only used two datasets (FB15k and FB15k-237); only focused on static graphs; and its proposed categories for KGE models may not be perfect.
  • Evident from the text: the experiments cover selected representative models rather than all surveyed models, and SACN’s FB15k results are missing in Table 5 (“----”).
  • Evident from the text: the paper notes future work will use more datasets such as WN18, WN18RR, and FB13, and explore dynamic and heterogeneous graphs, indicating those are not covered here.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/sym13030485

Cites

206 of 206 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

39 of 58 cited sources checked · 28 supported · 1 flagged · accuracy not yet measured

  • Premisecitation

    PTransE introduces contextual information by using multiple-step relation paths to extend TransE.

    “PTransE [83] is a translation-based model, and it introduces contextual information by using multiple-step relation paths to extend TransE, which treats relation paths as transformations of representation learning between entities.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [83] Lin, Y., Liu, Z., Luan, H.B., Sun, M., Rao, S., and Liu, S. (2015). Modeling Relation Paths for Representation Learning of Knowledge Bases. arXiv. source
  • Premisecitation

    RotatE can model and infer various relation patterns, including symmetry (antisymmetry), inversion and composition.

    “RotatE [35] can model and infer various relation patterns, including symmetry (antisymmetry), inversion and composition.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [35] Sun, Z., Deng, Z.H., Nie, J.Y., and Tang, J. (2019, January 6–9). RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. Proceedings of the ICLR(Poster), New Orleans, LA, USA. source
  • Premisecitation

    ConvE is the first model to use the convolutional neural network framework for knowledge graph completion.

    “ConvE [22] is the first model to use the convolutional neural network (CNN) framework for KG completion.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [22] Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2017). Convolutional 2D Knowledge Graph Embeddings, AAAI Press. source

      The Related Work section (p. 2) describes ConvE as, to the authors’ knowledge, the first neural link-prediction model to use 2D convolutional layers. The citing sentence drops both the 2D restriction and the authors’ qualification, making a broader priority claim than the source supports. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • Premisecitation

    CompGCN addresses overparameterization by sharing a relation embedding calculated using basis decomposition across layers.

    “CompGCN is a general GCN-based model that addresses the shortcomings of overparameterization by sharing a relation embedding calculated using basis decomposition across layers.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [25] Vashishth, S., Sanyal, S., Nitin, V., and Talukdar, P.P. (2020, January 26–30). Composition-based Multi-Relational Graph Convolutional Networks. Proceedings of the ICLR, Addis Ababa, Ethiopia. source
  • Premisecitation

    Compared with TransE, ProjE saves many transformation matrix calculations because of its combination operations.

    “Compared with TransE, ProjE saves many transformation matrix calculations because of the combination operations”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [176] Shi, B., and Weningr, T. (2017). ProjE: Embedding Projection for Knowledge Graph Completion, AAAI Press. source

      The Model Architecture section (p. 3) describes ProjE’s combination operator and its diagonal matrices. It does not say that this saves transformation-matrix calculations compared with TransE; instead, it says ProjE has additional parameters relative to TransE. The claimed computational saving is unsupported. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
  • May combine two claims. 44
  • Classified as probably not a substantial claim. 44
  • May combine two claims.

    Premisereasoning

    Rossi et al.'s survey selected few models and cannot cover all types of KGE models.

    “However, there is no overall classification and summary of the KGE models proposed in recent years in this paper, and the selected models are few, which cannot cover all types of KGE models.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [28] Rossi, 2021, Knowledge graph embedding for link prediction: A comparative analysis, ACM Trans. Knowl. Discov. Data TKDD source

      Section 3 (p. 5) explicitly proposes a taxonomy of KG link-prediction models, dividing them into three main families and smaller groups. The Introduction (p. 2) also describes it as an educational taxonomy for knowledge graph embedding techniques, contrary to the claim that the paper offers no overall classification. The paper selects 16 representative models, but does not say they cover every type. (LLM, conf=0.89)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    TransW uses word embeddings to compose knowledge graph embeddings and can detect unknown facts.

    “TransW [101] uses word embeddings to compose knowledge graph embeddings and learns a function mapping from the word embedding space to the knowledge embedding space.Entities and relations are represented in the form of linear combinations of word embeddings in this model, which can detect unknown facts”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [101] Ma, L., Sun, P., Lin, Z., and Wang, H. (2019). Composing Knowledge Graph Embeddings via Word Embeddings. arXiv. source
  • May combine two claims.

    Premisecitation

    Traditional semantic-based models focus only on the information of the triple itself and do not fuse any additional information.

    “The traditional semantic-based models focus only on the information of the triple itself and do not fuse any additional information, as DistMult [20] and Complex [21] do.”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [20] Yang, B., Yih, W., He, X., Gao, J., and Deng, L. (2015, January 7–9). Embedding Entities and Relations for Learning and Inference in Knowledge Bases. Proceedings of the ICLR (Poster), San Diego, CA, USA. source
    • cites [21] Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., and Bouchard, G. (2016). Complex Embeddings for Simple Link Prediction, ICML. source
  • May combine two claims.

    Premisecitation

    TransH introduces a hyperplane, and TransR uses a relation-specific space to handle different relations, excavating more semantic information.

    “TransH introduces a hyperplane, and TransR uses a relation-specific space to handle different relations, excavating more semantic information.”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [15] Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014). Knowledge Graph Embedding by Translating on Hyperplanes, AAAI Press. source

      The TransH section (p. 3) confirms that the paper introduces relation-specific hyperplanes and projects entity embeddings onto them to represent different roles across relations. The cited paper does not address TransR or its use of a relation-specific space, so it supports only the TransH part of the sentence. (LLM, conf=0.90)

      Experimental — accuracy not yet measured
    • cites [17] Lin, Y., Liu, Z., Sun, M., Liu, Y., and Zhu, X. (2015). Learning Entity and Relation Embeddings for Knowledge Graph Completion, AAAI Press. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    LiteralE introduces literature information, giving priority to numerical literature.

    “LiteralE [115] introduces the literature information, giving priority to numerical literature.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [115] Kristiadi, A., Khan, M.A., Lukovnikov, D., Lehmann, J., and Fischer, A. (2019, January 26–30). Incorporating Literals into Knowledge Graph Embeddings. Proceedings of the ISWC, Auckland, New Zealand. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Ji et al. divided research on KGs into four categories: knowledge representation learning, knowledge acquisition, temporal KGs and knowledge-aware applications.

    “Ji et al. [31] divided the research on KGs into four categories: knowledge representation learning, knowledge acquisition, temporal KGs and knowledge-aware applications.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [31] Ji, S., Pan, S., Cambria, E., Marttinen, P., and Yu, P.S. (2020). A Survey on Knowledge Graphs: Representation, Acquisition and Applications. arXiv. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    SACN improves the GCN model to obtain a weighted graph convolutional network by introducing weights for different types of relations.

    “In the encoder part, by introducing weights for different types of relations, SACN improves the GCN model to obtain a weighted graph convolutional network (WGCN).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [26] Shang, C., Tang, Y., Huang, J., Bi, J., He, X., and Zhou, B. (2019). End-to-End Structure-Aware Convolutional Networks for Knowledge Base Completion, AAAI Press. source
  • May combine two claims.

    Premisecitation

    HypER implements nonlinear quadratic combinations of entity and relation embeddings rather than the linear combinations in ConvE, giving HypER richer expressive capacity and fewer parameters.

    “HypER implements nonlinear (quadratic) combinations of entity and relation embeddings rather than the linear combinations (weighted sums) in ConvE, which gives HypER the advantages of a much richer expressive capacity and fewer parameters.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [24] Balazevic, I., Allen, C., and Hospedales, T.M. (2019, January 17–19). Hypernetwork Knowledge Graph Embeddings. Proceedings of the ICANN (Workshop), Munich, Germany. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Rossi et al. classified models into three categories: tensor decomposition models, geometric models and deep learning models.

    “Rossi et al. [28] classified models into three categories: tensor decomposition models, geometric models and deep learning models.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [28] Rossi, 2021, Knowledge graph embedding for link prediction: A comparative analysis, ACM Trans. Knowl. Discov. Data TKDD source
  • May combine two claims.

    Premisecitation

    The second group of multiplicative models includes DistMult and Complex, which can outperform additive models by capturing more semantic information.

    “The second group of multiplicative models includes DistMult [20] and Complex [21], which can outperform the additive models by capturing more semantic information [19].”
    Quote in the paperNot a substantial claim2 of 3 sources checked
    • cites [19] Liu, Z., Sun, M., Lin, Y., and Xie, R. (2016). Knowledge Representation Learning: A Review. J. Comp. Res. Develop., 247–261. source
    • cites [20] Yang, B., Yih, W., He, X., Gao, J., and Deng, L. (2015, January 7–9). Embedding Entities and Relations for Learning and Inference in Knowledge Bases. Proceedings of the ICLR (Poster), San Diego, CA, USA. source

      The Results (p. 5) report that DistMult outperformed the additive DistAdd model on the evaluated datasets. The Introduction (p. 1) says bilinear embeddings capture the compositional semantics of relations, but the paper does not evaluate Complex or establish that both named models outperform additive models by capturing more semantic information. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites [21] Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., and Bouchard, G. (2016). Complex Embeddings for Simple Link Prediction, ICML. source
  • May combine two claims.

    Premisecitation

    ProjE complements missing information in a knowledge graph by learning joint embeddings of entities and edges and modifying the loss function, improving the KGE model through trivial changes to the network architecture and eliminating complex feature engineering.

    “ProjE [176] complements the missing information in a KG by learning the joint embedding of the entities and edges and making modifications to the loss function, thus improving the KGE model through trivial changes to the network architecture and eliminating complex feature engineering.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [176] Shi, B., and Weningr, T. (2017). ProjE: Embedding Projection for Knowledge Graph Completion, AAAI Press. source
  • May combine two claims.

    Premisecitation

    ConvE obtains local relationships in different dimensions between entities through a convolution layer and a fully connected layer, but ignores the global relationships between triple embeddings of the same dimension.

    “ConvE obtains local relationships in different dimensions between entities through a convolution layer and a fully connected layer, which ignores the global relationships between triple embeddings of the same dimension.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [22] Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2017). Convolutional 2D Knowledge Graph Embeddings, AAAI Press. source

      The model description (p. 3) says ConvE uses convolutional and fully connected layers to model interactions between entity and relation embeddings. The discussion of 2D convolutions (p. 2) describes interactions between embeddings, but does not say ConvE ignores global relationships between triple embeddings of the same dimension. The Conclusion (p. 7) proposes increasing large-scale structure as future work, which does not establish that specific limitation. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    SACN's Conv-TransE decoder removes the reshaping operation and lets convolutional filters operate directly on input entities and relations in the same dimension, so translation properties of TransE remain while the same prediction performance as ConvE is maintained.

    “The decoder, called Conv-TransE, removes the reshaping operation from the input entity and relation embeddings and lets the convolutional filters operate directly on input entities and relations in the same dimension.Thus, the translation properties of TransE remain, while the same prediction performance as ConvE is maintained.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [26] Shang, C., Tang, Y., Huang, J., Bi, J., He, X., and Zhou, B. (2019). End-to-End Structure-Aware Convolutional Networks for Knowledge Base Completion, AAAI Press. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    SACN is an end-to-end structure-aware convolutional network that takes into account node connectivity, node attributes and relation types simultaneously.

    “Weighted GCN, known as SACN [26], is an end-to-end structure-aware convolutional network that takes into account node connectivity, node attributes and relation types simultaneously.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [26] Shang, C., Tang, Y., Huang, J., Bi, J., He, X., and Zhou, B. (2019). End-to-End Structure-Aware Convolutional Networks for Knowledge Base Completion, AAAI Press. source

      The Introduction and Conclusion describe SACN as an end-to-end network whose weighted GCN encoder uses graph connectivity, node attributes, and relation types. But the citing sentence conflates the encoder with the full model: WGCN is a component of SACN, which also has a Conv-TransE decoder. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    ConvKB uses 1D convolution to maintain the translation characteristics of TransE, which is sufficient for capturing global relationships and transitional characteristics between entities.

    “Removing the reshaping operation from ConvE, ConvKB [23] uses 1D convolution to maintain the translation characteristics of TransE, which is sufficient for capturing the global relationships and transitional characteristics between entities.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [23] Nguyen, D.Q., Nguyen, T.D., Nguyen, D.Q., and Phung, D.Q. (2018, January 1–6). A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network. Proceedings of the NAACL-HLT, New Orleans, LA, USA. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    ConvE introduces a 1-N scoring program that takes a head-entity-relation pair and matches all tail entities simultaneously, saving much evaluation time.

    “Moreover, ConvE introduces a 1-N scoring program that takes a head-entity-relation pair and matches all the tail entities simultaneously, which is different from other models that use the 1-1 scoring program; thus, much evaluation time is saved.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [22] Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2017). Convolutional 2D Knowledge Graph Embeddings, AAAI Press. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    For link-prediction tasks, R-GCN can be regarded as an autoencoder consisting of an encoder and a decoder.

    “For link-prediction tasks, a relational graph convolutional network (R-GCN) can be regarded as an autoencoder consisting of an encoder and a decoder.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [158] Schlichtkrull, M.S., Kipf, T.N., Bloem, P., Berg, R.v.d., Titov, I., and Welling, M. (2018, January 3–7). Modeling Relational Data with Graph Convolutional Networks. Proceedings of the ESWC, Crete, Greece. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    Rossi et al.'s experiment was not reproduced in a unified environment configuration but used different coding frameworks, such as Python and C++.

    “In addition, the experiment of this survey was not reproduced in a unified environment configuration but used different coding frameworks, such as Python and C++.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [28] Rossi, 2021, Knowledge graph embedding for link prediction: A comparative analysis, ACM Trans. Knowl. Discov. Data TKDD source

      Section 5.1 (pp. 18–19) says Rossi et al. trained and evaluated the models from scratch using implementations from several repositories, which supports the use of different implementations. But it says all experiments ran on the same server environment; it does not establish that the environment configuration was not unified or that the implementations used Python and C++. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Interpretationcitation

    SimplEx has low performance for FB15k-237 and high performance for FB15k because FB15k contains inverse relations and SimplEx can model inverse relations appropriately.

    “SimplEx [152] has low performance for FB15k-237 and high performance for FB15k because FB15k contains inverse relations and SimplEx can model the inverse relations appropriately.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [152] Kazemi, S.M., and Poole, D. (2018). SimplE Embedding for Link Prediction in Knowledge Graphs. NeurIPS. source

      Section 6.1 (p. 8) reports strong SimplE performance on FB15k, and Section 4 (p. 3) says the model uses inverse relations. The paper reports experiments on WN18 and FB15k, not FB15k-237 (Section 6, p. 7); it does not establish low performance on FB15k-237 or attribute its FB15k results to inverse relations in that dataset. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • May combine two claims.

    Findingcitation

    SACN also performs well among the implemented models, using relation types and entity attributes in the GCN model structure.

    “SACN [26] also performs well among these models; it uses the relation types and entity attributes in the GCN model structure.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [26] Shang, C., Tang, Y., Huang, J., Bi, J., He, X., and Zhou, B. (2019). End-to-End Structure-Aware Convolutional Networks for Knowledge Base Completion, AAAI Press. source
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Findingnone given

    The bilinear+TR model has the shortest training time, with a type regularizer incorporated into the loss function.

    “The bilinear+TR model has the shortest training time, with a type regularizer incorporated into the loss function, which fully considers the type information of entities.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Training time results on FB15k are representative for general conclusions about model time efficiency.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    Semantic matching models such as DistMult and ComplEx all suffer from longer training times.

    “Semantic matching models such as DistMult and ComplEx all suffer from longer training times.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Training time results on FB15k are representative for general conclusions about model time efficiency.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingreasoning

    Translational distance models such as HAKE and RotatE all have shorter training times because the translational-distance model has a relatively simple model structure and scoring function without too many parameters.

    “Translational distance models such as HAKE and RotatE all have shorter training times because the translational-distance model has a relatively simple model structure and scoring function without too many parameters.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Training time results on FB15k are representative for general conclusions about model time efficiency.
  • May combine two claims.

    Findingreasoning

    LiteralE introduces overhead in the number of parameters compared to the base method, leading to a long training time.

    “LiteralE introduces some overhead in terms of the number of parameters compared to the base method, leading to a long training time.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Training time results on FB15k are representative for general conclusions about model time efficiency.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    The performance of conventional models such as translation models (TransE) and semantic models (DistMult and ComplEx) is not good.

    “The performance of conventional models such as translation models (TransE) and semantic models (DistMult and ComplEx) is not good.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • May combine two claims.

    Findingreasoning

    HypER has many fewer parameters than ConvE, so it saves much training time.

    “While HypER utilizes a 1D relation-specific filter and a nonlinear (quadratic) combination of entity and relation embeddings via hypernetworks to perform weight sharing, it has many fewer parameters than ConvE, so it saves much training time.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Training time results on FB15k are representative for general conclusions about model time efficiency.
  • May combine two claims.

    Findingreasoning

    For FB15k, only ComplEx obtains good results upon adding literal information, while for FB15-237, only DistMult improves slightly after adding literal information.

    “For FB15k, only ComplEx obtains good results upon adding literal information, while for FB15-237, only DistMult improves slightly after adding literal information.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Semantic-matching-based models have been continuously mining deeper semantic information, including path information, entity types and contextual information, to obtain more accurate representations for KGE.

    “Since the traditional model was put forward, semantic-matching-based models have been continuously mining deeper semantic information, including path information, entity types, contextual information and so on, to obtain more accurate representations for KGE.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    HAKE considers the semantic hierarchy of entities by using polar coordinates, in which concentric circles can naturally reflect the hierarchy.

    “HAKE [60] considers the semantic hierarchy of entities by using polar coordinates, in which concentric circles can naturally reflect the hierarchy.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [60] Zhang, Z., Cai, J., Zhang, Y., and Wang, J. (2020, January 7–12). Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction. Proceedings of the AAAI 2020, New York, NY, USA.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    Recently proposed semantic models fuse various additional information to obtain better performance to mine deeper semantic information at the bottoms of graphs.

    “The former recently proposed models fuse various additional information to obtain better performance to mine deeper semantic information at the bottoms of graphs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    Translation-distance-based models are additive models that usually use distance-based functions to define the scoring function for link prediction.

    “These models are additive models, which usually use distance-based functions to define the scoring function for link prediction.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisereasoning

    RW-LMLM consists of a random walk algorithm for KGs and a language model-based link-prediction model, and its random walk can capture semantic and syntactic information in KGs by considering entities, relations and order information of paths.

    “RW-LMLM is a novel approach for link prediction that consists of a random walk algorithm for KGs (RW) and a language model-based link-prediction model (LMLM).”
    • Also stated in: § 3.2. Semantic Information-Based Models · plain
      “RW can capture the semantic and syntactic information in KGs by considering the entities, relations and order information of the paths, in contrast to DeepWalk (which considers only the entities and relations).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    Gaussian embedding models take the uncertainties of entities and relations into account but result in a complex model.

    “Gaussian embedding models take the uncertainties of the entities and relations into account, but this results in a complex model.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Real-world data are often dynamic and evolving, which makes constructing correct and complete knowledge graphs difficult.

    “Second, real-world data are often dynamic and evolving, which leads to difficulty in constructing correct and complete KGs [7].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [7] Cai, 2017, A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications, IEEE Trans. Knowl. Data Eng. source
  • May combine two claims.

    Premisecitation

    TransMS considers the semantics between the head entity and the relation as well as between the relation and the tail entity, which previous models do not do.

    “In this way, it considers the semantics between the head entity and the relation as well as the semantics between the relation and the tail entity, which is not done in previous models.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [52] Yang, S., Tian, J., Zhang, H., Yan, J., He, H., and Jin, Y. (2019, January 10–16). TransMS: Knowledge Graph Embedding for Complex Relations by Multidirectional Semantics. Proceedings of the IJCAI, Macao, China. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    Semantic information-based models usually use similarity-based functions to define scoring functions for traditional semantic-matching models or introduce additional information to mine more knowledge for recently proposed models.

    “Semantic information-based models usually use similarity-based functions to define scoring functions for traditional semantic-matching models or introduce additional information to mine more knowledge for recently proposed models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    TransE is one of the earliest models for link prediction and uses the relation to translate the head entity to a tail entity.

    “TransE [13] is one of the earliest models for link prediction, which uses the relation for translating the head entity to a tail entity.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., and Yakhnenko, O. (2013, January 5–8). Translating Embeddings for Modeling Multi-Relational Data. Proceedings of the NIPS, Lake Tahoe, NV, USA.

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Traditional semantic-based models suffer from higher computational complexity.

    “These models suffer from higher computational complexity.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    TransC combines structural information with entity concepts to improve KGE models and introduces a novel type of semantic similarity to measure the distinctness of entity semantics using concept information.

    “The TransC [149] model combines structural information with entity concepts (referring to the categories of entities) to improve KGE models and introduces a novel type of semantic similarity to measure the distinctness of entity semantics by using the concept information.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [149] Wang, Y., Liu, Y., Zhang, H., and Xie, H. (2019). Leveraging Lexical Semantic Information for Learning Concept-Based Multiple Embedding Representations for Knowledge Graph Completion. Asia-Pacific Web (APWeb) and Web-Age Information Management (WAIM) Joint International Conference on Web and Big Data, Springer. source
  • May combine two claims.

    Interpretationreasoning

    Translation-based models have insufficient expressiveness due to the direct addition of h + r and the lack of different semantic information.

    “Although the embedding operation of this type of model is relatively simple, the expressiveness is not sufficient due to the direct addition of h + r and the lack of different semantic information.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    TransE has difficulty dealing with multirelational graphs and is limited by its simple translation operation and lack of a discrimination policy for all kinds of relations.

    “TransE is the earliest translation-based embedding model, and it has difficulty dealing with multirelational graphs; it is limited by its simple translation operation as well as its lack of a discrimination policy for all kinds of relations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The three categories of KGE models reflect the mainstream models of KGE development in three main stages.

    “These three categories reflect the mainstream models of KGE development in three main stages.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The three categories (translation-distance-based, semantic-matching-based and neural-network-based) exhaustively cover mainstream KGE models for link prediction.
  • May combine two claims.

    Premisenone given

    Neural-network-based models consider the type of entity or relation, temporal information, path information and substructure information.

    “These models consider the type of entity or relation, temporal information, path information and substructure information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    FB15k and FB15k-237 could be used to evaluate model performance more comprehensively.

    “Therefore, these datasets could be used to evaluate the performance of the model more comprehensively.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Additional information used by KGE models includes path information, order information, concepts, entity attributes and entity types.

    “The additional information includes path information, order information, concepts, entity attributes, entity types and so on.”
    • Also stated in: § 3.3. Neural Network-Based Models · plain
      “The additional information also includes path information, order information, concepts and so on.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The implementation used the code provided in the original paper with the same settings to obtain the best results.

    “We also used the code provided in the original paper with the same settings to obtain the best results.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    There are few studies on dynamic graphs, which are better able to reflect the real world.

    “There are few studies on dynamic graphs, which are better able to reflect the real world.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Dai et al. considered only two aspects and did not provide an overall table.

    “Regarding additional information, they considered only these two aspects and also did not provide an overall table.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [19] Liu, Z., Sun, M., Lin, Y., and Xie, R. (2016). Knowledge Representation Learning: A Review. J. Comp. Res. Develop., 247–261. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The GCN can be scaled linearly on the edge of the graph to learn hidden layer representations for encoding local graphical structures and features of nodes.

    “It can be scaled linearly on the edge of the graph to learn hidden layer representations for encoding the local graphical structures and features of nodes.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kipf et al.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    KGE models embed entities and relations into a low-dimensional vector space while preserving the structure of the KG and its underlying semantic information.

    “KGE models embed entities and relations into a low-dimensional vector space while preserving the structure of the KG and its underlying semantic information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Dai et al. described models with two categories: triplet fact-based representation learning models and description-based representation learning models.

    “Dai et al. [19] described these models with two categories: triplet fact-based representation learning models and description-based representation learning models.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [19] Liu, Z., Sun, M., Lin, Y., and Xie, R. (2016). Knowledge Representation Learning: A Review. J. Comp. Res. Develop., 247–261. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    ProjR can model N-1, N-N, 1-N-1 and one-relation circle structures with the advantage of a combination operator design.

    “It can model N-1, N-N, 1-N-1 and one-relation circle structures with the advantage of a combination operator design.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [178] Zhang, W., Li, J., and Chen, H. (2018, January 26–30). ProjR: Embedding Structure Diversity for Knowledge Graph Completion. Proceedings of the NLPCC, Hohhot, China. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Traditional distance-based and semantic-matching-based models cannot meet the requirements of KGE.

    “Traditional distance-based and semantic-matching-based models cannot meet the requirements of KGE.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    The use of convolutional neural networks or attention mechanisms helps to generate better embeddings.

    “The use of convolutional neural networks or attention mechanisms also helps to generate better embeddings.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    Link prediction is one of the most common tasks for evaluating the performance of KGE, and it has no formal definition.

    “Link prediction is one of the most common tasks for evaluating the performance of KGE, which has no formal definition.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Premisenone given

    It is difficult to model the heterogeneity of graphs.

    “It is difficult to model the heterogeneity of graphs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    Neural networks have the abilities of self-study, associative storage and high-speed optimization.

    “Neural networks have been a promising solution in many fields and have the abilities of self-study, associative storage and high-speed optimization.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The paper's experiments on representative models were conducted in a unified environment, including the server type and programming language (pytorch).

    “In addition, our experiments on some representative models were conducted in a unified environment, including the server type and programming language (pytorch).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Conducting experiments in a unified environment, including server type and programming language (pytorch), ensures fair comparison across models.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    A neural-network model was introduced into KGE to propagate neighborhood information.

    “Recently, to obtain better and more effective entity and relation embeddings, a neural-network model was also introduced into KGE to propagate neighborhood information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    All experiments targeting the link-prediction task were conducted in a unified environment with a T640 Dell server, Ubuntu 16.04, and an NVIDIA-SMI 418.67 GPU.

    “We conducted all the experiments targeting the link-prediction task in a unified environment with a T640 Dell server, the Ubuntu 16.04 system, and an NVIDIA-SMI 418.67 GPU.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    There are many models for KGE, but there are still many challenges in obtaining better entity and relation embeddings for link prediction.

    “As described above, there are many models for KGE, but there are still many challenges in obtaining better entity and relation embeddings for link prediction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Kipf et al. proposed a simple but effective hierarchical-propagation rule running directly on a graph with a neural-network model, a GCN.

    “Kipf et al. proposed a simple but effective hierarchical-propagation rule running directly on a graph with a neural-network model, a GCN.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kipf et al.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    The graph convolution neural network has a strong ability to mine the underlying semantics of knowledge graphs.

    “Especially, the graph convolution neural network has a strong ability to mine the underlying semantics of knowledge graphs.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    If the node information of a multi-hop domain can be aggregated, the accuracy of the model in specific tasks can be greatly improved.

    “In addition, if the node information of a multi-hop domain can be aggregated, the accuracy of the model in specific tasks can be greatly improved.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    The selected models are representative for gaining deep insight into existing models, and they are conventional, recently proposed or highly cited.

    “Therefore, these selected models are representative for gaining deep insight into the existing models, and they are conventional, recently proposed or highly cited.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The rotation operation used in translational-distance models and the hypernetwork used in CNN-based models play important roles in improving performance.

    “which indicates that the rotation operation used in translational-distance models and the hypernetwork used in CNN-based models play important roles in improving performance.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • May combine two claims.

    Interpretationreasoning

    RotatE uses complex space and mines different types of relations, so different aspects of semantic information are modeled well by this integration strategy.

    “RotatE uses the complex space and mines different types of relations (symmetry/antisymmetry, inversion and composition); thus, different aspects of semantic information are modeled well by this integration strategy.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • May combine two claims.

    Interpretationreasoning

    DistMult's scoring function can only capture pairwise interactions of the same dimension between entities, so this simple embedding can only deal with symmetric relations.

    “Its scoring function can only capture pairwise interactions of the same dimension between entities.Therefore, this simple embedding can only deal with symmetric relations.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Compared with traditional models, the latest models have achieved better results, benefiting from their unique model structures and sampling technologies or from adding important additional information.

    “Compared with traditional models, the latest models have their own advantages.Generally, they have achieved better results, benefiting from their own unique model structures and sampling technologies or adding important additional information.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • May combine two claims.

    Interpretationreasoning

    Because ComplEx introduces a complex vector space and can deal with asymmetric relations, it has a good response to literal information for FB15k but not FB15k-237.

    “Because ComplEx introduces a complex vector space and can deal with asymmetric relations, it has a good response to literal information for FB15k but not FB15k-237.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Models with additional information, such as node attributes, node types, relationship types, and prior knowledge, have better performance.

    “Models with additional information, such as node attributes, node types, relationship types, prior knowledge and so on, have better performance.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
  • May combine two claims.

    Premisecitation

    RW-LMLM takes into account both order information and the random walk algorithm, and it has the capability of dealing with underlying semantic information.

    “RW-LMLM [91] takes into account both the order information and random walk algorithm, and it has the capability of dealing with underlying semantic information.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [91] Wang, C., Yan, M., Yi, C., and Sha, Y. (2019, January 26–30). Capturing Semantic and Syntactic Information for Link Prediction in Knowledge Graphs. Proceedings of the ISWC, Auckland, New Zealand. source
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    For HAKE, polar coordinates may have great benefits because their particular structure enables them to mine considerable hidden semantic structure information.

    “For HAKE [60], we believe that the polar coordinates may have great benefits because of their particular structure, which enables them to mine considerable hidden semantic structure information.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [60] Zhang, Z., Cai, J., Zhang, Y., and Wang, J. (2020, January 7–12). Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction. Proceedings of the AAAI 2020, New York, NY, USA.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • Rests on an assumption: FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.
73 of 73
  • The paper relies on this without support.

    The three categories (translation-distance-based, semantic-matching-based and neural-network-based) exhaustively cover mainstream KGE models for link prediction.

    “In this paper, we comprehensively survey existing KGE models and categorize them into three groups: translational-distance-based models, semantic-matching-based models and neural-network-based models.”
  • The paper relies on this without support.

    The selected representative models are representative of their respective categories.

    “Several representative models in each category are also analyzed and compared along five main lines.”
  • The paper relies on this without support.

    The two benchmark datasets are adequate for comparing KGE models for link prediction.

    “We conducted experiments on two benchmark datasets to report comprehensive findings and provide new insights into the strengths and weaknesses of existing models.”
  • The paper relies on this without support.

    Conducting experiments in a unified environment, including server type and programming language (pytorch), ensures fair comparison across models.

    “In addition, our experiments on some representative models were conducted in a unified environment, including the server type and programming language (pytorch).”
  • The paper relies on this without support.

    The five main lines capture the meaningful correlations among KGE models.

    “we classify all these models from a more fine-grained perspective, proposing five main lines.”
  • The paper relies on this without support.

    FB15k and FB15k-237 are standard datasets commonly used in this field and are suitable for comprehensively evaluating model performance.

    “We selected two datasets for our experiments, FB15k and FB15-237, which are the standard datasets commonly used in this field.”
    “Therefore, these datasets could be used to evaluate the performance of the model more comprehensively.”
  • The paper relies on this without support.

    Training time results on FB15k are representative for general conclusions about model time efficiency.

    “Generally, the time efficiencies of the models based on neural networks are relatively low due to the introduction of more parameters.”
7 of 7

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • HAKE exceeds both models said to outperform the others

    Minor

    On FB15k-237, HAKE has higher Hits@1, Hits@3, Hits@10, and MRR than both RotatE and HypER, contradicting the unqualified claim that those two outperform the other models.

  • Hits@n is defined in the opposite direction from the results

    Minor

    If Hits@n were the proportion of ranks larger than n, Hits@1 could not be smaller than Hits@3 or Hits@10 for the same model. The reported RotatE values increase from 0.2471 to 0.3802 to 0.5370.

  • The number of model categories changes

    Minor

    The abstract says the representative models are classified into five categories, while the introduction says the paper categorizes KGE models into three groups.

  • Link prediction is both said to include and exclude entity prediction

    Minor

    Section 2.2 explicitly defines entity prediction as a subtask of link prediction, whereas the conclusion treats entity prediction as a task to study beyond this survey's focus on link prediction.

4 of 4

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Wu, T., Khan, A., Gao, H., and Li, C. (2019). Efficiently Embedding Dynamic Knowledge Graphs. arXiv.
  2. Nayyeri, M., Xu, C., Lehmann, J., and Yazdi, H.S. (2019). LogicENN: A Neural Based Knowledge Graphs Embedding Model with Logical Rules. arXiv.

Cited by

Sorted by citations

Authors
Wang, M., Qiu, L., & Wang, X.
Affiliations
Xiamen University (CN)
Corresponding author
Wang, Xiaoli
Venue
Symmetry
Publisher
MDPI AG
Published
2021-03-16
Volume
13
Issue
3
Pages
485
ISSN
2073-8994 (ISSN-L)
OpenAlex
W3138149011
Cited by
212
References
204
Citations by year
2026: 21 · 2025: 41 · 2024: 47 · 2023: 57 · 2022: 41 · 2021: 5
FWCI
13.02
Type
journal article
Language
en
Open access
Locations
  • Symmetry (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Fujian Provincial Department of Science and Technology (2019H0001)
  • National Natural Science Foundation of China (61702432)
  • Fundamental Research Funds for Central Universities of China (20720180070)
  • International Cooperation Projects of Fujian Province in China (2018I0016)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
Keywords
knowledge graph embedding, link prediction, knowledge graph completion, incomplete knowledge graphs

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-23.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-23.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review