PreprintCited by 476Advanced Graph Neural NetworksTopic ModelingTensor decomposition and applications

The DOI matches its DataCite record; 56 of the 69 references it cites were found in a registry or an index; 16 of the 26 sources its claims cite were checked for support.

SimplE Embedding for Link Prediction in Knowledge Graphs

Open access

Abstract

Knowledge graphs contain knowledge about the world and provide a structured representation of this knowledge. Current knowledge graphs contain only a small subset of what is true in the world. Link prediction approaches aim at predicting new links for a knowledge graph given the existing links among the entities. Tensor factorization approaches have proved promising for such link prediction problems. Proposed in 1927, Canonical Polyadic (CP) decomposition is among the first tensor factorization approaches. CP generally performs poorly for link prediction as it learns two independent embedding vectors for each entity, whereas they are really tied. We present a simple enhancement of CP (which we call SimplE) to allow the two embeddings of each entity to be learned dependently. The complexity of SimplE grows linearly with the size of embeddings. The embeddings learned through SimplE are interpretable, and certain types of background knowledge can be incorporated into these embeddings through weight tying. We prove SimplE is fully expressive and derive a bound on the size of its embeddings for full expressivity. We show empirically that, despite its simplicity, SimplE outperforms several state-of-the-art tensor factorization techniques. SimplE's code is available on GitHub at https://github.com/Mehran-k/SimplE.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

SimplE is a simple bilinear tensor-factorization model for knowledge graph link prediction that ties the two CP embeddings of each entity via inverse relations, making them learned dependently while retaining linear complexity. It is proved fully expressive and empirically matches or outperforms ComplEx and other baselines on WN18 and FB15k, with large gains when background-knowledge rules are incorporated by weight tying.

Key findings

  • SimplE is fully expressive: Proposition 1 gives an embedding size of min(|E|·|R|, γ+1) for any ground truth with γ true facts; it addresses CP’s independent head/tail embeddings by averaging CP scores for (e_i, r, e_j) and (e_j, r^{-1}, e_i).
  • On WN18, SimplE achieves filtered MRR 0.942, raw MRR 0.588, and Hit@1/3/10 0.939/0.944/0.947; on FB15k, filtered MRR 0.727, raw MRR 0.239, and Hit@1/3/10 0.660/0.773/0.838. It outperforms ComplEx on FB15k filtered MRR (0.727 vs. 0.692) and is comparable on WN18 (0.942 vs. 0.941).
  • Background knowledge via weight tying: after removing redundant WN18 training triples (approximately 141K to 90K, about 36% reduction), filtered MRR was 0.221 for SimplE-ignr, 0.384 for SimplE, and 0.275 for ComplEx without rules; with tied rules, SimplE-ignr-bk reached 0.772 and SimplE-bk 0.776.
  • Complexity: SimplE and SimplE-ignr are O(d); per triple, SimplE-ignr uses 1 multiplication between three vectors, SimplE uses 2, and ComplEx uses 4, reducing computations by factors of 4 and 2 versus ComplEx. FSTransE is shown not fully expressive with restrictions R1–R3.

Methods

  • Model: tensor factorization based on CP; each entity has head h_e and tail t_e vectors, each relation has v_r and v_{r^{-1}}; score for (e_i, r, e_j) is 1/2(〈h_ei, v_r, t_ej〉 + 〈h_ej, v_{r^{-1}}, t_ei〉). SimplE-ignr updates both scores during training but tests only 〈h_ei, v_r, t_ej〉.
  • Training/evaluation: SGD with minibatches, negative sampling by corrupting head or tail (Bordes et al. procedure), and L2-regularized negative log-likelihood with softplus. Datasets: WN18 (40,943 entities, 18 relations, 141,442 train, 5,000 validation, 5,000 test triples) and FB15k (14,951 entities, 1,345 relations, 483,142 train, 50,000 validation, 59,071 test triples). Metrics: filtered/raw MRR and Hit@k; baselines include CP, TransE, TransR, DistMult, NTN, STransE, ER-MLP, and ComplEx.
  • Hyperparameters: TensorFlow implementation; embedding size 200; max iterations 1000; batch size 100; learning rate 0.1 for WN18 and 0.05 for FB15k; adagrad; 1 negative per positive for WN18 and 10 for FB15k. Best λ values: SimplE-ignr WN18 0.001, FB15k 0.03; SimplE WN18 0.03, FB15k 0.1.

Limitations

  • The paper does not have a dedicated limitations section; it lists future improvements (ensembles, 1-N scoring, combining with logic, incorporating other background knowledge) and notes that the background-knowledge experiment provides an upper bound on how much such knowledge can improve SimplE.
  • Evident from the text: empirical evaluation is limited to WN18 and FB15k, and the background-knowledge experiment is only on WN18 after removing redundant triples, so those gains may not generalize.
  • Evident from the text: no variance, confidence intervals, or significance tests are reported; hyperparameters were tuned on validation sets, and results appear to be single runs as described.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1802.04868

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

33 Own interpretation · 24 No basis given · 13 Own result · 6 Supported · 5 Partly supported · 2 Sources not found · 2 Not checked yet · 2 Own method · 1 Supported so far · accuracy not yet measured

Show all 53 claims

  • Probably not a substantial claim. 21
  • It may state two separate claims as one. 18
35 of 35
  • The paper relies on this without support.

    Models with many parameters usually overfit and give poor performance.

    “Models with many parameters usually overfit and give poor performance.”
  • The paper relies on this without support.

    For a triple (h,r,t) to hold in FSTransE, we should ideally have p_rh + v_r = α q_rt for some α.

    “For any entity e and relation r , let p re = P r v e and q re = Q r v e . For a triple ( h , r , t ) to hold, we should ideally have p rh + v r = αq rt for some α .”
  • The paper relies on this without support.

    The rules in Table 2 correctly describe background knowledge in WN18.

    “To test this empirically, we conducted an experiment on WN18 in which we incorporated several such rules into the embeddings as outlined in Propositions 3, 4, and 5. The rules can be found in Table 2.”
  • The paper relies on this without support.

    Using the same search grid on embedding size and λ as [39] makes the results directly comparable to [39].

    “We used the same search grid on embedding size and λ as [39] to make our results directly comparable to their results.”
4 of 4

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 69 references

Research works printed but not linked: 5

  1. [4][4] Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. Translating embeddings for modeling multi-relational data. In NIPS , pages 2787-2795, 2013. -
  2. [28][28] Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. A three-way model for collective learning on multi-relational data. In ICML , volume 11, pages 809-816, 2011. -
  3. [30][30] Maximilian Nickel, Xueyan Jiang, and Volker Tresp. Reducing the rank in relational factorization models by including observable patterns. In NIPS , pages 1179-1187, 2014. -
  4. [37][37] Richard Socher, Danqi Chen, Christopher D Manning, and Andrew Ng. Reasoning with neural tensor networks for knowledge base completion. In NIPS , 2013. -
  5. [42][42] Quan Wang, Bin Wang, Li Guo, et al. Knowledge base completion using embeddings and rules. In International Joint Conference on Artificial Intelligence , pages 1859-1866, 2015. -

Cited by

Sorted by citations

Items 301–400 of 475

Metadata

Authors
Kazemi, S. M., & Poole, D.
Affiliations
University of British Columbia (CA)
Venue
arXiv
Publisher
arXiv
Published
2018
ISSN
2331-8422 (ISSN-L)
OpenAlex
W2785761199
Cited by
476
References
69
Citations by year
2026: 2 · 2025: 49 · 2024: 68 · 2023: 80 · 2022: 91 · 2021: 95 · 2020: 70 · 2019: 20
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Mathematics › Computational Mathematics › Tensor decomposition and applications
Keywords
link prediction, knowledge graphs, SIMPLE, canonical polyadic decomposition, tensor decomposition, entity embeddings, weight tying, expressivity, interpretable embeddings

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-23, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-23 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review