TuckER: Tensor Factorization for Knowledge Graph Completion
Open accessAbstract
Knowledge graphs are structured representations of real world facts. However, they typically contain only a small subset of all possible facts. Link prediction is a task of inferring missing facts based on existing ones. We propose TuckER, a relatively straightforward but powerful linear model based on Tucker decomposition of the binary tensor representation of knowledge graph triples. TuckER outperforms previous state-of-the-art models across standard link prediction datasets, acting as a strong baseline for more elaborate models. We show that TuckER is a fully expressive model, derive sufficient bounds on its embedding dimensionalities and demonstrate that several previously introduced linear models can be viewed as special cases of TuckER.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
TuckER relies on Tucker decomposition and learns a shared core tensor jointly with KG embeddings.
“TuckER [6] relies on the Tucker decomposition [21], which factorizes a tensor into a set of vectors and a smaller shared core 𝑾 . The TuckER model learns 𝑾 jointly with the KG embeddings.”
From Knowledge Graph Embedding for Link Prediction (2021) · cites this paper as [6]
SimplE, TuckER, ComplEx and HolE have been demonstrated to be fully expressive.
“Examples of models that have been demonstrated to be fully expressive are SimplE [27], TuckER [6], ComplEx [61] and HolE [60].”
From Knowledge Graph Embedding for Link Prediction (2021) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 25
- Ivana Balažević, Carl Allen, and Timothy M Hospedales. 2019. Hypernetwork Knowledge Graph Embeddings. In International Conference on Artificial Neural Networks.
- Hedi Ben-Younes, Rémi Cadene, Matthieu Cord, and Nicolas Thome. 2017. MUTAN: Multimodal Tucker Fusion for Visual Question Answering. In International Conference on Computer Vision.
- Antoine Bordes, Nicolas Usunier, Alberto Garcia- Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi- relational Data. In Advances in Neural Information Processing Systems.
- Rajarshi Das, Shehzaad Dhuliawala, Manzil Zaheer, Luke Vilnis, Ishan Durugkar, Akshay Krishna- murthy, Alex Smola, and Andrew McCallum. 2018. Go for a Walk and Arrive at the Answer: Reason- ing over Paths in Knowledge Bases Using Rein- forcement Learning. In International Conference on Learning Representations.
- Frank L Hitchcock. 1927. The Expression of a Ten- sor or a Polyadic as a Sum of Products. Journal of Mathematics and Physics, 6(1-4):164-189.
- Sergey Ioffe and Christian Szegedy. 2015. Batch Nor- malization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. In International Conference on Machine Learning.
- Seyed Mehran Kazemi and David Poole. 2018. Sim- plE Embedding for Link Prediction in Knowledge Graphs. In Advances in Neural Information Pro- cessing Systems.
- Diederik P Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In Interna- tional Conference on Learning Representations.
- Tamara G Kolda and Brett W Bader. 2009. Tensor Decompositions and Applications. SIAM review, 51(3):455-500.
- Pieter M Kroonenberg and Jan De Leeuw. 1980. Prin- cipal Component Analysis of Three-Mode Data by Means of Alternating Least Squares Algorithms. Psychometrika, 45(1):69-97.
- Timothée Lacroix, Nicolas Usunier, and Guillaume Obozinski. 2018. Canonical Tensor Decomposition for Knowledge Base Completion. In International Conference on Machine Learning.
- Hanxiao Liu, Yuexin Wu, and Yiming Yang. 2017. Analogical Inference for Multi-relational Embed- dings. In International Conference on Machine Learning.
- Dat Quoc Nguyen, Kairit Sirts, Lizhen Qu, and Mark Johnson. 2016. STransE: a Novel Embedding Model of Entities and Relationships in Knowledge Bases. In North American Chapter of the Associ- ation for Computational Linguistics: Human Lan- guage Technologies.
- Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. 2011. A Three-Way Model for Collective Learning on Multi-Relational Data. In International Conference on Machine Learning.
- Adam Paszke, Sam Gross, Soumith Chintala, Gre- gory Chanan, Edward Yang, Zachary DeVito, Zem- ing Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic Differentiation in PyTorch. In NIPS-W.
- Aaron Schein, Mingyuan Zhou, David Blei, and Hanna Wallach. 2016. Bayesian Poisson Tucker Decom- position for Learning the Structure of International Relations. In International Conference on Machine Learning.
- Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, and Jianfeng Gao. 2018. M-Walk: Learning to Walk over Graphs using Monte Carlo Tree Search. In Advances in Neural Information Processing Sys- tems.
- Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A Simple Way to Prevent Neural Networks from Overfitting. Journal of Machine Learning Re- search, 15(1):1929-1958.
- Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. 2019. RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. In Inter- national Conference on Learning Representations.
- Théo Trouillon, Christopher R Dance, Éric Gaussier, Johannes Welbl, Sebastian Riedel, and Guillaume Bouchard. 2017. Knowledge Graph Completion via Complex Tensor Factorization. Journal of Machine Learning Research, 18(1):4735-4772.
- Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, and Guillaume Bouchard. 2016. Complex Embeddings for Simple Link Prediction. In Interna- tional Conference on Machine Learning.
- Ledyard R Tucker. 1966. Some Mathematical Notes on Three-Mode Factor Analysis. Psychometrika, 31(3):279-311.
- Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In International Conference on Learning Representations.
- Fan Yang, Zhilin Yang, and William W Cohen. 2017. Differentiable Learning of Logical Rules for Knowl- edge Base Reasoning. In Advances in Neural Infor- mation Processing Systems.
- Yongxin Yang and Timothy Hospedales. 2017. Deep Multi-task Representation Learning: A Tensor Fac- torisation Approach. In International Conference on Learning Representations.
Cited by
Sorted by citations
Knowledge Graph Embedding for Link Prediction
Rossi, A., Barbosa, D., Firmani, D., Matinata, A., & Merialdo, P. (2021) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3424672 · Cited by 601 · see citing works
- Authors
- Balažević, I., Allen, C., & Hospedales, T. M.
- Affiliations
- University of Edinburgh (GB)
- ORCID
- Balažević, Ivana
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Pages
- 5184-5193
- arXiv
- 1901.09590
- OpenAlex
- W2914592219
- Cited by
- 702
- References
- 0
- Citations by year
- 2026: 87 · 2025: 125 · 2024: 165 · 2023: 137 · 2022: 109 · 2021: 55 · 2020: 21 · 2019: 3
- FWCI
- 17.98
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- University of Edinburgh
- Engineering and Physical Sciences Research Council (EP/L016427/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Mathematics › Computational Mathematics › Tensor decomposition and applications
- Keywords
- knowledge graph completion, tensor decomposition, Tucker, knowledge graphs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
