The DOI matches its DataCite record; 3 of the 3 references it cites were found in a registry or an index.
Tensor Decompositions for temporal knowledge base completion
Abstract
Most algorithms for representation learning and link prediction in relational data have been designed for static data. However, the data they are applied to usually evolves with time, such as friend graphs in social networks or user interactions with items in recommender systems. This is also the case for knowledge bases, which contain facts such as (US, has president, B. Obama, [2009-2017]) that are valid only at certain points in time. For the problem of link prediction under temporal constraints, i.e., answering queries such as (US, has president, ?, 2012), we propose a solution inspired by the canonical decomposition of tensors of order 4. We introduce new regularization schemes and present an extension of ComplEx (Trouillon et al., 2016) that achieves state-of-the-art performance. Additionally, we propose a new dataset for knowledge base completion constructed from Wikidata, larger than previous benchmarks by an order of magnitude, as a new reference for evaluating temporal and non-temporal link prediction methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
[Lin and She, 2020] and [Lacroix et al., 2020] adopt temporal smoothness penalties to ensure neighboring timestamps learn similar representations.
“These two models further adopt temporal smoothness penalties to ensure neighboring timestamps learn similar representations.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Lacroix et al., 2020
[Lacroix et al., 2020] uses complex-valued representation vectors so that the model can adapt to asymmetric relations.
“A similar CP decomposition model is adopted by [Lacroix et al., 2020], except that it uses complex-valued representation vectors so that the model can adapt to asymmetric relations.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Lacroix et al., 2020
TComplEx is a suitable method for inferring missing facts such as (s, r, ?, t) and (s, r, o, ?) over an incomplete TKG.
“The embedding learning procedure makes TComplEx a suitable method for inferring missing facts such as (s, r, ?, t) and (s, r, o, ?) over an incomplete TKG.”
From TempoQR: Temporal Question Reasoning over Knowledge Graphs (2022) · cites this paper as Lacroix, Obozinski, and Usunier 2020
TComplEx employs additional regularizers to improve the quality of the learned embeddings, such as enforcing close timestamps to have similar embeddings.
“TComplEx employs additional regularizers to improve the quality of the learned embeddings such as enforcing close timestamps to have similar embeddings (closeness of time).”
From TempoQR: Temporal Question Reasoning over Knowledge Graphs (2022) · cites this paper as Lacroix, Obozinski, and Usunier 2020
TComplEx embeddings of entities and timestamps encode their temporal properties.
“TempoQR leverages pre-trained TKG embeddings of entities and timestamps that encode their temporal properties, i.e., TComplEx.”
From TempoQR: Temporal Question Reasoning over Knowledge Graphs (2022) · cites this paper as Lacroix, Obozinski, and Usunier 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Knowledge Graph Embedding by Translating on Hyperplanes
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8870 · Cited by 3,915
Complex Embeddings for Simple Link Prediction
Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., & Bouchard, G. (2016) · arXiv · doi:10.48550/arxiv.1606.06357 · Cited by 2,100
STransE: a novel embedding model of entities and relationships in knowledge bases
Nguyen, D. Q., Sirts, K., Qu, L., & Johnson, M. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1054 · Cited by 177
Flagged first, then by citations
Research works printed but not linked: 24
- Brett W Bader, Richard A Harshman, and Tamara G Kolda. Temporal analysis of semantic graphs using asalsan. In Seventh IEEE international conference on data mining (ICDM 2007), pp. 33-42. IEEE, 2007.
- Ivana Balažević, Carl Allen, and Timothy M Hospedales. Tucker: Tensor factorization for knowl- edge graph completion. arXiv preprint arXiv:1901.09590, 2019. · arXiv
- Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. Translating Embeddings for Modeling Multi-relational Data. In C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger (eds.), Advances in Neural Information Pro- cessing Systems 26, pp. 2787-2795.
- John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12(Jul):2121-2159, 2011.
- Rina Foygel, Ohad Shamir, Nati Srebro, and Ruslan R Salakhutdinov. Learning with the weighted trace-norm under arbitrary sampling distributions. In Advances in Neural Information Processing Systems, pp. 2133-2141, 2011.
- Shmuel Friedland and Lek-Heng Lim. Nuclear norm of higher-order tensors. Mathematics of Com- putation, 87(311):1255-1281, 2018.
- Alberto García-Durán, Sebastijan Dumančić, and Mathias Niepert. Learning sequence encoders for temporal knowledge graph completion. arXiv preprint arXiv:1809.03202, 2018. · arXiv
- Rishab Goel, Seyed Mehran Kazemi, Marcus Brubaker, and Pascal Poupart. Diachronic embedding for temporal knowledge graph completion. In AAAI, 2020.
- Frank L. Hitchcock. The expression of a tensor or a polyadic as a sum of products. Studies in Applied Mathematics, 6(1-4):164-189, 1927.
- Guoliang Ji, Shizhu He, Liheng Xu, Kang Liu, and Jun Zhao. Knowledge graph embedding via dynamic mapping matrix. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Pro- cessing (Volume 1: Long Papers), pp. 687-696, 2015.
- Rudolf Kadlec, Ondrej Bajgar, and Jan Kleindienst. Knowledge base completion: Baselines strike back. In Proceedings of the 2nd Workshop on Representation Learning for NLP, pp. 69-74, 2017.
- Seyed Mehran Kazemi and David Poole. Simple embedding for link prediction in knowledge graphs. In Advances in Neural Information Processing Systems 31, pp. 4289-4300. 2018.
- Tamara G. Kolda and Brett W. Bader. Tensor decompositions and applications. SIAM review, 51(3): 455-500, 2009.
- Yehuda Koren, Robert Bell, and Chris Volinsky. Matrix factorization techniques for recommender systems. Computer, 42(8), 2009.
- Timothée Lacroix, Nicolas Usunier, and Guillaume Obozinski. Canonical tensor decomposition for knowledge base completion. In Proceedings of the 35th International Conference on Machine Learning (ICML-18), pp. 2863-2872, 2018.
- Yunpu Ma, Volker Tresp, and Erik A Daxberger. Embedding models for episodic knowledge graphs. Journal of Web Semantics, pp. 100490, 2018.
- Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. A three-way model for collective learn- ing on multi-relational data. In Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp. 809-816, 2011.
- Maximilian Nickel, Kevin Murphy, Volker Tresp, and Evgeniy Gabrilovich. A Review of Relational Machine Learning for Knowledge Graphs. Proceedings of the IEEE, 104(1):11-33, 2016a.
- Maximilian Nickel, Lorenzo Rosasco, Tomaso A Poggio, et al. Holographic embeddings of knowl- edge graphs. 2016b. Purnamrita Sarkar and Andrew W Moore. Dynamic social network analysis using latent space models. In Advances in Neural Information Processing Systems, pp. 1145-1152, 2006.
- Michael Schlichtkrull, Thomas N Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling. Modeling relational data with graph convolutional networks. In European Semantic Web Conference, pp. 593-607. Springer, 2018.
- Age Smilde, Rasmus Bro, and Paul Geladi. Multi-way analysis: applications in the chemical sci- ences. John Wiley & Sons, 2005.
- Nathan Srebro and Ruslan R Salakhutdinov. Collaborative filtering in a non-uniform world: Learn- ing with the weighted trace norm. In Advances in Neural Information Processing Systems, pp. 2056-2064, 2010.
- Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. Embedding entities and relations for learning and inference in knowledge bases. arXiv preprint arXiv:1412.6575, 2014. · arXiv
- Marinka Zitnik, Monica Agrawal, and Jure Leskovec. Modeling polypharmacy side effects with graph convolutional networks. Bioinformatics, 34(13):457â Ȃ Ş466, 2018.
Cited by
Sorted by citations
A Survey on Knowledge Graphs: Representation, Acquisition, and Applications
Ji, S., Pan, S., Cambria, E., Marttinen, P., & Yu, P. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3070843 · Cited by 2,947
TeMP: Temporal Message Passing for Temporal Knowledge Graph Completion
Wu, J., Cao, M., Cheung, J. C. K., & Hamilton, W. L. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.462 · Cited by 167
Temporal Knowledge Graph Completion: A Survey
Cai, B., Xiang, Y., Gao, L., Zhang, H., Li, Y., & Li, J. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/734 · Cited by 133
TempoQR: Temporal Question Reasoning over Knowledge Graphs
Mavromatis, C., Subramanyam, P. L., Ioannidis, V. N., Adeshina, A., Howard, P. R., Grinberg, T., Hakim, N., & Karypis, G. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i5.20526 · Cited by 16
Metadata
- Authors
- Lacroix, T., Obozinski, G., & Usunier, N.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- arXiv
- 2004.04926
- References
- 3
- Type
- Preprint
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
