The DOI matches its Crossref record; 29 of the 33 references it cites were found in a registry or an index.
Low-Dimensional Hyperbolic Knowledge Graph Embeddings
Open accessAbstract
Knowledge graph (KG) embeddings learn lowdimensional representations of entities and relations to predict missing facts.KGs often exhibit hierarchical and logical patterns which must be preserved in the embedding space.For hierarchical data, hyperbolic embedding methods have shown promise for high-fidelity and parsimonious representations.However, existing hyperbolic embedding methods do not account for the rich logical patterns in KGs.In this work, we introduce a class of hyperbolic KG embedding models that simultaneously capture hierarchical and logical patterns.Our approach combines hyperbolic reflections and rotations with attention to model complex relational patterns.Experimental results on standard KG benchmarks show that our method improves over previous Euclidean-and hyperbolic-based efforts by up to 6.1% in mean reciprocal rank (MRR) in low dimensions.Furthermore, we observe that different geometric transformations capture different types of relations while attentionbased transformations generalize to multiple relations.In high dimensions, our approach yields new state-of-the-art MRRs of 49.6% on WN18RR and 57.7% on YAGO3-10.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“While there are methods for reasoning over KGs that use hyperbolic space (MuRP [15], RotH [16]), which is suitable for modeling tree-like graphs, the choice of relational transformations used in these works (rotation) prevents them from faithfully capturing all the properties of hierarchical relations.”
From Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones (2021) · cites this paper as [16]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, transformations used in MuRP and RotH cannot capture transitive relations which hierarchical relations naturally are.”
From Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones (2021) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“RotH [16] uses rotation and reflection transformation in n -dimensional Poincaré space to model relational patterns, and achieves state-of-the-art for the KG completion task, especially under low-dimensionality.”
From Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones (2021) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The reason why RotH [16] needs learning space curvature while ConE does not lie in the choice of embedding space: RotH uses a 2 d -dimensional hyperbolic space while ConE uses product space of d hyperbolic planes.”
From Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones (2021) · cites this paper as [16]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015
(2010) · Cited by 8,261
Modeling Relational Data with Graph Convolutional Networks
Schlichtkrull, M., Kipf, T. N., Bloem, P., van den Berg, R., Titov, I., & Welling, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93417-4_38 · Cited by 5,570
Knowledge Graph Embedding by Translating on Hyperplanes
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8870 · Cited by 3,915
Learning Entity and Relation Embeddings for Knowledge Graph Completion
Lin, Y., Liu, Z., Sun, M., Liu, Y., & Zhu, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9491 · Cited by 3,749
Yago: a core of semantic knowledge
Suchanek, F. M., Kasneci, G., & Weikum, G. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242667 · Cited by 2,512
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Yang, B., Yih, W.-T., He, X., Gao, J., & Deng, L. (2014) · arXiv · doi:10.48550/arxiv.1412.6575 · Cited by 2,252
Complex Embeddings for Simple Link Prediction
Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., & Bouchard, G. (2016) · arXiv · doi:10.48550/arxiv.1606.06357 · Cited by 2,100
Knowledge Graph Embedding via Dynamic Mapping Matrix
Ji, G., He, S., Xu, L., Liu, K., & Zhao, J. (2015) · Annual Meeting of the Association for Computational Linguistics · doi:10.3115/v1/p15-1067 · Cited by 1,943
A Three-Way Model for Collective Learning on Multi-Relational Data
Nickel, M., Tresp, V., & Kriegel, H. (2011) · Cited by 1,806
RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space
Sun, Z., Deng, Z.-H., Nie, J.-Y., & Tang, J. (2019) · arXiv · doi:10.48550/arxiv.1902.10197 · Cited by 1,414
Observed versus latent features for knowledge base and text inference
Toutanova, K., & Chen, D. (2015) · Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality · doi:10.18653/v1/w15-4007 · Cited by 1,070
A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network
Nguyen, D. Q., Nguyen, T. D., Nguyen, D. Q., & Phung, D. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2053 · Cited by 923
Learning Attention-based Embeddings for Relation Prediction in \nKnowledge Graphs
Nathani, D., Chauhan, J., Sharma, C., & Kaul, M. (2019) · Research Archive of Indian Institute of Technology Hyderabad (Indian Institute of Technology Hyderabad) · Cited by 681
Poincaré Embeddings for Learning Hierarchical Representations
Nickel, M., & Kiela, D. (2017) · arXiv · doi:10.48550/arxiv.1705.08039 · Cited by 667
Convolutional 2D Knowledge Graph EmbeddingsPreprint
Dettmers, T., Minervini, P., Stenetorp, P., & Riedel, S. (2017) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.833287 · Cited by 639
Stochastic Gradient Descent on Riemannian Manifolds
Bonnabel, S. (2013) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2013.2254619 · Cited by 540
Quaternion Knowledge Graph EmbeddingsPreprint
Zhang, S., Tay, Y., Yao, L., & Liu, Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.10281 · Cited by 392
Hyperbolic Graph Convolutional Neural Networks
Chami, I., Ying, R., Ré, C., & Leskovec, J. (2019) · arXiv · doi:10.48550/arxiv.1910.12933 · Cited by 344
Self-citationGraph theoretical dimensions of informal organizations
(1994) · L. Erlbaum Associates Inc. eBooks · doi:10.4324/9781315806648-11 · Cited by 306
Canonical Tensor Decomposition for Knowledge Base Completion
Lacroix, T., Usunier, N., & Obozinski, G. (2018) · arXiv · doi:10.48550/arxiv.1806.07297 · Cited by 247
Hyperbolic Graph Neural NetworksPreprint
Liu, Q., Nickel, M., & Kiela, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12892 · Cited by 212
Poincaré GloVe: Hyperbolic Word EmbeddingsPreprint
Ţifrea, A., Bécigneul, G., & Ganea, O.-E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06546 · Cited by 196
A2N: Attending to Neighbors for Knowledge Graph Inference
Bansal, T., Juan, D.-C., Ravi, S., & McCallum, A. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1431 · Cited by 135
Self-citationLearning Mixed-Curvature Representations in Product Spaces.
Gu, A., Sala, F., Gunel, B., & Ré, C. (2018) · International Conference on Learning Representations · Cited by 94
Self-citationRepresentation Tradeoffs for Hyperbolic Embeddings.
De, C., Gu, A., Ré, C., & Sala, F. (2018) · PubMed · Cited by 84
Self-citationRelation Embedding with Dihedral Group in Knowledge Graph
Xu, C., & Li, R. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1026 · Cited by 76
Introduction to Differential Geometry
Lévine, J. (2009) · Springer eBooks · doi:10.1007/978-3-642-00839-9_2 · Cited by 33
Flagged first, then by citations
4 of the 33 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Ivana Balažević, Carl Allen, and Timothy Hospedales. 2019. Multi-relational poincaré graph embeddings. In Advances in Neural Information Processing Sys- tems, pages 4465-4475.
- Ivana Balazevic, Carl Allen, and Timothy Hospedales. 2019. Tucker: Tensor factorization for knowledge graph completion. In Proceedings of the 2019 Con- ference on Empirical Methods in Natural Language Processing and the 9th International Joint Confer- ence on Natural Language Processing (EMNLP- IJCNLP), pages 5188-5197.
- Antoine Bordes, Nicolas Usunier, Alberto Garcia- Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi- relational data. In Advances in Neural Information Processing Systems, pages 2787-2795.
- Octavian Ganea, Gary Bécigneul, and Thomas Hof- mann. 2018. Hyperbolic neural networks. In Ad- vances in Neural Information Processing Systems.
Cited by
Sorted by citations
A Survey on Knowledge Graphs: Representation, Acquisition, and Applications
Ji, S., Pan, S., Cambria, E., Marttinen, P., & Yu, P. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3070843 · Cited by 2,947
Benchmarking Graph Neural NetworksPreprint
Dwivedi, V. P., Joshi, C. K., Luu, A. T., Laurent, T., Bengio, Y., & Bresson, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00982 · Cited by 886
A Generalization of Transformer Networks to Graphs
Dwivedi, V. P., & Bresson, X. (2020) · arXiv · doi:10.48550/arxiv.2012.09699 · Cited by 398
Structure-Augmented Text Representation Learning for Efficient Knowledge Graph Completion
Wang, B., Shen, T., Long, G., Zhou, T., Wang, Y., & Chang, Y. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450043 · Cited by 297
Hyperbolic Deep Neural Networks: A Survey
Peng, W., Varanka, T., Mostafa, A., Shi, H., & Zhao, G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3136921 · Cited by 252
Metadata
- Authors
- Chami, I., Wolf, A., Juan, D.-C., Sala, F., Ravi, S., & Ré, C.
- Affiliations
- Stanford University (US)
- Google (United States) (US)
- ORCID
- Ré, Christopher
- Venue
- Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
- Published
- 2020
- Pages
- 6901-6914
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W3023009950
- Cited by
- 384
- References
- 33
- Citations by year
- 2026: 26 · 2025: 55 · 2024: 87 · 2023: 78 · 2022: 59 · 2021: 69 · 2020: 10
- FWCI
- 20.63
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1763315, 1563078, 1937301)
- Gordon and Betty Moore Foundation
- Accenture
- VMware
- Okawa Foundation for Information and Telecommunications
- Swiss Re
- Ant Financial Services Group
- National Institutes of Health (N000141712266)
- Defense Advanced Research Projects Agency (FA86501827882, FA86501827865)
- Office of Naval Research (N000141712266)
- National Institute of Biomedical Imaging and Bioengineering (U54EB020405)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- knowledge graph embedding, hyperbolic embeddings, hyperbolic geometry, hyperbolic reflections, hyperbolic rotations, attention mechanism, hierarchical relations, logical relations, low-dimensional representation, missing fact prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
