The DOI matches its DataCite record; 33 of the 33 references it cites were found in a registry or an index; 8 of the 20 sources its claims cite were checked for support.
Poincaré Embeddings for Learning Hierarchical Representations
Open accessAbstract
Representation learning has become an invaluable approach for learning from symbolic data such as text and graphs. However, while complex symbolic datasets often exhibit a latent hierarchical structure, state-of-the-art methods typically learn embeddings in Euclidean vector spaces, which do not account for this property. For this purpose, we introduce a new approach for learning hierarchical representations of symbolic data by embedding them into hyperbolic space -- or more precisely into an n-dimensional Poincaré ball. Due to the underlying hyperbolic geometry, this allows us to learn parsimonious representations of symbolic data by simultaneously capturing hierarchy and similarity. We introduce an efficient algorithm to learn the embeddings based on Riemannian optimization and show experimentally that Poincaré embeddings outperform Euclidean embeddings significantly on data with latent hierarchies, both in terms of representation capacity and in terms of generalization ability.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The paper introduces Poincaré embeddings, which embed symbolic data into an n-dimensional Poincaré ball via Riemannian optimization to capture both hierarchy and similarity. Experiments on WordNet taxonomies, collaboration networks, and lexical entailment show that Poincaré embeddings outperform Euclidean embeddings, especially in low dimensions.
Key findings
- On the transitive closure of the WordNet noun hierarchy (82,115 nouns and 743,241 hypernymy relations), Poincaré embeddings achieved mean rank 4.9 and MAP 0.823 at dimensionality 5 in reconstruction, and mean rank 5.7 and MAP 0.825 at dimensionality 5 in link prediction; Euclidean embeddings at dimensionality 5 had mean rank 3542.3 and MAP 0.024 in reconstruction, and mean rank 3311.1 and MAP 0.024 in link prediction.
- On collaboration networks, Poincaré embeddings outperformed Euclidean embeddings especially in low dimensions: for ASTROPH at dimensionality 10, reconstruction MAP was 0.703 vs. 0.376 and link prediction MAP was 0.671 vs. 0.508; for CONDMAT at dimensionality 10, reconstruction MAP was 0.799 vs. 0.356 and link prediction MAP was 0.539 vs. 0.308; for GRQC at dimensionality 10, reconstruction MAP was 0.990 vs. 0.522 and link prediction MAP was 0.660 vs. 0.438; for HEPPH at dimensionality 10, reconstruction MAP was 0.811 vs. 0.434 and link prediction MAP was 0.683 vs. 0.642.
- On the noun part of HYPERLEX (2,163 rated noun pairs), Poincaré embeddings achieved Spearman’s ρ = 0.512, compared with Euclidean ρ = 0.389 and the listed baselines FR 0.283, SLQS-Sim 0.229, WN-Basic 0.240, WN-WuP 0.214, WN-LCh 0.214, and Vis-ID 0.253. The same embeddings achieved accuracy 0.86 on WBLESS.
- A two-dimensional Poincaré embedding trained on the WordNet mammals subtree achieved mean rank 1.26 and MAP 0.927.
Methods
- The approach embeds symbols into the Poincaré ball model of hyperbolic space and optimizes a problem-specific loss via stochastic Riemannian optimization, using the Riemannian gradient, retraction \(R_\theta(v)=\theta+v\), projection to keep embeddings within the ball with \(\epsilon=10^{-5}\), random initialization from \(U(-0.001,0.001)\), and a burn-in phase with reduced learning rate \(\eta/c\), \(c=10\), for 10 epochs.
- Data include the transitive closure of the WordNet noun hierarchy (82,115 nouns, 743,241 hypernymy relations); four collaboration networks ASTROPH (N=18,772; E=198,110), CONDMAT (N=23,133; E=93,497), GRQC (N=5,242; E=14,496), and HEPPH (N=12,008; E=118,521); HYPERLEX noun pairs (2,163); and WBLESS.
- For taxonomy embedding, the loss is a soft ranking loss with 10 negative examples per positive example, evaluated by mean rank and MAP. For networks, edge probability is modeled via a Fermi-Dirac distribution with cross-entropy loss and negative sampling. For lexical entailment, a score function with penalty \(\alpha(\|v\|-\|u\|)\), \(\alpha=10^3\), is evaluated by Spearman’s rank correlation.
Limitations
- The paper states that its main focus was to evaluate general properties of hyperbolic geometry for embedding symbolic data, and that future work includes expanding applications, for instance to multi-relational data, and deriving models tailored to specific applications such as word embeddings. It also states that natural gradient based optimization already produces good embeddings and scales to large datasets, but expects that a full Riemannian optimization approach can further increase quality and lead to faster convergence.
- Evident from the text: the empirical evaluation is limited to taxonomy embedding, network link prediction, and lexical entailment; no multi-relational or broader symbolic-data experiments are reported.
- Evident from the text: the translational score function has more information for asymmetric is-a relations and is “not fully unsupervised,” while the Poincaré and Euclidean distances are symmetric; the Poincaré distance captures hierarchy through norm but does not directly model ordered input pairs unless an additional asymmetric score is used.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
8 of 20 cited sources checked · 4 supported · 1 flagged · accuracy not yet measured
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“The same embeddings also achieved a state-of-the-art accuracy of 0 . 86 on WBLESS [33, 14], which evaluates non-graded lexical entailment.”
What the sources say
- Partly supportedcites [33] [33] Julie Weeds, Daoud Clarke, Jeremy Reffin, David Weir, and Bill Keller. Learning to distinguish hypernyms and co-hyponyms. In Proceedings of the 25th International Conference on Computational Linguistics COLING , pages 2249-2259. Dublin City University and Association for Computational Linguistics, 2014. -Experimental — accuracy not yet measured
Section 3.3.1 describes a BLESS dataset for lexical entailment, and Table 3 reports accuracy on that dataset. Our copy does not report a WBLESS evaluation or a state-of-the-art accuracy of 0.86; the reported hyponym BLESS accuracies reach 0.75. Searches for “WBLESS,” “0.86,” and “86% accuracy” found no supporting passage. (LLM, conf=0.83)
- Disputedcites [14] [14] Douwe Kiela, Laura Rimell, Ivan Vulic, and Stephen Clark. Exploiting image generality for lexical entailment detection. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics (ACL 2015) , pages 119-124. ACL, 2015. - sourceExperimental — accuracy not yet measured
Table 2 (Results) reports WBLESS accuracy of 0.75 for image dispersion and 0.74 for centroid distance, not 0.86. The Results say dispersion matches the best-performing supervised method; the paper does support describing WBLESS as a non-graded entailment-detection evaluation. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“complex symbolic datasets often exhibit a latent hierarchical structure”
- Also stated in: § 1 Introduction · p. 1 · plain
“large datasets whose objects can be organized according to a latent hierarchy - a property that is inherent in many complex datasets”
What the sources say
- Partly supportedcites [25] [25] Erzsébet Ravasz and Albert-László Barabási. Hierarchical organization in complex networks. Physical Review E , 67(2):026112, 2003. - sourceExperimental — accuracy not yet measured
The paper reports hierarchical organization in several complex networks, including a language network linking synonymous words (Section II, p. 3). This supports the possibility of latent hierarchy in symbolic data, but it does not establish that complex symbolic datasets in general often exhibit it. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites [1] [1] Aaron B Adcock, Blair D Sullivan, and Michael W Mahoney. Tree-like structure in large social and information networks. In Data Mining (ICDM), 2013 IEEE 13th International Conference on , pages 1-10. IEEE, 2013. - source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § 1 Introduction · p. 1 · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“It can be seen that the ranking based on Poincaré embeddings clearly outperforms all state-of-the-art methods evaluated in [32].”
What the sources say
- Supportedcites [32] [32] Ivan Vuli´ c, Daniela Gerz, Douwe Kiela, Felix Hill, and Anna Korhonen. Hyperlex: A large-scale evaluation of graded lexical entailment. arXiv preprint arXiv:1608.02117 , 2016. - source
Section 7.2 describes evaluating state-of-the-art word embedding models on HyperLex, and Table 11 reports results for prominent lexical-entailment models. The citation identifies the source of the comparison methods; the statement that Poincaré embeddings outperform them is the citing authors’ own conclusion, not a result attributed to this paper. (LLM, conf=0.90)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Since edges in complex networks can often be explained via latent hierarchies over their nodes [8], we are interested in the benefits of Poincaré embeddings both in terms representation size and generalization performance.”
What the sources say
- Supportedcites [8] [8] Aaron Clauset, Cristopher Moore, and Mark EJ Newman. Hierarchical structure and the prediction of missing links in networks. Nature , 453(7191):98-101, 2008. - source
On p. 1, the paper models the probability of an edge between two vertices using their relationship in a hierarchical dendrogram. On p. 2, it reports that fitted hierarchical models capture structural features of several example networks, supporting the claim that latent hierarchies can often explain their edges. (LLM, conf=0.93)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It can be seen that Poincaré embeddings are very successful in the embedding of large taxonomies - both with regard to their representation capacity and their generalization performance.”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The transitive closure of the WORDNET noun hierarchy exhibits a clear latent hierarchical structure.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Second, we found that a good initial angular layout can be helpful to find good embeddings. For this reason, we train during an initial “burn-in” phase with a reduced learning rate η/c . In combination with initializing close to the origin, this can improve the angular layout without moving too far towards the boundary.”
Strength:plain· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Furthermore, the results of Poincaré embeddings in the link prediction task are very robust with regard to the embedding dimension.”
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The transitive closure of the WORDNET noun hierarchy exhibits a clear latent hierarchical structure.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A Poincaré embedding with d = 5 achieves mean rank 1.26 and MAP 0.927 on this subtree.”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The transitive closure of the WORDNET noun hierarchy exhibits a clear latent hierarchical structure.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, we show that embeddings trained on WORDNET provide state-of-the-art performance for lexical entailment.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- The authors state this as an assumption: There exists a latent hierarchy in which the symbols can be organized.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In R 2 , a similar construction is not possible as circle length ( 2 πr ) and disc area ( 2 πr 2 ) grow only linearly and quadratically with regard to r in Euclidean geometry.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- It may state two separate claims as one. 23
- Probably not a substantial claim. 12
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Since the Poincaré Ball has a Riemannian manifold structure, we can optimize Equation (2) via stochastic Riemannian optimization methods such as RSGD [5] or RSVRG [34].”
What the sources say
- Not matchedcites [5] [5] Silvere Bonnabel. Stochastic gradient descent on riemannian manifolds. IEEE Trans. Automat. Contr. , 58(9):2217-2229, 2013. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites [34] [34] Hongyi Zhang, Sashank J. Reddi, and Suvrit Sra. Riemannian SVRG: fast stochastic optimization on riemannian manifolds. In Advances in Neural Information Processing Systems 29 , pages 4592-4600, 2016. - source
The citation [34] is attached to RSVRG, not to the Poincaré ball’s geometry or RSGD. The Abstract identifies Riemannian SVRG as a variance-reduced method for optimization on Riemannian manifolds, supporting its use here as an example of a stochastic Riemannian optimization method. (LLM, conf=0.92)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- The authors state this as an assumption: We are given a problem-specific loss function L(Θ) that encourages semantically similar objects to be close in the embedding space according to their Poincaré distance.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“Moreover, the algorithm is straightforward to parallelize via methods such as Hogwild [26], as the updates are sparse (only a small number of embeddings are modified in an update) and collisions are very unlikely on large-scale data.”
What the sources say
- Supportedcites [26] [26] Benjamin Recht, Christopher Ré, Stephen J. Wright, and Feng Niu. Hogwild: A lock-free approach to parallelizing stochastic gradient descent. In Advances in Neural Information Processing Systems 24 , pages 693-701, 2011. - source
The Introduction (p. 2) says Hogwild runs SGD in parallel without locks and that, when individual steps modify only a small part of the decision variable, memory overwrites are rare. This supports the cited rationale for parallelizing sparse updates; the reference to embeddings describes the citing authors’ algorithm. (LLM, conf=0.93)
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- The authors state this as an assumption: We are given a problem-specific loss function L(Θ) that encourages semantically similar objects to be close in the embedding space according to their Poincaré distance.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“the existence of power-law distributions in datasets can often be traced back to hierarchical structures [25]”
What the sources say
- Partly supportedcites [25] [25] Erzsébet Ravasz and Albert-László Barabási. Hierarchical organization in complex networks. Physical Review E , 67(2):026112, 2003. - sourceExperimental — accuracy not yet measured
The paper’s opening section (p. 1) says that the scale-free properties of several real networks are a consequence of hierarchical organization, and its hierarchical model has a power-law degree distribution (Section I, p. 2). The claim extends that finding from network degree distributions to power-law distributions in datasets generally, which the paper does not establish. (LLM, conf=0.84)
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“show experimentally that Poincaré embeddings outperform Euclidean embeddings significantly on data with latent hierarchies, both in terms of representation capacity and in terms of generalization ability”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- The authors state this as an assumption: There exists a latent hierarchy in which the symbols can be organized.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Furthermore, we have shown that natural gradient based optimization already produces very good embeddings and scales to large datasets.”
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear? Based: unclearIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“First, we initialize all embeddings randomly from the uniform distribution U ( -0 . 001 , 0 . 001) . This causes embeddings to be initialized close to the origin of B d .”
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On collaboration networks, we also show that Poincaré embeddings are successful in predicting links in graphs where they outperform Euclidean embeddings, especially in low dimensions.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- The authors state this as an assumption: There exists a latent hierarchy in which the symbols can be organized.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It can be seen that Poincaré embeddings perform again very well on these datasets and - especially in the low-dimensional regime - outperform Euclidean embeddings.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The four social networks ASTROPH, CONDMAT, GRQC, and HEPPH have latent hierarchies over their nodes.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Experimentally, we show that our approach can provide high quality embeddings of large taxonomies - both with and without missing data.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- The authors state this as an assumption: There exists a latent hierarchy in which the symbols can be organized.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Furthermore, please note that Equation (1) is symmetric and that the hierarchical organization of the space is solely determined by the distance of points to the origin.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- The authors state this as an assumption: There exists a latent hierarchy in which the symbols can be organized.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We base our approach on a particular model of hyperbolic space, i.e., the Poincaré ball model, as it is well-suited for gradient-based optimization.”
- Also stated in: § 3 Poincaré Embeddings · p. 3 · plain
“we will base our approach on the Poincaré ball model, as it is well-suited for gradient-based optimization”
Load-bearingStrength:boosted· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
- The authors state this as an assumption: There exists a latent hierarchy in which the symbols can be organized.
- Also stated in: § 3 Poincaré Embeddings · p. 3 · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It can be seen from Equation (1), that the distance within the Poincaré ball changes smoothly with respect to the location of u and v . This locality property of the Poincaré distance is key for finding continuous embeddings of hierarchies.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- The authors state this as an assumption: There exists a latent hierarchy in which the symbols can be organized.
In the paper
“Although non-linear embeddings can mitigate this problem [7], complex graph patterns can still require a computationally infeasible embedding dimensionality.”
What the sources say
- Not checked — no full text of the sourcecites [7] [7] Guillaume Bouchard, Sameer Singh, and Theo Trouillon. On approximate reasoning capabilities of low-rank vector spaces. AAAI Spring Syposium on Knowledge Representation and Reasoning (KRR): Integrating Symbolic and Neural Approaches , 2015. -
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“both disc area and circle length grow exponentially with r”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Informally, hyperbolic space can be thought of as a continuous version of trees and as such it is naturally equipped to model hierarchical structures.”
- Also stated in: § 2 Embeddings and Hyperbolic Geometry · p. 2 · plain
“Intuitively, hyperbolic spaces can be thought of as continuous versions of trees or vice versa, trees can be thought of as “discrete hyperbolic spaces” [16].”
What the sources say
- Not checked — no full text of the sourcecites [16] [16] Dmitri Krioukov, Fragkiskos Papadopoulos, Maksim Kitsak, Amin Vahdat, and Marián Boguná. Hyperbolic geometry of complex networks. Physical Review E , 82(3):036106, 2010. - source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Also stated in: § 2 Embeddings and Hyperbolic Geometry · p. 2 · plain
In the paper
“As retraction operation we use R θ ( v ) = θ + v . In combination with the Riemannian gradient, this corresponds then to the well-known natural gradient method [2].”
What the sources say
- Not matchedcites [2] [2] Shun-ichi Amari. Natural gradient works efficiently in learning. Neural Computation , 10(2): 251-276, 1998. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Due to the underlying hyperbolic geometry, this allows us to learn parsimonious representations of symbolic data by simultaneously capturing hierarchy and similarity.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- The authors state this as an assumption: There exists a latent hierarchy in which the symbols can be organized.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“As the number of parameters increases, this can lead to computational problems in terms of runtime and memory complexity as well as to overfitting.”
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Since the Poincaré ball is a conformal model of hyperbolic space, the angles between adjacent vectors are identical to their angles in the Euclidean space.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“state-of-the-art methods typically learn embeddings in Euclidean vector spaces, which do not account for this property”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For instance, the hyperboloid model is constrained to points where 〈 x , x 〉 = -1 , while the distance function of the Beltrami-Klein model requires to compute the location of ideal points on the boundary ∂ B of the unit ball.”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“An interesting aspect of Poincaré embeddings is that they allow us to make graded assertions about hierarchical relationships as hierarchies are represented in a continuous space.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For the Poincaré distance and the Euclidean distance we could randomly permute the order of ( u, v ) and obtain the identical embedding, while this is not the case for the translational score function.”
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“For asymmetric data, we also include the score function d ( u , v ) = ‖ u -v + r ‖ 2 , as proposed by Bordes et al. [6] for modeling large-scale graph-structured data.”
What the sources say
- Not matchedcites [6] [6] Antoine Bordes, Nicolas Usunier, Alberto García-Durán, Jason Weston, and Oksana Yakhnenko. Translating embeddings for modeling multi-relational data. In Advances in Neural Information Processing Systems 26 , pages 2787-2795, 2013. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“First, Poincaré embeddings enable very parsimonious representations whats allows us to learn high-quality embeddings of large-scale taxonomies.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The transitive closure of the WORDNET noun hierarchy exhibits a clear latent hierarchical structure.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Methods in Table 3 that are prefixed with WN also use WORDNET as a basis and therefore are most comparable.”
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Here, r corresponds to the radius around each point u such that points within this radius are likely to have an edge with u .”
What the sources say
- Not checked — no full text of the sourcecites [16] [16] Dmitri Krioukov, Fragkiskos Papadopoulos, Maksim Kitsak, Amin Vahdat, and Marián Boguná. Hyperbolic geometry of complex networks. Physical Review E , 82(3):036106, 2010. - source
Strength:hedged· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We attribute this result to the structural bias of Poincaré embeddings, what could lead to reduced overfitting on this kind of data with a clear latent hierarchy.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The transitive closure of the WORDNET noun hierarchy exhibits a clear latent hierarchical structure.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As such, it is not fully unsupervised and only applicable where this hierarchical information is available.”
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“The parameter t specifies the steepness of the logistic function and influences both average clustering as well as the degree distribution [16].”
What the sources say
- Not checked — no full text of the sourcecites [16] [16] Dmitri Krioukov, Fragkiskos Papadopoulos, Maksim Kitsak, Amin Vahdat, and Marián Boguná. Hyperbolic geometry of complex networks. Physical Review E , 82(3):036106, 2010. - source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The authors state this as an assumption.
There exists a latent hierarchy in which the symbols can be organized.
“We assume that there exists a latent hierarchy in which the symbols can be organized.”
The paper relies on this without support.
In many datasets such as text corpora, multiple latent hierarchies can co-exist.
“First, in many datasets such as text corpora, multiple latent hierarchies can co-exist, which can not always be modeled in two dimensions.”
The authors state this as an assumption.
We are given a problem-specific loss function L(Θ) that encourages semantically similar objects to be close in the embedding space according to their Poincaré distance.
“We assume we are given a problem-specific loss function L (Θ) which encourages semantically similar objects to be close in the embedding space according to their Poincaré distance.”
The authors state this as an assumption.
The gradient of the loss function L is known.
“the Euclidean gradient ∇ E = ∂ L ( θ ) ∂d ( θ , x ) ∂d ( θ , x ) ∂ θ depends on the gradient of L , which we assume is known”
The paper relies on this without support.
The transitive closure of the WORDNET noun hierarchy exhibits a clear latent hierarchical structure.
“In the first set of experiments, we are interested in evaluating the ability of Poincaré embeddings to embed data that exhibits a clear latent hierarchical structure. For this purpose, we conduct experiments on the transitive closure of the WORDNET noun hierarchy [18] in two settings:”
The paper relies on this without support.
The four social networks ASTROPH, CONDMAT, GRQC, and HEPPH have latent hierarchies over their nodes.
“We performed our experiments on four commonly used social networks, i.e, ASTROPH, CONDMAT, GRQC, and HEPPH. These networks represent scientific collaborations such that there exists an undirected edge between two persons if they co-authored a paper.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the approach of (Nickel & Kiela, 2017) suffers from a few drawbacks: first, their loss function causes most points to collapse on the border of the Poincar´ e ball, as exemplified in Figure 3.”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous work (Nickel & Kiela, 2017) optimizing word embeddings in the Poincar´ e ball used the retraction map R x ( v ) := x + v as a first order approximation of exp x ( v ) .”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Hyperbolic embeddings can naturally capture hierarchical structures.”
From Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones (2021) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Many real-world knowledge graphs contain hierarchical relations [10, 11, 26].”
From Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones (2021) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Poincaré embeddings (Nickel and Kiela, 2017) represent entities in hyperbolic space, leveraging the inductive bias of negative curvature to fit hierarchies.”
From Probabilistic Box Embeddings for Uncertain Knowledge Graph Reasoning (2021) · cites this paper as Nickel and Kiela, 2017
The cited source says what the claim attributes to it.
In the citing paper
“We also compute an analytic closed-form expression for the exponential map in the n -dimensional Poincar´ e ball, allowing us to perform full Riemannian optimization (Bonnabel, 2013) in the Poincar´ e ball, as opposed to the approximate optimization method used by (Nickel & Kiela, 2017).”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
The cited source says what the claim attributes to it.
In the citing paper
“Second, the hyperbolic distance alone (being symmetric) is not capable of encoding asymmetric relations needed for entailment detection, thus a heuristic score is chosen to account for concept generality or specificity encoded in the embedding norm.”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
The cited source says what the claim attributes to it.
In the citing paper
“Experiments show significant improvements of our method over strong recent baselines both in terms of representational capacity and generalization.”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
The cited source says what the claim attributes to it.
In the citing paper
“The latent hierarchical structure surprisingly emerges as a simple reflection of the space's negative curvature.”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
The cited source says what the claim attributes to it.
In the citing paper
“From a machine learning perspective, recently, hyperbolic spaces have been observed to provide powerful representations of entailment relations (Nickel & Kiela, 2017).”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
The cited source says what the claim attributes to it.
In the citing paper
“We note that Poincar´ e and Simple Euclidean embeddings were trained using a symmetric distance function, and thus cannot be directly used to evaluate asymmetric entailment relations.”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
The cited source says what the claim attributes to it.
In the citing paper
“For the Simple Euclidean embeddings and Poincar´ e embeddings, we find the burn-in strategy of (Nickel & Kiela, 2017) to be essential for a good initial disentanglement.”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
The cited source says what the claim attributes to it.
In the citing paper
“For the hyperbolic models, we do not find significant empirical improvements when using full Riemannian optimization instead of approximating it with a retraction map as done in (Nickel & Kiela, 2017).”
From Hyperbolic Entailment Cones for Learning Hierarchical Embeddings (2018) · cites this paper as Nickel & Kiela, 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Euclidean disk area has an extra factor of two
MinorThe stated circle length, 2πr, implies an enclosed disk area of πr2, not 2πr2. The two formulas are inconsistent.
“disc area ( 2 πr 2 )”
“circle length ( 2 πr )”
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
node2vec: Scalable Feature Learning for Networks
Grover, A., & Leskovec, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939754 · Cited by 10,926
DeepWalk: online learning of social representations
Perozzi, B., Al-Rfou, R., & Skiena, S. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623732 · Cited by 10,123
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
(2013) · Cited by 5,726
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Chao, Y. R. (1950) · Language · doi:10.2307/409735 · Cited by 2,210
Hierarchical structure and the prediction of missing links in networks
Clauset, A., Moore, C., & Newman, M. E. J. (2008) · Nature · doi:10.1038/nature06830 · Cited by 2,171
Hierarchical organization in complex networks
Ravasz, E., & Barabási, A.-L. (2003) · Physical Review E · doi:10.1103/physreve.67.026112 · Cited by 2,160
Complex Embeddings for Simple Link Prediction
Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., & Bouchard, G. (2016) · arXiv · doi:10.48550/arxiv.1606.06357 · Cited by 2,100
Latent Space Approaches to Social Network Analysis
Hoff, P. D., Raftery, A. E., & Handcock, M. S. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618906 · Cited by 1,917
A Three-Way Model for Collective Learning on Multi-Relational Data
Nickel, M., Tresp, V., & Kriegel, H. (2011) · Cited by 1,806
Self-citationThe Large‐Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth
Mark Steyvers, B., & Tenenbaum, J. B. (2005) · Cognitive Science · doi:10.1207/s15516709cog2901_3 · Cited by 1,453
Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent
Niu, F., Recht, B., Re, C., & Wright, S. J. (2011) · arXiv · doi:10.48550/arxiv.1106.5730 · Cited by 1,211
Hyperbolic geometry of complex networks
Krioukov, D., Papadopoulos, F., Kitsak, M., Vahdat, A., & Boguñá, M. (2010) · Physical Review E · doi:10.1103/physreve.82.036106 · Cited by 1,059
Relation Extraction with Matrix Factorization and Universal Schemas
Riedel, S., Yao, L., McCallum, A., & Marlin, B. M. (2013) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 570
Holographic embeddings of knowledge graphs
Nickel, M., Rosasco, L., & Poggio, T. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10314 · Cited by 559
Self-citationStochastic Gradient Descent on Riemannian Manifolds
Bonnabel, S. (2013) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2013.2254619 · Cited by 540
Sustaining the Internet with hyperbolic mapping
Boguñá, M., Papadopoulos, F., & Krioukov, D. (2010) · Nature Communications · doi:10.1038/ncomms1063 · Cited by 463
Enriching Word Vectors with Subword InformationPreprint
Bojanowski, P., Grave, É., Joulin, A., & Mikolov, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.04606 · Cited by 457
Geographic Routing Using Hyperbolic Space
Kleinberg, R. (2007) · doi:10.1109/infcom.2007.221 · Cited by 397
Word Representations via Gaussian EmbeddingPreprint
Vilnis, L., & McCallum, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6623 · Cited by 359
Order-Embeddings of Images and Language
Vendrov, I., Kiros, R., Fidler, S., & Urtasun, R. (2015) · arXiv · doi:10.48550/arxiv.1511.06361 · Cited by 296
(2014) · Sussex Research Online (University of Sussex) · Cited by 163
Tree-Like Structure in Large Social and Information Networks
Adcock, A. B., Sullivan, B. D., & Mahoney, M. W. (2013) · 2013 IEEE 13th International Conference on Data Mining · doi:10.1109/icdm.2013.77 · Cited by 141
Riemannian SVRG: Fast Stochastic Optimization on Riemannian Manifolds
Zhang, H., Reddi, S. J., & Sra, S. (2016) · arXiv · doi:10.48550/arxiv.1605.07147 · Cited by 140
Learning distributed representations of concepts using linear relational embedding
Paccanaro, A., & Hinton, G. E. (2001) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.917563 · Cited by 131
HyperLex: A Large-Scale Evaluation of Graded Lexical Entailment
Vulić, I., Gerz, D., Kiela, D., Hill, F., & Korhonen, A. (2017) · Computational Linguistics · doi:10.1162/coli_a_00301 · Cited by 95
Self-citationHyperLex: A Large-Scale Evaluation of Graded Lexical Entailment
Vulić, I., Gerz, D., Kiela, D., Hill, F., & Korhonen, A. (2016) · arXiv · doi:10.48550/arxiv.1608.02117 · Cited by 90
Self-citation(2015) · Cited by 70
(2014) · Cited by 66
Self-citationExploiting Image Generality for Lexical Entailment Detection
Kiela, D., Rimell, L., Vulić, I., & Clark, S. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.3115/v1/p15-2020 · Cited by 55
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- [2][2] Shun-ichi Amari. Natural gradient works efficiently in learning. Neural Computation , 10(2): 251-276, 1998. -
- [10][10] Mikhael Gromov. Hyperbolic groups. In Essays in group theory , pages 75-263. Springer, 1987. -
- [35][35] George Kingsley Zipf. Human Behaviour and the Principle of Least Effort: an Introduction to Human Ecology . Addison-Wesley, 1949.
Cited by
Sorted by citations
Geom-GCN: Geometric Graph Convolutional NetworksPreprint
Pei, H., Wei, B., Chang, K. C., Yu, L., & Yang, B. X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05287 · Cited by 747
Mitigating Gender Bias in Natural Language Processing: Literature Review
Sun, T., Gaut, A., Tang, S., Huang, Y., ElSherief, M., Zhao, J., Mirza, D., Belding, E., Chang, K.-W., & Wang, W. Y. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1159 · Cited by 492
Low-Dimensional Hyperbolic Knowledge Graph Embeddings
Chami, I., Wolf, A., Juan, D.-C., Sala, F., Ravi, S., & Ré, C. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.617 · Cited by 384
From Word To Sense Embeddings: A Survey on Vector Representations of Meaning
Camacho-Collados, J., & Pilehvar, M. T. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11259 · Cited by 393
A Review of Challenges and Opportunities in Machine Learning for Health
Ghassemi, M., Naumann, T., Schulam, P., Beam, A. L., Chen, I. Y., & Ranganath, R. (2018) · PubMed · doi:10.48550/arxiv.1806.00388 · Cited by 368
Metadata
- Authors
- Nickel, M., & Kiela, D.
- ORCID
- Nickel, Maximilian
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1705.08039
- OpenAlex
- W2618798060
- Semantic Scholar
- 1590bd1bca945fc6ff50b8cdf2da14ea2061c79a
- Cited by
- 667
- References
- 28
- Citations by year
- 2026: 3 · 2025: 46 · 2024: 90 · 2023: 55 · 2022: 35 · 2021: 151 · 2020: 146 · 2019: 100 · 2018: 37 · 2017: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- Poincaré embeddings, hyperbolic space, hierarchical representation, symbolic data, Riemannian optimization, hyperbolic geometry, embedding learning, generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-23, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-23 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
