Hyperbolic Entailment Cones for Learning Hierarchical Embeddings
Open accessAbstract
Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior work, we first advocate for using hyperbolic spaces which provably model tree-like structures better than Euclidean geometry. Second, we view hierarchical relations as partial orders defined using a family of nested geodesically convex cones. We prove that these entailment cones admit an optimal shape with a closed form expression both in the Euclidean and hyperbolic spaces, and they canonically define the embedding learning process. Experiments show significant improvements of our method over strong recent baselines both in terms of representational capacity and generalization.
AI snapshot
Written from the paper’s full text.
TL;DR
The paper introduces geodesically convex entailment cones for embedding directed acyclic graphs and hierarchical relations, with closed-form optimal cone shapes in Euclidean and hyperbolic space. On WordNet hypernym link prediction, hyperbolic entailment cones outperform strong baselines, especially as more transitive-closure edges are available during training.
Key findings
- The optimal entailment cones satisfying axial symmetry, rotation invariance, continuity, and transitivity admit closed-form expressions in both Euclidean and hyperbolic geometry; the authors also derive a closed-form exponential map in the Poincaré ball.
- On WordNet link prediction, hyperbolic cones achieve test F1 of 80.1%, 86.0%, and 92.8% at embedding dimension 5 for 10%, 25%, and 50% of non-basic transitive-closure edges in training, and 85.9%, 91.0%, and 94.4% at dimension 10 for the same settings.
- Hyperbolic cones are better than all baselines in all settings except 0% training edges, where order embeddings are better; once a small percentage of transitive-closure edges is available, improvements are sometimes more than 8% F1.
- Hyperbolic cones show the largest growth when transitive-closure edges are added at train time.
Methods
- The model represents an entailment relation \((u,v)\) as \(v\) belonging to the entailment cone \(S_{\psi(u)}^u\), trained with a max-margin loss on angles using margin \(\gamma=0.01\), 10 negative edges per positive edge, batch size 10, learning rate 1e-4, and projection outside an \(\epsilon=0.1\) ball.
- Data: the full transitive closure of the WordNet noun hierarchy with the root removed, containing 82,114 nodes and 661,127 edges; basic transitive-reduction edges are always in training, while non-basic edges are split into validation (5%), test (5%), and training fractions of 0%, 10%, 25%, or 50%.
- Baselines are Simple Euclidean embeddings, Poincaré embeddings, and Order embeddings; evaluation uses precision, recall, and F1, with thresholds tuned on validation, and negative validation/test pairs generated by corrupting each positive edge with five \(u'\) and five \(v'\) non-edges.
Limitations
- The paper states that future work should test whether entailment cones can embed more complex data such as sentences or images; the current experiments are limited to WordNet noun hierarchy link prediction.
- The paper reports that order embeddings are better in the 0% training-edge setting, and that initialization is very important because the loss is highly non-convex; hyperbolic cones are initialized from Poincaré embeddings pretrained for 100 epochs and rescaled by 0.7.
- The paper states that full Riemannian optimization did not give significant empirical improvements over the retraction approximation, so the faster retraction was used; evident from the text, evaluation is restricted to low-dimensional settings (5 and 10 dimensions) and one WordNet-based DAG task.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
15 of 29 cited sources checked · 10 supported · 0 flagged · accuracy not yet measured
- Premisecitation§ Abstract · p. 1
Hyperbolic spaces provably model tree-like structures better than Euclidean geometry.
“Following prior work, we first advocate for using hyperbolic spaces which provably model tree-like structures better than Euclidean geometry.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites Gromov, 1987 source
- cites Bowditch, 2006 source
- cites Sarkar, 2011 source
Searches for Euclidean geometry, trees, and distortion found no substantive passage from the paper’s body. The indexed result contains an abstract describing low-distortion embeddings in the hyperbolic plane, but no body-text passage establishing the claimed comparison with Euclidean geometry; the abstract cannot decide the verdict under the evidence rule. (LLM, conf=0.70)
Experimental — accuracy not yet measured
- Premiseown data§ 1. Introduction · p. 2
The approach of Nickel & Kiela (2017) suffers from its loss function causing most points to collapse on the border of the Poincaré ball.
“However, the approach of (Nickel & Kiela, 2017) suffers from a few drawbacks: first, their loss function causes most points to collapse on the border of the Poincar´ e ball, as exemplified in Figure 3.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Nickel & Kiela, 2017 source
Section 3 (p. 4) says leaf nodes can be placed close to the Poincaré ball’s boundary to represent hierarchy. It does not say that most points collapse there, or that the loss function causes such a collapse. Section 3.2 (p. 5) instead describes a training step intended to avoid moving too far toward the boundary. (LLM, conf=0.83)
Experimental — accuracy not yet measured
- Premisecitation§ 1. Introduction · p. 2
Hyperbolic spaces have been observed to provide powerful representations of entailment relations.
“From a machine learning perspective, recently, hyperbolic spaces have been observed to provide powerful representations of entailment relations (Nickel & Kiela, 2017).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Nickel & Kiela, 2017 source
- Premisecitation§ 1. Introduction · p. 1
The exponential growth property enables hyperbolic spaces to embed any weighted tree while almost preserving their metric.
“This exponential growth property enables hyperbolic spaces to embed any weighted tree while almost preserving their metric 3 (Gromov, 1987; Bowditch, 2006; Sarkar, 2011).”
Quote in the paperSubstantial claim1 of 3 sources checked- cites Gromov, 1987 source
- cites Bowditch, 2006 source
- cites Sarkar, 2011 source
The indexed matches contain only an Abstract and bibliographic metadata, not a passage from the paper’s full text that can serve as evidence under the stated rule. Searches for “exponential,” “growth,” and weighted-tree embedding found no qualifying full-text passage establishing the attributed explanation. (LLM, conf=0.72)
Experimental — accuracy not yet measured
- Findingown data§ 5. Experiments · p. 8
Full Riemannian optimization does not yield significant empirical improvements over approximating it with a retraction map for hyperbolic models.
“For the hyperbolic models, we do not find significant empirical improvements when using full Riemannian optimization instead of approximating it with a retraction map as done in (Nickel & Kiela, 2017).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Nickel & Kiela, 2017 source
- Premisecitation§ 5. Experiments · p. 8
Poincaré and Simple Euclidean embeddings were trained using a symmetric distance function and thus cannot be directly used to evaluate asymmetric entailment relations.
“We note that Poincar´ e and Simple Euclidean embeddings were trained using a symmetric distance function, and thus cannot be directly used to evaluate asymmetric entailment relations.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Nickel & Kiela, 2017 source
- Findingnone given§ 5. Experiments · p. 8
The burn-in strategy of Nickel & Kiela (2017) is essential for good initial disentanglement for Simple Euclidean and Poincaré embeddings.
“For the Simple Euclidean embeddings and Poincar´ e embeddings, we find the burn-in strategy of (Nickel & Kiela, 2017) to be essential for a good initial disentanglement.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Nickel & Kiela, 2017 source
- Findingreasoning§ Abstract · p. 1
The optimal entailment cones satisfying four natural properties exhibit canonical closed-form expressions in both Euclidean and hyperbolic geometry.
“We prove that these entailment cones admit an optimal shape with a closed form expression both in the Euclidean and hyperbolic spaces, and they canonically define the embedding learning process.”
- Also stated in: § 1. Introduction · p. 2 · boosted
“The optimal entailment cones satisfying four natural properties surprisingly exhibit canonical closed-form expressions in both Euclidean and hyperbolic geometry that we rigorously derive.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The optimal entailment cones should satisfy axial symmetry, rotation invariance, continuous aperture, and transitivity.
- Also stated in: § 1. Introduction · p. 2 · boosted
- Findingreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 6
The closed form expression for ψ is also a sufficient condition for transitivity to hold.
“which is also a sufficient condition for transitivity to hold:”
Quote in the paperSubstantial claim - Findingreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 6
Theorem 4 states that if ψ is defined as in Eqs.25-26, then transitivity holds.
“Theorem 4. If ψ is defined as in Eqs.25-26, then transitivity holds.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The optimal entailment cones should satisfy axial symmetry, rotation invariance, continuous aperture, and transitivity.
- Findingown data§ 5. Experiments · p. 8
Best results for hyperbolic cones are obtained by initializing with Poincaré embeddings pretrained for 100 epochs.
“In practice, we obtain our best results when initializing the embeddings corresponding to the hyperbolic cones using the Poincar´ e embeddings pretrained for 100 epochs.”
Quote in the paperNot a substantial claim - Findingown data§ 5. Experiments · p. 8
Hyperbolic cones have the largest growth/benefit when transitive closure edges are added at train time.
“Moreover, hyperbolic cones have the largest growth when transitive closure edges are added at train time.”
- Also stated in: § 6. Conclusion · p. 9 · boosted
“We empirically discover that strong embedding methods can vary a lot with the percentage of the taxonomy observable during training and demonstrate that our proposed method benefits the most from increasing size of the training data.”
Quote in the paperNot a substantial claim- Rests on an assumption: The basic edges (transitive reduction) are hard to predict.
- Rests on an assumption: The tree root carries little information and only has trivial edges to predict.
- Rests on an assumption: The WordNet noun hierarchy exhibits a latent hierarchical structure.
- Also stated in: § 6. Conclusion · p. 9 · boosted
- Findingown data§ 5. Experiments · p. 8
Poincaré embeddings are heavily collapsed to the unit ball border.
“We also observe that the Poincar´ e embeddings are heavily collapsed to the unit ball border (as also pictured in Fig. 3)”
Quote in the paperSubstantial claim - Findingreasoning§ 5. Experiments · p. 8
Initialization is very important for all methods except Order embeddings.
“For all methods except Order embeddings, we observe that initialization is very important.”
Quote in the paperNot a substantial claim - Findingown data§ 6. Conclusion · p. 9
Strong embedding methods can vary a lot with the percentage of the taxonomy observable during training.
“We empirically discover that strong embedding methods can vary a lot with the percentage of the taxonomy observable during training and demonstrate that our proposed method benefits the most from increasing size of the training data.”
Quote in the paperSubstantial claim- Rests on an assumption: The basic edges (transitive reduction) are hard to predict.
- Rests on an assumption: The tree root carries little information and only has trivial edges to predict.
- Rests on an assumption: The WordNet noun hierarchy exhibits a latent hierarchical structure.
- Findingown data§ 5. Experiments · p. 8
Once a small percentage of transitive closure edges is available during training, the proposed method shows significant improvements, sometimes by more than 8% F1.
“However, once a small percentage of the transitive closure edges becomes available during training, we observe significant improvements of our method, sometimes by more than 8% F1 score.”
Quote in the paperSubstantial claim- Rests on an assumption: The basic edges (transitive reduction) are hard to predict.
- Rests on an assumption: The tree root carries little information and only has trivial edges to predict.
- Rests on an assumption: The WordNet noun hierarchy exhibits a latent hierarchical structure.
- Interpretationreasoning§ 2.2. Hyperbolic geometry · p. 4
The exponential volume growth of hyperbolic metric spaces confers them enough capacity to embed trees quasi-isometrically, unlike the Euclidean space.
“The exponential volume growth of hyperbolic metric spaces confers them enough capacity to embed trees quasi-isometrically, unlike the Euclidean space.”
Quote in the paperNot a substantial claim - Premisecitation§ 2.2. Hyperbolic geometry · p. 4
For any δ > 0, any δ-hyperbolic metric space and any set of points, there exists a finite weighted tree and an embedding f such that for all i, j, a distance condition holds.
“Theorem : For any δ > 0 , any δ -hyperbolic metric space ( X,d X ) and any set of points x 1 , ..., x n ∈ X , there exists a finite weighted tree ( T, d T ) and an embedding f : T → X such that for all i, j ,”
Quote in the paperSubstantial claim0 of 2 sources checked - Interpretationnone given§ 2.2. Hyperbolic geometry · p. 4
The difficulty in embedding trees having a branching factor at least 2 in a quasi-isometric manner comes from the fact that they have an exponentially increasing number of nodes with depth.
“The difficulty in embedding trees having a branching factor at least 2 in a quasi-isometric manner comes from the fact that they have an exponentially increasing number of nodes with depth.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 5
The above lemma implies that we cannot define a useful cone at the origin.
“However, the above surprising lemma implies that we cannot define a useful cone at the origin.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The origin should entail the entire space D^n, i.e. S_0 = D^n.
- Premisereasoning§ 1. Introduction · p. 1
The hyperbolic space does not suffer from the capacity problem because the volume of any ball grows exponentially with its radius, instead of polynomially as in Euclidean space.
“Fortunately, the hyperbolic space does not suffer from the aforementioned capacity problem because the volume of any ball grows exponentially with its radius, instead of polynomially as in the Euclidean space.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 5
Theorem 3 implies that a non-zero ψ cannot be defined on the entire (0,1) because lim_{r→0} h(r)=0 for any function ψ.
“The above theorem implies that a non-zero ˜ ψ cannot be defined on the entire (0 , 1) because lim r → 0 h ( r ) = 0 , for any function ˜ ψ .”
Quote in the paperSubstantial claim - Interpretationreasoning§ 5. Experiments · p. 8
Properly disentangling embeddings from different subparts of the graph in the initial learning stage is essential to train qualitative models.
“Being able to properly disentangle embeddings from different subparts of the graph in the initial learning stage is essential in order to train qualitative models.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 5
We are forced to restrict the domain of ψ to some [ε,1), leaving the open ball B^n(O,ε) outside of the domain of ψ.
“As a consequence, we are forced to restrict Dom ( ˜ ψ ) to some [ ϵ, 1) , i.e. to leave the open ball B n ( O,ϵ ) outside of the domain of ψ .”
Quote in the paperSubstantial claim - Interpretationreasoning§ 4.2. Full Riemannian optimization · p. 7
Since the authors derived a closed-form expression of the exponential map in the Poincaré ball (Corollary 1.1), they are able to perform full Riemannian optimization in this model of the hyperbolic space.
“Note that since we derived a closed-form expression of the exponential map in the Poincar´ e ball (Corollary 1.1), we are able to perform full Riemannian optimization in this model of the hyperbolic space.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 5
It is impossible for the cone at 0 to be a continuous deformation of the cones of any sequence of points converging to 0 because Lemma 2 implies that the cone at each point x_n can only cover at most half of D^n.
“However, this is impossible because Lemma 2 implies that the cone at each point x n can only cover at most half of D n .”
Quote in the paperSubstantial claim
- May combine two claims. 15
- Classified as probably not a substantial claim. 16
- The quote only partly states this claim. 3
May combine two claims.
Premisereasoning§ 1. Introduction · p. 2The hyperbolic distance alone, being symmetric, is not capable of encoding asymmetric relations needed for entailment detection, so a heuristic score is chosen to account for concept generality or specificity encoded in the embedding norm.
“Second, the hyperbolic distance alone (being symmetric) is not capable of encoding asymmetric relations needed for entailment detection, thus a heuristic score is chosen to account for concept generality or specificity encoded in the embedding norm.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Nickel & Kiela, 2017 source
Classified as probably not a substantial claim.
Premisecitation§ 1. Introduction · p. 2The latent hierarchical structure emerges as a simple reflection of the space's negative curvature.
“The latent hierarchical structure surprisingly emerges as a simple reflection of the space's negative curvature.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Nickel & Kiela, 2017 source
May combine two claims.
Findingown data§ Abstract · p. 1Experiments show significant improvements of the method over strong recent baselines both in terms of representational capacity and generalization, including on hypernymy link prediction for word embeddings over Nickel & Kiela (2017) and Vendrov et al. (2015).
“Experiments show significant improvements of our method over strong recent baselines both in terms of representational capacity and generalization.”
- Also stated in: § 1. Introduction · p. 2 · plain
“Experimentally, we learn high quality embeddings and improve over experimental results in (Nickel & Kiela, 2017) and (Vendrov et al., 2015) on hypernymy link prediction for word embeddings, both in terms of capacity of the model and generalization performance.”
Quote in the paperSubstantial claim2 of 2 sources checked- Also stated in: § 1. Introduction · p. 2 · plain
May combine two claims.
Premisecitation§ 2.2. Hyperbolic geometry · p. 4Any tree can be embedded with arbitrary low distortion into the Poincaré disk (with only 2 dimensions), whereas this is not true for Euclidean spaces even when an unbounded number of dimensions is allowed.
“Conversely, any tree can be embedded with arbitrary low distortion into the Poincar´ e disk (with only 2 dimensions), whereas this is not true for Euclidean spaces even when an unbounded number of dimensions is allowed (Sarkar, 2011; De Sa et al., 2018).”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Sarkar, 2011 source
The indexed results for distortion, embedding, and hyperbolic space returned only abstract and bibliographic text, not a passage from the paper’s full text that can serve as evidence under this rubric. No eligible passage establishes the claim about arbitrarily low distortion in the Poincaré disk or the comparison with Euclidean spaces. (LLM, conf=0.62)
Experimental — accuracy not yet measured - cites De Sa et al., 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingcitation§ 1. Introduction · p. 2An analytic closed-form expression for the exponential map in the n-dimensional Poincaré ball is computed, allowing full Riemannian optimization in the Poincaré ball, as opposed to the approximate optimization method used by Nickel & Kiela (2017).
“We also compute an analytic closed-form expression for the exponential map in the n -dimensional Poincar´ e ball, allowing us to perform full Riemannian optimization (Bonnabel, 2013) in the Poincar´ e ball, as opposed to the approximate optimization method used by (Nickel & Kiela, 2017).”
Quote in the paperSubstantial claim2 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 4.2. Full Riemannian optimization · p. 7Previous work (Nickel & Kiela, 2017) optimizing word embeddings in the Poincaré ball used the retraction map R_x(v):=x+v as a first order approximation of exp_x(v).
“Previous work (Nickel & Kiela, 2017) optimizing word embeddings in the Poincar´ e ball used the retraction map R x ( v ) := x + v as a first order approximation of exp x ( v ) .”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Nickel & Kiela, 2017 source
Section 3.1 (p. 5) explicitly says the authors use the retraction Rθ(v) = θ + v for optimization in the Poincaré ball. The paper does not describe it in terms of an exponential-map approximation, and its Discussion (p. 8) treats models tailored to word embeddings as future work rather than the application optimized here. (LLM, conf=0.87)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone given§ 2.2. Hyperbolic geometry · p. 3Theorem 1 gives the unit-speed geodesic in D^n with given initial point and tangent vector.
“Theorem 1. (Unit-speed geodesics) Let x ∈ D n and v ∈ T x D n (= R n ) such that g D x ( v, v ) = 1 . The unitspeed geodesic γ x,v : R + → D n with γ x,v (0) = x and ˙ γ x,v (0) = v is given by”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone given§ 2.2. Hyperbolic geometry · p. 4Given any arbitrary geodesic in D^n, all its points are coplanar with the origin O.
“Corollary 1.2. Given any arbitrary geodesic in D n , all its points are coplanar with the origin O .”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Findingnone given§ 1. Introduction · p. 2The proposed geodesically convex entailment cones are defined on a large class of Riemannian manifolds and induce a partial ordering relation in the embedding space.
“We propose to replace the entailment regions O x of order-embeddings by a more efficient and generic class of objects, namely geodesically convex entailment cones . These cones are defined on a large class of Riemannian manifolds and induce a partial ordering relation in the embedding space.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Hierarchical relations can be modeled as partial orders defined using a family of nested geodesically convex cones.
- The authors state this as an assumption: The optimal entailment cones should satisfy axial symmetry, rotation invariance, continuous aperture, and transitivity.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingreasoning§ 2.2. Hyperbolic geometry · p. 3Corollary 1.1 gives the exponential map at a point x in D^n.
“Corollary 1.1. (Exponential map) The exponential map at a point x ∈ D n , namely exp x : T x D n → D n , is given by”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 5. Experiments · p. 8The proposed hyperbolic cones outperform all baselines in all settings except the 0% setting, where order embeddings are better.
“It can be seen that our hyperbolic cones are better than all the baselines in all settings, except in the 0% setting for which order embeddings are better.”
Quote in the paperSubstantial claim- Rests on an assumption: The basic edges (transitive reduction) are hard to predict.
- Rests on an assumption: The tree root carries little information and only has trivial edges to predict.
- Rests on an assumption: The WordNet noun hierarchy exhibits a latent hierarchical structure.
May combine two claims.
Findingreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 6Setting h constant gives both a restriction on ε in terms of K and a closed form expression for ψ.
“which gives both a restriction on ϵ (in terms of K ):”
- Also stated in: § 3. Entailment Cones in the Poincar´ e Ball · p. 6 · plain
“as well as a closed form expression for ψ”
Quote in the paperSubstantial claim- Also stated in: § 3. Entailment Cones in the Poincar´ e Ball · p. 6 · plain
May combine two claims. The quote only partly states this claim.
Findingreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 6Theorem 5 gives an expression for the angle between the half-lines (xy and (0x for any x,y in D^n outside B^n(O,ε), and an equivalent expression of the Poincaré entailment cones satisfying Eq. 26.
“Moreover, we have the following equivalent expression of the Poincar´ e entailment cones satisfying Eq. 26:”
Quote in the paperSubstantial claim- The authors state this as an assumption: The optimal entailment cones should satisfy axial symmetry, rotation invariance, continuous aperture, and transitivity.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown data§ 3. Entailment Cones in the Poincar´ e Ball · p. 6Figure 2 shows that transitivity is satisfied for some points on the border of the hypercones.
“This figure also shows that transitivity is satisfied for some points on the border of the hypercones.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 5Theorem 3 states that if transitivity holds, then the function h(r) is non-increasing.
“Theorem 3. If transitivity holds, then the function”
Quote in the paperSubstantial claim- The authors state this as an assumption: The optimal entailment cones should satisfy axial symmetry, rotation invariance, continuous aperture, and transitivity.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims. The quote only partly states this claim.
Findingreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 6One can adapt the above proofs to derive entailment cones in Euclidean space; in that case h(r)=r sin(ψ(r)) is non-decreasing, the optimal values of ψ are obtained for constant h equal to K ≤ ε, and a closed form expression follows.
“One can easily adapt the above proofs to derive entailment cones in the Euclidean space ( R n , g E ) . The only adaptations are: i) replace the hyperbolic cosine law by usual Euclidean cosine law, ii) geodesics are straight lines, and iii) the exponential map is given by exp x ( v ) = x + v . Thus, one similarly obtains that h ( r ) = r sin( ψ ( r )) is non-decreasing, the optimal values of ψ are”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The optimal entailment cones should satisfy axial symmetry, rotation invariance, continuous aperture, and transitivity.
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 2.2. Hyperbolic geometry · p. 4The hyperbolic laws of cosines and sines hold in the Poincaré ball.
“Then, the hyperbolic laws of cosines and sines hold respectively”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Parkkonen, 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Premisecitation§ 2.2. Hyperbolic geometry · p. 4Euclidean space R^n for n ≥ 2 is not δ-hyperbolic for any δ ≥ 0, while the Poincaré ball D^n is log(1+√2)-hyperbolic.
“For instance, the Euclidean space R n for n ≥ 2 is not δ -hyperbolic for any δ ≥ 0 , while the Poincar´ e ball D n is log(1+ √ 2) -hyperbolic.”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ 2.2. Hyperbolic geometry · p. 3The hyperbolic space is complete as a metric space, guaranteeing that D^n is geodesically complete.
“We know from the Hopf-Rinow theorem that the hyperbolic space is complete as a metric space. This guarantees that D n is geodesically complete.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Hopf-Rinow theorem
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Premisecitation§ 1. Introduction · p. 1The entailment regions O_x of order embeddings suffer from heavy intersections, implying that their disjoint volumes rapidly become bounded.
“Moreover, the regions O x suffer from heavy intersections, implying that their disjoint volumes rapidly become bounded 2 .”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone given§ 3. Entailment Cones in the Poincar´ e Ball · p. 5For hyperbolic space models the injectivity radius of the tangent space at any point is infinite, thus no restriction is needed.
“Note that for hyperbolic space models the injectivity radius of the tangent space at any point is infinite, thus no restriction is needed.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The exponential map should be injective.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ 2.2. Hyperbolic geometry · p. 3The hyperbolic space has five models which are isometric to each other and conformal to the Euclidean space.
“The hyperbolic space has five models which are often insightful to work in. They are isometric to each other and conformal to the Euclidean space (Cannon et al., 1997; Parkkonen, 2013) 4 .”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Cannon et al., 1997 source
- cites Parkkonen, 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Interpretationreasoning§ 1. Introduction · p. 1Representing wide and deep hierarchical structures in a bounded region of Euclidean space would cause many points to end up undesirably close to each other, so Euclidean distances would no longer reflect the original tree metric.
“As a consequence, representing wide (with high branching factor) and deep hierarchical structures in a bounded region of the Euclidean space would cause many points to end up undesirably close to each other. This also implies that Euclidean distances would no longer be capable of reflecting the original tree metric.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone given§ 2.2. Hyperbolic geometry · p. 3Geodesics in D^n are all intersections of the Euclidean unit ball D^n with (degenerated) Euclidean circles orthogonal to the unit sphere ∂D^n.
“Geodesics in D n are all intersections of the Euclidean unit ball D n with (degenerated) Euclidean circles orthogonal to the unit sphere ∂ D n (equations are derived below).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 2.2. Hyperbolic geometry · p. 3The hyperbolic space of dimension n ≥ 2 is uniquely characterized as a complete, simply connected Riemannian manifold with constant negative curvature.
“It is (up to isometry) uniquely characterized as a complete, simply connected Riemannian manifold with constant negative curvature (Cannon et al., 1997).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Cannon et al., 1997 source
Probably not a substantial claim: may not pass S3 (load-bearing).
Interpretationreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 6In the Euclidean case, there is no need to be concerned about Riemannian optimization, as the usual Euclidean gradient-step is used.
“From a learning perspective, there is no need to be concerned about the Riemannian optimization described in Section 4.2, as the usual Euclidean gradient-step is used in this case.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationreasoning§ 3. Entailment Cones in the Poincar´ e Ball · p. 6Since we are interested in cones with an aperture as large as possible, it is natural to set all terms h(r) equal to K := h(ε), i.e. to make h constant.
“Since we are interested in cones with an aperture as large as possible (to maximize model capacity), it is natural to set all terms h ( r ) equal to K := h ( ϵ ) , i.e. to make h constant:”
Quote in the paperSubstantial claim- The authors state this as an assumption: Cones should have an aperture as large as possible to maximize model capacity.
The authors state this as an assumption.
The origin should entail the entire space D^n, i.e. S_0 = D^n.
“we first note that the origin should 'entail' the entire space D n , i.e. S 0 = D n .”
The authors state this as an assumption.
Cones should have an aperture as large as possible to maximize model capacity.
“Since we are interested in cones with an aperture as large as possible (to maximize model capacity)”
The authors state this as an assumption.
The exponential map should be injective.
“Note that, in the above definition, we desire that the exponential map be injective.”
The authors state this as an assumption.
Hierarchical relations can be modeled as partial orders defined using a family of nested geodesically convex cones.
“we view hierarchical relations as partial orders defined using a family of nested geodesically convex cones.”
The authors state this as an assumption.
The optimal entailment cones should satisfy axial symmetry, rotation invariance, continuous aperture, and transitivity.
“we want the definition of cones to exhibit the following four intuitive properties detailed below.”
The paper relies on this without support.
The basic edges (transitive reduction) are hard to predict.
“These edges are hard to predict, so we will always include them in the training set.”
The paper relies on this without support.
The tree root carries little information and only has trivial edges to predict.
“We remove the tree root since it carries little information and only has trivial edges to predict.”
The paper relies on this without support.
Hyperbolic geometry is powerful for embedding hierarchical structures.
“Hyperbolic geometry has proven to be powerful for embedding hierarchical structures.”
The paper relies on this without support.
The WordNet noun hierarchy exhibits a latent hierarchical structure.
“We evaluate the representational and generalization power of hyperbolic entailment cones and of other baselines using data that exhibits a latent hierarchical structure.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Hyperbolic entailment cones satisfy transitivity.
“The goal is to model partial order by containment relationship between cones, in particular, the entailment cones satisfy transitivity:”
From Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones (2021) · cites this paper as [12]
Hyperbolic cone is hard to optimize with randomized initialization.
“As suggested in [12], hyperbolic cone is hard to optimize with randomized initialization”
From Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones (2021) · cites this paper as [12]
Hyperbolic entailment cones combine order embeddings with hyperbolic geometry.
“Hyperbolic entailment cones (Ganea et al., 2018) combine order embeddings with hyperbolic geometry.”
From Probabilistic Box Embeddings for Uncertain Knowledge Graph Reasoning (2021) · cites this paper as Ganea et al., 2018
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 3× · see citing works
“A large line of research focuses on embedding discrete data such as graphs (Grover & Leskovec, 2016; Goyal & Ferrara, 2017) or linguistic instances (Mikolov et al., 2013; Pennington et al., 2014; Kiros et al., 2015) into continuous spaces that exhibit certain desirable geometric properties.”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 3× · see citing works
“A large line of research focuses on embedding discrete data such as graphs (Grover & Leskovec, 2016; Goyal & Ferrara, 2017) or linguistic instances (Mikolov et al., 2013; Pennington et al., 2014; Kiros et al., 2015) into continuous spaces that exhibit certain desirable geometric properties.”
Backgroundnode2vec: Scalable Feature Learning for Networks
Grover, A., & Leskovec, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939754 · Cited by 10,926 · cited 1× · see citing works
“A large line of research focuses on embedding discrete data such as graphs (Grover & Leskovec, 2016; Goyal & Ferrara, 2017) or linguistic instances (Mikolov et al., 2013; Pennington et al., 2014; Kiros et al., 2015) into continuous spaces that exhibit certain desirable geometric properties.”
Background(2013) · Cited by 5,726 · see citing works
Introduction to WordNet: An On-line Lexical Database *
Miller, G. A., Beckwith, R., Fellbaum, C., Gross, D., & Miller, K. J. (1990) · International Journal of Lexicography · doi:10.1093/ijl/3.4.235 · Cited by 4,197 · cited 2× · see citing works
“, 2015) and use the full transitive closure of the WordNet noun hierarchy (Miller et al., 1990).”
BackgroundMethodGeometric Deep Learning: Going beyond Euclidean data
Bronstein, M. M., Bruna, J., LeCun, Y., Szlam, A., & Vandergheynst, P. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2693418 · Cited by 3,661 · cited 2× · see citing works
“, 2001), Social Networks), one has to deal with data whose latent anatomy is best defined by nonEuclidean spaces such as Riemannian manifolds (Bronstein et al., 2017).”
BackgroundA Comprehensive Introduction to Differential Geometry.
Kramer, A. D., & Spivak, M. (1973) · American Mathematical Monthly · doi:10.2307/2319112 · Cited by 3,525 · cited 1× · see citing works
“For an in-depth introduction, we refer the reader to (Spivak, 1979) and (Hopper & Andrews, 2010).”
MethodLatent Space Approaches to Social Network Analysis
Hoff, P. D., Raftery, A. E., & Handcock, M. S. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618906 · Cited by 1,917 · cited 2× · see citing works
“…for various tasks and applications, such as link prediction in knowledge bases (Nickel et al., 2011; Bor-des et al., 2013) or in social networks (Hoff et al., 2002), text disambiguation (Ganea & Hofmann, 2017), word hyper-nymy (Shwartz et al., 2016), textual entailment (Rockt¨aschel et al.,…”
BackgroundGromov, M. (1987) · Mathematical Sciences Research Institute Publications · doi:10.1007/978-1-4613-9586-7_3 · Cited by 1,817 · see citing works
A Three-Way Model for Collective Learning on Multi-Relational Data
Nickel, M., Tresp, V., & Kriegel, H. (2011) · Cited by 1,806 · see citing works
Graph embedding techniques, applications, and performance: A survey
Goyal, P., & Ferrara, E. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.03.022 · Cited by 1,801 · cited 1× · see citing works
“A large line of research focuses on embedding discrete data such as graphs (Grover & Leskovec, 2016; Goyal & Ferrara, 2017) or linguistic instances (Mikolov et al., 2013; Pennington et al., 2014; Kiros et al., 2015) into continuous spaces that exhibit certain desirable geometric properties.”
BackgroundKiros, R., Zhu, Y., Salakhutdinov, R., Zemel, R. S., Torralba, A., Urtasun, R., & Fidler, S. (2015) · arXiv · doi:10.48550/arxiv.1506.06726 · Cited by 1,293 · see citing works
Hyperbolic geometry of complex networks
Krioukov, D., Papadopoulos, F., Kitsak, M., Vahdat, A., & Boguñá, M. (2010) · Physical Review E · doi:10.1103/physreve.82.036106 · Cited by 1,059 · cited 2× · see citing works
“, 2009; Cvetkovski & Crovella, 2009) or to embed heterogeneous, scale-free graphs (Shavitt & Tankel, 2008; Krioukov et al., 2010; Bläsius et al., 2016).”
MethodA focus+context technique based on hyperbolic geometry for visualizing large hierarchies
Lamping, J., Rao, R., & Pirolli, P. L. T. (1995) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/223904.223956 · Cited by 900 · cited 1× · see citing works
“Moreover, hyperbolic spaces are used to visualize large hierarchies (Lamping et al., 1995), to efficiently forward information in complex networks (Krioukov et al., 2009; Cvetkovski & Crovella, 2009) or to embed heterogeneous, scale-free graphs (Shavitt & Tankel, 2008; Krioukov et al., 2010;…”
MethodPoincaré Embeddings for Learning Hierarchical Representations
Nickel, M., & Kiela, D. (2017) · arXiv · doi:10.48550/arxiv.1705.08039 · Cited by 667 · cited 16× · see citing works
“Thus, for these baselines we use the heuristic scoring function proposed in (Nickel & Kiela, 2017): and tune the parameter α on the validation set.”
BackgroundMethodInfluentialReasoning about Entailment with Neural AttentionPreprint
Rocktäschel, T., Grefenstette, E., Hermann, K. M., Kočiský, T., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.06664 · Cited by 583 · cited 1× · see citing works
“…as link prediction in knowledge bases (Nickel et al., 2011; Bor-des et al., 2013) or in social networks (Hoff et al., 2002), text disambiguation (Ganea & Hofmann, 2017), word hyper-nymy (Shwartz et al., 2016), textual entailment (Rockt¨aschel et al., 2015) or taxonomy induction (Fu et al., 2014).”
BackgroundGeometry of the Space of Phylogenetic Trees
Billera, L. J., Holmes, S., & Vogtmann, K. (2001) · Advances in Applied Mathematics · doi:10.1006/aama.2001.0759 · Cited by 575 · cited 2× · see citing works
“However, in many fields (e.g. Recommender Systems, Genomics (Billera et al., 2001), Social Networks), one has to deal with data whose latent anatomy is best defined by non-Euclidean spaces such as Riemannian manifolds (Bronstein et al., 2017).”
BackgroundStochastic Gradient Descent on Riemannian Manifolds
Bonnabel, S. (2013) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2013.2254619 · Cited by 540 · cited 3× · see citing works
“The exponential map is important, for instance, when performing gradient-descent over parameters lying in a manifold (Bonnabel, 2013).”
BackgroundMethodAnderson, J. W. (1999) · Springer undergraduate mathematics series · doi:10.1007/978-1-4471-3987-4 · Cited by 425 · see citing works
Order-Embeddings of Images and Language
Vendrov, I., Kiros, R., Fidler, S., & Urtasun, R. (2015) · arXiv · doi:10.48550/arxiv.1511.06361 · Cited by 296 · cited 15× · see citing works
“We compare against the strong hierarchical embedding methods of Order embeddings (Vendrov et al., 2015) and Poincaré embeddings (Nickel & Kiela, 2017).”
BackgroundMethodInfluentialLearning Semantic Hierarchies via Word Embeddings
Fu, R., Guo, J., Qin, B., Che, W., Wang, H., & Liu, T. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1113 · Cited by 254 · cited 1× · see citing works
“…as link prediction in knowledge bases (Nickel et al., 2011; Bor-des et al., 2013) or in social networks (Hoff et al., 2002), text disambiguation (Ganea & Hofmann, 2017), word hyper-nymy (Shwartz et al., 2016), textual entailment (Rockt¨aschel et al., 2015) or taxonomy induction (Fu et al., 2014).”
BackgroundImproving Hypernymy Detection with an Integrated Path-based and Distributional Method
Shwartz, V., Goldberg, Y., & Dagan, I. (2016) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.18653/v1/p16-1226 · Cited by 211 · cited 1× · see citing works
“…as link prediction in knowledge bases (Nickel et al., 2011; Bor-des et al., 2013) or in social networks (Hoff et al., 2002), text disambiguation (Ganea & Hofmann, 2017), word hyper-nymy (Shwartz et al., 2016), textual entailment (Rockt¨aschel et al., 2015) or taxonomy induction (Fu et al., 2014).”
BackgroundRepresentation Tradeoffs for Hyperbolic EmbeddingsPreprint
De, C., Gu, A., Ré, C., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.03329 · Cited by 189 · see citing works
Low Distortion Delaunay Embedding of Trees in Hyperbolic Plane
Sarkar, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25878-7_34 · Cited by 168 · cited 2× · see citing works
“This exponential growth property enables hyperbolic spaces to embed any weighted tree while almost preserving their metric 3 (Gromov, 1987; Bowditch, 2006; Sarkar, 2011).”
BackgroundHyperbolic Embedding and Routing for Dynamic Graphs
Cvetkovski, A., & Crovella, M. E. (2009) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infcom.2009.5062083 · Cited by 134 · cited 1× · see citing works
“…spaces are used to visualize large hierarchies (Lamping et al., 1995), to efficiently forward information in complex networks (Krioukov et al., 2009; Cvetkovski & Crovella, 2009) or to embed heterogeneous, scale-free graphs (Shavitt & Tankel, 2008; Krioukov et al., 2010; Bl¨asius et al., 2016).”
MethodCannon, J. W., Floyd, W. J., Kenyon, R., & Parry, W. R. (1997) · Flavors of Geometry · doi:10.1017/9781009701853.003 · Cited by 133 · see citing works
Hyperbolic Embedding of Internet Graph for Distance Estimation and Overlay Construction
Shavitt, Y., & Tankel, T. (2008) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2007.899021 · Cited by 123 · see citing works
Introduction to Differential Geometry
Robbin, J. W., & Salamon, D. A. (2022) · Springer Studium Mathematik - Master · doi:10.1007/978-3-662-64340-2 · Cited by 118 · see citing works
The Ricci Flow in Riemannian Geometry
Andrews, B., & Hopper, C. (2010) · Lecture notes in mathematics · doi:10.1007/978-3-642-16286-2 · Cited by 94 · see citing works
Representation Tradeoffs for Hyperbolic Embeddings.
De, C., Gu, A., Ré, C., & Sala, F. (2018) · PubMed · Cited by 84 · see citing works
A Course On Geometric Group Theory
Bowditch, B. (2006) · doi:10.2969/msjmemoirs/016010000 · Cited by 80
Greedy forwarding in scale-free networks embedded in hyperbolic metric spaces
Krioukov, D., Papadopoulos, F., Boguñá, M., & Vahdat, A. (2009) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/1639562.1639568 · Cited by 41 · cited 1× · see citing works
“Moreover, hyperbolic spaces are used to visualize large hierarchies (Lamping et al., 1995), to efficiently forward information in complex networks (Krioukov et al., 2009; Cvetkovski & Crovella, 2009) or to embed heterogeneous, scale-free graphs (Shavitt & Tankel, 2008; Krioukov et al., 2010;…”
MethodA Course on Geometric Group Theory
(2006) · Mathematical Society of Japan Memoirs · doi:10.1142/e003 · Cited by 40 · see citing works
On the tree-likeness of hyperbolic spaces
Hamann, M. (2017) · Mathematical Proceedings of the Cambridge Philosophical Society · doi:10.1017/s0305004117000238 · Cited by 27 · cited 1× · see citing works
“The tree-likeness of hyperbolic spaces has been extensively studied (Hamann, 2017).”
BackgroundDeep Joint Entity Disambiguation with Local Neural AttentionPreprint
Ganea, O.-E., & Hofmann, T. (2017) · arXiv (Cornell University) · doi:10.3929/ethz-b-000225539 · Cited by 24 · see citing works
Self-citationDeep Joint Entity Disambiguation with Local Neural Attention
Ganea, O.-E., & Hofmann, T. (2017) · arXiv · doi:10.48550/arxiv.1704.04920
Self-citationGraph Embedding Techniques, Applications, and Performance: A Survey
Goyal, P., & Ferrara, E. (2017) · arXiv · doi:10.48550/arxiv.1705.02801
Flagged first, then by citations
Research works printed but not linked: 1
- Bl¨ asius, T., Friedrich, T., Krohmer, A., and Laue, S. Efficient embedding of scale-free graphs in the hyperbolic plane. In LIPIcs-Leibniz International Proceedings in Informatics , volume 57. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 2016.
Cited by
Sorted by citations
Hyperbolic Neural NetworksPreprint
Ganea, O.-E., Bécigneul, G., & Hofmann, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09112 · Cited by 290 · see citing works
Self-citationHyperbolic Deep Neural Networks: A Survey
Peng, W., Varanka, T., Mostafa, A., Shi, H., & Zhao, G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3136921 · Cited by 220 · see citing works
“TextHyper [66] 2018 AE(GRUs) Text Embedding B Google NAACL W h-MDS [68] 2018 Embedding Tree and tree-like data modeling B Stanford PMLR HyperQA [139] 2018 Encoder-Decoder Neural Question Answering B NTU WSDM HyperCone [140] 2018 Embedding NLP and Graph B ETH Zürich ICML HNN [23] 2018 RNN NLP(textual entailment and noi…”
MethodDeep Hierarchical Semantic Segmentation
Li, L., Zhou, T., Wang, W., Li, J., & Yang, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00131 · Cited by 199 · see citing works
“Table 9 shows that Cosine distance performs much better than Euclidean distance, corroborating relevant observations in [26,59,65].”
BackgroundA comprehensive overview of knowledge graph completion
Shen, T., Zhang, F., & Cheng, J. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109597 · Cited by 153 · see citing works
Hyperbolic Visual Embedding Learning for Zero-Shot Recognition
Liu, S., Chen, J., Pan, L., Ngo, C., Chua, T., & Jiang, Y. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00929 · Cited by 130 · see citing works
“It has been shown that Hyperbolic space is particularly suitable for modeling hierarchical data [26, 13].”
BackgroundMethodHyperbolic Graph Attention Network
Zhang, Y., Wang, X., Shi, C., Jiang, X., & Ye, Y. F. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2021.3081431 · Cited by 125 · see citing works
“Followed (Nickel and Kiela 2017; Nickel and Kiela 2018; Ganea, B´ecigneul, and Hofmann 2018a), we directly visualize the learned two-dimensional representations of the nodes.”
BackgroundMethodInfluentialHyperbolic Heterogeneous Information Network Embedding
Wang, X., Zhang, Y., & Shi, C. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015337 · Cited by 121 · see citing works
“( Nickel and Kiela 2017) and (Ganea, Becigneul, and Hofmann 2018) learn the embeddings of homogeneous networks.”
BackgroundAtigh, M. G., Schoep, J., Acar, E., van Noord, N., & Mettes, P. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00441 · Cited by 88 · see citing works
“Hyperbolic alternatives have been proposed for various network layers, from intermediate layers [17, 39] to classification layers [3, 11, 17, 39].”
BackgroundLorentzian Graph Convolutional Networks
Zhang, Y., Wang, X., Shi, C., Liu, N., & Song, G. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449872 · Cited by 79 · see citing works
Discriminative Topic Mining via Category-Name Guided Text Embedding
Yu, M., Huang, J., Wang, G., Wang, Z., Zhang, C., Zhang, Y., & Han, J. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380278 · Cited by 67 · see citing works
“for lexical entailment, which is relevant to our task because it may help determine which terms belong to a category. Hyperbolic models such as Poincaré [12, 36, 47], Lorentz [37] and hyperbolic cone [17] have proven successful in graded lexical entailment detection. However, the above models are supervised and requir…”
BackgroundLeveraging Hierarchical Representations for Preserving Privacy and Utility in Text
Feyisetan, O., Diethe, T., & Drake, T. (2019) · Proceedings · doi:10.1109/icdm.2019.00031 · Cited by 68 · see citing works
“The main advantage of this model is that it is conformal as a result, earlier research into Hyperbolic word embeddings have leveraged on this model [28], [31], [32].”
BackgroundResultHyperbolic Deep Learning in Computer Vision: A Survey
Mettes, P., Atigh, M. G., Keller‐Ressel, M., Gu, J., & Yeung, S. Y. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02043-5 · Cited by 68 · see citing works
“The exponential map in the direction of a tangent vector v ∈ T p can then be written as for p ∈ D d κ , see Ganea et al. (2018b).”
InfluentialLearning the Predictability of the Future
Surís, D., Liu, R., & Vondrick, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01242 · Cited by 62 · see citing works
“Following the Poincare embedding [53], [17] use a hyperbolic entailment cone to represent the hierarchical relation in an acyclic graph.”
MethodModeling Fine-Grained Entity Types with Box Embeddings
Onoe, Y., Boratko, M., McCallum, A., & Durrett, G. (2021) · doi:10.18653/v1/2021.acl-long.160 · Cited by 66 · see citing works
Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddings
Le, M., Roller, S., Meng-Papaxanthos, L., Kiela, D., & Nickel, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1313 · Cited by 56 · see citing works
“By using hyperbolic space for the embedding, we can exploit the following important advantages: Consistency Hyperbolic entailment cones (Ganea et al., 2018) allow us to enforce transitivity of is-a -relations in the entire embedding space.”
BackgroundMethodInfluentialHyperbolic Contrastive Learning for Visual Representations beyond Objects
Ge, S., Mishra, S. K., Kornblith, S., Li, C., & Jacobs, D. W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00661 · Cited by 55 · see citing works
“Consequently, Euclidean space may require an arbitrarily large number of dimensions to faithfully embed these scenes, whereas it is known that any infinite trees can be embedded without distortion in a 2D hyperbolic space [28].”
Hierarchical Image Classification using Entailment Cone Embeddings
Dhall, A., Makarova, A., Ganea, O.-E., Pavllo, D., Greeff, M., & Krause, A. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00426 · Cited by 50 · see citing works
“The cones can have a maximum aperture of π/2 [7].”
BackgroundMethodInfluentialSelf-citationProbabilistic Box Embeddings for Uncertain Knowledge Graph Reasoning
Chen, X., Boratko, M., Chen, M., Dasgupta, S. S., Li, X. L., & McCallum, A. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.68 · Cited by 47 · see citing works
“Hyperbolic entailment cones (Ganea et al., 2018) combine order embeddings with hyperbolic geometry.”
BackgroundSearching for Actions on the Hyperbole
Long, T., Mettes, P., Shen, H. T., & Snoek, C. G. M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00122 · Cited by 47 · see citing works
“Where current works focus on preserving hypernymhyponym relations in hyperbolic embeddings [36, 29, 16], we use the action positions in the hyperbolic space for the downstream task of search.”
BackgroundMethodInfluentialSemantic Hierarchy-Aware Segmentation
Li, L., Wang, W., Zhou, T., Quan, R., & Yang, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3332435 · Cited by 46 · see citing works
“Some alternatives [130], [131], [132], [133] design hierarchy-aware metric learning objectives [110], [134], [135] to shape the embedding space.”
BackgroundMixed-curvature Variational AutoencodersPreprint
Skopek, O., Ganea, O.-E., & Bécigneul, G. (2019) · arXiv (Cornell University) · doi:10.3929/ethz-b-000372387 · Cited by 40 · see citing works
“…exponential map in P nK and its inverse is In the case of x := µ 0 = (0 , . . . , 0) T they simplify to: Parallel transport Kochurov et al. (2019); Ganea et al. (2018a) have also derived and implemented the parallel transport operation for the Poincar´e ball: where is the gyration operation…”
BackgroundMethodInfluentialSelf-citationExpanding Taxonomies with Implicit Edge Semantics
Manzoor, E., Li, R., Shrouty, D., & Leskovec, J. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380271 · Cited by 36 · see citing works
“Knowledge-base embeddings [11, 46, 61] and hierarchical embeddings [21, 44, 63] enable accurate link-prediction in knowledge graphs with heterogeneous, explicit edge-types.”
BackgroundMethodLearning Feature Interactions with Lorentzian Factorization Machine
Xu, C., & Wu, M. F. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6119 · Cited by 33 · see citing works
“…et al. 2019) for recommendation systems, accompanied by the recent advances in hyperbolic representation learning and hyperbolic neural networks (Nickel and Kiela 2017; 2018; Ganea, Bécigneul, and Hofmann 2018; Sala et al. 2018; Law et al. 2019; Gülçehre et al. 2019; Bécigneul and Ganea 2019).”
BackgroundRiemannian adaptive stochastic gradient algorithms on matrix manifoldsPreprint
Kasai, H., Jawanpuria, P., & Mishra, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.01144 · Cited by 32 · see citing works
“…analysis (PCA), matrix completion (Mishra & Sepulchre, 2014; Boumal & Absil, 2015), learning taxonomy or latent hierarchies (Nickel & Kiela, 2017, 2018; Ganea et al., 2018), deep metric learning (Harandi et al., 2017a), applications in computer vision (Harandi et al., 2017b), among others.”
BackgroundModeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones
Bai, Y., Ying, R., Ren, H., & Leskovec, J. (2021) · arXiv · doi:10.48550/arxiv.2110.14923 · Cited by 31 · see citing works
Ontology Embedding: A Survey of Methods, Applications and Resources
Chen, J., Mashkova, O., Zhapa-Camacho, F., Hoehndorf, R., He, Y., & Horrocks, I. R. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3559023 · Cited by 39 · see citing works
“Anotablecontribution inthislineisthehyperbolicentailmentconeby[62],whichnot onlypreservestransitivitybutalsoenablesdirectpredictionof entitysubsumptionsthroughitsconstruction.”
H-Diffu: Hyperbolic Representations for Information Diffusion Prediction
Feng, S., Zhao, K., Fang, L., Feng, K., Wei, W., Li, X., & Shao, L. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3209067 · Cited by 29 · see citing works
“[39], [40] developed hyperbolic disk embedding models to capture asymmetric relations in directed acyclic graphs.”
MethodScalable Hyperbolic Recommender SystemsPreprint
Chamberlain, B. P., Hardwick, S. R., Wardrope, D. R., Dzogang, F., Daolio, F., & Vargas, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.08648 · Cited by 28 · see citing works
“[16] analysed the trade-offs in numerical precision and embedding size in these different approaches and [21] extended these models to include undirected graphs.”
BackgroundMethodEmbedding Heterogeneous Networks into Hyperbolic Space Without Meta-path
Wang, L., Gao, C., Huang, C., Liu, R., Ma, W., & Vosoughi, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17217 · Cited by 27 · see citing works
“…embedding, Nickel et al. (2017) proposed a method (PoincaréEmb) of learning hierarchical representations of symbolic data; McDonald et al. (2019) proposed a “teleport” walk to embed attributed graphs and Ganea et al. (2018) use hyperbolic cones as a heuristic for embedding directed acyclic graphs.”
MethodTabaghi, P., & Dokmanić, I. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403224 · Cited by 24 · see citing works
“[20] model order relations as a family of nested geodesically convex cones.”
Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019)
Augenstein, I., Gella, S., Ruder, S., Kann, K., Can, B., Conneau, A., Welbl, J., Ren, X., & Rei, M. (2019) · doi:10.18653/v1/w19-43 · Cited by 24 · see citing works
Hyperbolic Capsule Networks for Multi-Label Classification
Chen, B., Huang, X., Xiao, L., & Jing, L. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.283 · Cited by 23 · see citing works
“…works explore the superiority of hyperbolic space to Euclidean space for serval natural language processing tasks, we intend to couple with the hyperbolic neural networks (Ganea et al., 2018b) and the hyperbolic word embedding method such as P OINCAR ´ E G LOVE (Tifrea et al., 2019) in the future.”
BackgroundMethodInfluentialLearning weakly supervised audio-visual violence detection in hyperbolic space
Zhou, X. Z., Peng, X., Wen, H., Luo, Y., Yu, K., Yang, P., & Wu, Z. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105286 · Cited by 22 · see citing works
Extracting Event Temporal Relations via Hyperbolic Geometry
Tan, X., Pergola, G., & He, Y. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.636 · Cited by 22 · see citing works
“Ganea et al. (2018a) generalized the idea of order embed-dings (Vendrov et al., 2016) to the Poincaré ball, levering the projected areas to infer data relations.”
BackgroundMethodInfluentialTaxoCom: Topic Taxonomy Completion with Hierarchical Discovery of Novel Topic Clusters
Lee, D., Shen, J., Kang, S., et al. (2022) · ACM Web Conference (WWW) · doi:10.1145/3485447.3512002 · Cited by 22 · see citing works
“Combining a max-margin loss function [9, 22, 40, 41] with the probability (or likelihood) defined above, the objective of our text embedding in Equation (1) is summarized as follows.”
BackgroundTag2Vec: Learning Tag Representations in Tag Networks
Wang, J., Lu, Z., Song, G., Fan, Y. B., Du, L., & Lin, W. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313622 · Cited by 21 · see citing works
“[14] embeds acyclic graphs into hyperbolic space to learn their hierarchical features.”
BackgroundInferring Concept Hierarchies from Text Corpora via Hyperbolic EmbeddingsPreprint
Le, M., Roller, S., Meng-Papaxanthos, L., Kiela, D., & Nickel, M. (2019) · arXiv (Cornell University) · doi:10.3929/ethz-b-000445083 · Cited by 21 · see citing works
Betweenness centrality-based community adaptive network representation for link prediction
Zhou, M., Jin, H., Wu, Q., et al. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02633-7 · Cited by 20 · see citing works
“For hierarchical networks, hyperbolic entailment cones have also achieved good results [11].”
BackgroundSpecializing Distributional Vectors of All Words for Lexical Entailment
Kamath, A., Pfeiffer, J., Ponti, E. M., Glavaš, G., & Vulić, I. (2019) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w19-4310 · Cited by 19 · see citing works
“The same limitation holds for a family of recent models that embed concept hierarchies (i.e., trees or directed acyclic graphs) in hyperbolic spaces (Nickel and Kiela, 2017; Chamberlain et al., 2017; Nickel and Kiela, 2018; Sala et al., 2018; Ganea et al., 2018).”
BackgroundMethodHyperbolic disc embedding of functional human brain connectomes using resting-state fMRI
Whi, W., Ha, S., Kang, H., & Lee, D. S. (2022) · Network Neuroscience · doi:10.1162/netn_a_00243 · Cited by 19 · see citing works
Hierarchical Explanations for Video Action Recognition
Gulshad, S., Long, T., & van Noord, N. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00379 · Cited by 19 · see citing works
“Their effectiveness has also been shown for textual [10, 41, 49] and visual data [1, 11, 17, 25].”
BackgroundMethodPERFECT: A Hyperbolic Embedding for Joint User and Community Alignment
Sun, L., Zhang, Z., Zhang, J., Wang, F., Du, Y., Su, S., & Yu, P. S. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00059 · Cited by 19 · see citing works
Liao, X., Liu, W., Chen, C., Zhou, P., Zhu, H., Tan, Y., Wang, J., & Qi, Y. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/440 · Cited by 18 · see citing works
Accept the Modality Gap: An Exploration in the Hyperbolic Space
Ramasinghe, S., Shevchenko, V., Avraham, G., & Ajanthan, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02574 · Cited by 19 · see citing works
“To further incorporate a tree-like inductive bias, Ganea et al. [ 10] introduce an entailment loss which forces child nodes to be contained within the cone emanating from the parent node embedding.”
Multilingual and Cross-Lingual Graded Lexical Entailment
Vulić, I., Ponzetto, S. P., & Glavaš, G. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1490 · Cited by 17 · see citing works
“In the future, we will work on cross-lingual extensions of monolingual hyperbolic embedding models (Nickel and Kiela, 2017; Ganea et al., 2018).”
MethodBiRRE: Learning Bidirectional Residual Relation Embeddings for Supervised Hypernymy Detection
Wang, C., & He, X. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.334 · Cited by 17 · see citing works
“Recently, several approaches are proposed to learn hypernymy embeddings, considering the semantic hierarchies of concepts (Yu et al., 2015; Luu et al., 2016; Nguyen et al., 2017; Chang et al., 2018; Nickel and Kiela, 2018; Ganea et al., 2018; Rei et al., 2018; Chen et al., 2018).”
BackgroundLearning Hyperbolic Embedding for Phylogenetic Tree Placement and Updates
Jiang, Y., Tabaghi, P., & Mirarab, S. (2022) · Biology · doi:10.3390/biology11091256 · Cited by 16 · see citing works
“[11] point out, this exponential growth enables hyperbolic spaces to embed any weighted tree while preserving its metric with high fidelity.”
BackgroundEnhancing Recommendation with Automated Tag Taxonomy Construction in Hyperbolic Space
Tan, Y., Yang, C., Wei, X., Chen, C., Li, L., & Zheng, X. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00093 · Cited by 15 · see citing works
“Recall that hyperbolic space has five models, which are isometric to each other [6], [13].”
BackgroundHigh Dimensional Hyperbolic Geometry of Complex Networks
Yang, W., & Rideout, D. (2020) · Mathematics · doi:10.3390/math8111861 · Cited by 15 · see citing works
“High dimensional hyperbolic embeddings are also proving fruitful in representing taxonomic information within machine generated knowledge bases [9,10].”
BackgroundWhen Hearst Is not Enough: Improving Hypernymy Detection from Corpus with Distributional Models
Yu, C., Han, J., Wang, P., Song, Y., Zhang, H., Ng, W., & Shi, S. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.502 · Cited by 15 · see citing works
“Some methods (Vendrov et al., 2016; Athiwaratkun and Wilson, 2018; Nickel and Kiela, 2017, 2018; Ganea et al., 2018) embed WordNet in low-dimensional space.”
BackgroundMethodMatching Biomedical Ontologies via a Hybrid Graph Attention Network
Wang, P., & Hu, Y. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.893409 · Cited by 14 · see citing works
“Inspired by this insight, numerous research studies focus on investigating the hyperbolic geometric graph models, such as those by Nickel and Kiela (2017); Nickel and Kiela (2018); Ganea et al. (2018); and Hao et al. (2021).”
MethodEuclidean and Poincaré space ensemble Xgboost
Suganthan, P. N., Kong, L., Snåšel, V., et al. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102746 · Cited by 13 · see citing works
Leveraging Hyperbolic Dynamic Neural Networks for Knowledge-Aware Recommendation
Zhang, Y., Li, K., Zhu, J., Yuan, M., Huang, Y., & Li, X. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3353467 · Cited by 13 · see citing works
“By leveraging the hyperbolic angle properties [44], we can significantly mitigate distortion.”
BackgroundWord2Box: Capturing Set-Theoretic Semantics of Words using Box Embeddings
Dasgupta, S. S., Boratko, M., Mishra, S., Atmakuri, S., Patel, D., Li, X., & McCallum, A. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.161 · Cited by 13 · see citing works
“Hyperbolic representations (Nickel and Kiela, 2017; Ganea et al., 2018; Chamberlain et al., 2017) have become popular in recent years.”
BackgroundAn Overview of Utilizing Knowledge Bases in Neural Networks for Question Answering
Kafle, S., de Silva, N., & Dou, D. (2020) · Information Systems Frontiers · doi:10.1007/s10796-020-10035-2 · Cited by 11 · see citing works
Computationally Tractable Riemannian Manifolds for Graph Embeddings
Cruceru, C., Bécigneul, G., & Ganea, O.-E. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16877 · Cited by 10 · see citing works
“…flavor – being explicit about the assumed manifold and, perhaps, the inductive bias that it entails: hyperbolic spaces (Nickel and Kiela 2017; Ganea, Becigneul, and Hofmann 2018), spherical spaces (Wilson et al. 2014), and Cartesian products of Copyright © 2021, Association for the…”
BackgroundMethodInfluentialSelf-citationHyperRank: Hyperbolic Ranking Model for Unsupervised Keyphrase Extraction
Song, M., Liu, H., & Jing, L. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.997 · Cited by 9 · see citing works
“However, capturing such hierarchies, even in infinite dimensions within Euclidean space, poses a considerable challenge (Ganea et al., 2018a; Tifrea et al., 2019).”
BackgroundMethodInfluentialMetric Learning for Dynamic Text Classification
Wohlwend, J., Elenberg, E. R., Altschul, S., Henry, S., & Lei, T. (2019) · Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo) · doi:10.18653/v1/d19-6116 · Cited by 9 · see citing works
“In particular, recent work has successfully applied hyperbolic geometry to graph embeddings (Sarkar, 2011; Nickel and Kiela, 2017, 2018; Sala et al., 2018; Ganea et al., 2018a; Gu et al., 2019).”
BackgroundMethodHyperbolic Learning with Synthetic Captions for Open-World Detection
Kong, F., Chen, Y., Cai, J., & Modolo, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01586 · Cited by 11 · see citing works
“Our formulation is inspired by the advances of structural representation learning with hyperbolic geometry [8, 9, 12, 13, 22].”
MethodInfluentialLearning Image-Specific Attributes by Hyperbolic Neighborhood Graph Propagation
Xu, X., Tsang, I. W.-H., Cao, X., et al. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/554 · Cited by 9 · see citing works
“Therefore, hyperbolic geometry outperforms euclidean geometry in some special tasks, such as learning hierarchical embedding [Ganea et al., 2018], question answer retrieval [Tay et al.”
BackgroundContext Mover's Distance & Barycenters: Optimal Transport of Contexts for Building RepresentationsPreprint
Singh, S. P., Hug, A., Dieuleveut, A., & Jaggi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.09663 · Cited by 9 · see citing works
Cross-modal Scalable Hyperbolic Hierarchical Clustering
Long, T., & van Noord, N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01527 · Cited by 8 · see citing works
Heterogeneous Social Event Detection via Hyperbolic Graph Representations
Qiu, Z., Wu, J. X., Yang, J. Y., Su, X., & Aggarwal, C. C. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3381017 · Cited by 8 · see citing works
“For instance, HNN [44] is one of the pioneering works that apply traditional neural networks to hyperbolic space.”
InfluentialLees, A., Welty, C., Zhao, S., et al. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.110 · Cited by 8 · see citing works
“(Dhingra et al., 2018) (Nickel and Douwe, 2017) (Nickel and Douwe, 2018) (Ganea et al., 2018) (De Sa et al., 2017).”
Hyperbolic node embedding for temporal networks
Wang, L., Huang, C., Ma, W., et al. (2021) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-021-00774-4 · Cited by 8 · see citing works
“There are several works that attempt to embed networks in hyperbolic space (Nickel and Kiela 2017; Alanis-Lobato et al. 2016a,b; Chamberlain et al. 2017; De Sa et al. 2018; Muscoloni et al. 2017; McDon-ald and He 2019; Wang et al. 2019; Ganea et al. 2018).”
BackgroundMethodROLE: Rotated Lorentzian Graph Embedding Model for Asymmetric Proximity
Feng, S., Chen, L., Zhao, K., Wei, W., Song, X., Shang, S., Kalnis, P., & Shao, L. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3221929 · Cited by 8 · see citing works
“Note that Dankar model can generalize several embedding models by nested subspace arrangement [53], including hyperbolic cone embedding [28] and hyperbolic disk embedding [29].”
BackgroundMethodInfluentialTarget-Oriented Deformation of Visual-Semantic Embedding Space
Matsubara, T. (2020) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2020mup0003 · Cited by 7 · see citing works
“vector or a cone in a hyperbolic space [9], [22], and a Gaussian distribution [10], [23].”
BackgroundNode2LV: Squared Lorentzian Representations for Node Proximity
Feng, S., Chen, L., Zhao, K., Wei, W., Li, F., & Shang, S. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00193 · Cited by 7 · see citing works
“Ganea et al. [22] developed a hyperbolic entailment cone embedding model and Suzuki et al. [23] proposed a hyperbolic disk embedding model to capture asymmetric relations.”
BackgroundA Holistic Approach for Answering Logical Queries on Knowledge Graphs
Wu, Y., Xu, Y., Lin, X., et al. (2023) · Proceedings - International Conference on Data Engineering · doi:10.1109/icde55515.2023.00181 · Cited by 7 · see citing works
“In this paper, we propose the arc embedding as the basis for HaLk based on the rotation paradigm, in which embedding based on the rotation paradigm has been applied to many tasks [8], [13]–[16].”
MethodLow-rank approximations of hyperbolic embeddings
Jawanpuria, P., Meghwanshi, M., & Mishra, B. (2019) · Proceedings of the IEEE Conference on Decision & Control, including the Symposium on Adaptive Processes · doi:10.1109/cdc40024.2019.9029297 · Cited by 7 · see citing works
“Hyperbolic embeddings (numerical representations of tasks) have been considered in several applications such as question answering system [10], recommender systems [11], [12], link prediction [13], [14], natural language inference [15], vertex classification [16], and machine translation [17].”
BackgroundOn Searching Multiple Disjoint Shortest Paths in Scale-Free Networks With Hyperbolic Geometry
Wang, Q., Jiang, H., Jiang, Y., Yi, S., Li, L., Xing, C.-C., & Huang, J. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3169691 · Cited by 7 · see citing works
A Survey of Graph Curvature and Embedding in Non-Euclidean Spaces
Saxena, C., Liu, T., & King, I. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-63833-7_11 · Cited by 6 · see citing works
Representation of Multirelations of Geographic Scenes Based on Hyperbolic Space
Cui, W., Xu, X., Chen, J., Feng, Z., Zhao, H., Hao, Y., Tian, Y., Wang, J., & Xia, C. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3407843 · Cited by 6 · see citing works
“We select 900 typical objects and 60 typical samples and train the hyperbolic model using full Riemannian stochastic gradient descent (RSGD) [34], [39] during the optimization stage.”
BackgroundMethodPrerequisite Relation Learning for Course Concepts Based on Hyperbolic Deep Representation
Liu, L., Lin, F., Wang, B., Li, K., Xiao, M., Xiahou, J., & Wu, P. (2020) · IEEE Access · doi:10.1109/access.2020.2979555 · Cited by 6 · see citing works
“The advantage of this method is to model the conceptual relationship from the perspective of graph, which is more interpretable [20].”
MethodKnowledge Graph Representation via Hierarchical Hyperbolic Neural Graph Embedding
Wang, S., Wei, X., dos Santos, C. N., Wang, Z., Nallapati, R. M., Arnold, A. O., & Yu, P. S. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671651 · Cited by 6 · see citing works
“Möbius operations [13], [31] are defined in Gyrovector space and used to perform vector operation.”
MethodSymmetric Spaces for Graph Embeddings: A Finsler-Riemannian ApproachPreprint
López, F., Pozzetti, B., Trettel, S., Strube, M., & Wienhard, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04941 · Cited by 6 · see citing works
“Our systematic approach to symmetric spaces comprises embeddings in hyperbolic spaces (Chamberlain et al., 2017; Ganea et al., 2018; Nickel & Kiela, 2018; López et al., 2019), spherical spaces (Meng et al., 2019; Defferrard et al., 2020), combinations thereof (Bachmann et al., 2020; Grattarola et…”
BackgroundHyperbolic Deep Learning for Foundation Models: A Survey
He, N., Madhu, H., Bui, N., Yang, M., & Ying, R. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3736564 · Cited by 6 · see citing works
Differentiating atypical parkinsonian syndromes with hyperbolic few-shot contrastive learning
Choi, W. J., Hwangbo, J., Duong, Q. A., et al. (2024) · NeuroImage · doi:10.1016/j.neuroimage.2024.120940 · Cited by 5 · see citing works
“However, according to the study by Ganea et al. (2018), hierarchical structures constructed in Euclidean space are incapable of preserving original low-level structures.”
DCPB: Deformable Convolution based on the Poincaré Ball for Top-view Fisheye Cameras
Wei, X., Ran, Z., & Lu, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01224 · Cited by 5 · see citing works
“In machine learning, hyperbolic representations recently sig-nificantly outperformed Euclidean embeddings for hierarchical, taxonomic, or entailment data [20,33].”
BackgroundIwamoto, R., Kohita, R., & Wachi, A. (2021) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2021.conll-1.37 · Cited by 5 · see citing works
“We tested all models with 5 or 10 dimensions as in a previous study (Ganea et al., 2018b).”
BackgroundMethodResultInfluentialHyperbolic Embedding of Attributed and Directed Networks
McDonald, D., & He, S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3188426 · Cited by 5 · see citing works
“Directed acyclic graphs (DAGs) can be embedded to the Poincar (cid:1) e disk [25], [26].”
MethodMulti-Prototype Hyperbolic Learning Guided by Class Hierarchy
Berg, P., Buecher, L., Michele, B., Pham, M., Chapel, L., & Courty, N. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02571-8 · Cited by 4 · see citing works
“Ganea et al. (2018) proposed a counterpart for Euclidean hyperplanes in the hyperbolic space, more specifically the Poincaré ball model, called hyperbolic gyroplanes.”
InfluentialLiu, Z., Ji, F. Q., Yang, J., et al. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3405898 · Cited by 4 · see citing works
“Hyperbolic space has been introduced into many GNN methods due to its superiority in learning graphs with hierarchical structures [24], [37].”
MethodAn Overview of Utilizing Knowledge Bases in Neural Networks for Question Answering
Kafle, S., de Silva, N., & Dou, D. (2019) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri.2019.00058 · Cited by 4 · see citing works
Exploring Semantic Capacity of Terms
Huang, J., Wang, Z., Chang, K. C., Hwu, W., & Xiong, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.684 · Cited by 4 · see citing works
“…Aly et al. (2019) use Poincar´e embeddings to improve exiting methods to domain-specific taxonomy induction, and Le et al. (2019) propose a method to predict missing hypernymy relations and correct wrong extractions for Hearst patterns based on the hyperbolic entailment cones (Ganea et al., 2018).”
MethodWylie, K. P., & Tregellas, J. R. (2024) · Mathematics · doi:10.3390/math13010072 · Cited by 3 · see citing works
“Recent work has emphasized the potential utility of hyperbolic geometry for the unsupervised learning of abstract concepts hierarchies [3] and low-dimensional stochastic embeddings of complex datasets [4–6].”
Fuzzy C-Poincaré Fréchet means clustering in hyperbolic space
Wu, C., & Pan, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128245 · Cited by 3 · see citing works
Distribution Matching for Machine Teaching
Cao, X., & Tsang, I. W.-H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3256412 · Cited by 3 · see citing works
“…a more general equation that applies hypersphere S to observe the density on u is presented 2) Specification on f H (u , v ): The Poincaré distance [58] of hyperbolic (non-Euclidean) geometry has presented effective improvements in latent hierarchical tasks compared with the Euclidean distance,…”
BackgroundImproved Box Embeddings for Fine-Grained Entity Typing
Qin, Y., Wang, Y., Li, J., Mao, S., Wang, H., & Jiang, Y. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3310239 · Cited by 3 · see citing works
“Although hyperbolicspace[26],[28],[29]basedfine-grainedentitytyping methodsdonotrequireanexplicittypehierarchy,theylacka mathematicalinterpretationandcancaptureonlyapartofentity type relationships [20].”
Binder: Hierarchical Concept Representation through Order Embedding of Binary Vectors
Gyurek, C., Talukder, N., & Hasan, M. A. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671793 · Cited by 2 · see citing works
“We tune our hyper-parameters: dimension 𝑑 , positive and negative sample weights 𝛼 , 𝛽 , negative sample multiplier 𝑛 − , and learning rate 𝑟 ℓ and bias 𝑏 ℓ manually by running separate experiments for each dataset.”
InfluentialUsing hyperbolic large-margin classifiers for biological link prediction.
Agibetov, A., Dorffner, G., & Matthias Samwald, A. (2019) · International Joint Conference on Artificial Intelligence · Cited by 2 · see citing works
Box-To-Box Transformations for Modeling Joint Hierarchies
Dasgupta, S. S., Li, X. L., Boratko, M., Zhang, D., & McCallum, A. (2021) · Proceedings of the 6th Workshop on Representation Learning for NLP (RepL4NLP-2021) · doi:10.18653/v1/2021.repl4nlp-1.28 · Cited by 2 · see citing works
“Hyperbolic space has been shown to be efficient in representing hierarchical relations, but also encounters difficulties in training (Nickel and Kiela, 2017; Ganea et al., 2018b; Chamberlain et al., 2017).”
BackgroundMethodProbabilistic Box Embeddings for Uncertain Knowledge Graph ReasoningPreprint
Chen, X., Boratko, M., Chen, M., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04597 · Cited by 2 · see citing works
“Hyperbolic entailment cones (Ganea et al., 2018) combine order embeddings with hyperbolic geometry.”
BackgroundWeisfeiler and Leman go Hyperbolic: Learning Distance Preserving Node RepresentationsPreprint
Nikolentzos, G., Chatzianastasis, M., & Vazirgiannis, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.02501 · Cited by 2 · see citing works
“Ganea et al. (2018a) proposed an algorithm for embedding directed acyclic graphs in the Poincar´e-ball model, while Balazevic et al. (2019) proposed an algorithm for embedding hierarchical multi-relational data also in the Poincar ´ e-ball model.”
BackgroundMethodInfluentialEntity Type-Aware Ultra-Fine Entity Typing with Adaptive Distance Optimization
Wang, F., & Qin, Y. (2025) · Tehnicki vjesnik - Technical Gazette · doi:10.17559/tv-20250224002415 · Cited by 1 · see citing works
“UFET methods utilizing hyperbolic space [25, 28, 29] do not rely on an explicit type hierarchy, but they suffer from a lack of mathematical interpretation and are limited in their ability to capture entity type relations [18].”
Hyperbolic graph representation learning: methods, applications and challenges—A survey
Chen, Y., Zhang, L., Li, J., & Dong, P. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131044 · Cited by 1 · see citing works
Multi-Behavior Recommendation with Hyperbolic Geometry
You, D., Tran, T., & Lee, K. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020616 · Cited by 1 · see citing works
HypLL: The Hyperbolic Learning Library
van Spengler, M., Wirth, P., & Mettes, P. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3613462 · Cited by 1 · see citing works
“For embedding hierarchies, foundational work in hyperbolic learning has shown that hyperbolic space is superior, leading to minimal distortion while requiring only few embedding dimensions [10, 19].”
BackgroundExpanding the Hyperbolic Kernels: A Curvature-aware Isometric Embedding View
Yang, M., Fang, P., & Xue, H. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/497 · Cited by 1 · see citing works
“In recent years, the hyperbolic space has shown its superiority to encode the data hierarchy, since the volume of hyperbolic space increases exponentially with radius [Ganea et al. , 2018a; Ganea et al. , 2018b].”
BackgroundMethodInfluentialGMMDA: Gaussian Mixture Modeling of Graph in Latent Space for Graph Data Augmentation
Li, Y., Xu, L., & Yamanishi, K. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00041 · Cited by 1 · see citing works
- Authors
- Ganea, O.-E., Bécigneul, G., & Hofmann, T.
- Affiliations
- ETH Zurich (CH)
- ORCID
- Hofmann, Thomas
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 4
- Pages
- 1646-1655
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1804.01882
- OpenAlex
- W2796314760
- Cited by
- 115
- References
- 31
- Citations by year
- 2025: 7 · 2024: 18 · 2023: 15 · 2022: 15 · 2021: 22 · 2020: 19 · 2019: 16 · 2018: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Funders
- National Science Foundation
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (167176)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Topological and Geometric Data Analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- hyperbolic embeddings, directed acyclic graphs, hierarchical embedding, partially ordered sets, graph representation learning, tree-like structures, hyperbolic geometry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-23.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-23.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review