The DOI matches its DataCite record; 32 of the 32 references it cites were found in a registry or an index; 10 of the 16 sources its claims cite were checked for support.
Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddings
Open accessAbstract
Answering complex logical queries on large-scale incomplete knowledge graphs (KGs) is a fundamental yet challenging task. Recently, a promising approach to this problem has been to embed KG entities as well as the query into a vector space such that entities that answer the query are embedded close to the query. However, prior work models queries as single points in the vector space, which is problematic because a complex query represents a potentially large set of its answer entities, but it is unclear how such a set can be represented as a single point. Furthermore, prior work can only handle queries that use conjunctions ($\wedge$) and existential quantifiers ($\exists$). Handling queries with logical disjunctions ($\vee$) remains an open problem. Here we propose query2box, an embedding-based framework for reasoning over arbitrary queries with $\wedge$, $\vee$, and $\exists$ operators in massive and incomplete KGs. Our main insight is that queries can be embedded as boxes (i.e., hyper-rectangles), where a set of points inside the box corresponds to a set of answer entities of the query. We show that conjunctions can be naturally represented as intersections of boxes and also prove a negative result that handling disjunctions would require embedding with dimension proportional to the number of KG entities. However, we show that by transforming queries into a Disjunctive Normal Form, query2box is capable of handling arbitrary logical queries with $\wedge$, $\vee$, $\exists$ in a scalable manner. We demonstrate the effectiveness of query2box on three large KGs and show that query2box achieves up to 25% relative improvement over the state of the art.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
Query2Box embeds logical queries as boxes (axis-aligned hyper-rectangles) in vector space, so a query represents a set of answer entities rather than a single point. It handles conjunctive and disjunctive existential positive first-order (EPFO) queries by transforming them into disjunctive normal form and reports up to 25% relative improvement over the state of the art.
Key findings
- Box embeddings naturally model sets: projection translates and expands a box, intersection produces a smaller box inside the inputs, and entity-to-box distance downweights points inside the box via a fixed scalar \(0<\alpha<1\).
- The paper proves a negative result: handling disjunction with single-point or box embeddings requires embedding dimension/VC dimension proportional to the number of KG entities; on FB15k it finds \(M=13{,}365\) disjoint conjunctive queries while \(|V|=14{,}951\).
- DNF rewriting makes EPFO queries tractable by answering \(N\) conjunctive queries and taking the minimum distance to any resulting box; this extends any conjunctive-query method to union.
- On H@3, Q2B averages 0.484 on FB15k, 0.268 on FB15k-237, and 0.306 on NELL995, versus GQE at 0.386, 0.228, and 0.247; the paper reports 9.8% (25% relative), 3.8% (15% relative), and 5.9% (24% relative) higher H@3 than the best baselines, respectively.
Methods
- Experiments use three KG benchmarks: FB15k, FB15k-237, and NELL995. Models are trained on the first 5 of 9 query structures and evaluated on all 9; evaluation focuses on answers requiring missing edges, i.e. \(J_qK_{\text{test}} \setminus J_qK_{\text{val}}\).
- Entities are embedded as points and queries as boxes. Projection is \(p+r\) (sum centers and offsets); intersection uses attention over box centers plus a sigmoid-shrunk offset; union is handled by DNF transformation and aggregation via minimum box distance.
- Training uses negative sampling loss with embedding dimension \(d=400\), margin \(\gamma=24\), \(\alpha=0.2\), Adam with learning rate 0.0001, 250 epochs, minibatch size 512 queries per query structure, and 1 positive plus 128 negative entities per query. Baselines are GQE and GQE-DOUBLE, with ablations Q2B-AVG, Q2B-DEEPSETS, Q2B-AVG-1P, and Q2B-SHAREDOFFSET.
Limitations
- The paper states a negative result: exactly modeling arbitrary EPFO queries with low-dimensional embeddings is impossible; DNF rewriting may require \(N=\prod_{v\in V_{\text{union}}}|P_v|\) conjunctive queries, though it argues \(N\) may not be large and computations can be parallelized.
- The paper focuses on EPFO queries whose computation graphs are DAGs, with union as an additional edge type; it does not claim to handle all first-order logic beyond this class.
- Evident from the text: evaluation is restricted to answers that require missing edges (\(J_qK_{\text{test}} \setminus J_qK_{\text{val}}\)), not full answer sets; link prediction gains are minor, and the paper notes simple link prediction does not require modeling large answer sets.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
34 Own interpretation · 19 Own result · 8 No basis given · 7 Own method · 4 Supported · 2 Partly supported · 1 Mixed support · 1 Not supported · 1 Sources not found · 1 Not checked yet · accuracy not yet measured
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, prior work models queries as single points in the vector space, which is problematic because a complex query represents a potentially large set of its answer entities, but it is unclear how such a set can be represented as a single point.”
What the sources say
- Supportedcites Guu et al., 2015 source
Section 3.1 (p. 2) describes representing the entities reached at each step of a path query with a single “set vector.” The Related Work section (p. 9) distinguishes the paper’s approach from prior path-query work by its modeling of intermediate denotations. This supports the attributed point that queries can be modeled as single points in vector space; the citing authors’ concern about whether that representation is adequate is their own framing. (LLM, conf=0.88)
- Supportedcites Hamilton et al., 2018 source
Section 4 (p. 4) says the framework maps any conjunctive graph query to an embedding q in a low-dimensional vector space. Section 4 (p. 5) further describes that embedding as implicitly representing the query’s set of answer nodes, supporting the attributed point that this prior work models a query as a single point. (LLM, conf=0.94)
- Not matchedcites Das et al., 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Furthermore, prior work can only handle queries that use conjunctions ( ∧ ) and existential quantifiers ( ∃ ).”
What the sources say
- Supportedcites Hamilton et al., 2018 source
The Introduction (p. 1) defines the paper’s focus as queries using only conjunction and existential quantification. The Conclusion (p. 9) confirms that its framework cannot handle negation or disjunction. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observe that complex logical queries (especially 2p, 3p, ip, pi, up) indeed require modeling a much larger number of answer entities (often more than 10 times) than the simple 1p queries do.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On the simple link prediction (1p query) task, box embeddings provide minor empirical performance improvement over TransE, possibly because simple link prediction does not require modeling large sets of entities, as shown in Table 1.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“(2) QUERY2BOX can generalize to new logical query structures that it has never seen during training;”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We demonstrate the effectiveness of QUERY2BOX on three large KGs and show that QUERY2BOX achieves up to 25% relative improvement over the state of the art.”
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
“QUERY2BOX provides up to 25% relative improvement in accuracy of answering EPFO queries over state-of-the-art baselines.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Notice that naïvely increasing embedding dimensionality in GQE yields limited performance improvement.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“one-to-many relations tend to have larger offset embeddings”
- Also stated in: § H ANALYSIS OF LEARNED BOX OFFSET SIZE · p. 16 · boosted
“Specifically, we see that one-to-many relations tend to have larger offset embeddings”
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § H ANALYSIS OF LEARNED BOX OFFSET SIZE · p. 16 · boosted
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, we observe that explicitly training on complex logical queries beyond one-hop path queries (1p in Fig. 4) improves the reasoning performance.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Q2B-SHAREDOFFSET does not work well on all types of queries.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 17
- It may state two separate claims as one. 23
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“When α = 1 , dist box reduces to the ordinary L 1 distance, i.e. , ‖ Cen ( q ) -v ‖ 1 , which is used by the conventional TransE (Bordes et al., 2013) as well as prior query embedding methods (Guu et al., 2015; Hamilton et al., 2018).”
What the sources say
- Not matchedcites Bordes et al., 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites Guu et al., 2015 sourceExperimental — accuracy not yet measured
Section 3.4 (p. 3) describes a compositional TransE query model with the traversal operator Tᵣ(xₛ) = xₛ + wᵣ, supporting the citation as an example of a prior query-embedding method. In our copy, the scoring and membership formulas are not decoded, and no readable passage specifies an L1 distance. The paper therefore does not verify the L1-specific part of the citing sentence or its claim about dist_box at α = 1. (LLM, conf=0.78)
- Disputedcites Hamilton et al., 2018 sourceExperimental — accuracy not yet measured
The citation to Hamilton et al. is attached to the assertion that prior query-embedding methods used ordinary L1 distance, not to the citing paper’s α=1 calculation. In §4, p. 5, Hamilton et al. explicitly state that their method uses cosine distance instead. Their paper does not define dist_box or α. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“The L 1 distance is used as the distance between query and entity vectors.”
What the sources say
- Disputedcites Hamilton et al., 2018 sourceExperimental — accuracy not yet measured
Section 4 (p. 4) says GQE scores a query–node pair using the distance between their embeddings. Its footnote in Section 4 (p. 5) specifies cosine distance, not L1 distance. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“Different from the generic deep sets to model the intersection (Hamilton et al., 2018), our geometric intersection operator effectively constrains the center position and models the shrinking set size.”
What the sources say
- Supportedcites Hamilton et al., 2018 source
Section 4 (p. 5) describes Hamilton et al.’s intersection operator as a neural-network function over a set of query embeddings, motivated by deep learning on sets. The citation supports the comparison to a generic set-based intersection operator; the claims about the citing authors’ own operator are not attributed to Hamilton et al. (LLM, conf=0.93)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Note that our DNF-query rewriting scheme is general and is able to extend any method that works for conjunctive queries ( e.g. , (Hamilton et al., 2018)) to handle more general class of EPFO queries.”
What the sources say
- Supportedcites Hamilton et al., 2018 source
The citation identifies Hamilton et al. as an example of a method for conjunctive queries, not as the source of the citing authors’ DNF rewriting scheme. The Introduction (p. 1) says conjunctive queries are the paper’s focus, and the Conclusion (p. 9) says it proposes a framework to embed them. (LLM, conf=0.93)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Such approach robustly handles missing relations (Hamilton et al., 2018) and is also orders of magnitude faster, as answering an arbitrary logical query is reduced to simply identifying entities nearest to the embedding of the query in the vector space.”
What the sources say
- Supportedcites Hamilton et al., 2018 source
The citation is attached to the claim that the approach handles missing relations. The Introduction (p. 2) says it can predict answers to conjunctive queries involving unobserved edges, and §3.1 (p. 4) explicitly describes generalizing to query answers that rely on missing edges. The subsequent speed comparison is not attached to this citation. (LLM, conf=0.91)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“GQE embeds a query to a single vector, and models projection and intersection operators as translation and deep sets (Zaheer et al., 2017), respectively.”
What the sources say
- Partly supportedcites Hamilton et al., 2018 sourceExperimental — accuracy not yet measured
Section 4 (pp. 5–6) says GQE generates a single query embedding and implements intersection with a permutation-invariant neural network operating on sets. But its base projection operator uses a trainable matrix (p. 5); translation is a TransE variant described in Section 4.3 (p. 7), not the general GQE projection operator. (LLM, conf=0.90)
- Not matchedcites Zaheer et al., 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Partly supported
None of the sources cited for this claim have been checked yet.
In the paper
“For a real-world KG, there are M ≈ |V| conjunctive queries with non-overlapping answers.”
- Also stated in: § 3.3 TRACTABLE HANDLING OF DISJUNCTION USING DISJUNCTIVE NORMAL FORM · p. 6 · plain
“For example, in the commonly-used FB15k dataset (Bordes et al., 2013), derived from the Freebase (Bollacker et al., 2008), we find M = 13,365, while |V| is 14,951 (see Appendix B for the details).”
What the sources say
- Not matchedcites Bordes et al., 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Bollacker et al., 2008 source
plaincorrelationalSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § 3.3 TRACTABLE HANDLING OF DISJUNCTION USING DISJUNCTIVE NORMAL FORM · p. 6 · plain
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“(1) QUERY2BOX provides strong generalization as it can answer complex queries;”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As listed in Tables 2, our method significantly and consistently outperforms the state-of-the-art baseline across all the query structures, including those not seen during training as well as those with union operations.”
- Also stated in: § 5 CONCLUSION · p. 10 · boosted
“Experimental results on standard KGs demonstrate that QUERY2BOX significantly outperforms the existing work in answering diverse logical queries.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § 5 CONCLUSION · p. 10 · boosted
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“(3) QUERY2BOX is able to implicitly impute missing relations as it can answer any EPFO query with high accuracy even when relations involving answering the query are missing in the KG;”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Out of all the queries in S 1p , 129,717 queries have more than one answer entities”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On average, we obtain 9.8% (25% relative), 3.8% (15% relative), and 5.9% (24% relative) higher H@3 than the best baselines on FB15k, FB15k-237, and NELL995, respectively.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Specifically, on FB15k-237, Q2B obtains more than 4% and 2% absolute gain in H@3 compared to Q2B-AVG and Q2B-DEEPSETS, respectively.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Also notice that Q2B performs well on new queries with the same structure as the training queries as well as on new query structures never seen during training”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On the FB15k, we instantiate 308,006 queries of type '1p', which we denote by S 1p .”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, as all the union operators are removed from G q (1) , . . . , G q ( N ) , all of these computation graphs represent conjunctive queries, which we denote as q (1) , . . . , q ( N ) .”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This means that to answer any EPFO query we first answer individual conjunctive queries and then take the union of the answer entities.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(3) Executing logical operators over boxes results in new boxes, which means that the operations are closed;”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(1) Boxes naturally model sets of entities they enclose;”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The benefit is that unlike a single point, the box has the interior ; thus, if an entity is in a set, it is natural to model the entity embedding to be a point inside the box.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This modeling aligns well with the union operation; an entity is inside the union of sets as long as the entity is in one of the sets.”
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In other words, the dimensionality of the logical query embeddings needs to be Θ( |V| ) , which is not low-dimensional; thus not scalable to large KGs and not generalizable in the presence of unobserved KG edges.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, for these queries, traditional graph traversal techniques would not be able to find the answers (due to missing relations).”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, prior work models queries as single points in the vector space, which is problematic because a complex query represents a potentially large set of its answer entities, but it is unclear how such a set can be represented as a single point.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Since q is logically equivalent to q (1) ∨ · · · ∨ q ( N ) , we can naturally define the aggregated distance function using the box distance dist box :”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“This means we always evaluate on queries/entities that were not part of the training set and the method has not seen them before.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The adaptive box size effectively models a different number of entities/vectors in the set.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The intuition behind our geometric intersection is to generate a smaller box that lies inside a set of boxes, as illustrated in Fig. 2(B).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In this paper we proposed a reasoning framework called QUERY2BOX that can effectively model and reason over sets of entities as well as handle EPFO queries in a vector space.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Note that during the entity and relation assignment, we specifically filter out all the degenerated queries, as shown in Fig. D.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Note that we filter out all the entities that only appear in the validation and test sets but not in the training set.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“For a fair comparison, we also compare with GQE-DOUBLE (GQE with doubled embedding dimensionality) so that QUERY2BOX and GQE-DOUBLE have the same amount of parameters.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Here, to treat queries equally regardless of the number of answers they have, we take average over queries .”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“When generating validation/test queries, we explicitly filter out trivial queries that can be fully answered by subgraph matching on G train / G valid .”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Although the original GQE cannot handle EPFO queries, we apply our DNF-query rewriting strategy and in our evaluation extend GQE to handle general EPFO queries as well.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This is most likely because different queries have different numbers of answer entities, and the adaptive box size enables us to better model it.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper relies on this without support.
Handling queries with logical disjunctions remains an open problem.
“Handling queries with logical disjunctions ( ∨ ) remains an open problem.”
The paper relies on this without support.
Computational complexity of subgraph matching is exponential in query size, and thus cannot scale to modern KGs.
“(1) Computational complexity of subgraph matching is exponential in the query size, and thus cannot scale to modern KGs;”
The paper relies on this without support.
Subgraph matching is very sensitive as it cannot correctly answer queries with missing relations.
“(2) Subgraph matching is very sensitive as it cannot correctly answer queries with missing relations.”
The authors state this as an assumption.
For the proof, assigning a single entity embedding to all entities in a query's denotation set is without loss of generality.
“For the sake of modeling Q , without loss of generality, we consider assigning a single entity embedding v q i to all v ∈ J q i K , so there are M kinds of entity vectors, v q 1 , . . . , v q M .”
The paper relies on this without support.
Simple link prediction does not involve logical reasoning nor handling a large set of answer entities.
“Note that in the case of simple link prediction, we do not expect a huge performance gain by using box embeddings as link prediction does not involve logical reasoning nor handling a large set of answer entities.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Query2Box (Ren et al., 2020) and BoxE (Abboud et al., 2020) make use of boxes in the loss function of their models, however entities themselves are represented as vectors, and thus these models do not benefit from the probabilistic semantics of box embeddings, which we rely on heavily for modeling UKGs.”
From Probabilistic Box Embeddings for Uncertain Knowledge Graph Reasoning (2021) · cites this paper as Ren et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Similarly to Ren et al. (2020) and Dasgupta et al. (2021), we also make use of a learned transform for each relation, however we differ from Ren et al. (2020) in that entities themselves are boxes, and differ from both in the structure of the learned transform.”
From Probabilistic Box Embeddings for Uncertain Knowledge Graph Reasoning (2021) · cites this paper as Ren et al., 2020
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
(2013) · Cited by 5,726
Introduction to Lattices and Order
Davey, B., & Priestley, H. A. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809088 · Cited by 4,975
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
Approximate nearest neighbors: towards removing the curse of dimensionality
Indyk, P., & Motwani, R. (1998) · Proceedings of the thirtieth annual ACM symposium on Theory of computing - STOC '98 · doi:10.1145/276698.276876 · Cited by 4,188
A Review of Relational Machine Learning for Knowledge Graphs
Nickel, M., Murphy, K. P., Volker Tresp, C., & Gabrilovich, E. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2483592 · Cited by 1,780
RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space
Sun, Z., Deng, Z.-H., Nie, J.-Y., & Tang, J. (2019) · arXiv · doi:10.48550/arxiv.1902.10197 · Cited by 1,414
Research works printed but not linked: 2
- John Venn. I. on the diagrammatic and mechanical representation of propositions and reasonings. The London, Edinburgh, and Dublin philosophical magazine and journal of science , 10(59):1-18, 1880.
- Manzil Zaheer, Satwik Kottur, Siamak Ravanbakhsh, Barnabas Poczos, Ruslan R Salakhutdinov, and Alexander J Smola. Deep sets. In Advances in Neural Information Processing Systems (NeurIPS) , pp. 3391-3401, 2017.
Cited by
Sorted by citations
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Self-citationQA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering
Yasunaga, M., Ren, H., Bosselut, A., Liang, P., & Leskovec, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.45 · Cited by 726
Self-citationTowards knowledge graph reasoning for supply chain risk management using graph neural networks
Kosasih, E. E., Margaroli, F., Gelli, S., Aziz, A., Wildgoose, N., & Brintrup, A. M. (2022) · International Journal of Production Research · doi:10.1080/00207543.2022.2100841 · Cited by 192
Interpretability research of deep learning: A literature survey
Xu, B., & Yang, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102721 · Cited by 176
Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link PredictionPreprint
Zhu, Z., Zhang, Z., Xhonneux, L.-P., & Tang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06935 · Cited by 174
Gaur, M., Faldu, K., & Sheth, A. (2021) · IEEE Internet Computing · doi:10.1109/mic.2020.3031769 · Cited by 149
Wang, X., & El-Gohary, N. (2023) · Automation in Construction · doi:10.1016/j.autcon.2022.104696 · Cited by 140
Explainable Subgraph Reasoning for Forecasting on Temporal Knowledge Graphs
Han, Z., Chen, P., Ma, Y., & Tresp, V. (2021) · International Conference on Learning Representations · Cited by 108
Kosasih, E. E., Papadakis, E., Baryannis, G., & Brintrup, A. M. (2023) · International Journal of Production Research · doi:10.1080/00207543.2023.2281663 · Cited by 124
BoxE: A Box Embedding Model for Knowledge Base Completion
Abboud, R., Ceylan, İ. İ., Lukasiewicz, T., & Salvatori, T. (2020) · arXiv · doi:10.48550/arxiv.2007.06267 · Cited by 74
Fuzzy Logic Based Logical Query Answering on Knowledge Graphs
Chen, X., Hu, Z., & Sun, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20310 · Cited by 83
Tackling Over-Smoothing for General Graph Convolutional NetworksPreprint
Huang, W., Rong, Y., Xu, T., Sun, F., & Huang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.09864 · Cited by 112
Role-Aware Modeling for N-ary Relational Knowledge Bases
Liu, Y., Yao, Q., & Li, Y. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449874 · Cited by 67
Modeling Fine-Grained Entity Types with Box Embeddings
Onoe, Y., Boratko, M., McCallum, A., & Durrett, G. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.160 · Cited by 67
ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge GraphsPreprint
Zhang, Z., Wang, J., Chen, J., Ji, S., & Wu, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13715 · Cited by 61
ConsRec: Learning Consensus Behind Interactions for Group Recommendation
Wu, X., Xiong, Y., Zhang, Y., Jiao, Y., Zhang, J., Zhu, Y., & Yu, P. S. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583277 · Cited by 59
LEGO: Latent Execution-Guided Reasoning for Multi-Hop Question Answering on Knowledge Graphs
Ren, H., Dai, H., Dai, B., Chen, X., Yasunaga, M., Sun, H., Schuurmans, D., Leskovec, J., & Zhou, D. (2021) · International Conference on Machine Learning · Cited by 50
Self-citationSelf-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphs
Choudhary, N., Rao, N., Katariya, S., Subbian, K., & Reddy, C. K. A. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449974 · Cited by 58
QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question AnsweringPreprint
Yasunaga, M., Ren, H., Bosselut, A., Liang, P., & Leskovec, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06378 · Cited by 50
Self-citationLiu, X., Zhao, S., Su, K., Cen, Y., Qiu, J., Zhang, M., Wu, W. B., Dong, Y., & Tang, J. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539472 · Cited by 60
Probabilistic Box Embeddings for Uncertain Knowledge Graph Reasoning
Chen, X., Boratko, M., Chen, M., Dasgupta, S. S., Li, X. L., & McCallum, A. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.68 · Cited by 47
“Query2Box (Ren et al., 2020) and BoxE (Abboud et al.”
BackgroundMethodComplex Query Answering with Neural Link PredictorsPreprint
Arakelyan, E., Daza, D., Minervini, P., & Cochez, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.03459 · Cited by 65
Adaptable and Interpretable Neural MemoryOver Symbolic Knowledge
Verga, P., Sun, H., Soares, L. B., & Cohen, W. W. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.288 · Cited by 49
Neural-Answering Logical Queries on Knowledge Graphs
Liu, L., Du, B., Ji, H., et al. (2021) · doi:10.1145/3447548.3467375 · Cited by 44
Knowledge Graph Embeddings and Explainable AIPreprint
Bianchi, F., Rossiello, G., Costabello, L., Palmonari, M., & Minervini, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.14843 · Cited by 41
Khan, A. (2023) · ACM SIGMOD Record · doi:10.1145/3615952.3615956 · Cited by 41
Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
Hu, Z., Yi‐chong, X., Yu, W., Wang, S., Yang, Z., Zhu, C., Chang, K.-W., & Sun, Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.650 · Cited by 49
Type-aware Embeddings for Multi-Hop Reasoning over Knowledge Graphs
Hu, Z., Gutiérrez-Basulto, V., Xiang, Z., Li, X., Li, R., & Pan, J. Z. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/427 · Cited by 35
Link Prediction with Attention Applied on Multiple Knowledge Graph Embedding Models
Gregucci, C., Nayyeri, M., Hernández, D., & Staab, S. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583358 · Cited by 38
Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic KnowledgePreprint
Verga, P., Sun, H., Soares, L. B., & Cohen, W. W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00849 · Cited by 53
Machine learning with biomedical ontologiesPreprint
Kulmanov, M., Smaili, F. Z., Gao, X., & Hoehndorf, R. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.07.082164 · Cited by 30
AdaVis: Adaptive and Explainable Visualization Recommendation for Tabular Data
Zhang, S., Li, H., Qu, H., & Wang, Y. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3316469 · Cited by 34
ExCut: Explainable Embedding-Based Clustering over Knowledge Graphs
Gad-Elrab, M. H., Stepanova, D., Tran, T.-K., Adel, H., & Weikum, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62419-4_13 · Cited by 30
Context-Aware Explainable Recommendation Based on Domain Knowledge Graph
Syed, M. H., Huy, T. Q., & Chung, S.-T. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6010011 · Cited by 26
Learning graph attention-aware knowledge graph embedding
Li, C., Peng, X., Niu, Y., Zhang, S., Peng, H. M., Zhou, C. D., & Li, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.139 · Cited by 24
Query2Particles: Knowledge Graph Reasoning with Particle Embeddings
Bai, J., Wang, Z., Zhang, H., & Song, Y. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.207 · Cited by 32
LeL-GNN: Learnable Edge Sampling and Line Based Graph Neural Network for Link Prediction
Morshed, M. G., Sultana, T., & Lee, Y.-K. (2023) · IEEE Access · doi:10.1109/access.2023.3283029 · Cited by 24
Shrinking Embeddings for Hyper-Relational Knowledge Graphs
Xiong, B., Nayyeri, M., Pan, S., & Staab, S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.743 · Cited by 34
COKG-QA: Multi-hop Question Answering over COVID-19 Knowledge Graphs
Du, H., Le, Z., Wang, H., Chen, Y., & Yu, J. (2022) · Data Intelligence · doi:10.1162/dint_a_00154 · Cited by 22
xERTE: Explainable Reasoning on Temporal Knowledge Graphs for Forecasting Future LinksPreprint
Han, Z., Chen, P., Ma, Y., & Tresp, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15537 · Cited by 22
Querying in the Age of Graph Databases and Knowledge Graphs
Arenas, M., Gutiérrez, C., & Sequeda, J. (2021) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3448016.3457545 · Cited by 21
TCMM: A unified database for traditional Chinese medicine modernization and therapeutic innovations
Ren, Z., Ren, Y., Li, Z., & Xu, H. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.04.016 · Cited by 27
GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphs
Yang, D. L., Qing, P., Li, Y., Lu, H., & Lin, X. S. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.47 · Cited by 28
LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking
Jiang, H., Gurajada, S., Lu, Q., Neelam, S., Popa, L. C., Sen, P., Li, Y., & Gray, A. (2021) · doi:10.18653/v1/2021.acl-long.64 · Cited by 22
Learning User Representations with Hypercuboids for Recommender Systems
Zhang, S., Liu, H., Zhang, A., et al. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441768 · Cited by 19
Local and Global: Temporal Question Answering via Information Fusion
Liu, Y., Liang, D., Li, M., Giunchiglia, F., Li, X., Wang, S., Wu, W. B., Huang, L., Feng, X., & Guan, R. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/571 · Cited by 21
Dong, Y., Wieting, J., & Verga, P. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.76 · Cited by 16
LMGFuse: Language Models and Graph reasoning Fuse deeply for question answering
Wang, A., Duan, P., Li, Y., Hu, W., & Xiong, S. (2023) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2023-023 · Cited by 15
Self-citationARLPE: A meta reinforcement learning framework for glucose regulation in type 1 diabetics
Yu, X., Guan, Y., Yan, L., Li, S., Fu, X., & Jiang, J. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120156 · Cited by 13
Knowledge Graph Embeddings and Explainable AI
Bianchi, F., Rossiello, G., Luca, C., Palmonari, M., & Minervini, P. (2020) · Studies on the semantic web · doi:10.3233/ssw200011 · Cited by 74
Word2Box: Capturing Set-Theoretic Semantics of Words using Box Embeddings
Dasgupta, S. S., Boratko, M., Mishra, S., Atmakuri, S., Patel, D., Li, X., & McCallum, A. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.161 · Cited by 15
Probabilistic Entity Representation Model for Reasoning over Knowledge Graphs
Choudhary, N., Rao, N., Katariya, S., Subbian, K., & Reddy, C. K. A. (2021) · VTechWorks (Virginia Tech) · doi:10.48550/arxiv.2110.13522 · Cited by 14
Machine Reasoning: Technology, Dilemma and Future
Duan, N., Tang, D., & Zhou, M. (2020) · doi:10.18653/v1/2020.emnlp-tutorials.1 · Cited by 14
The Power of the Weisfeiler-Leman Algorithm for Machine Learning with Graphs
Morris, C., Fey, M., & Kriege, N. M. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/618 · Cited by 11
net.science: A Cyberinfrastructure for Sustained Innovation in Network Science and EngineeringPreprint
Kuhlman, C. J. (2020) · OSF Preprints (OSF Preprints) · Cited by 11
Efficient Embeddings of Logical Variables for Query Answering over Incomplete Knowledge Graphs
Wang, D., Chen, Y., & Grau, B. C. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25588 · Cited by 11
Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphs
Wang, S., Wei, Z., Han, M., Fan, Z., Shan, H., Zhang, Q., & Huang, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.259 · Cited by 12
CylE: Cylinder Embeddings for Multi-hop Reasoning over Knowledge Graphs
Nguyen, C. D. M., French, T., Liu, W., & Stewart, M. G. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.127 · Cited by 10
Knowledge Graph-Based Reinforcement Federated Learning for Chinese Question and Answering
Xu, L., Chen, T., Hou, Z., Zhang, W., Hon, C., Wang, X., Wang, D., Chen, L., Zhu, W., Tian, Y., et al. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3246795 · Cited by 11
Learning structured embeddings of knowledge graphs with generative adversarial framework
Liu, L., Zeng, J., & Zheng, X. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117361 · Cited by 12
Concept-aware embedding for logical query reasoning over knowledge graphs
Pan, P., Lei, J., Wang, J., Ouyang, D., Qu, J., & Li, Z. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103971 · Cited by 11
Marra, G., Diligenti, M., & Giannini, F. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112822 · Cited by 9
Message Passing Query EmbeddingPreprint
Daza, D., & Cochez, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02406 · Cited by 27
LogicRec: Recommendation with Users' Logical Requirements
Tang, Z., Floto, G., Toroghi, A., et al. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3592012 · Cited by 8
Complex Query Answering with Neural Link Predictors (Extended Abstract)*
Minervini, P., Arakelyan, E., Daza, D., & Cochez, M. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/741 · Cited by 10
Query Embedding on Hyper-relational Knowledge GraphsPreprint
Alivanistos, D., Berrendorf, M., Cochez, M., & Galkin, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08166 · Cited by 14
A Probabilistic Inference Based Approach for Querying Associative Entities in Knowledge Graph
Li, J., Yue, K., Li, J., et al. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85899-5_6 · Cited by 7
Time Series Pattern Discovery by Deep Learning and Graph Mining
Romanova, A. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-87101-7_19 · Cited by 7
A Holistic Approach for Answering Logical Queries on Knowledge Graphs
Wu, Y., Xu, Y., Lin, X., & Zhang, W. (2023) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde55515.2023.00181 · Cited by 9
Commonsense Knowledge Graph Completion Via Contrastive Pretraining and Node Clustering
Wu, S., Shen, X., & Xia, R. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.878 · Cited by 9
Neural-based Mixture Probabilistic Query Embedding for Answering FOL queries on Knowledge Graphs
Xiao, L., Zhuang, L., Li, A., Wang, S., & Li, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.194 · Cited by 8
Logic Embeddings for Complex Query AnsweringPreprint
Luus, F., Sen, P., Kapanipathi, P., Riegel, R. N., Makondo, N., Lebese, T., & Gray, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.00418 · Cited by 35
SQALER: Scaling Question Answering by Decoupling Multi-Hop and Logical ReasoningPreprint
Atzeni, M., Bogojeska, J., & Loukas, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14266 · Cited by 7
Gerasimova, O., Severin, N., & Makarov, I. (2023) · IEEE Access · doi:10.1109/access.2023.3305272 · Cited by 6
Interpretability Methods for Graph Neural Networks
Khan, A., & Mobaraki, E. B. (2023) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa60987.2023.10302600 · Cited by 7
Kim, M., & Baek, S. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956509 · Cited by 6
A Data Source for Reasoning Embodied Agents
Lanchantin, J., Sukhbaatar, S., Synnaeve, G., Sun, Y., Srinet, K., & Szlam, A. D. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.26017 · Cited by 6
Knowledge Graph Embeddings: Open Challenges and Opportunities
Biswas, R., Kaffee, L.-A., Cochez, M., Dumbrava, S., Jendal, T. E., Lissandrini, M., López, V., Mencía, E. L., Paulheim, H., Sack, H., et al. (2023) · VBN Forskningsportal (Aalborg Universitet) · doi:10.4230/tgdk.1.1.4 · Cited by 15
Answering Complex Queries in Knowledge Graphs with Bidirectional Sequence Encoders
Kotnis, B., Lawrence, C., & Niepert, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i6.16630 · Cited by 6
NQE: N-ary Query Embedding for Complex Query Answering over Hyper-Relational Knowledge Graphs
Luo, H., Haihong, E., Yang, Y., Zhou, G., Guo, Y., Yao, T., Tang, Z., Lin, X., & Wan, K. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25576 · Cited by 15
SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge GraphsPreprint
Ren, H., Dai, H., Dai, B., Chen, X., Zhou, D., Leskovec, J., & Schuurmans, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14890 · Cited by 5
Self-citationOntology Population With Large Language Models (LLMs): A Case Study on Asbestos Ontology
Ayad, S., & Khelifa, L. C. (2025) · Applied Ontology · doi:10.1177/15705838251334528 · Cited by 7
Box4Rec: Box Embedding for Sequential Recommendation
Deng, K. Y., Huang, J., & Qin, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-75765-6_43 · Cited by 4
Set2Box: Similarity Preserving Representation Learning for Sets
Lee, G., Park, C., & Shin, K. (2022) · Proceedings · doi:10.1109/icdm54844.2022.00125 · Cited by 4
CoSe-Co: Text Conditioned Generative CommonSense Contextualizer
Bansal, R., Aggarwal, M., Bhatia, S., Kaur, J. N., & Krishnamurthy, B. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.83 · Cited by 5
What Is Learned in Knowledge Graph Embeddings?
Douglas, M. R., Simkin, M., Ben‐Eliezer, O., et al. (2022) · Studies in computational intelligence · doi:10.1007/978-3-030-93413-2_49 · Cited by 4
Benchmarking the Combinatorial Generalizability of Complex Query Answering on Knowledge GraphsPreprint
Wang, Z., Yin, H., & Song, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08925 · Cited by 7
Neural Reasoning for Sure Through Constructing Explainable Models
Dong, T., Jamnik, M., & Lió, P. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i11.33262 · Cited by 3
Zhang, Q., Chen, B., & Liu, G. (2023) · Journal of Breath Research · doi:10.1088/1752-7163/acf065 · Cited by 3
Bayesian Inference with Complex Knowledge Graph Evidence
Toroghi, A., & Sanner, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i18.30040 · Cited by 6
Knowledge Graph Embedding for Hierarchical Entities Based on Auto-Embedding Size
Zhang, P., Zhang, X., Fang, Y., Liao, J., Ma, W., Tan, Z., & Xiao, W. (2024) · Mathematics · doi:10.3390/math12203237 · Cited by 3
Graph Data Management and Graph Machine Learning: Synergies and Opportunities
Khan, A., Ke, X., & Wu, Y. (2025) · ACM SIGMOD Record · doi:10.1145/3749116.3749122 · Cited by 5
Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphs
Yao, X., He, S., Wang, C., Cai, L., Liu, K., & Zhao, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.761 · Cited by 7
Neural-Symbolic Reasoning on Knowledge Graphs.Preprint
Zhang, J., Chen, B., Zhang, L., Ke, X., & Ding, H. (2020) · arXiv (Cornell University) · Cited by 3
Experimental Comparison between Neural-Symbolic Question-Answering Methods
Hoang, H. T., Triet, N. T., Ho, N. T. T., et al. (2023) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse59128.2023.10299450 · Cited by 2
DAGE: DAG Query Answering via Relational Combinator with Logical Constraints
He, Y., Xiong, B., Hernández, D., et al. (2025) · doi:10.1145/3696410.3714677 · Cited by 2
Approximate Knowledge Graph Query Answering: From Ranking to Binary Classification
van Bakel, R., Aleksiev, T. I., Daza, D., et al. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72308-8_8 · Cited by 2
Embedding Ontologies via Incorporating Extensional and Intensional Knowledge
Wang, K., Qi, G., Chen, J., Huang, Y., & Wu, T. (2024) · Data Intelligence · doi:10.3724/2096-7004.di.2024.0088 · Cited by 3
Graph Structures for Knowledge Representation and Reasoning
Cochez, M., Madalina Croitoru, A., Marquis, P., & Rudolph, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72308-8 · Cited by 2
Metadata
- Authors
- Ren, H., Hu, W., & Leskovec, J.
- Affiliations
- Stanford University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2002.05969
- OpenAlex
- W2994695355
- Cited by
- 135
- References
- 31
- Citations by year
- 2025: 9 · 2024: 11 · 2023: 35 · 2022: 20 · 2021: 44 · 2020: 16
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- International Conference on Learning Representations
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Keywords
- knowledge graph reasoning, box embeddings, vector space representation, disjunctive normal form, incomplete knowledge graphs, existential quantifier
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-23, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-23 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review