PreprintCited by 135Advanced Graph Neural NetworksTopic ModelingSemantic Web and Ontologies

The DOI matches its DataCite record; 32 of the 32 references it cites were found in a registry or an index; 10 of the 16 sources its claims cite were checked for support.

Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddings

Open access

Abstract

Answering complex logical queries on large-scale incomplete knowledge graphs (KGs) is a fundamental yet challenging task. Recently, a promising approach to this problem has been to embed KG entities as well as the query into a vector space such that entities that answer the query are embedded close to the query. However, prior work models queries as single points in the vector space, which is problematic because a complex query represents a potentially large set of its answer entities, but it is unclear how such a set can be represented as a single point. Furthermore, prior work can only handle queries that use conjunctions ($\wedge$) and existential quantifiers ($\exists$). Handling queries with logical disjunctions ($\vee$) remains an open problem. Here we propose query2box, an embedding-based framework for reasoning over arbitrary queries with $\wedge$, $\vee$, and $\exists$ operators in massive and incomplete KGs. Our main insight is that queries can be embedded as boxes (i.e., hyper-rectangles), where a set of points inside the box corresponds to a set of answer entities of the query. We show that conjunctions can be naturally represented as intersections of boxes and also prove a negative result that handling disjunctions would require embedding with dimension proportional to the number of KG entities. However, we show that by transforming queries into a Disjunctive Normal Form, query2box is capable of handling arbitrary logical queries with $\wedge$, $\vee$, $\exists$ in a scalable manner. We demonstrate the effectiveness of query2box on three large KGs and show that query2box achieves up to 25% relative improvement over the state of the art.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

Query2Box embeds logical queries as boxes (axis-aligned hyper-rectangles) in vector space, so a query represents a set of answer entities rather than a single point. It handles conjunctive and disjunctive existential positive first-order (EPFO) queries by transforming them into disjunctive normal form and reports up to 25% relative improvement over the state of the art.

Key findings

  • Box embeddings naturally model sets: projection translates and expands a box, intersection produces a smaller box inside the inputs, and entity-to-box distance downweights points inside the box via a fixed scalar \(0<\alpha<1\).
  • The paper proves a negative result: handling disjunction with single-point or box embeddings requires embedding dimension/VC dimension proportional to the number of KG entities; on FB15k it finds \(M=13{,}365\) disjoint conjunctive queries while \(|V|=14{,}951\).
  • DNF rewriting makes EPFO queries tractable by answering \(N\) conjunctive queries and taking the minimum distance to any resulting box; this extends any conjunctive-query method to union.
  • On H@3, Q2B averages 0.484 on FB15k, 0.268 on FB15k-237, and 0.306 on NELL995, versus GQE at 0.386, 0.228, and 0.247; the paper reports 9.8% (25% relative), 3.8% (15% relative), and 5.9% (24% relative) higher H@3 than the best baselines, respectively.

Methods

  • Experiments use three KG benchmarks: FB15k, FB15k-237, and NELL995. Models are trained on the first 5 of 9 query structures and evaluated on all 9; evaluation focuses on answers requiring missing edges, i.e. \(J_qK_{\text{test}} \setminus J_qK_{\text{val}}\).
  • Entities are embedded as points and queries as boxes. Projection is \(p+r\) (sum centers and offsets); intersection uses attention over box centers plus a sigmoid-shrunk offset; union is handled by DNF transformation and aggregation via minimum box distance.
  • Training uses negative sampling loss with embedding dimension \(d=400\), margin \(\gamma=24\), \(\alpha=0.2\), Adam with learning rate 0.0001, 250 epochs, minibatch size 512 queries per query structure, and 1 positive plus 128 negative entities per query. Baselines are GQE and GQE-DOUBLE, with ablations Q2B-AVG, Q2B-DEEPSETS, Q2B-AVG-1P, and Q2B-SHAREDOFFSET.

Limitations

  • The paper states a negative result: exactly modeling arbitrary EPFO queries with low-dimensional embeddings is impossible; DNF rewriting may require \(N=\prod_{v\in V_{\text{union}}}|P_v|\) conjunctive queries, though it argues \(N\) may not be large and computations can be parallelized.
  • The paper focuses on EPFO queries whose computation graphs are DAGs, with union as an additional edge type; it does not claim to handle all first-order logic beyond this class.
  • Evident from the text: evaluation is restricted to answers that require missing edges (\(J_qK_{\text{test}} \setminus J_qK_{\text{val}}\)), not full answer sets; link prediction gains are minor, and the paper notes simple link prediction does not require modeling large answer sets.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2002.05969

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

34 Own interpretation · 19 Own result · 8 No basis given · 7 Own method · 4 Supported · 2 Partly supported · 1 Mixed support · 1 Not supported · 1 Sources not found · 1 Not checked yet · accuracy not yet measured

Show all 42 claims

  • Probably not a substantial claim. 17
  • It may state two separate claims as one. 23
36 of 36
  • The paper relies on this without support.

    Handling queries with logical disjunctions remains an open problem.

    “Handling queries with logical disjunctions ( ∨ ) remains an open problem.”
  • The paper relies on this without support.

    Computational complexity of subgraph matching is exponential in query size, and thus cannot scale to modern KGs.

    “(1) Computational complexity of subgraph matching is exponential in the query size, and thus cannot scale to modern KGs;”
  • The paper relies on this without support.

    Subgraph matching is very sensitive as it cannot correctly answer queries with missing relations.

    “(2) Subgraph matching is very sensitive as it cannot correctly answer queries with missing relations.”
  • The authors state this as an assumption.

    For the proof, assigning a single entity embedding to all entities in a query's denotation set is without loss of generality.

    “For the sake of modeling Q , without loss of generality, we consider assigning a single entity embedding v q i to all v ∈ J q i K , so there are M kinds of entity vectors, v q 1 , . . . , v q M .”
  • The paper relies on this without support.

    Simple link prediction does not involve logical reasoning nor handling a large set of answer entities.

    “Note that in the case of simple link prediction, we do not expect a huge performance gain by using box embeddings as link prediction does not involve logical reasoning nor handling a large set of answer entities.”
5 of 5

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 31 references

Research works printed but not linked: 2

  1. John Venn. I. on the diagrammatic and mechanical representation of propositions and reasonings. The London, Edinburgh, and Dublin philosophical magazine and journal of science , 10(59):1-18, 1880.
  2. Manzil Zaheer, Satwik Kottur, Siamak Ravanbakhsh, Barnabas Poczos, Ruslan R Salakhutdinov, and Alexander J Smola. Deep sets. In Advances in Neural Information Processing Systems (NeurIPS) , pp. 3391-3401, 2017.

Cited by

Sorted by citations

Items 101–134 of 134

Metadata

Authors
Ren, H., Hu, W., & Leskovec, J.
Affiliations
Stanford University (US)
Venue
arXiv
Publisher
arXiv
Published
2020
ISSN
2331-8422 (ISSN-L)
OpenAlex
W2994695355
Cited by
135
References
31
Citations by year
2025: 9 · 2024: 11 · 2023: 35 · 2022: 20 · 2021: 44 · 2020: 16
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
  • TIB Data Manager
  • International Conference on Learning Representations
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
Keywords
knowledge graph reasoning, box embeddings, vector space representation, disjunctive normal form, incomplete knowledge graphs, existential quantifier

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-23, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-23 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review