Cited by 252Advanced Graph Neural NetworksSemantic Web and OntologiesLogic, Reasoning, and Knowledge

Anytime Bottom-Up Rule Learning for Knowledge Graph Completion

Open access
Meilicke, Christian, Chekol, Melisachew Wudage, Ruffinelli, Daniel, Stuckenschmidt, Heiner·2019·Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence

Abstract

We propose an anytime bottom-up technique for learning logical rules from large knowledge graphs. We apply the learned rules to predict candidates in the context of knowledge graph completion. Our approach outperforms other rule-based approaches and it is competitive with current state of the art, which is based on latent representations. Besides, our approach is significantly faster, requires less computational resources, and yields an explanation in terms of the rules that propose a candidate.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.24963/ijcai.2019/435

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • For AnyBURL on datasets FB15k-237 and YAGO3-10, the paper used training time 1,000 secs instead of 10,000 secs because 10,000 secs made prediction times prohibitively long.

    “We note that in AnyBURL [37], for datasets FB15k-237 and YAGO3-10 we used training time 1,000 secs whereas the original papers report slightly better results with a training time of 10000s; this is because, due to our already described necessity for full rankings, when using models trained for 10,000 secs prediction times got prohibitively long.”

    From Knowledge Graph Embedding for Link Prediction (2021) · cites this paper as [37]

    Section 5.1 reports AnyBURL results after both 1,000 and 10,000 seconds of rule learning and says that learning more rules increases application time. It does not say the original paper chose 1,000 seconds instead of 10,000 because prediction became prohibitively slow. In the citing sentence, that choice and its reason are described as the citing authors’ own. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • AnyBURL is a very challenging baseline for LP, as it is shown to outperform most latent-features-based models.

    “As a matter of fact, AnyBURL is a very challenging baseline for LP, as it is shown to outperform most latent-featuresbased models.”

    From Knowledge Graph Embedding for Link Prediction (2021) · cites this paper as [37]

    Section 5.2 says AnyBURL's results are at the same level as, and sometimes slightly better than, most of the embedding models compared. It reports stronger results than ConvE on most datasets and than SimplE, but says ComplEx-N3 performs better than AnyBURL. Thus the paper supports calling AnyBURL a challenging baseline, but 'outperform most' overstates its qualified comparison. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • AnyBURL is computationally fast: depending on the training setting, it can take from a couple of minutes (100s setting) to about 3 hours (10000s setting) to learn its rules.

    “It is also computationally fast: depending on the training setting, in order to learn its rules it can take from a couple of minutes ( 100s setting) to about 3 hours ( 10000s setting).”

    From Knowledge Graph Embedding for Link Prediction (2021) · cites this paper as [37]

  • The paper uses AnyBURL as a baseline.

    “As a baseline we use AnyBURL [37], a popular LP model based on observable features.”

    From Knowledge Graph Embedding for Link Prediction (2021) · cites this paper as [37]

  • In comparison to the embedding-based models, the baseline AnyBURL is strikingly fast.

    “In comparison to the embedding-based models, the baseline project AnyBURL [37] is strikingly fast.”

    From Knowledge Graph Embedding for Link Prediction (2021) · cites this paper as [37]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 19

  1. Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. Translating embeddings for modeling multi-relational data. In Advances in neural information processing systems, pages 2787-2795, 2013.
  2. Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, and Sebastian Riedel. Convolutional 2d knowledge graph embeddings. In Thirty-Second AAAI Conference on Artificial Intelligence, 2018.
  3. Luis Antonio Galárraga, Christina Teflioudi, Katja Hose, and Fabian Suchanek. Amie: as- sociation rule mining under incomplete evidence in onto- logical knowledge bases. In Proceedings of the 22nd inter- national conference on World Wide Web, pages 413-422. ACM, 2013.
  4. Luis Galárraga, Christina Teflioudi, Katja Hose, and Fabian M Suchanek. Fast rule mining in ontological knowledge bases with AMIE+. The VLDB Journal-The International Journal on Very Large Data Bases, 24(6):707-730, 2015.
  5. Shu Guo, Quan Wang, Lihong Wang, Bin Wang, and Li Guo. Knowledge graph embedding with iterative guidance from soft rules. In Thirty-Second AAAI Conference on Artificial Intelligence, 2018.
  6. Timothée Lacroix, Nicolas Usunier, and Guillaume Obozinski. Canonical tensor decompo- sition for knowledge base completion. In ICML, pages 2869-2878, 2018.
  7. Ni Lao, Tom Mitchell, and William W Co- hen. Random walk inference and learning in a large scale knowledge base. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pa- ges 529-539. Association for Computational Linguistics, 2011.
  8. Ni Lao, Einat Minkov, and William Co- hen. Learning relational features with backward random walks. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th In- ternational Joint Conference on Natural Language Pro- cessing, volume 1, pages 666-675, 2015.
  9. Meilicke et al., 2018] Christian Meilicke, Manuel Fink, Yanjie Wang, Daniel Ruffinelli, Rainer Gemulla, and Hei- ner Stuckenschmidt. Fine-grained evaluation of rule-and embedding-based systems for knowledge graph comple- tion. In Proceedings of the International Semantic Web Conference, pages 3-20. Springer International Publis- hing, 2018.
  10. Stephen H. Muggleton and Cao Feng. Efficient induction of logic programs. In Pro- ceedings of the First Conference on Algorithmic Learning Theory, pages 368-381, 1990.
  11. Niepert, 2016] Mathias Niepert. Discriminative gaifman models. In Advances in Neural Information Processing Systems, pages 3405-3413, 2016.
  12. Pouya Ghiasnezhad Omran, Kewen Wang, and Zhe Wang. Scalable rule learning via learning representation. In IJCAI, pages 2149-2155, 2018.
  13. Stefano Ortona, Venkata Vamsikrishna Meduri, and Paolo Papotti. Robust discovery of positive and negative rules in knowledge bases. In 2018 IEEE 34th International Conference on Data Engineering (ICDE), pages 1168-1179. IEEE, 2018.
  14. Michael Schlichtkrull, Thomas N Kipf, Peter Bloem, Rianne Van Den Berg, Ivan Titov, and Max Welling. Modeling relational data with graph convo- lutional networks. In European Semantic Web Conference, pages 593-607. Springer, 2018.
  15. Ashwin Srinivasan. The aleph ma- nual(techical report). Technical report, Computing Labo- ratory, Oxford University, 2000.
  16. Thomas Pellissier Tanon, Daria Stepa- nova, Simon Razniewski, Paramita Mirza, and Gerhard Weikum. Completeness-aware rule learning from know- ledge graphs. In International Joint Conference on Artifi- cial Intelligence, pages 507-525. Springer, 2017.
  17. Toutanova and Chen, 2015] Kristina Toutanova and Danqi Chen. Observed versus latent features for knowledge base and text inference. In Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositiona- lity, pages 57-66, 2015.
  18. Quan Wang, Zhendong Mao, Bin Wang, and Li Guo. Knowledge graph embedding: A survey of approaches and applications. IEEE Transactions on Kno- wledge and Data Engineering, 29(12):2724-2743, 2017.
  19. Wen Zhang, Bibek Paudel, Wei Zhang, Abraham Bernstein, and Huajun Chen. Interaction embed- dings for prediction and explanation in knowledge graphs. In Proceedings of the Twelfth ACM International Confe- rence on Web Search and Data Mining, pages 96-104. ACM, 2019.

Cited by

Sorted by citations

  • Knowledge Graph Embedding for Link Prediction

    Rossi, A., Barbosa, D., Firmani, D., Matinata, A., & Merialdo, P. (2021) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3424672 · Cited by 601 · see citing works

    “For the baseline AnyBURL [43], we compute prediction times a posteriori by dividing the time required to perform all test predictions by the number of test facts.”
    BackgroundMethodInfluential

Authors
Meilicke, C., Chekol, M. W., Ruffinelli, D., & Stuckenschmidt, H.
Affiliations
University of Mannheim (DE)
Venue
Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence
Published
2019-08
Pages
3137-3143
OpenAlex
W2966298461
Cited by
252
References
2
Citations by year
2026: 22 · 2025: 38 · 2024: 51 · 2023: 57 · 2022: 36 · 2021: 26 · 2020: 20 · 2019: 2
FWCI
8.03
Type
conference paper
Language
en
Open access
Locations
  • International Joint Conference on Artificial Intelligence (publishedVersion)
  • MADOC (University of Mannheim) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
  • Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
  • Physical Sciences › Computer Science › Artificial Intelligence › Logic, Reasoning, and Knowledge
Keywords
knowledge graph completion, anytime algorithms, rule-based explanations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review