CoChat
Sign Up
PreprintCited by 1

One-shot Learning for Temporal Knowledge Graphs

Mirtaheri, Mehrnoosh, Rostami, Mohammad, Ren, Xiang, Morstatter, Fred, Galstyan, Aram·2020·arXiv
DOI 10.48550/arxiv.2010.12144arXiv 2010.12144
Open this paper in CoChat — free account

Abstract

Most real-world knowledge graphs are characterized by a long-tail relation frequency distribution where a significant fraction of relations occurs only a handful of times. This observation has given rise to recent interest in low-shot learning methods that are able to generalize from only a few examples. The existing approaches, however, are tailored to static knowledge graphs and not easily generalized to temporal settings, where data scarcity poses even bigger problems, e.g., due to occurrence of new, previously unseen relations. We address this shortcoming by proposing a one-shot learning framework for link prediction in temporal knowledge graphs. Our proposed method employs a self-attention mechanism to effectively encode temporal interactions between entities, and a network to compute a similarity score between a given query and a (one-shot) example. Our experiments show that the proposed algorithm outperforms the state of the art baselines for two well-studied benchmarks while achieving significantly better performance for sparse relations.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2010.12144

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Many aspects related to the datasets limit TKGC performance; for example, the imbalanced distribution of facts results in a long tail structure for entities and relations.

    “Many aspects related to the datasets limit the performance; for example, the in-balanced distribution of facts, which results in a long tail structure for entities and relations [Mirtaheri et al., 2020].”

    From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Mirtaheri et al., 2020

    The Introduction says that real-world knowledge graphs have a long-tail structure in which many relationships occur only a few times. Model Analysis also reports that TKG baselines perform much worse on sparse than on frequent relations. The cited paper does not establish the claimed long-tail structure for entities as well as relations. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 25

  1. Bose, A. J.; Jain, A.; Molino, P.; and Hamilton, W. L. 2019. Meta- Graph: Few shot Link Prediction via Meta Learning. arXiv preprint arXiv:1912.09867 . · arXiv
  2. Chen, M.; Zhang, W.; Zhang, W.; Chen, Q.; and Chen, H. 2019. Meta Relational Learning for Few-Shot Link Prediction in Knowl- edge Graphs. In Proceedings of the 2019 Conference on Empiri- cal Methods in Natural Language Processing and the 9th Interna- tional Joint Conference on Natural Language Processing (EMNLP- IJCNLP), 4208-4217.
  3. Dasgupta, S. S.; Ray, S. N.; and Talukdar, P. 2018. Hyte: Hyperplane- based temporally aware knowledge graph embedding. In Proceed- ings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2001-2011.
  4. Du, Z.; Zhou, C.; Ding, M.; Yang, H.; and Tang, J. 2019. Cognitive Knowledge Graph Reasoning for One-shot Relational Learning. arXiv preprint arXiv:1906.05489 . · arXiv
  5. Finn, C.; Abbeel, P.; and Levine, S. 2017. Model-agnostic meta- learning for fast adaptation of deep networks. In Proceedings of the 34th International Conference on Machine Learning-Volume 70, 1126-1135.
  6. Garcia-Duran, A.; Dumančić, S.; and Niepert, M. 2018. Learning Sequence Encoders for Temporal Knowledge Graph Completion. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 4816-4821.
  7. Jin, W.; Jiang, H.; Qu, M.; Chen, T.; Zhang, C.; Szekely, P.; and Ren, X. 2019. Recurrent event network: Global structure inference over temporal knowledge graph. arXiv: 1904.05530 . · arXiv
  8. Kasneci, G.; Ramanath, M.; Suchanek, F.; and Weikum, G. 2009. The YAGO-NAGA approach to knowledge discovery. ACM SIG- MOD Record 37(4): 41-47.
  9. Koch, G.; Zemel, R.; and Salakhutdinov, R. 2015. Siamese neural networks for one-shot image recognition. In ICML deep learning workshop, volume 2. Lille.
  10. Leblay, J.; and Chekol, M. W. 2018. Deriving validity time in knowl- edge graph. In Companion Proceedings of the The Web Conference 2018, 1771-1776. International World Wide Web Conferences Steer- ing Committee.
  11. Lv, X.; Gu, Y.; Han, X.; Hou, L.; Li, J.; and Liu, Z. 2019. Adapting Meta Knowledge Graph Information for Multi-Hop Reasoning over Few-Shot Relations. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 3367-3372.
  12. Mishra, N.; Rohaninejad, M.; Chen, X.; and Abbeel, P. 2018. A Simple Neural Attentive Meta-Learner. In ICLR.
  13. Nickel, M.; Murphy, K.; Tresp, V.; and Gabrilovich, E. 2016. A Review of Relational Machine Learning for Knowledge Graphs. Proceedings of the IEEE 1(104): 11-33.
  14. Snell, J.; Swersky, K.; and Zemel, R. 2017. Prototypical networks for few-shot learning. In Advances in Neural Information Processing Systems, 4077-4087.
  15. Trivedi, R.; Dai, H.; Wang, Y.; and Song, L. 2017. Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. In Pro- ceedings of the 34th International Conference on Machine Learning- Volume 70, 3462-3471. JMLR. org.
  16. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, Ł.; and Polosukhin, I. 2017. Attention is all you need. In Advances in neural information processing systems, 5998-6008.
  17. Vinyals, O.; Blundell, C.; Lillicrap, T.; Wierstra, D.; et al. 2016. Matching networks for one shot learning. In Advances in neural information processing systems, 3630-3638.
  18. Vrandečić, D.; and Krötzsch, M. 2014. Wikidata: a free collabora- tive knowledgebase. Communications of the ACM 57(10): 78-85.
  19. Wang, H.; Xiong, W.; Yu, M.; Guo, X.; Chang, S.; and Wang, W. Y. 2019a. Meta Reasoning over Knowledge Graphs. arXiv preprint arXiv:1908.04877 . · arXiv
  20. Wang, Z.; Lai, K.; Li, P.; Bing, L.; and Lam, W. 2019b. Tack- ling Long-Tailed Relations and Uncommon Entities in Knowledge Graph Completion. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 250-260.
  21. Wang, Z.; Lv, Q.; Lan, X.; and Zhang, Y. 2018. Cross-lingual knowledge graph alignment via graph convolutional networks. In Proceedings of the 2018 Conference on Empirical Methods in Natu- ral Language Processing, 349-357.
  22. Xiong, W.; Yu, M.; Chang, S.; Guo, X.; and Wang, W. Y. 2018. One- Shot Relational Learning for Knowledge Graphs. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 1980-1990.
  23. Yao, X.; and Van Durme, B. 2014. Information extraction over structured data: Question answering with freebase. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 956-966.
  24. Zhang, C.; Yao, H.; Huang, C.; Jiang, M.; Li, Z.; and Chawla, N. V. 2020a. Few-Shot Knowledge Graph Completion. In International Joint Conference on Artificial Intelligence.
  25. Zhang, N.; Deng, S.; Sun, Z.; Chen, J.; Zhang, W.; and Chen, H. 2020b. Relation Adversarial Network for Low Resource Knowledge Graph Completion. In Proceedings of The Web Conference 2020, 1-12.

Cited by

Sorted by citations

Authors
Mirtaheri, M., Rostami, M., Ren, X., Morstatter, F., & Galstyan, A.
Venue
arXiv
Publisher
arXiv
Published
2020
DOI
10.48550/arxiv.2010.12144
arXiv
2010.12144
References
0
Type
Preprint
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review