PreprintCited by 42Advanced Graph Neural NetworksSemantic Web and OntologiesTopic Modeling

The DOI matches its DataCite record; 26 of the 26 references it cites were found in a registry or an index; none of the 104 sources its claims cite is checked for support yet.

On the Evolution of Knowledge Graphs: A Survey and Perspective

Open access

Abstract

Knowledge graphs (KGs) are structured representations of diversified knowledge. They are widely used in various intelligent applications. In this article, we provide a comprehensive survey on the evolution of various types of knowledge graphs (i.e., static KGs, dynamic KGs, temporal KGs, and event KGs) and techniques for knowledge extraction and reasoning. Furthermore, we introduce the practical applications of different types of KGs, including a case study in financial analysis. Finally, we propose our perspective on the future directions of knowledge engineering, including the potential of combining the power of knowledge graphs and large language models (LLMs), and the evolution of knowledge extraction, reasoning, and representation.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

This survey reviews the evolution of knowledge graphs from static to dynamic, temporal, and event-based forms, along with knowledge extraction and reasoning techniques for each type. It also discusses applications, including a financial case study, and proposes future directions for combining KGs with large language models.

Key findings

  • The paper organizes KG evolution into four stages—static KGs, dynamic KGs, temporal KGs, and event KGs—with formal definitions and representative examples such as Freebase, DBpedia, ICEWS/GDELT/Wikidata, and EventKG/ELG/EvGraph.
  • It surveys knowledge extraction (NER, relation extraction, dynamic, temporal, and event extraction) and reasoning methods, classifying static KGR into matrix decomposition, translation, GNN, LLM, and neural-symbolic methods; dynamic KGR into GNN, LLM, and few-shot methods; and temporal KGR into completion and prediction methods.
  • Applications include finance (financial information extraction and KG construction, reasoning for event-driven quantitative investment, and LLM-integrated QA) and other domains such as healthcare, transportation, manufacturing, legal, and personalized services.
  • Future directions include knowledge programmability, zero-shot/unsupervised extraction, quality control, non-static and event KG reasoning, neural-symbolic reasoning, and KG-LLM integration; the paper notes that NELL amassed over 80 million facts by 2015, KnowItAll accumulated over 54,753 facts in four days, and GPT-3 has 175B parameters with a reported $10 million cost for a single training session.

Methods

  • This is a survey and perspective paper: it provides a comprehensive literature review of KG types, knowledge extraction, knowledge reasoning, applications, and future directions, without new empirical experiments.
  • It organizes prior work by KG type (SKG, DKG, TKG, EKG) and method category, using formal definitions and summary tables (Tables 1–3) to classify representative methods.
  • It includes a financial case study illustration of event KG reasoning for event-driven quantitative investment; the figure’s news contents, company names, and numerical values are explicitly described as fictional and illustrative.

Limitations

  • The paper states that existing knowledge reasoning techniques mainly focus on static KGs; dynamic and temporal KG reasoning remain nascent, event KG reasoning is largely unexplored, and neural-symbolic reasoning remains to be explored.
  • It states that generative LLMs still significantly underperform fully-supervised baselines on knowledge extraction tasks, and that LLMs have limitations including black-box behavior, outdated knowledge, temporal reasoning challenges, and difficulty with event-centric knowledge.
  • Evident from the text: as a survey, it does not provide new experimental validation or benchmark results, and its coverage reflects literature available up to 2023.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2310.04835

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 of 104 cited sources checked · 0 supported · 0 flagged

  • Findingreasoning

    Matrix decomposition-based methods enable efficient computation of similarity and relationship prediction through low-dimensional latent space representations.

    “These approaches enable efficient computation of similarity and relationship prediction through low-dimensional latent space representations.”
    Quote in the paperNot a substantial claim
  • Findingnone given

    Matrix decomposition-based methods face limitations in scalability and handling sparsity, which may hinder their applicability in large-scale knowledge graphs or those with complex relational structures.

    “However, they face limitations in terms of scalability and handling sparsity, which may hinder their applicability in large-scale knowledge graphs or those with complex relational structures.”
    Quote in the paperNot a substantial claim
  • Findingnone given

    Most knowledge graphs are dynamic and evolving.

    “Most KGs are dynamic and evolving.”
    Quote in the paperSubstantial claim
  • Findingnone given

    Event knowledge graphs contain one more node type (event nodes) and two more relation types (entity-event relations and event-event relations) compared with temporal knowledge graphs.

    “Compared with TKGs, EKGs contain one more node type (i.e., event nodes) and two more relation types (entity-event relations, eventevent relations).”
    Quote in the paperNot a substantial claim
  • Findingreasoning

    Matrix decomposition-based methods offer advantages in modeling static knowledge reasoning in knowledge graphs by capturing latent semantics and patterns in the data.

    “Matrix decomposition-based methods offer advantages in modeling static knowledge reasoning in knowledge graphs by capturing latent semantics and patterns in the data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. 169
  • It may state two separate claims as one. 114
  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Most knowledge graphs reviewed in the paper suffer from incompleteness, and this severely limits the metric of KG application to downstream tasks.

    “In addition, most KGs reviewed in this paper are suffering from the problem of incompleteness, and it severely limits the metric of KG application to downstream tasks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Experimental results illustrate the effectiveness of LLM-based methods in DKGR.

    “Experimental results illustrate the effectiveness of LLM-based methods in DKGR.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Early work on knowledge graph reasoning mainly focused on static knowledge graph reasoning.

    “Early work on KGR mainly focus on SKGR.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Knowledge graph reasoning techniques have evolved from static learning methods to temporal learning methods.

    “With the development of KGs, KGR techniques have also evolved from static learning methods to temporal learning methods.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingreasoning

    Large language models incorporating knowledge graph information show promise for knowledge graph reasoning tasks, capturing rich semantic information and leveraging pre-trained knowledge.

    “In conclusion, large language models incorporating knowledge graph information show promise for knowledge graph reasoning tasks, capturing rich semantic information and leveraging pre-trained knowledge.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    GNN-based methods for knowledge graph reasoning can effectively capture local graph structure and complex relationships, making them a suitable choice for various applications.

    “In conclusion, GNN-based methods for knowledge graph reasoning can effectively capture local graph structure and complex relationships, making them a suitable choice for various applications.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Translation-based methods face difficulties in modeling complex relationships and handling noisy or incomplete data.

    “However, they face difficulties in modeling complex relationships and handling noisy or incomplete data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingreasoning

    Multiple works have subsequently been proposed for dynamic knowledge graph reasoning and temporal knowledge graph reasoning.

    “To this end, multiple works are subsequently proposed for DKGR and TKGR.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    GNN-based methods may face challenges related to scalability, over-smoothing, computational complexity, and parameter tuning.

    “However, they may face challenges related to scalability, over-smoothing, computational complexity, and parameter tuning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Translation-based methods for knowledge graph reasoning are simple, computationally efficient, and scalable, making them suitable for a wide range of applications.

    “In conclusion, Translation-based methods for knowledge graph reasoning are simple, computationally efficient, and scalable, making them suitable for a wide range of applications.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Static knowledge graph reasoning methods based on neural network models suffer from interpretability and reliability problems and cannot be adopted in some real-world scenarios such as medical, finance, and military, which have high reliability demands.

    “The above static knowledge graph reasoning method all based on neural network models, which suffer the interpretable and unreliable problems, and can not be adopted in some real-world scenarios such as medical, finance, and military which have high reliability demands.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Large language model-based methods may face challenges related to scalability, memory limitations, computational complexity, and prompt design.

    “However, they may face challenges related to scalability, memory limitations, computational complexity, and prompt design.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingreasoning

    Existing KGs face challenges in unifying different granularities and types of knowledge and modeling their interactions, with RDF/OWL-based knowledge modeling being overly complex and prone to redundancy in rapidly evolving scenarios.

    “the demand for a representation that supports continuous business iteration while effectively avoiding combinatorial explosion and redundant construction, challenges the existing KGs in unifying different granularities and types of knowledge and modeling their interactions, with RDF/OWL-based knowledge modeling being overly complex and prone to redundancy in rapidly evolving scenarios”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Findingnone given

    Event-centric knowledge is updated very quickly, and it is difficult for LLMs to learn from constant addition of new event-centric knowledge.

    “Moreover, event-centric knowledge is updated very quickly, and it is difficult for LLMs to learn from the constant addition of new event-centric knowledge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may state two separate claims as one.

    Findingreasoning

    Integration of financial KGs with LLMs enhances LLMs' ability to perform financial domain tasks and allows fact-consistency checks ensuring factual accuracy of LLM-generated content.

    “This integration not only enhances the ability of LLMs to perform tasks in the financial domain but also allows for fact-consistency checks, ensuring the factual accuracy of the content generated by LLMs.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    KGs express semantic information of entities by recording their types, attributes, descriptions, and relations between them.

    “KGs express the semantic information of entities by recording their types, attributes, and descriptions, as well as relations between them.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Current KGs cannot effectively handle and directly compute numerical knowledge.

    “ineffective handling and direct computation of numerical knowledge through KGs”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    With formal evolution of KGs, knowledge reasoning techniques for DKGs and TKGs have received more attention but still remain to be improved.

    “With the formal evolution of KGs, knowledge reasoning techniques for DKGs and TKGs have received more attention, but still remain to be improved.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingcitation

    Some follow-up works propose various automatic prompt generation methods to further improve probing performances of LLMs.

    “Moreover, some follow-up works propose various automatic prompt generation methods to further improve probing performances of LLMs [189], [190], [191], [192], [193].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [189]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [190]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [191]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    TKGs tend to have longer time scopes and factual knowledge in TKGs is much more time-sensitive.

    “Relatively, TKGs tend to have longer time scopes and the factual knowledge in TKGs is much more time-sensitive.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Lack of flexibility: storage structure and query method of a KG are relatively fixed, difficult to adapt to various data structures and query requirements.

    “Lack of flexibility: The storage structure and query method of a KG are relatively fixed, and it is difficult to adapt to various data structures and query requirements.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingnone given

    Both KGs and LLMs can be used as knowledge sources for downstream applications, e.g., question answering.

    “both of them can be used as knowledge sources for downstream applications, e.g., question answering.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingreasoning

    In healthcare, KGs amalgamate patient records, medical literature, and drug information, enabling enhanced diagnosis, smart treatments, and drug discovery.

    “Knowledge graphs amalgamate patient records, medical literature, and drug information, paving the way for enhanced diagnosis, smart treatments, and drug discovery by elucidating relationships between diseases, symptoms, medications, and patient histories.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingreasoning

    Some LLMs and large-scale KGs use the same data sources.

    “Some LLMs and large-scale KGs even use the same data sources.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingreasoning

    Event-driven quantitative investment formulates investment strategies based on relationships and patterns identified within KGs.

    “One practical application of this is event-driven quantitative investment, where investment strategies are formulated based on the relationships and patterns identified within the KGs.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingnone given

    KGs and LLMs have different representation forms to store knowledge and different ways of performing knowledge reasoning.

    “In addition to their respective limitations, KGs and LLMs have different representation forms to store knowledge and different ways of performing knowledge reasoning.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingnone given

    Training LLMs requires large amounts of textual data, often obtained from publicly available Internet websites.

    “The training of LLMs requires large amounts of textual data, which are often obtained from publicly available Internet websites.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingreasoning

    One of the main advantages of KGs is their explainability; it is easier to know how answers are inferred over a KG.

    “Meanwhile, one of the main advantages of KGs is their explainability.It would be easier to know how the answers are inferred over a KG.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Findingnone given

    LLMs are black-box models in nature; it is difficult to know the basis of answers and reasoning process.

    “LLM vs SKG: LLMs are black-box models in nature.It is difficult to know the basis of the answers given by an LLM and the corresponding reasoning process.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Findingnone given

    An SKG will give a consistent answer to a query no matter how many times this query is performed.

    “Moreover, regardless of knowledge updating and revision, an SKG will give a consistent answer to a query no matter how many times this query is performed.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingcitation

    The largest GPT3 model has a parametric count of 175B and costs 10 million dollars for a single training session.

    “For example, the largest GPT3 model [196] has a parametric count of 175B and costs 10 million dollars for a single training session.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [196]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper may give no reason why it holds.

    Findingnone given

    Recent advances have prompted a shift from SKGs to more dynamic structures like DKGs and TKGs.

    “Recent advances have prompted a shift from SKGs to more dynamic structures like DKGs and TKGs, aiming to accurately represent and reason over the dynamic nature of real-world knowledge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    The application of static and temporal logical rules to KG reasoning tasks remains an open avenue for exploration.

    “Yet, the application of static and temporal logical rules to KG reasoning tasks remains an open avenue for exploration.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingcitation

    Some LLMs can further improve their performances on open-domain QA after fine-tuning.

    “Some literature shows that such LLMs can further improve their performances on opendomain QA after fine-tuning [194].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [194]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingnone given

    Financial information extraction targets financial entities, relatively stable concepts, dynamically evolving knowledge, temporal information, and financial events.

    “In this context, information extraction targets various elements, including financial entities (e.g., stocks, bonds, corporations), relatively stable concepts (e.g., market indices, financial instruments), dynamically evolving knowledge (e.g., stock prices, economic indicators), temporal information (e.g., trade dates), and financial events (e.g., mergers, acquisitions, dividends announcements).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Reasoning techniques for DKGs and TKGs are still nascent, with temporal knowledge completion and extrapolation emerging as notable endeavors.

    “However, reasoning techniques for DKGs and TKGs are still nascent, with temporal knowledge completion and extrapolation emerging as notable endeavors.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Dynamically updated financial KGs can keep LLMs current with real-time financial knowledge.

    “Through dynamically updated financial knowledge graphs, LLMs can be kept current with real-time financial knowledge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Wikipedia is the most important training corpus for many LLMs like BERT and also the main data source for general KGs, e.g., DBpedia and YAGO.

    “For example, Wikipedia is the most important training corpus for a lot of LLMs like BERT, and also the main data source for general KGs, e.g., DBpedia, and YAGO.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    In legal domain, KGs consolidate statutes, case law, and legal doctrines, aiding legal research, case preparation, and regulatory compliance.

    “In the legal domain, knowledge graphs consolidate statutes, case law, and legal doctrines, aiding in legal research, case preparation, and regulatory compliance by structuring and analyzing the relationships between different legal entities and concepts.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingcitation

    LLMs are trained on large text corpora via self-supervised learning and may not have access to structured data that can help them learn about event temporal relations.

    “This is because LLMs are trained on large text corpora via self-supervised learning methods and may not have access to structured data that can help them learn about event temporal relations [198].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [198]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Some existing works have demonstrated substantial improvements in static knowledge graph reasoning tasks by applying first-order logical rules.

    “Some existing works have demonstrated substantial improvements in static knowledge graph reasoning tasks by applying first-order logical rules.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingnone given

    LLMs are trained on text data to obtain character-level or word-level embeddings of entities, which can represent semantics of entities.

    “On the other hand, LLMs are trained on text data to obtain character-level embeddings or word-level embeddings of entities, which can also represent the semantics of entities.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Current KGs cannot directly and accurately model higher-order logic knowledge or apply it in higher-order knowledge reasoning.

    “the inability to directly and accurately model higher-order logic knowledge and apply it in higher-order knowledge reasoning”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingreasoning

    Both KGs and LLMs have data sources from massive amounts of unstructured data.

    “both of their data sources come from massive amounts of unstructured data”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Research on knowledge reasoning in SKGs, DKGs, and TKGs has attracted widespread interest.

    “In recent years, research on knowledge reasoning in SKGs, DKGs, and TKGs has attracted widespread interest.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    KGs have widespread applications beyond finance, notably in healthcare, transportation, retail, manufacturing, legal, and personalized services.

    “Knowledge graphs have widespread applications beyond finance, notably in healthcare, transportation, retail, manufacturing, legal, and personalized services.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Existing knowledge reasoning techniques mainly focus on SKGs.

    “The existing knowledge reasoning techniques mainly focus on SKGs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Neural-symbolic knowledge reasoning remains to be explored.

    “Besides, neural-symbolic knowledge reasoning also remains to be explored.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingreasoning

    Financial KGs integrated with LLMs enable intelligent QA systems tailored for finance.

    “Financial knowledge graphs can also be integrated with large language models to enable intelligent QA systems tailored for the finance sector.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingcitation

    Previous studies have shown that masking/natural language generation probing paradigms can perform well on some knowledge probing benchmarks like LAMA.

    “Previous studies have shown that such paradigms can perform well on some knowledge probing benchmarks like LAMA [188].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [188]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Findingcitation

    Although LLMs obtain decent knowledge probing performances on LAMA, some follow-up works propose more difficult and domain-specific probing datasets for LLMs and demonstrate that current LLMs are not reliable in factual knowledge extraction, contrary to the perspective that LLMs can be seen as knowledge bases.

    “And although LLMs obtain decent knowledge probing performances on LAMA, some follow-up works propose more difficult and domain-specific probing datasets [199], [200] for LLMs and demonstrate that current LLMs are not reliable in factual knowledge extraction [201], [202], which is contrary to the perspective that LLMs can be seen as knowledge bases.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [199]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [200]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [201]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Findingreasoning

    LLMs have limited editability; it is difficult for LLMs to frequently learn new knowledge and information due to unaffordable training cost.

    “And LLMs have limited editability, that is to say it is difficult for LLMs to frequently learn new knowledge and information due to their unaffordable training cost.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Reasoning over EKGs is largely unexplored.

    “It is also worth noting that reasoning over EKGs is largely unexplored.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Findingnone given

    A considerable amount of logical knowledge is implied in KGs, encompassing first-order or temporal logical rules between relations and events.

    “Besides factual knowledge, a considerable amount of logical knowledge is implied in KGs, encompassing a vast number of first-order or temporal logical rules between relations and events.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim.

    Findingnone given

    KG-related techniques, like knowledge extraction and reasoning, have evolved with the change in form of KGs.

    “KG-related techniques, like knowledge extraction and reasoning, have also evolved with the change in the form of KGs.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    Construction of large-scale KGs relies on information extraction from unstructured open data.

    “The construction of large-scale KGs also relies on information extraction from unstructured open data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim.

    Findingnone given

    Since emergence of KG technology, form of KGs is gradually changing.

    “Since the emergence of the technology of KG, the form of KGs is gradually changing.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    In transportation, KGs structure data on routes, traffic conditions, and vehicle statuses, enabling intelligent systems to optimize route planning, manage traffic efficiently, and predict maintenance needs.

    “In transportation, knowledge graphs structure data encompassing routes, traffic conditions, and vehicle statuses, empowering intelligent systems to optimize route planning, manage traffic efficiently, and predict maintenance needs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Social KGs modeling users' cognition and preferences have enabled personalized services across education, psychotherapy, and personalized recommendations.

    “Through social knowledge graphs modeling users' cognition and preferences, personalized services have burgeoned across sectors like education, psychotherapy, and personalized recommendations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingreasoning

    Extracted financial knowledge is organized into a KG, transforming unstructured financial data into high-quality structured financial knowledge.

    “This process transforms massive amounts of unstructured financial data into high-quality, structured financial knowledge, which is then effectively represented and made easily accessible through the KG.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingreasoning

    In manufacturing, KGs assimilate data on product components, manufacturing processes, and supply chains, supporting predictive maintenance, quality control, and optimized production planning.

    “Within manufacturing, knowledge graphs assimilate data on product components, manufacturing processes, and supply chains, supporting predictive maintenance, quality control, and optimized production planning by analyzing relationships between machine performances, material availability, and production schedules.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    How to develop an EKG embedding model to model events has never been discussed in previous research.

    “However, how to develop an EKG embedding model to model events, a new kind of knowledge element, has never been discussed in previous research.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Large-scale KGs are often the main knowledge sources of some downstream applications, e.g., a KBQA system.

    “Large-scale KGs are often the main knowledge sources of some downstream applications, e.g., a knowledge base question answering (KBQA) system.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingreasoning

    Both KGs and LLMs can represent entity semantics and store correlations between entities.

    “both of them can represent entity semantics, and store correlations between entities”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    The reliability of knowledge is ensured by quality assessment for a KG, especially for small-scale domain-specific KGs.

    “while the reliability of knowledge is ensured by quality assessment for a KG, especially for small-scale domain-specific KGs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingcitation

    BERT has been proven to do remarkably well on open-domain QA.

    “For instance, BERT has been proven to do remarkably well on open-domain QA [188].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [188]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Findingreasoning

    LLMs have achieved noticeable success on many NLP tasks, but they still struggle with event-centric tasks.

    “LLMs have achieved noticeable success on many NLP tasks, but they still struggle with event-centric tasks.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    When the core tensor is a hyper-diagonal matrix, Tucker decomposition is a special case of CP decomposition.

    “When the core tensor is a hyper-diagonal matrix, Tucker decomposition is a special case of CP decomposition.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    Rule mining uses observed co-occurrences of frequent patterns in KGs to determine logical rules, which can transfer reasoning to unseen facts.

    “Rule mining uses observed co-occurrences of frequent patterns in KGs to determine logical rules, which can transfer reasoning to unseen facts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    In LLM-based dynamic knowledge graph reasoning methods, entities and relations of edges in KGs are usually converted into natural language as input to LLMs, and the understanding ability of LLMs benefits these models.

    “In the LLMbased methods, the entities and relations of the edges in KGs are usually converted into natural language, serving as the input of LLMs, and the powerful understanding ability of LLMs benefits these models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisenone given

    Previous methods usually represent relations and entities based on a large amount of training data, whereas few-shot knowledge graph reasoning mainly relies on transferring and adapting learned knowledge.

    “To learn the representation of the components in KGs, previous methods usually represent relations and entities based on a large amount of training data.In contrast, few-shot knowledge graph reasoning mainly relies on transferring and adapting learned knowledge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    Definition 4 subsumes Definition 3.

    “Thus, Definition 4 subsumes Definition 3.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Interpretationreasoning

    GNN-based DKGR methods capture transferable knowledge in DKGs through rich structure information and transfer it to new entities and relations, obtaining trusted representations for reasoning tasks over DKGs, such as inductive link prediction.

    “Because of the advantages above, GNN-based DKGR methods capture the transferable knowledge in DKGs through rich structure information and transfer it to new entities and relations, obtaining trusted representations for reasoning tasks over DKGs, such as inductive link prediction.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    In GNN-based dynamic knowledge graph reasoning methods, the source of inductive ability can be divided into four categories: the structure of graphs, relation rules, embedding aggregators, and meta-learning.

    “In the GNN-based methods, they use GNN or its variants to model emerging entities and relations and the source of the inductive ability can be further divided into four categories: the structure of graphs, relation rules, embedding aggregators and meta-learning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    GNN-based methods may face challenges related to computational complexity and over-smoothing, and they are restricted by the original framework of GNN.

    “However, GNN-based methods may face challenges related to computational complexity and over-smoothing, and they are restricted by the original framework of GNN.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    A separate version of a dynamic knowledge graph can be viewed as a static knowledge graph.

    “It is worth noting that a separate version of a DKG can be viewed as an SKG.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Interpretationcitation

    Once the types and relations in KGs are fixed, the dimension of nodes in INDIGO's node-annotated graph does not depend on the input KG, making the inductive capabilities of GNN fully exploited.

    “Once the types and relations in KGs are fixed, the dimension of nodes in the node-annotated graph does not depend on the input KG, making the inductive capabilities of GNN fully exploited.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [116]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. It may state two separate claims as one.

    Interpretationnone given

    Neural-symbolic methods for knowledge graph reasoning offer a more interpretable and explainable way of reasoning, making them suitable for applications that require transparency and understanding.

    “In conclusion, neural-symbolic methods for knowledge graph reasoning offer a more interpretable and explainable way of reasoning, making them suitable for various applications that require transparency and understanding.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisenone given

    Current LLM-based works research how to integrate KG-specific knowledge into the inductive ability of LLMs and attempt to convert from a data-driven way to a knowledge-driven way.

    “Current LLM-based works research how to integrate KG-specific knowledge into the inductive ability of LLMs and attempt to convert from a data-driven way to a knowledge-driven way.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    The pre-trained LLMs have shown that factual knowledge inside KGs can be recovered from PLMs, so LLM-based methods convert edges or relation paths connecting subject and object into natural language form.

    “In conclusion, the pre-trained LLMs have shown that factual knowledge inside KGs can be recovered from PLMs, so LLM-based methods convert edges or relation paths connecting subject and object into natural language form.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    KEPLER encodes textual entity descriptions with BERT as their embeddings and aligns them to the symbol space of KGs, then jointly optimizes the knowledge embedding objective and the masked language modeling objective.

    “For example, KEPLER [129] encodes textual entity descriptions with BERT as their embeddings and aligns them to the symbol space of KGs, then KEPLER jointly optimizes the knowledge embedding objective and the masked language modeling (MLM) objective.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [129]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim.

    Interpretationreasoning

    The formal evolution of knowledge graphs can be divided into four stages: static KGs, dynamic KGs, temporal KGs, and event KGs.

    “Based on this observation, we divide the formal evolution of KGs into four stages, corresponding to the emergence of static KGs (SKGs), dynamic KGs (DKGs), the temporal KGs (KGs) stage, and event KGs (EKGs), respectively.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    GMUC leverages Gaussian metric learning to capture uncertain semantic information and to complete few-shot uncertain knowledge graphs.

    “GMUC [144] leverages Gaussian metric learning to capture uncertain semantic information and to complete few-shot uncertain knowledge graphs.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [144]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Premisecitation

    Meta-KGR proposes a meta-based RL framework, where the learned meta-knowledge on normal relations provides well-initialized parameters of new models for few-shot relations and the multi-hop reasoning offers interpretability for the results.

    “Meta-KGR [137] proposes a meta-based RL framework, where the learned meta-knowledge on normal relations provides well-initialized parameters of new models for fewshot relations and the multi-hop reasoning offers interpretability for the results.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [137]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Translation-based reasoning methods can be divided into two types: reasoning with explicitly represented time information and implicitly represented time information.

    “Translation-based reasoning methods can be divided into two types: reasoning with explicitly represented time information and implicitly represented time information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Tensor decomposition-based completion methods can be divided into CP decomposition methods and Tucker decomposition methods.

    “The tensor decomposition-based completion methods can be divided into CP decomposition methods [147] and Tucker decomposition methods [148].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [147]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [148]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    The BERT in BERTRL is used as a score function to score the probability that the candidate relational triple is true.

    “The BERT in BERTRL is used as a score function to score the probability that the candidate relational triple is true.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [130]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Temporal knowledge graph completion methods aim to understand the time information and integrate it into the semantic and structural information in the knowledge graph.

    “The temporal knowledge graph completion methods aim to understand the time information and integrate it into the semantic and structural information in the knowledge graph.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Some temporal knowledge graphs are extracted from event news but do not effectively represent event information due to their entity-centric representations.

    “On the other hand, some TKGs are extracted from event news, but do not effectively represent event information due to their entity-centric representations.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Entity-centric knowledge graphs are unable to elegantly represent the event information that appears in news texts.
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    LLM-based DKGR methods are classified into two categories: triple-level methods and path-level methods.

    “In Figure 11, LLM-based DKGR methods are classified into two categories: triple-level methods and path-level methods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    Bi-Link searches for relational prompts according to learned syntactical patterns via BERT and comes up with probabilistic syntax prompts for link predictions, and uses contrastive learning for bidirectional linking between forward prediction and backward prediction to express symmetric relations.

    “Bi-Link [131] searches for relational prompts according to learned syntactical patterns via BERT and comes up with probabilistic syntax prompts for link predictions.Bi-Link also uses contrastive learning for bidirectional linking between forward prediction and backward prediction to express symmetric relations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [131]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    GNN-based methods are under an encoder-decoder framework and are able to take advantage of the connectivity structure to generate the representation of emerging entities and relations.

    “In conclusion, GNN-based methods are under an encoder-decoder framework and are able to take advantage of the connectivity structure to generate the representation of emerging entities and relations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Event knowledge graphs can facilitate downstream event-related applications such as financial quantitative investments and text generation.

    “Furthermore, EKG can facilitate downstream event-related applications such as financial quantitative investments and text generation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Before the proposal of LLMs, DKRL explores the continuous bag-of-words (CBOW) model to maximize the likelihood of predicting the description text of entities.

    “Before the proposal of LLMs, DKRL [128] explores the continuous bag-of-words (CBOW) model to maximize the likelihood of predicting the description text of entities.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [128]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Premisecitation

    RMPI conducts relational message passing over subgraphs for fully-inductive KGC and further proposes new techniques on graph transformation, graph pruning, relation-aware neighborhood attention, and addressing empty subgraphs.

    “Combining GraIL and PathCon, RMPI [121] conducts relational message passing over subgraphs for fully-inductive KGC and further proposes new techniques on graph transformation, graph pruning, relation-aware neighborhood attention, addressing empty subgraphs, etc.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [121]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    Temporal knowledge graphs offer a more comprehensive view of data over time, which is useful for a wide range of applications, including temporal query answering and predictive analysis.

    “Overall, TKGs offer a more comprehensive view of data over time, which is useful for a wide range of applications, including temporal query answering, and predictive analysis.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationnone given

    Early static knowledge graph reasoning approaches are not applicable to other types of knowledge graphs.

    “However, these approaches are not applicable to other types of KGs.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    Based on Meta-KGR, FIRE further performs heterogeneous structure encoding and knowledge-aware search space pruning in the reinforcement learning process, outperforming Meta-KGR.

    “Based on Meta-KGR, FIRE [138] further performs heterogeneous structure encoding and knowledge-aware search space pruning in the reinforcement learning process, outperforming Meta-KGR.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [138]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    A dynamic knowledge graph that is no longer updated will degenerate into a static knowledge graph.

    “And a DKG that is no longer updated will also degenerate into an SKG.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    ADK-KG uses pre-trained entity and relation embeddings and the optimized parameters can be fast adapted for few-shot relations.

    “ADK-KG [141] uses pre-trained entity and relation embeddings and the optimized parameters can be fast adapted for few-shot relations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [141]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Dynamic knowledge graphs cannot be applied in some applications such as historical analysis, trend analysis, and forecasting, due to the loss of historical data.

    “However, DKGs can not be applied in some applications such as historical analysis, trend analysis and forecasting, due to the loss of historical data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    DRUM further attaches the found rules with confidence scores by bidirectional RNNs.

    “DRUM [118] further attaches the found rules with confidence scores by bidirectional RNNs.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [118]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Interpretationcitation

    Compared to CP decomposition, Tucker decomposition has better reasoning performance, but its decomposition efficiency is lower due to the operations involving the core tensor.

    “Compared to CP decomposition, Tucker decomposition has better reasoning performance, but its decomposition efficiency is lower due to the operations involving the core tensor.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    P-INT leverages the paths that can expressively encode the relation of two few-shot entities and calculates the interactions of the paths.

    “P-INT [140] leverages the paths that can expressively encode the relation of two few-shot entities and calculates the interactions of the paths.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [140]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    BERTRL concatenates the paths consisting of constructed triples into textual information and combines it with the pre-trained prior knowledge, forming rule-like reasoning evidence.

    “BERTRL [130] concatenates the paths consisting of constructed triples into textual information and combines it with the pre-trained prior knowledge, forming rule-like reasoning evidence.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [130]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    TAE-ILP considers the valid time intervals of knowledge and uses the Integer Linear Programming technique to restrict the temporal knowledge of shared head entities to non-overlapping time intervals.

    “TAE-ILP [155] considers the valid time intervals of knowledge and uses the Integer Linear Programming technique to restrict the temporal knowledge of shared head entities to non-overlapping time intervals.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [155]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Premisecitation

    GraIL proposes to learn entity-independent relational semantics and aggregates the representation of nodes by GNN, so GraIL can be naturally generalized to unseen nodes.

    “GraIL [114] proposes to learn entity-independent relational semantics and aggregates the representation of nodes by GNN, so GraIL can be naturally generalized to unseen nodes.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [114]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    GEN proposes an inductive learning module to extrapolate knowledge in the support set and then considers interrelationships between unseen entities in the transductive learning module.

    “GEN [139] proposes an inductive learning module to extrapolate knowledge in the support set and then considers interrelationships between unseen entities in the transductive learning module.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [139]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    Yao et al. proposes a data augmentation technique from inter-task view to generate new tasks for few-shot knowledge graph completion, and from intra-task view to enrich the support or query set for an individual task.

    “Yao et al. [145] proposes a data augmentation technique from inter-task view to generate new tasks for few-shot knowledge graph completion, and from intra-task view to enrich the support or query set for an individual task.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [145]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    Both static or dynamic knowledge graphs only record the knowledge graph at a certain time or the latest state, and cannot reflect the evolution process of the relations between entities at different times.

    “Both static or dynamic knowledge graphs only record the knowledge graph at a certain time or the latest state, and cannot reflect the evolution process of the relations between entities at different times.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    TAE incorporates the temporal information of relationships using a temporal matrix to learn relationship representations that contain temporal information.

    “The time-aware embedding (TAE) incorporates the temporal information of relationships using a temporal matrix to learn relationship representations that contain temporal information.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [154]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    LLM-based models like KG-BERT, StAR, and CKBC can also be used in DKGR since they are able to deal with unseen entities via the pre-trained prior knowledge in LLMs.

    “LLM-based models mentioned in Section 4.1.4like KG-BERT, StAR, CKBC can also be used in DKGR since they are able to deal with unseen entities via the pre-trained prior knowledge in LLMs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisenone given

    CP decomposition decomposes high-dimensional tensors into a series of rank tensors, and Tucker decomposition considers the core tensor, which represents the main properties of the original tensor.

    “The former decomposes high-dimensional tensors into a series of rank tensors, and the latter considers the core tensor, which represents the main properties of the original tensor.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    Temporal knowledge graph reasoning includes two parts: temporal knowledge graph completion (explaining the TKG at some past time) and temporal knowledge graph prediction (predicting the state of TKG at a given future time).

    “The temporal knowledge graph reasoning includes two parts as shown in Figure 12: The temporal knowledge graph completion(explaining the TKG at some past time), and the temporal knowledge graph prediction (predicting the state of TKG at a given future time) [146].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [146]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationreasoning

    LLMs enable LLM-based DKGs methods to have language comprehension skills and be able to deal with emerging entities and relations in the semantic space.

    “LLMs enable LLM-based DKGs methods to have language comprehension skills and be able to deal with emerging entities and relations in the semantic space.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim.

    Premisereasoning

    Different from static or dynamic knowledge graphs, the temporal knowledge graph records the valid time of knowledge.

    “Different from them, the temporal knowledge graph records the valid time of knowledge.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Premisecitation

    Lacroix et al. represented the temporal knowledge graph as a four-dimensional tensor and extended ComplEX to temporal knowledge graph reasoning, proposing the CP decomposition method TComplEX.

    “Lacroix et al. [149] represented the temporal knowledge graph as a four-dimensional tensor and extends the ComplEX [92] to the temporal knowledge graph reasoning, proposing the CP decomposition method TComplEX.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [149]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [92]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Premisecitation

    TACT categorizes topology-aware correlations between relations into seven topological patterns, and learns their importance in an entity-independent manner for inductive link prediction.

    “TACT [119] categorizes topology-aware correlations between relations into seven topological patterns, and learns their importance in an entity-independent manner for inductive link prediction.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [119]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    TIMEPLEX considers the periodicity scores and temporal dependency scores of the relations in the reasoning procedure.

    “Based on [150], TIMEPLEX [153] considers the periodicity scores and temporal dependency scores of the relations in the reasoning procedure.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [153]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    Existing dynamic knowledge graph reasoning methods are categorized according to their modeling perspectives into GNN-based methods and LLM-based methods.

    “We categorized the existing methods according to their modeling perspectives: GNN-based methods and LLMbased methods.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Interpretationcitation

    In KEPLER, knowledge embeddings provide factual knowledge for PLMs, while informative text data also benefit knowledge embeddings.

    “In KEPLER, knowledge embeddings provide factual knowledge for PLMs, while informative text data also benefit knowledge embeddings.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [129]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    FSRL proposes to discover facts of new relations with few-shot references, which is more suitable for practical scenarios than one-shot and zero-shot learning.

    “However, FSRL [134] thinks works of one-shot and zeroshot learning limit the generalizability of models and do not fully use the supervisory information, so FSRL proposes to discover facts of new relations with few-shot references which is more suitable for practical scenarios.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [134]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    Methods for temporal knowledge graph reasoning are classified into two categories: completion methods and prediction methods.

    “In this section, we classify the methods for temporal knowledge graph reasoning into two categories: completion methods and prediction methods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationnone given

    The dynamic properties in few-shot learning have not been widely researched.

    “However, the dynamic properties in few-shot learning have not been widely researched.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    LLM-based DKGR methods may face the shortcomings of high GPU memory and the static property of LLMs may not catch up with the dynamic property of DKGs for the rapid update of DKGs.

    “However, LLMbased DKGR methods may face the shortcomings of high GPU memory and the static property of LLMs may not catch up with the dynamic property of DKGs for the rapid update of DKGs.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    GMatching is the first to propose the task of predicting long-tail relations and formulate it as one-shot relational learning.

    “GMatching [132] is the first to propose the task of predicting longtail relations and formulate it as one-shot relational learning.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [132]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Premisecitation

    PathCon leverages relational context and relational paths to directly pass relational messages among edges iteratively to aggregate neighborhood information, and is applicable to inductive settings since nodes temporarily store messages from their neighbor edges.

    “PathCon [120] leverages relational context and relational paths to directly pass relational messages among edges iteratively to aggregate neighborhood information.PathCon is applicable to the inductive settings since nodes temporarily store the messages from their neighbor edges.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [120]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Interpretationreasoning

    Meta-learning for the few-shot setting aims to capture transferable relation-specific meta-information and is suitable and well-performing for dynamic knowledge graphs, since emerging relations usually have few links.

    “Meta-learning for the few-shot setting aims to capture transferable relation-specific meta-information and is suitable and well-performing for dynamic knowledge graphs, since emerging relations usually have few links.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    GNN-based dynamic knowledge graph reasoning methods are categorized into four categories according to four sources of their inductive ability.

    “In Figure 10, we categorize the GNN-based methods into four categories, according to four sources of their inductive ability.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    ROLAND views the node embeddings at different GNN layers as hierarchical node states and then recurrently updates them, easily repurposing any static GNN to dynamic graphs.

    “ROLAND [123] views the node embeddings at different GNN layers as hierarchical node states and then recurrently updates them, easily repurposing any static GNN to dynamic graphs.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [123]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    REFORM points out that plenty of errors could be inevitably incorporated in most existing large-scale KGs and proposes an error mitigation module to study error-aware few-shot KG completion.

    “REFORM [143] points out that plenty of errors could be inevitably incorporated in most existing large-scale KGs and proposes an error mitigation module to study error-aware few-shot KG completion.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [143]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Interpretationcitation

    GMatching learns a matching metric to discover similar triples for target triples, and once trained can be adapted to any new relations without fine-tuning, achieving one-shot learning.

    “GMatching learns a matching metric to discover similar triples for target triples.Once trained, GMatching can be adapted to any new relations without fine-tuning, achieving one-shot learning.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [132]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Premisecitation

    MaKEr and MorsE propose a problem called inductive knowledge graph embedding and train knowledge graph embedding models based on meta-learning on a set of entities that can generalize to unseen entities for either in-KG (link prediction) or out-of-KG tasks (question answering).

    “MaKEr [126] and MorsE [127] propose a problem called inductive knowledge graph embedding.They train knowledge graph embedding models based on metalearning on a set of entities that can generalize to unseen entities for either in-KG(i.e., link prediction) or out-of-KG tasks(i.e., question answering).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [126]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [127]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    SE-GNN studies KGE extrapolation problems from a data-relevant and model-independent view and proposes a GNN-based KGE method modeling the semantic evidence.

    “SE-GNN [124] studies KGE extrapolation problems from a data-relevant and model-independent view and proposes a GNN-based KGE method modeling the semantic evidence.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [124]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    Niu et al. proposes a gated neighbor aggregator to filter the noise neighbors, capturing the most valuable contextual semantics of few-shot relations, and considers complex relations simultaneously.

    “Niu et al. [142] proposes a gated neighbor aggregator to filter the noise neighbors, capturing the most valuable contextual semantics of few-shot relations, and considers complex relations simultaneously.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [142]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    Few-shot DKG reasoning is a relatively new research area and the meta-learning approach fixes the challenges of data limitation, to a certain extent.

    “In conclusion, few-shot DKG reasoning is a relatively new research area and the meta-learning approach fixes the challenges of data limitation, to a certain extent.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Tensor decomposition-based completion methods learn the evolution law of the entire graph.

    “The tensor decomposition-based completion methods learn the evolution law of the entire graph.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisereasoning

    GNN and its variants have been widely used for dynamic knowledge reasoning in dynamic knowledge graphs because GNN can model entities and relations based on connecting structure and has the potential to handle knowledge out of distribution.

    “GNN and its variants have been widely used for dynamic knowledge reasoning in dynamic knowledge graphs (DKGs), since GNN can model entities and relations based on the connecting structure and has the potential to handle knowledge out of distribution.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    Neural-symbolic methods may face challenges related to scalability, computational complexity, implementation complexity, and sensitivity to data quality.

    “However, they may face challenges related to scalability, computational complexity, implementation complexity, and sensitivity to data quality.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    The temporal knowledge graph is represented as a sequence of static snapshots, which can be modeled as a sequence of matrices or high-dimensional tensors.

    “As the temporal knowledge graph is represented as a sequence of static snapshots, which can be modeled as a sequence of matrices or high-dimensional tensors.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    LLM-based dynamic knowledge graph reasoning methods can be categorized into triple-level methods (depending on one single edge) and path-level methods (depending on paths composed of edges).

    “They can be categorized into two groups: depending on one single edge (triple-level) and depending on paths composed of edges (path-level).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    For zero-shot (new-added) relations, ZS-GAN is able to generate text category representations from text descriptions by setting adversarial learning goals.

    “For zero-shot(new-added) relations, ZS-GAN [133] is able to generate text category representations from text descriptions by setting adversarial learning goals.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [133]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Premisecitation

    INDIGO constructs a node-annotated graph, where nodes represent pairs of constants and two nodes are connected only if their pairs share a constant, and the original KG is fully encoded into a GNN in a transparent way.

    “INDIGO [116] constructs a node-annotated graph, where nodes represent pairs of constants and two nodes are connected only if their pairs share a constant, and the original KG is fully encoded into a GNN in a transparent way.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [116]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    The proposal of Large Language Models indicates that general semantic knowledge which widely exists in open source corpus can be encoded into the parameters of LLMs via pre-training and fine-tuning.

    “The proposal of Large Language Models (LLMs) indicates that general semantic knowledge which widely exists in open source corpus can be encoded into the parameters of LLMs via pre-training and fine-tuning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    Temporal knowledge graph completion methods can be divided into tensor decomposition-based completion methods and translation-based completion methods.

    “The temporal knowledge graph completion methods can be divided into two parts: tensor decomposition-based completion methods and translation-based completion methods.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    FAAN formally proposes the notion of dynamic properties in few-shot KG completion for the first time and designs an adaptive attention network to adapt dynamic entity representations in different tasks.

    “FAAN [135] formally proposes the notion of dynamic properties in few-shot KG completion for the first time and designs an adaptive attention network to adapt dynamic entity representations in different tasks.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [135]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Premisecitation

    CoMPILE further considers the directed nature of the extracted subgraph structure to enable a sufficient flow of relation information, and can naturally handle asymmetric and anti-symmetric relations in subgraphs.

    “Following GraIL, CoMPILE [115] further considers the directed nature of the extracted subgraph structure to enable a sufficient flow of relation information.Therefore, CoMPILE can naturally handle asymmetric and anti-symmetric relations in subgraphs.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [115]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    xERTE collects temporal paths from the target entity and propagates attention scores along the paths while continuously expanding the query subgraph.

    “xERTE [170] collects temporal paths from the target entity and propagates attention scores along the paths while continuously expanding the query subgraph.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [170]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Interpretationnone given

    KGs serve as a repository containing both logical and factual knowledge, providing a richer source of information.

    “From the perspective of knowledge-driven LLM reasoning, KGs serve as a repository containing both logical and factual knowledge, providing a richer source of information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    LLMs are the most powerful parameter knowledge form, excelling in generativity and adaptability, handling diverse tasks, but can be opaque in decision-making.

    “LLMs are the most powerful parameter knowledge form, which excels in generativity and adaptability, handling diverse tasks, but can be opaque in decision-making.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    Sequence neural network-based prediction methods consist of snapshot encoders and temporal encoders: snapshot encoders extract representations of entities at different times from the snapshot sequence; temporal encoders integrate the snapshot representations to learn the entity evolution information from them.

    “Sequence neural network-based prediction methods consist of snapshot encoders and temporal encoders: snapshot encoders extract representations of entities at different times from the snapshot sequence; temporal encoders integrate the snapshot representations to learn the entity evolution information from them.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    The temporal Point Process (TPP) is a probabilistic method for predicting future events.

    “The temporal Point Process (TPP) is a probabilistic method for predicting future events.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    In TPP-based prediction methods, the expected existence probability of knowledge at time t is represented as the product of the conditional intensity function and the survival function, i.e., f(t) = S(t)λ(t).

    “In TPP-based prediction methods, the expected existence probability of knowledge at time t is represented as the product of the conditional intensity function and the survival function, i.e., f (t) = S(t)λ(t).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim.

    Premisenone given

    In an L-length temporal walk, the adjacent temporal edges should satisfy the temporal-ordered constraint t1 ≤ t2 ≤ ... ≤ tL, ensuring that the walk contains the temporal dependency information between entities.

    “In an L-length temporal walk (v 1 , v 2 , t 1 ), (v 2 , v 3 , t 2 ), ..., (v L , v L+1 , t L ), the adjacent temporal edges should satisfy the temporal-ordered constraint t 1 ≤ t 2 ≤ ... ≤ t L , ensuring that the walk contains the temporal dependency information between entities.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    KGs significantly contribute to data organization and analysis across disparate sectors.

    “In summation, KGs significantly contribute to data organization and analysis across disparate sectors.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Pattern induction capabilities of LLMs present new opportunities for neural-symbolic reasoning.

    “In terms of knowledge inference, the pattern induction capabilities of LLMs present new opportunities for neural-symbolic reasoning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may state two separate claims as one.

    Interpretationreasoning

    Quality control and maintenance are crucial in knowledge engineering, affecting KG usability in real-world applications because it is hard to ensure completeness and correctness of extracted knowledge.

    “Quality control and maintenance are crucial in knowledge engineering, affecting KG usability in real-world applications because it is hard to ensure the completeness and correctness of extracted knowledge.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    TOKEI designs the hierarchical temporal matrix that is adaptable to different time granularities (e.g., year-month-day or year-quarter-month-week-day).

    “Considering time information in knowledge graphs can be represented at different granularities, TOKEI [159] designs the hierarchical temporal matrix that is adaptable to different time granularities (e.g., year-month-day or yearquarter-month-week-day).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [159]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.

    Interpretationnone given

    As forms of KGs evolve, corresponding techniques still face various challenges and open problems.

    “However, as the forms of KGs have evolving, the corresponding techniques still face various challenges and open problems in the future.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    TLogic considers the temporal properties of multi-hop relation reasoning and proposes the Cyclic Temporal Logical Rule.

    “TLogic [167] considers the temporal properties of multi-hop relation reasoning and proposes the Cyclic Temporal Logical Rule, represented as:”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [167]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    The TPP-based prediction methods treat the occurrences and disappearances of relations between entities as sequences of events, where the event probability depends on the historical evolution characteristics of relevant entities.

    “The TPP-based prediction methods treat the occurrences and disappearances of relations between entities as sequences of events, where the event probability depends on the historical evolution characteristics of relevant entities.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    For effectively learning the evolution of temporal knowledge graphs in a data-driven approach rather than the pre-defined conditional intensity function, neural temporal point processes have become a popular research direction for TPP-based prediction methods.

    “For effectively learning the evolution of temporal knowledge graphs in a data-driven approach rather than the pre-defined conditional intensity function, neural temporal point processes have become a popular research direction for TPP-based prediction methods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    TA-TRANSE takes into account that time sequences at different granularities are of unequal lengths, such as [1989] and [1989, January, 16th], and uses the LSTM to encode the time sequences as the temporal information of knowledge.

    “TA-TRANSE [160] takes into account that time sequences at different granularities are of unequal lengths, such as [1989] and [1989, January, 16th].It uses the LSTM to encode the time sequences as the temporal information of knowledge.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [160]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    The aforementioned temporal knowledge graph completion methods ignore the correlation between temporal information.

    “However, the aforementioned methods ignore the correlation between temporal information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    RE_NET aggregates the representations of entity neighbors in historical time steps, concatenates them with the vector representations of the head entity s and relation r, encodes the evolving information through RNN to obtain the latest representation of the tail entity, which is used to predict the correct entity in the next time step.

    “RE_NET [177] aggregates the representations of entity neighbors in historical time steps, concatenates them with the vector representations of the head entity s and relation r, encodes the evolving information through RNN to obtain the latest representation of the tail entity, which is used to predict the correct entity in the next time step.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [177]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Temporal knowledge graph prediction methods can be further categorized into three types: path-based prediction methods, point process-based prediction methods, and sequence network-based prediction methods.

    “These methods can be further categorized into three types: path-based prediction methods, point process-based prediction methods, and sequence networkbased prediction methods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    LLMs provide new perspectives on addressing quality control and maintenance challenges by leveraging parameterized knowledge learned from vast corpora for KGs' quality control and maintenance in an unsupervised way.

    “The advent of LLMs provides new perspectives on addressing these challenges, which leverages parameterized knowledge of LLMs learned from vast corpora for KGs' quality control and maintenance in an unsupervised way.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    T-GAP designs an interpretable mechanism: starting from the target entity u in the incomplete knowledge (u, r, ?, t), T-GAP iteratively expands the subgraph using attention pruning strategies and updates the representations and attention scores of each entity in the subgraph through a time-aware graph neural network.

    “T-GAP [165] designs an interpretable mechanism: starting from the target entity u in the incomplete knowledge (u, r, ?, t), T-GAP iteratively expands the subgraph using attention pruning strategies and updates the representations and attention scores of each entity in the subgraph through a time-aware graph neural network.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [165]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.

    Interpretationnone given

    By complementing each other, both KGs and LLMs have the potential to achieve superior performance and broader application scenarios.

    “By complementing each other, both entities have the potential to achieve superior performance and broader application scenarios.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    Know-evolve treats transient knowledge (u, r, v, t) as a probability event and uses a loss function based on a multivariate Rayleigh point process to model the event probability.

    “It treats transient knowledge (u, r, v, t) as a probability event.It uses a loss function based on a multivariate Rayleigh point process to model the event probability.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [171]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    CEN considers the length diversity and temporal variability of temporal patterns, encodes multiple lengths using a relation-aware graph convolutional network to model the length diversity, and trains the model online to address temporal variability.

    “CEN [179] considers the length diversity and temporal variability of temporal patterns.It encodes multiple lengths using a relation-aware graph convolutional network to model the length diversity and trains the model online to address temporal variability.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [179]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Premisecitation

    RE-GCN uses a relation-aware graph convolutional network (RGCN) to encode snapshot features in the knowledge graph and then learns the evolution patterns of features through a recurrent neural network.

    “To better learn the topological features of knowledge graphs at each stage, RE-GCN [178] uses a relation-aware graph convolutional network (RGCN) to encode snapshot features in the knowledge graph and then learns the evolution patterns of features through a recurrent neural network.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [178]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim.

    Interpretationnone given

    Recent advancements in neural or symbolic reasoning have highlighted the potential of integrating neural networks' data-driven learning with symbolic reasoning's structured logic to enhance reasoning on various KGs.

    “Recent advancements in neural or symbolic reasoning have highlighted the potential of integrating neural networks' data-driven learning with symbolic reasoning's structured logic, to enhance reasoning on various KGs.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    M2DNE learns entity representations by modeling evolutionary trends at both macro and micro levels.

    “M 2 DNE [174] learns entity representations by modeling evolutionary trends at both macro and micro levels.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [174]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. It may be too vague to check against evidence.

    Interpretationreasoning

    There is significant potential for integration between KGs and LLMs.

    “In summary, despite the distinct characteristics and functionalities of KGs and LLMs, there is significant potential for integration between the two, as illustrated in Figure 15.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    In finance, knowledge extraction, knowledge reasoning, and intelligent QA systems combining KGs with LLMs play a vital role.

    “Specifically, knowledge extraction, knowledge reasoning, and intelligent QA systems that combine KGs with LLMs play a vital role in this domain.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    xERTE designs a temporal relation graph attention mechanism to guide expansion in the direction that benefits query prediction and the expanded subgraph can be viewed as an explanation for predicting the entity.

    “xERTE designs a temporal relation graph attention mechanism to guide expansion in the direction that benefits query prediction and the expanded subgraph can be viewed as an explanation for predicting the entity.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [170]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    DyRep uses neural networks to model the conditional intensity function λ(u,v)k(t), which calculates the probability of the existence of associated knowledge between entities (u,v) at time t (k denotes the relation type).

    “DyRep uses neural networks to model the conditional intensity function λ (u,v) k (t), which calculates the probability of the existence of associated knowledge between entities (u,v) at time t (k denotes the relation type).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [173]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationreasoning

    LLMs can offer better extendability and expressibility to different kinds of downstream tasks and thus have a broader range of application scenarios.

    “By contrast, LLMs can offer better extendability and expressibility to different kinds of downstream tasks and thus have a broader range of application scenarios.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    TRESCAL extends the static knowledge graph reasoning method RESCAL to temporal knowledge graph reasoning and considers that the information of relations evolves over time, with the relation-temporal matrix W r,t trained at different temporal information.

    “TRESCAL [156] extends the static knowledge graph reasoning method RESCAL [90] to temporal knowledge graph reasoning.TRESCAL considers that the information of relations evolves over time, and the temporal information depends on the existence of the relationship, i.e., the relation-temporal matrix W r,t is trained at different temporal information.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [156]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [90]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. It may state two separate claims as one.

    Interpretationreasoning

    The finance sector benefits from KGs by streamlining information extraction, enabling sophisticated knowledge reasoning, and enhancing user interaction through integration with LLMs.

    “In conclusion, the finance sector benefits immensely from knowledge graphs by streamlining information extraction, enabling sophisticated knowledge reasoning, and enhancing user interaction through the integration of large language models.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Premisecitation

    DANE, DACHA, and HIP also design structure-temporal self-attention mechanisms, which are applied to the entity and relation prediction tasks.

    “Moreover, DANE [184], DACHA [185], HIP [186] also design structuretemporal self-attention mechanisms, which are applied to the entity and relation prediction tasks.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [184]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [185]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [186]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    The path-based prediction methods of temporal knowledge graphs believe that the temporal walks in the graph reflect the evolution rules of knowledge.

    “The path-based prediction methods of temporal knowledge graphs believe that the temporal walks [166] in the graph reflect the evolution rules of knowledge.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [166]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    LLMs can offer unsupervised quality control and maintenance for KGs, ensuring quality and accuracy of knowledge.

    “Additionally, LLMs can offer unsupervised quality control and maintenance for KGs, ensuring the quality and accuracy of knowledge.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    Recurrent neural networks suffer from the problem of information forgetting when encoding long-distance temporal information and perform poorly in multi-step prediction tasks.

    “However, recurrent neural networks suffer from the problem of information forgetting when encoding long-distance temporal information and perform poorly in multi-step prediction tasks [181].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [181]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim.

    Interpretationreasoning

    KGs and LLMs represent contrasting paradigms in knowledge representation.

    “Knowledge Graphs and Large Language Models represent contrasting paradigms in knowledge representation.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    KGs are the most representative symbolic knowledge form, providing interpretability through structured information, yet may lack flexibility.

    “KGs are the most representative symbolic knowledge form, which provides interpretability through structured information, yet may lack flexibility.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    DySAT proposes a structural-temporal attention mechanism: the structure self-attention mechanism extracts features from the entity neighborhoods in each snapshot and aggregates them with weights, while the temporal self-attention mechanism captures the evolution law by flexibly weighting the historical entity representations of multiple time steps.

    “Furthermore, DySAT [181] proposes a structural-temporal attention mechanism.The structure self-attention mechanism extracts features from the entity neighborhoods in each snapshot and aggregates them with weights, while the temporal self-attention mechanism captures the evolution law by flexibly weighting the historical entity representations of multiple time steps.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [181]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    TeMP uses R-GCN as the snapshot encoder to extract the historical vector sequence of the target entity s, x s,t-τ , . . ., x s,t-1 , x s,t ; based on the self-attention mechanism, the temporal encoder aggregates the historical vector sequence with weights to obtain the vector representation z s,t of entity s at time t.

    “TeMP [183] uses R-GCN [99] as the snapshot encoder to extract the historical vector sequence of the target entity s, x s,t-τ , . . ., x s,t-1 , x s,t ; based on the self-attention mechanism, the temporal encoder aggregates the historical vector sequence with weights to obtain the vector representation z s,t of entity s at time t.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [183]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [99]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Temporal knowledge graph prediction methods aim to learn the evolution patterns of TKG historical information to predict future states.

    “Temporal knowledge graph prediction methods aim to learn the evolution patterns of TKG historical information to predict future states.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Based on the types of temporal encoders, sequence neural network-based prediction methods can be divided into RNN-based temporal encoding methods and self-attention-based temporal encoding methods.

    “Based on the types of temporal encoders, these methods can be divided into RNN-based temporal encoding methods and self-attention-based temporal encoding methods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    The interplay between KGs and advanced technologies like LLMs amplifies their application spectrum, propelling innovation and efficiency.

    “The interplay between KGs and advanced technologies like LLMs further amplifies their application spectrum, propelling innovation and efficiency.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    TIME2BOX and RTGE both design temporal smoothing mechanisms to constrain the change in adjacent time vectors.

    “TIME2BOX [162] and RTGE [163] both design temporal smoothing mechanisms to constrain the change in adjacent time vectors.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [162]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [163]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    The self-attention mechanism can effectively alleviate the forgetting problem in encoding long-distance time series.

    “The selfattention mechanism can effectively alleviate the forgetting problem in encoding long-distance time series.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    ATiSE considers uncertainty in the time functions and adds random noise to the representation of entities and relations to simulate random interference factors, and conducts reasoning by learning the parameters of a multi-dimensional Gaussian distribution composed of linear trend, periodic trend, and noise.

    “Furthermore, ATiSE [8] considers uncertainty in the time functions and adds random noise to the representation of entities and relations to simulate random interference factors.It conducts reasoning by learning the parameters of a multi-dimensional Gaussian distribution composed of three factors: linear trend, periodic trend, and noise.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [8]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    TLogic learns the confidence of cyclic temporal logical rules through statistical frequency and selects high-confidence paths as reasoning rules.

    “TLogic learns the confidence of cyclic temporal logical rules through statistical frequency and selects high-confidence paths as reasoning rules, such as:”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [167]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Diachronic embedding regards representations of entity and relation as a series of time functions, which use parameterized Fourier functions to encode the entity and relation representations at time spots.

    “Diachronic embedding [164] regards representations of entity and relation as a series of time functions, which use parameterized Fourier functions to encode the entity and relation representations at time spots.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [164]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    The completion methods implicitly represented the time information, and model the evolution of entities or relations with time as functions, which reflects the evolution trend of each entity at each moment.

    “The completion methods implicitly represented the time information, and model the evolution of entities or relations with time as functions, which reflects the evolution trend of each entity at each moment.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    Most knowledge extraction tasks are labeling tasks, while generative LLMs are good at generation tasks.

    “This is because most of the knowledge extraction tasks are labeling tasks, while generative LLMs are good at generation tasks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    TTransE learns the time representation based on the static knowledge reasoning method TransE, and combines the representation of entities, relations, and time information to calculate the confidence of the temporal knowledge.

    “TTransE [156] learns the time representation based on the static knowledge reasoning method TransE, and combines the representation of entities, relations, and time information to calculate the confidence of the temporal knowledge.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [156]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim.

    Interpretationreasoning

    This fusion aims to overcome limitations of exclusively neural or symbolic approaches, particularly in representing dynamic and time-variant nature of real-world knowledge in DKGs and TKGs.

    “This fusion aims to overcome limitations posed by exclusively neural or symbolic approaches, particularly in representing the dynamic and time-variant nature of real-world knowledge in DKGs and TKGs.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim.

    Premisereasoning

    Due to the graph nature of temporal knowledge graphs, the sampled time-constrained random walk paths in temporal knowledge graphs can be viewed as multi-hop relations between entities to represent reasoning rules.

    “Due to the graph nature of temporal knowledge graphs, the sampled timeconstrained random walk paths in temporal knowledge graphs can be viewed as multi-hop relations between entities to represent reasoning rules.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Premisecitation

    HiSMatch uses relation-aware graph neural networks and recurrent neural networks to distinguish between graph sequences relevant to queries and those relevant to candidate entities and proposes a matching framework for temporal reasoning.

    “HiSMatch [180] uses relation-aware graph neural networks and recurrent neural networks to distinguish between graph sequences relevant to queries and those relevant to candidate entities and proposes a matching framework for temporal reasoning.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [180]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    The emergence of LLMs presents an opportunity to uncover underlying patterns in knowledge, aiding in reasoning tasks.

    “Furthermore, the emergence of LLMs presents an opportunity to uncover underlying patterns in knowledge, aiding in reasoning tasks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    The Cyclic Temporal Logical Rule strictly follows the temporal-ordered constraint to collect temporal walks and represents the evolution feature of multi-hop relation reasoning.

    “The Cyclic Temporal Logical Rule (CTL) strictly follows the temporal-ordered constraint to collect temporal walks and represents the evolution feature of multihop relation reasoning.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [167]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    HyTE designs the time hyperplane to reflect the entity and relation information at a specific time.

    “HyTE [157] designs the time hyperplane to reflect the entity and relation information at a specific time.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [157]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    Utilizing text processing capabilities of LLMs, KGs can achieve more efficient unsupervised knowledge extraction during construction, enhancing automated building and editing capabilities.

    “Utilizing the text processing capabilities of LLMs, KGs can achieve more efficient unsupervised knowledge extraction during their construction phase, thereby enhancing their automated building and editing capabilities.”
    Quote in the paperNot a substantial claim
207 of 207
  • The paper relies on this without support.

    Events are dynamic and temporal in nature, and relations between events and facts are often temporal or causal.

    “Noteworthy, events are dynamic and tem- poral in nature and relations between events and facts are often temporal or causal ones.”
  • The paper relies on this without support.

    Existing survey papers each only focus on technologies related to a single type of knowledge graph and thus do not study the difference and connection between the types of their target knowledge graphs.

    “Although there are several survey papers focusing on knowledge graphs and the relevant techniques of knowledge extraction and KGR, they each only focus on technologies related to a single type of KGs and thus do not study the difference and connection between the types of their target KGs.”
  • The paper relies on this without support.

    Entity-centric knowledge graphs are unable to elegantly represent the event information that appears in news texts.

    “Nevertheless, entity-centric KGs are still unable to elegantly represent the event information that appears in news texts.”
  • The paper relies on this without support.

    Traditional knowledge graph reasoning methods are under a closed-world assumption, so these models are designed for a fixed set of entities and relations and are unable to consider unseen components.

    “Traditional knowledge graph reasoning methods are under a closed-world assumption, so these models are designed for a fixed set of entities and relations and are unable to consider unseen components.”
  • The paper relies on this without support.

    New entities and relations emerge continuously in the ever-changing real world due to improvements to knowledge extraction techniques and refinement/enrichment of information.

    “However, new entities and relations emerge continuously in the ever-changing real world due to several reasons, such as improvements to the knowledge extraction techniques and refinement/enrichment of information.”
  • The paper relies on this without support.

    With the changing of dynamic knowledge graphs, there is a certain probability that unseen entities and relations are long-tail.

    “With the changing of DKGs, there is a certain probability that unseen entities and relations are long-tail.”
  • The paper relies on this without support.

    The representations of unseen relations and entities cannot be sufficiently trained given limited training instances in the few-shot setting.

    “Therefore, the representations of unseen relations and entities cannot be sufficiently trained given limited training instances (fewshot setting).”
  • The paper relies on this without support.

    Subgraphs consisting of the local neighborhood of a particular triplet in dynamic knowledge graphs contain the logical evidence needed to deduce the relation between the target nodes.

    “Subgraphs consisting of the local neighborhood of a particular triplet in DKGs have been proven to contain the logical evidence needed to deduce the relation between the target nodes.”
  • The paper relies on this without support.

    Most existing knowledge extraction methods are supervised models needing a large amount of labeled data.

    “Most of the existing knowledge extraction methods are supervised models needing a large amount of labeled data.”
9 of 9

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • The section guide assigns the definitions to Section 1 instead of Section 2

    Minor

    The article guide says Section 1 introduces the evolution, definitions, and notations, but Section 2 says it provides the notations and four definitions.

  • The authors attributed to reference [46] do not match its entry

    Minor

    The main text attributes the subsequence-kernel approach in [46] to Tazvan et al., whereas reference [46] lists Bunescu and Mooney.

  • The authors attributed to TRE reference [50] do not match its entry

    Minor

    The text attributes TRE [50] to Wu et al., while reference [50] lists Alt, Marc, and Leonhard.

  • The descriptions of event-extraction references [71] and [72] are reversed

    Minor

    The text assigns an RNN to [71] and CNNs to [72]. Their reference titles identify [71] as a convolutional-network paper and [72] as a recurrent-network paper.

  • Table 2 gives different references for BERT and ELMo

    Minor

    The table labels BERT [85] and ELMo [86], while the main text consistently identifies them as BERT [37] and ELMo [36].

  • The cited reference for GHNN describes a different task

    Minor

    The text presents [172] as a Graph Hawkes Neural Network for future prediction, but the entry for [172] is titled as a graph-network paper on fake-news detection.

  • Table 2 gives different references for the same static embeddings

    Minor

    Table 2 cites [39], [40], and [84] for word2vec, GloVe, and fastText, respectively; the main text identifies them as [34], [33], and [38].

7 of 7

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 167

  1. T. Steiner, R. Verborgh, R. Troncy, J. Gabarro, and R. Van de Walle, "Adding realtime coverage to the google knowledge graph," in Proc. of ISWC, 2012.
  2. S. Ji, S. Pan, E. Cambria, P. Marttinen, and P. S. Yu, "A survey on knowledge graphs: Representation, acquisition and applica- tions," ArXiv preprint, 2020.
  3. F. Mahdisoltani, J. Biega, and F. M. Suchanek, "YAGO3: A knowl- edge base from multilingual wikipedias," in Proc. of CIDR, 2015.
  4. M. Rospocher, M. Van Erp, P. Vossen, A. Fokkens, I. Aldabe, G. Rigau, A. Soroa, T. Ploeger, and T. Bogaard, "Building event- centric knowledge graphs from news," Journal of Web Semantics, 2016.
  5. J. Li, A. Sun, J. Han, and C. Li, "A survey on deep learning for named entity recognition," IEEE Transactions on Knowledge and Data Engineering, 2020.
  6. W. W. Denham, "The detection of patterns in alyawara nonverbal behavior," Ph.D. dissertation, 1973.
  7. S. Gottschalk and E. Demidova, "Eventkg: A multilingual event- centric temporal knowledge graph," in The Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3-7, 2018, Proceedings 15, 2018.
  8. X. Ding, Z. Li, T. Liu, and K. Liao, "Elg: an event logic graph," ArXiv preprint, 2019.
  9. A. Akbik, D. Blythe, and R. Vollgraf, "Contextual string embed- dings for sequence labeling," in Proc. of COLING, 2018.
  10. M. E. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. Zettlemoyer, "Deep contextualized word representations," in Proc. of NAACL, 2018.
  11. J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, "BERT: Pre- training of deep bidirectional transformers for language under- standing," in Proc. of NAACL, 2019.
  12. P. Bojanowski, E. Grave, A. Joulin, and T. Mikolov, "Enriching word vectors with subword information," Transactions of the Association for Computational Linguistics, 2017.
  13. P.-H. Li, R.-P. Dong, Y.-S. Wang, J.-C. Chou, and W.-Y. Ma, "Leveraging linguistic structures for named entity recognition with bidirectional recursive neural networks," in Proc. of EMNLP, 2017.
  14. M. Lewis, Y. Liu, N. Goyal, M. Ghazvininejad, A. Mohamed, O. Levy, V. Stoyanov, and L. Zettlemoyer, "BART: Denoising sequence-to-sequence pre-training for natural language genera- tion, translation, and comprehension," in Proc. of ACL, 2020.
  15. B. Athiwaratkun, C. Nogueira dos Santos, J. Krone, and B. Xiang, "Augmented natural language for generative sequence labeling," in Proc. of EMNLP, 2020.
  16. G. Paolini, B. Athiwaratkun, J. Krone, J. Ma, A. Achille, R. Anub- hai, C. N. dos Santos, B. Xiang, and S. Soatto, "Structured prediction as translation between augmented natural languages," in Proc. of ICLR, 2021.
  17. B. Rink and S. Harabagiu, "UTD: Classifying semantic relations by combining lexical and semantic resources," in Proc. of SemEval, 2010.
  18. R. C. Bunescu and R. J. Mooney, "Subsequence kernels for rela- tion extraction," in Proc. of NeurIPS, 2005.
  19. D. Zeng, K. Liu, S. Lai, G. Zhou, and J. Zhao, "Relation classifica- tion via convolutional deep neural network," in Proc. of COLING, 2014.
  20. D. Zeng, K. Liu, Y. Chen, and J. Zhao, "Distant supervision for relation extraction via piecewise convolutional neural networks," in Proc. of EMNLP, 2015.
  21. S. Wu and Y. He, "Enriching pre-trained language model with entity information for relation classification," in Proc. of CIKM, 2019.
  22. L. Baldini Soares, N. FitzGerald, J. Ling, and T. Kwiatkowski, "Matching the blanks: Distributional similarity for relation learn- ing," in Proc. of ACL, 2019.
  23. P.-L. Huguet Cabot and R. Navigli, "REBEL: Relation extraction by end-to-end language generation," in Proc. of EMNLP Findings, 2021.
  24. X. Zeng, S. He, D. Zeng, K. Liu, S. Liu, and J. Zhao, "Learning the extraction order of multiple relational facts in a sentence with reinforcement learning," in Proc. of EMNLP, 2019.
  25. M. Miwa and M. Bansal, "End-to-end relation extraction using LSTMs on sequences and tree structures," in Proc. of ACL, 2016.
  26. A. Katiyar and C. Cardie, "Going out on a limb: Joint extraction of entity mentions and relations without dependency trees," in Proc. of ACL, 2017.
  27. B. Yu, Z. Zhang, X. Shu, Y. Wang, T. Liu, B. Wang, and S. Li, "Joint extraction of entities and relations based on a novel decomposi- tion strategy," in Proc. of ECAI, 2020.
  28. Z. Wei, J. Su, Y. Wang, Y. Tian, and Y. Chang, "A novel cascade binary tagging framework for relational triple extraction," in Proc. of ACL, 2020.
  29. E. Markus and U. Adrian, "Span-based joint entity and relation extraction withtransformer pre-training," in Proc. of ECAI, 2020.
  30. D. Sui, X. Zeng, Y. Chen, K. Liu, and J. Zhao, "Joint entity and re- lation extraction with set prediction networks," IEEE Transactions on Neural Networks and Learning Systems, 2023.
  31. H. Ye, N. Zhang, S. Deng, M. Chen, C. Tan, F. Huang, and H. Chen, "Contrastive triple extraction with generative trans- former," in Proc. of AAAI, 2021.
  32. K.-H. Huang, S. Tang, and N. Peng, "Document-level entity- based extraction as template generation," in Proc. of EMNLP, 2021.
  33. O. Etzioni, M. J. Cafarella, D. Downey, S. Kok, A. Popescu, T. Shaked, S. Soderland, D. S. Weld, and A. Yates, "Web-scale information extraction in knowitall: (preliminary results)," in Proc. of WWW, 2004.
  34. Mausam, M. Schmitz, S. Soderland, R. Bart, and O. Etzioni, "Open language learning for information extraction," in Proc. of EMNLP, 2012.
  35. X. Dong, E. Gabrilovich, G. Heitz, W. Horn, N. Lao, K. Murphy, T. Strohmann, S. Sun, and W. Zhang, "Knowledge vault: a web- scale approach to probabilistic knowledge fusion," in Proc. of KDD, 2014.
  36. A. Carlson, J. Betteridge, B. Kisiel, B. Settles, E. R. H. Jr., and T. M. Mitchell, "Toward an architecture for never-ending language learning," in Proc. of AAAI, 2010.
  37. T. M. Mitchell, W. W. Cohen, E. R. H. Jr., P. P. Talukdar, J. Bet- teridge, A. Carlson, B. D. Mishra, M. Gardner, B. Kisiel, J. Krish- namurthy, N. Lao, K. Mazaitis, T. Mohamed, N. Nakashole, E. A. Platanios, A. Ritter, M. Samadi, B. Settles, R. C. Wang, D. Wijaya, A. Gupta, X. Chen, A. Saparov, M. Greaves, and J. Welling, "Never-ending learning," in Proc. of AAAI, 2015.
  38. J. Pustejovsky, J. M. Castano, R. Ingria, R. Sauri, R. J. Gaizauskas, A. Setzer, G. Katz, and D. R. Radev, "Timeml: Robust specification of event and temporal expressions in text." New directions in question answering, vol. 3, pp. 28-34, 2003.
  39. N. Chambers, "Event schema induction with a probabilistic entity-driven model," in Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013, pp. 1797- 1807.
  40. Q. Ning, B. Zhou, Z. Feng, H. Peng, and D. Roth, "Cogcomptime: A tool for understanding time in natural language," in Proceed- ings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 2018, pp. 72-77.
  41. S. Vashishtha, A. Poliak, Y. K. Lal, B. Van Durme, and A. S. White, "Temporal reasoning in natural language inference," in Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, pp. 4070-4078.
  42. T. H. Nguyen and R. Grishman, "Modeling skip-grams for event detection with convolutional neural networks," in Proc. of EMNLP, 2016.
  43. R. Ghaeini, X. Fern, L. Huang, and P. Tadepalli, "Event nugget detection with forward-backward recurrent neural networks," in Proc. of ACL, 2016.
  44. T. H. Nguyen and R. Grishman, "Graph convolutional networks with argument-aware pooling for event detection," in Proc. of AAAI, 2018.
  45. L. Du, X. Ding, K. Xiong, T. Liu, and B. Qin, "ExCAR: Event graph knowledge enhanced explainable causal reasoning," in Proc. of ACL, 2021.
  46. S. Yang, D. Feng, L. Qiao, Z. Kan, and D. Li, "Exploring pre- trained language models for event extraction and generation," in Proc. of ACL, 2019.
  47. Z. Tang, G. Hahn-Powell, and M. Surdeanu, "Exploring inter- pretability in event extraction: Multitask learning of a neural event classifier and an explanation decoder," in Proc. of ACL, 2020.
  48. M. Chen, Y. Cao, K. Deng, M. Li, K. Wang, J. Shao, and Y. Zhang, "ERGO: Event relational graph transformer for document-level event causality identification," in Proc. of COLING, 2022.
  49. H. Li, T. Mo, H. Fan, J. Wang, J. Wang, F. Zhang, and W. Li, "KiPT: Knowledge-injected prompt tuning for event detection," in Proc. of COLING, 2022.
  50. L. Du, X. Ding, Y. Zhang, T. Liu, and B. Qin, "A graph enhanced BERT model for event prediction," in Proc. of ACL Findings, 2022.
  51. Y. Zhou, X. Geng, T. Shen, G. Long, and D. Jiang, "Eventbert: A pre-trained model for event correlation reasoning," in Proceedings of the ACM Web Conference 2022, 2022.
  52. S. Fincke, S. Agarwal, S. Miller, and E. Boschee, "Language model priming for cross-lingual event extraction," in Proc. of AAAI, 2022.
  53. R. Han, X. Ren, and N. Peng, "ECONET: Effective continual pretraining of language models for event temporal reasoning," in Proc. of EMNLP, 2021.
  54. X. Ma and E. Hovy, "End-to-end sequence labeling via bi- directional LSTM-CNNs-CRF," in Proc. of ACL, 2016.
  55. C. Wang, K. Cho, and D. Kiela, "Code-switched named entity recognition with embedding attention," in Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching, 2018.
  56. X. Li, J. Feng, Y. Meng, Q. Han, F. Wu, and J. Li, "A unified MRC framework for named entity recognition," in Proc. of ACL, 2020.
  57. C. Xia, C. Zhang, T. Yang, Y. Li, N. Du, X. Wu, W. Fan, F. Ma, and P. Yu, "Multi-grained named entity recognition," in Proc. of ACL, 2019.
  58. C. Wang, X. Liu, Z. Chen, H. Hong, J. Tang, and D. Song, "Deep- Struct: Pretraining of language models for structure prediction," in Proc. of ACL Findings, 2022.
  59. H. Yan, T. Gui, J. Dai, Q. Guo, Z. Zhang, and X. Qiu, "A unified generative framework for various NER subtasks," in Proc. of ACL, 2021.
  60. Y. Chen, S. Liu, S. He, K. Liu, and J. Zhao, "Event extraction via bidirectional long short-term memory tensor neural networks," in Proc. of CCL, 2016.
  61. M. Nickel, V. Tresp, and H.-P. Kriegel, "A iee-way model for collective learning on multi-relational data." in ICML, 2011.
  62. B. Yang, W. Yih, X. He, J. Gao, and L. Deng, "Embedding entities and relations for learning and inference in knowledge bases," in Proc. of ICLR, 2015.
  63. T. Trouillon, J. Welbl, S. Riedel, É. Gaussier, and G. Bouchard, "Complex embeddings for simple link prediction," in Proc. of ICML, 2016.
  64. S. M. Kazemi and D. Poole, "Simple embedding for link predic- tion in knowledge graphs," in Proc. of NeurIPS, 2018.
  65. A. Bordes, N. Usunier, A. García-Durán, J. Weston, and O. Yakhnenko, "Translating embeddings for modeling multi- relational data," in Proc. of NeurIPS, 2013.
  66. Z. Wang, J. Zhang, J. Feng, and Z. Chen, "Knowledge graph embedding by translating on hyperplanes," in Proc. of AAAI, 2014.
  67. Y. Lin, Z. Liu, M. Sun, Y. Liu, and X. Zhu, "Learning entity and relation embeddings for knowledge graph completion," in Proc. of AAAI, 2015.
  68. Z. Sun, Z. Deng, J. Nie, and J. Tang, "Rotate: Knowledge graph embedding by relational rotation in complex space," in Proc. of ICLR, 2019.
  69. T. N. Kipf and M. Welling, "Semi-supervised classification with graph convolutional networks," in Proc. of ICLR, 2017.
  70. M. Schlichtkrull, T. N. Kipf, P. Bloem, R. v. d. Berg, I. Titov, and M. Welling, "Modeling relational data with graph convolutional networks," in European semantic web conference, 2018.
  71. S. Vashishth, S. Sanyal, V. Nitin, and P. P. Talukdar, "Composition- based multi-relational graph convolutional networks," in Proc. of ICLR, 2020.
  72. W. Liu, P. Zhou, Z. Zhao, Z. Wang, Q. Ju, H. Deng, and P. Wang, "K-BERT: enabling language representation with knowledge graph," in Proc. of AAAI, 2020.
  73. L. Yao, C. Mao, and Y. Luo, "Kg-bert: Bert for knowledge graph completion," ArXiv preprint, 2019.
  74. B. Kim, T. Hong, Y. Ko, and J. Seo, "Multi-task learning for knowl- edge graph completion with pre-trained language models," in Proc. of COLING, 2020.
  75. B. Wang, T. Shen, G. Long, T. Zhou, Y. Wang, and Y. Chang, "Structure-augmented text representation learning for efficient knowledge graph completion," in Proc. of WWW, 2021.
  76. J. Ju, D. Yang, and J. Liu, "Commonsense knowledge base com- pletion with relational graph attention network and pre-trained language model," in Proc. of CIKM, 2022.
  77. L. Wang, W. Zhao, Z. Wei, and J. Liu, "SimKGC: Simple con- trastive knowledge graph completion with pre-trained language models," in Proc. of ACL, 2022.
  78. Z. Zhang, X. Han, Z. Liu, X. Jiang, M. Sun, and Q. Liu, "ERNIE: Enhanced language representation with informative entities," in Proc. of ACL, 2019.
  79. S. Guo, Q. Wang, L. Wang, B. Wang, and L. Guo, "Jointly embed- ding knowledge graphs and logical rules," in Proc. of EMNLP, 2016.
  80. --, "Knowledge graph embedding with iterative guidance from soft rules," in Proc. of AAAI, 2018.
  81. Q. Wang, J. Liu, Y. Luo, B. Wang, and C.-Y. Lin, "Knowledge base completion via coupled path ranking," in Proc. of ACL, 2016.
  82. R. Das, S. Dhuliawala, M. Zaheer, L. Vilnis, I. Durugkar, A. Kr- ishnamurthy, A. Smola, and A. McCallum, "Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning," in Proc. of ICLR, 2018.
  83. K. Teru, E. Denis, and W. Hamilton, "Inductive relation predic- tion by subgraph reasoning," in Proc. of ICML, 2020.
  84. S. Mai, S. Zheng, Y. Yang, and H. Hu, "Communicative message passing for inductive relation reasoning," in Proc. of AAAI, 2021.
  85. S. Liu, B. C. Grau, I. Horrocks, and E. V. Kostylev, "INDIGO: gnn-based inductive knowledge graph completion using pair- wise encoding," in Proc. of NeurIPS, 2021.
  86. F. Yang, Z. Yang, and W. W. Cohen, "Differentiable learning of logical rules for knowledge base reasoning," in Proc. of NeurIPS, 2017.
  87. A. Sadeghian, M. Armandpour, P. Ding, and D. Z. Wang, "DRUM: end-to-end differentiable rule mining on knowledge graphs," in Proc. of NeurIPS, 2019.
  88. J. Chen, H. He, F. Wu, and J. Wang, "Topology-aware correlations between relations for inductive link prediction in knowledge graphs," in Proc. of AAAI, 2021.
  89. H. Wang, H. Ren, and J. Leskovec, "Relational message passing for knowledge graph completion," in Proc. of KDD, 2021.
  90. Y. Geng, J. Chen, W. Zhang, J. Z. Pan, M. Chen, H. Chen, and S. Jiang, "Relational message passing for fully inductive knowledge graph completion," ArXiv preprint, 2022.
  91. P. Wang, J. Han, C. Li, and R. Pan, "Logic attention based neighborhood aggregation for inductive knowledge graph em- bedding," in Proc. of AAAI, 2019.
  92. J. You, T. Du, and J. Leskovec, "ROLAND: graph learning frame- work for dynamic graphs," in Proc. of KDD, 2022.
  93. R. Li, Y. Cao, Q. Zhu, G. Bi, F. Fang, Y. Liu, and Q. Li, "How does knowledge graph embedding extrapolate to unseen data: A semantic evidence view," in Proc. of AAAI, 2022.
  94. Y. Zhang, W. Wang, W. Chen, J. Xu, A. Liu, and L. Zhao, "Meta-learning based hyper-relation feature modeling for out- of-knowledge-base embedding," in Proc. of CIKM, 2021.
  95. M. Chen, W. Zhang, Z. Yao, X. Chen, M. Ding, F. Huang, and H. Chen, "Meta-learning based knowledge extrapolation for knowledge graphs in the federated setting," ArXiv preprint, 2022.
  96. M. Chen, W. Zhang, Y. Zhu, H. Zhou, Z. Yuan, C. Xu, and H. Chen, "Meta-knowledge transfer for inductive knowledge graph embedding," in Proc. of SIGIR, 2022.
  97. R. Xie, Z. Liu, J. Jia, H. Luan, and M. Sun, "Representation learning of knowledge graphs with entity descriptions," in Proc. of AAAI, 2016.
  98. X. Wang, T. Gao, Z. Zhu, Z. Zhang, Z. Liu, J. Li, and J. Tang, "KEPLER: A unified model for knowledge embedding and pre- trained language representation," Transactions of the Association for Computational Linguistics, 2021.
  99. H. Zha, Z. Chen, and X. Yan, "Inductive relation prediction by BERT," in Proc. of AAAI, 2022.
  100. B. Peng, S. Liang, and M. Islam, "Bi-link: Bridging inductive link predictions from text via contrastive learning of transformers and prompts," ArXiv preprint, 2022.
  101. W. Xiong, M. Yu, S. Chang, X. Guo, and W. Y. Wang, "One-shot relational learning for knowledge graphs," in Proc. of EMNLP, 2018.
  102. P. Qin, X. Wang, W. Chen, C. Zhang, W. Xu, and W. Y. Wang, "Generative adversarial zero-shot relational learning for knowl- edge graphs," in Proc. of AAAI, 2020.
  103. C. Zhang, H. Yao, C. Huang, M. Jiang, Z. Li, and N. V. Chawla, "Few-shot knowledge graph completion," in Proc. of AAAI, 2020.
  104. J. Sheng, S. Guo, Z. Chen, J. Yue, L. Wang, T. Liu, and H. Xu, "Adaptive Attentional Network for Few-Shot Knowledge Graph Completion," in Proc. of EMNLP, 2020.
  105. M. Chen, W. Zhang, W. Zhang, Q. Chen, and H. Chen, "Meta relational learning for few-shot link prediction in knowledge graphs," in Proc. of EMNLP, 2019.
  106. X. Lv, Y. Gu, X. Han, L. Hou, J. Li, and Z. Liu, "Adapting meta knowledge graph information for multi-hop reasoning over few- shot relations," in Proc. of EMNLP, 2019.
  107. C. Zhang, L. Yu, M. Saebi, M. Jiang, and N. Chawla, "Few-shot multi-hop relation reasoning over knowledge bases," in Proc. of EMNLP Findings, 2020.
  108. J. Baek, D. B. Lee, and S. J. Hwang, "Learning to extrapolate knowledge: Transductive few-shot out-of-graph link prediction," in Proc. of NeurIPS, 2020.
  109. J. Xu, J. Zhang, X. Ke, Y. Dong, H. Chen, C. Li, and Y. Liu, "P-INT: A path-based interaction model for few-shot knowledge graph completion," in Proc. of EMNLP Findings, 2021.
  110. Y. Zhang, Y. Qian, Y. Ye, and C. Zhang, "Adapting distilled knowledge for few-shot relation reasoning over knowledge graphs," in Proc. of SDM, 2022.
  111. G. Niu, Y. Li, C. Tang, R. Geng, J. Dai, Q. Liu, H. Wang, J. Sun, F. Huang, and L. Si, "Relational learning with gated and attentive neighbor aggregator for few-shot knowledge graph completion," in Proc. of SIGIR, 2021.
  112. S. Wang, X. Huang, C. Chen, L. Wu, and J. Li, "REFORM: error- aware few-shot knowledge graph completion," in Proc. of CIKM, 2021.
  113. J. Zhang, T. Wu, and G. Qi, "Gaussian metric learning for few- shot uncertain knowledge graph completion," in Proc. of DAS- FAA, 2021.
  114. Y. Yao, Z. Zhang, Y. Xu, and C. Li, "Data augmentation for few- shot knowledge graph completion from hierarchical perspec- tive," in Proc. of COLING, 2022.
  115. F. L. Hitchcock, "The expression of a tensor or a polyadic as a sum of products," Journal of Mathematics and Physics, 1927.
  116. T. Lacroix, G. Obozinski, and N. Usunier, "Tensor decompositions for temporal knowledge base completion," in Proc. of ICLR, 2020.
  117. V. Tresp, Y. Ma, S. Baier, and Y. Yang, "Embedding learning for declarative memories," in The Semantic Web: 14th International Conference, ESWC 2017, Portoro, Slovenia, May 28-June 1, 2017, Proceedings, Part I 14, 2017.
  118. Y. Ma, V. Tresp, and E. A. Daxberger, "Embedding models for episodic knowledge graphs," Journal of Web Semantics, 2019.
  119. P. Jain, S. Rathi, Mausam, and S. Chakrabarti, "Temporal Knowl- edge Base Completion: New Algorithms and Evaluation Proto- cols," in Proc. of EMNLP, 2020.
  120. T. Jiang, T. Liu, T. Ge, L. Sha, S. Li, B. Chang, and Z. Sui, "Encoding temporal information for time-aware link prediction," in Proc. of EMNLP, 2016.
  121. T. Jiang, T. Liu, T. Ge, L. Sha, B. Chang, S. Li, and Z. Sui, "Towards time-aware knowledge graph completion," in Proc. of COLING, 2016.
  122. J. Leblay and M. W. Chekol, "Deriving validity time in knowl- edge graph," in Proc. of WWW, 2018.
  123. S. S. Dasgupta, S. N. Ray, and P. Talukdar, "HyTE: Hyperplane- based temporally aware knowledge graph embedding," in Proc. of EMNLP, 2018.
  124. C. Xu, M. Nayyeri, F. Alkhoury, H. Shariat Yazdi, and J. Lehmann, "TeRo: A time-aware knowledge graph embedding via temporal rotation," in Proc. of COLING, 2020.
  125. J. Leblay, M. W. Chekol, and X. Liu, "Towards temporal knowl- edge graph embeddings with arbitrary time precision," in Proc. of CIKM, 2020.
  126. A. García-Durán, S. Dumančić, and M. Niepert, "Learning se- quence encoders for temporal knowledge graph completion," in Proc. of EMNLP, 2018.
  127. C. Xu, Y.-Y. Chen, M. Nayyeri, and J. Lehmann, "Temporal knowledge graph completion using a linear temporal regularizer and multivector embeddings," in Proc. of NAACL, 2021.
  128. L. Cai, K. Janowicz, B. Yan, R. Zhu, and G. Mai, "Time in a box: advancing knowledge graph completion with temporal scopes," in Proceedings of the 11th on Knowledge Capture Conference, 2021.
  129. Y. Xu, S. Sun, Y. Miao, D. Yang, X. Meng, Y. Hu, K. Wang, H. Song, and C. Miao, "Time-aware graph embedding: A tem- poral smoothness and task-oriented approach," ArXiv preprint, 2020.
  130. R. Goel, S. M. Kazemi, M. Brubaker, and P. Poupart, "Diachronic embedding for temporal knowledge graph completion," in Proc. of AAAI, 2020.
  131. J. Jung, J. Jung, and U. Kang, "Learning to walk across time for interpretable temporal knowledge graph completion," in Proc. of KDD, 2021.
  132. G. H. Nguyen, J. B. Lee, R. A. Rossi, N. K. Ahmed, E. Koh, and S. Kim, "Dynamic network embeddings: From random walks to temporal random walks," in IEEE International Conference on Big Data, Big Data 2018, Seattle, WA, USA, December 10-13, 2018, 2018.
  133. Y. Liu, Y. Ma, M. Hildebrandt, M. Joblin, and V. Tresp, "Tlogic: Temporal logical rules for explainable link forecasting on tempo- ral knowledge graphs," in Proc. of AAAI, 2022.
  134. H. Sun, J. Zhong, Y. Ma, Z. Han, and K. He, "TimeTraveler: Rein- forcement learning for temporal knowledge graph forecasting," in Proc. of EMNLP, 2021.
  135. Z. Li, X. Jin, S. Guan, W. Li, J. Guo, Y. Wang, and X. Cheng, "Search from history and reason for future: Two-stage reasoning on temporal knowledge graphs," in Proc. of ACL, 2021.
  136. Z. Han, P. Chen, Y. Ma, and V. Tresp, "Explainable subgraph reasoning for forecasting on temporal knowledge graphs," in Proc. of ICLR, 2021.
  137. R. Trivedi, H. Dai, Y. Wang, and L. Song, "Know-evolve: Deep temporal reasoning for dynamic knowledge graphs," in Proc. of ICML, 2017.
  138. Y. Han, S. Karunasekera, and C. Leckie, "Graph neural networks with continual learning for fake news detection from social media," ArXiv preprint, 2020.
  139. R. Trivedi, M. Farajtabar, P. Biswal, and H. Zha, "Dyrep: Learning representations over dynamic graphs," in Proc. of ICLR, 2019.
  140. Y. Lu, X. Wang, C. Shi, P. S. Yu, and Y. Ye, "Temporal network embedding with micro-and macro-dynamics," in Proc. of CIKM, 2019.
  141. X. Chang, X. Liu, J. Wen, S. Li, Y. Fang, L. Song, and Y. Qi, "Continuous-time dynamic graph learning via neural interaction processes," in Proc. of CIKM, 2020.
  142. N. Park, F. Liu, P. Mehta, D. Cristofor, C. Faloutsos, and Y. Dong, "Evokg: Jointly modeling event time and network structure for reasoning over temporal knowledge graphs," in Proc. of WSDM, 2022.
  143. W. Jin, M. Qu, X. Jin, and X. Ren, "Recurrent event net- work: Autoregressive structure inferenceover temporal knowl- edge graphs," in Proc. of EMNLP, 2020.
  144. Z. Li, X. Jin, W. Li, S. Guan, J. Guo, H. Shen, Y. Wang, and X. Cheng, "Temporal knowledge graph reasoning based on evo- lutional representation learning," in Proc. of SIGIR, 2021.
  145. Z. Li, S. Guan, X. Jin, W. Peng, Y. Lyu, Y. Zhu, L. Bai, W. Li, J. Guo, and X. Cheng, "Complex evolutional pattern learning for temporal knowledge graph reasoning," in Proc. of ACL, 2022.
  146. Z. Li, Z. Hou, S. Guan, X. Jin, W. Peng, L. Bai, Y. Lyu, W. Li, J. Guo, and X. Cheng, "HiSMatch: Historical structure matching based temporal knowledge graph reasoning," in Proc. of EMNLP Findings, 2022.
  147. A. Sankar, Y. Wu, L. Gou, W. Zhang, and H. Yang, "Dysat: Deep neural representation learning on dynamic graphs via self- attention networks," in Proc. of WSDM, 2020.
  148. C. Xu, M. Nayyeri, Y.-Y. Chen, and J. Lehmann, "Geometric alge- bra based embeddings for static and temporal knowledge graph completion," IEEE Transactions on Knowledge and Data Engineering, 2022.
  149. J. Wu, M. Cao, J. C. K. Cheung, and W. L. Hamilton, "TeMP: Temporal message passing for temporal knowledge graph com- pletion," in Proc. of EMNLP, 2020.
  150. Z. Xu, Z. Ou, Q. Su, J. Yu, X. Quan, and Z. Lin, "Embedding dy- namic attributed networks by modeling the evolution processes," in Proc. of COLING, 2020.
  151. L. Chen, X. Tang, W. Chen, Y. Qian, Y. Li, and Y. Zhang, "Dacha: A dual graph convolution based temporal knowledge graph representation learning method using historical relation," ACM Transactions on Knowledge Discovery from Data (TKDD), 2021.
  152. Y. He, P. Zhang, L. Liu, Q. Liang, W. Zhang, and C. Zhang, "Hip network: Historical information passing network for extrapola- tion reasoning on temporal knowledge graph." in Proc. of IJCAI, 2021.
  153. B. AlKhamissi, M. Li, A. Celikyilmaz, M. Diab, and M. Ghazvininejad, "A review on language models as knowledge bases," ArXiv preprint, 2022.
  154. F. Petroni, T. Rocktäschel, S. Riedel, P. Lewis, A. Bakhtin, Y. Wu, and A. Miller, "Language models as knowledge bases?" in Proc. of EMNLP, 2019.
  155. Z. Jiang, F. F. Xu, J. Araki, and G. Neubig, "How can we know what language models know?" Transactions of the Association for Computational Linguistics, 2020.
  156. Z. Bouraoui, J. Camacho-Collados, and S. Schockaert, "Inducing relational knowledge from BERT," in Proc. of AAAI, 2020.
  157. A. Haviv, J. Berant, and A. Globerson, "BERTese: Learning to speak to BERT," in Proc. of EACL, 2021.
  158. T. Shin, Y. Razeghi, R. L. Logan IV, E. Wallace, and S. Singh, "AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts," in Proc. of EMNLP, 2020.
  159. Z. Zhong, D. Friedman, and D. Chen, "Factual probing is [MASK]: Learning vs. learning to recall," in Proc. of NAACL, 2021.
  160. D. Su, Y. Xu, G. I. Winata, P. Xu, H. Kim, Z. Liu, and P. Fung, "Generalizing question answering system with pre-trained lan- guage model fine-tuning," in Proceedings of the 2nd Workshop on Machine Reading for Question Answering, 2019.
  161. E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell, "On the dangers of stochastic parrots: Can language models be too big?" in Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, 2021.
  162. T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhari- wal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei, "Language models are few-shot learners," in Proc. of NeurIPS, 2020.
  163. B. Dhingra, J. R. Cole, J. M. Eisenschlos, D. Gillick, J. Eisenstein, and W. W. Cohen, "Time-aware language models as temporal knowledge bases," Transactions of the Association for Computational Linguistics, 2022.
  164. R. Han, X. Ren, and N. Peng, "ECONET: Effective continual pretraining of language models for event temporal reasoning," in Proc. of EMNLP, 2021.
  165. M. Sung, J. Lee, S. Yi, M. Jeon, S. Kim, and J. Kang, "Can language models be biomedical knowledge bases?" in Proc. of EMNLP, 2021.
  166. N. Poerner, U. Waltinger, and H. Schütze, "E-BERT: Efficient- yet-effective entity embeddings for BERT," in Proc. of EMNLP Findings, 2020.
  167. J. Sun, C. Xu, L. Tang, S. Wang, C. Lin, Y. Gong, H.-Y. Shum, and J. Guo, "Think-on-graph: Deep and responsible reasoning of large language model with knowledge graph," ArXiv preprint, 2023.

Cited by

Sorted by citations

Metadata

Authors
Jiang, X., Xu, C., Shen, Y., Sun, X., Tang, L., Wang, S., Chen, Z., Wang, Y., & Guo, J.
Affiliations
Chinese Academy of Sciences (CN)
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
OpenAlex
W4387559455
Cited by
42
References
1
Citations by year
2026: 15 · 2025: 16 · 2024: 11
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Natural Science Foundation of China (91646120, U1836206, 62172393, U21B2046)
  • National Key Research and Development Program of China
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
  • Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
knowledge graphs, dynamic knowledge graphs, temporal knowledge graphs, event knowledge graph, knowledge extraction, knowledge reasoning, knowledge engineering, financial analysis, large language models, knowledge representation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review