The DOI matches its DataCite record; 26 of the 26 references it cites were found in a registry or an index; none of the 104 sources its claims cite is checked for support yet.
On the Evolution of Knowledge Graphs: A Survey and Perspective
Open accessAbstract
Knowledge graphs (KGs) are structured representations of diversified knowledge. They are widely used in various intelligent applications. In this article, we provide a comprehensive survey on the evolution of various types of knowledge graphs (i.e., static KGs, dynamic KGs, temporal KGs, and event KGs) and techniques for knowledge extraction and reasoning. Furthermore, we introduce the practical applications of different types of KGs, including a case study in financial analysis. Finally, we propose our perspective on the future directions of knowledge engineering, including the potential of combining the power of knowledge graphs and large language models (LLMs), and the evolution of knowledge extraction, reasoning, and representation.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This survey reviews the evolution of knowledge graphs from static to dynamic, temporal, and event-based forms, along with knowledge extraction and reasoning techniques for each type. It also discusses applications, including a financial case study, and proposes future directions for combining KGs with large language models.
Key findings
- The paper organizes KG evolution into four stages—static KGs, dynamic KGs, temporal KGs, and event KGs—with formal definitions and representative examples such as Freebase, DBpedia, ICEWS/GDELT/Wikidata, and EventKG/ELG/EvGraph.
- It surveys knowledge extraction (NER, relation extraction, dynamic, temporal, and event extraction) and reasoning methods, classifying static KGR into matrix decomposition, translation, GNN, LLM, and neural-symbolic methods; dynamic KGR into GNN, LLM, and few-shot methods; and temporal KGR into completion and prediction methods.
- Applications include finance (financial information extraction and KG construction, reasoning for event-driven quantitative investment, and LLM-integrated QA) and other domains such as healthcare, transportation, manufacturing, legal, and personalized services.
- Future directions include knowledge programmability, zero-shot/unsupervised extraction, quality control, non-static and event KG reasoning, neural-symbolic reasoning, and KG-LLM integration; the paper notes that NELL amassed over 80 million facts by 2015, KnowItAll accumulated over 54,753 facts in four days, and GPT-3 has 175B parameters with a reported $10 million cost for a single training session.
Methods
- This is a survey and perspective paper: it provides a comprehensive literature review of KG types, knowledge extraction, knowledge reasoning, applications, and future directions, without new empirical experiments.
- It organizes prior work by KG type (SKG, DKG, TKG, EKG) and method category, using formal definitions and summary tables (Tables 1–3) to classify representative methods.
- It includes a financial case study illustration of event KG reasoning for event-driven quantitative investment; the figure’s news contents, company names, and numerical values are explicitly described as fictional and illustrative.
Limitations
- The paper states that existing knowledge reasoning techniques mainly focus on static KGs; dynamic and temporal KG reasoning remain nascent, event KG reasoning is largely unexplored, and neural-symbolic reasoning remains to be explored.
- It states that generative LLMs still significantly underperform fully-supervised baselines on knowledge extraction tasks, and that LLMs have limitations including black-box behavior, outdated knowledge, temporal reasoning challenges, and difficulty with event-centric knowledge.
- Evident from the text: as a survey, it does not provide new experimental validation or benchmark results, and its coverage reflects literature available up to 2023.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 104 cited sources checked · 0 supported · 0 flagged
- Findingreasoning
Matrix decomposition-based methods enable efficient computation of similarity and relationship prediction through low-dimensional latent space representations.
“These approaches enable efficient computation of similarity and relationship prediction through low-dimensional latent space representations.”
Quote in the paperNot a substantial claim - Findingnone given
Matrix decomposition-based methods face limitations in scalability and handling sparsity, which may hinder their applicability in large-scale knowledge graphs or those with complex relational structures.
“However, they face limitations in terms of scalability and handling sparsity, which may hinder their applicability in large-scale knowledge graphs or those with complex relational structures.”
Quote in the paperNot a substantial claim - Findingnone given
Most knowledge graphs are dynamic and evolving.
“Most KGs are dynamic and evolving.”
Quote in the paperSubstantial claim - Findingnone given
Event knowledge graphs contain one more node type (event nodes) and two more relation types (entity-event relations and event-event relations) compared with temporal knowledge graphs.
“Compared with TKGs, EKGs contain one more node type (i.e., event nodes) and two more relation types (entity-event relations, eventevent relations).”
Quote in the paperNot a substantial claim - Findingreasoning
Matrix decomposition-based methods offer advantages in modeling static knowledge reasoning in knowledge graphs by capturing latent semantics and patterns in the data.
“Matrix decomposition-based methods offer advantages in modeling static knowledge reasoning in knowledge graphs by capturing latent semantics and patterns in the data.”
Quote in the paperNot a substantial claim
- Findingreasoning
Data Sparsity: Due to high labor cost, domain and data volume covered by a KG are limited, leading to large amount of missing data.
“Data Sparsity: Due to the high labor cost, the domain and data volume covered by a KG are limited, which leads to a large amount of missing data in the KG.”
Quote in the paperNot a substantial claim - Findingcitation
Training processes of LLMs have the risk of learning incorrect or toxic knowledge.
“The training processes of LLMs have the risk of learning incorrect or toxic knowledge [195], while the reliability of knowledge is ensured by quality assessment for a KG, especially for small-scale domain-specific KGs.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [195]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingreasoning
Existing KGs segregate knowledge storage and reasoning, lacking a unified framework integrating large-scale knowledge storage with efficient knowledge reasoning.
“the segregation of knowledge storage and reasoning in existing KGs lacks a unified framework integrating large-scale knowledge storage with efficient knowledge reasoning, hindering the maximization of knowledge utilization.”
Quote in the paperSubstantial claim - Findingcitation
LLMs have been shown to be able to recall relational knowledge without fine-tuning.
“LLMs [187] have also been shown to be able to recall relational knowledge without fine-tuning.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [187]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingcitation
The rise of LLMs makes it possible to perform downstream tasks without access to external knowledge, e.g., closed-book QA.
“The rise of LLMs makes it possible to perform such downstream tasks without access to external knowledge, e.g., closed-book QA.”
Quote in the paperNot a substantial claim - Findingcitation
LLMs face challenge of averaging when dealing with temporal information, i.e., model may see conflicting information about time ranges.
“The first challenge is averaging, i.e., the model may see conflicting information about time ranges.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [197]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingreasoning
It is much easier for DKGs to revise and update the knowledge they have stored.
“By contrast, it is much easier for DKGs to revise and update the knowledge they have stored.”
Quote in the paperSubstantial claim - Findingreasoning
LLMs might suffer from outdated knowledge and information since they are pre-trained based on Internet data at a specific time.
“LLMs might suffer from outdated knowledge and information since they are pre-trained based on Internet data at a specific time.”
Quote in the paperSubstantial claim - Findingreasoning
LLMs might show different answers to the same question due to their randomness and nature of probabilistic models.
“By contrast, LLMs might show different answers to the same question due to their randomness and nature of probabilistic models.”
Quote in the paperSubstantial claim - Findingcitation
LLMs face challenge of poor temporal calibration, i.e., as LLMs become stale, they are increasingly likely to be queried for facts outside time range of training data.
“The third challenge is poor temporal calibration, i.e., as LLMs become”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [197]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingcitation
LLMs face challenge of forgetting, where model may not remember facts valid only for a representative period and performs poorly on questions about more distant past.
“The second challenge is forgetting, where the model may not remember facts that are valid only for a representative period of time, and therefore performs poorly when asked questions about the more distant past.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [197]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingreasoning
Existing generative LLMs still significantly underperform fully-supervised baseline models on knowledge extraction tasks.
“Nevertheless, the existing generative LLMs still significantly underperform fully-supervised baseline models on knowledge extraction tasks.”
Quote in the paperNot a substantial claim - Findingreasoning
One of the main disadvantages of LLMs in learning event-centric knowledge is that they may not be able to capture temporal relations between events effectively.
“One of the main disadvantages of LLMs in learning event-centric knowledge is that they may not be able to capture the temporal relations between events effectively.”
Quote in the paperSubstantial claim - Findingnone given
The training corpus used for LLM might be noisy.
“And the training corpus used for LLM might be noisy.”
Quote in the paperNot a substantial claim - Premisecitation
LAN introduces a novel aggregator that aggregates neighbors with both rules-and network-based attention weights to facilitate inductive KG embedding.
“LAN [122] introduces a novel aggregator, which addresses the properties by aggregating neighbors with both rules-and network-based attention weights, to facilitate inductive KG embedding.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [122]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisenone given
Training a neighborhood aggregator like conventional GNN may help embed new entities inductively via their existing neighbors.
“Recent efforts suggest that training a neighborhood aggregator like conventional GNN may help embed new entities inductively via their existing neighbors, so many methods modify GNN as an embedding aggregator in various ways.”
Quote in the paperSubstantial claim - Premisecitation
NeuralLP is the first end-to-end differentiable approach to learning the structure of logical rules.
“NeuralLP [117] is the first end-to-end differentiable approach to learning the structure of logical rules.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [117]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Knowledge graph reasoning is essential for creating a comprehensive and effective knowledge graph.
“Thus, KGR is also essential for creating a comprehensive and effective KG.”
Quote in the paperNot a substantial claim - Premisecitation
Static knowledge graphs, where triples are never updated or updated very infrequently, are limited due to the timeliness of the knowledge they hold.
“Thus, static KGs (SKGs) where triples are never updated or updated very infrequently, are limited due to the timeliness of the knowledge they hold [8].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [8]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Static knowledge graphs are not suitable for applications that require up-to-date information, such as news articles or social media feeds.
“However, they are not suitable for applications that require up-to-date information, such as news articles or social media feeds.”
Quote in the paperSubstantial claim - Premisecitation
HRFN concentrates on effectively embedding out-of-knowledge-base entities by a two-stage model, where coarse-grained pre-representation and fine-tuning aim at emerging entities are used.
“HRFN [125] concentrates on effectively embedding out-of-knowledge-base entities by a two-stage model, where coarse-grained prerepresentation and fine-tuning aim at emerging entities are used.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [125]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
GraIL introduces a series of new fully-inductive benchmark datasets for the inductive relation prediction problem, by sampling disjoint subgraphs from the KGs in four traditional transductive datasets.
“GraIL also introduces a series of new fullyinductive benchmark datasets for the inductive relation prediction problem, by sampling disjoint subgraphs from the KGs in four traditional transductive datasets.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [114]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
MetaR proposes relation meta and gradient meta with common and shared knowledge to predict new facts about the target relation, which only has a few observed associative triples.
“MetaR [136] proposes relation meta and gradient meta with common and shares knowledge to predict new facts about the target relation, which only has a few observed associative triples.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [136]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Many large-scale knowledge graphs, including Google Knowledge Graph, NELL, Linked Open Data, OpenCyc, ConceptNet, and UMLS, are continuously updated over time, even in real time, to reflect changes in the underlying data.
“Similarly, many large-scale KGs like Google Knowledge Graph [1], NELL [20], Linked Open Data [21], OpenCyc [22], ConceptNet [23] and UMLS [24], continuously updated over time, even in real-time, to reflect changes in the underlying data.”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [1]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [20]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [21]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
GraIL and CoMPILE require generating one subgraph for each target triple, which is a significant bottleneck in practice.
“These two approaches require generating one subgraph for each target triple, which is a significant bottleneck in practice.”
Quote in the paperNot a substantial claim - Premisecitation
Know-evolve first applies TPP to multi-relation reasoning.
“Know-evolve [171] first applies TPP to multi-relation reasoning.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [171]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
TeLM introduces a temporal smoothing mechanism into the loss function, which constrains the change in the representation of adjacent moments to reflect the temporal correlation.
“TeLM [161] introduces a temporal smoothing mechanism into the loss function, which constrains the change in the representation of adjacent moments to reflect the temporal correlation.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [161]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
The application of logical rules combined with various KG embedding models can significantly improve performance and interpretability of these models.
“The application of these logical rules, when combined with various KG embedding models, can significantly improve the performance and interpretability of these models.”
Quote in the paperSubstantial claim - Premisecitation
DyRep models both long-term (association) and short-term (communication) knowledge between individuals in social networks.
“DyRep [173] models both long-term(association) and short-term(communication) knowledge between individuals in social networks.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [173]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
TDIG and EvoKG both use graph neural networks and gated recurrent neural networks to model neural temporal point processes for tasks such as relation inference and temporal information reasoning.
“Similarly, TDIG [175] and EvoKG [176] both use graph neural networks and gated recurrent neural networks to model neural temporal point processes for tasks such as relation inference and temporal information reasoning.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [175]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [176]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
The Graph Hawkes Neural Network (GHNN) can effectively aggregate information from current entity neighbors to predict the future.
“The Graph Hawkes Neural Network (GHNN) [172] can effectively aggregate information from current entity neighbors to predict the future.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [172]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
The cost of knowledge updating will be significantly reduced for LLMs if LLMs and DKGs can be effectively combined without expensive training processes.
“Thus, the cost of knowledge updating will be significantly reduced for LLMs if LLMs and DKGs can be effectively combined without expensive training processes.”
Quote in the paperSubstantial claim - Premisecitation
TITer and CluSTeR use LSTM-based temporal path encoders to learn temporal order relationships.
“TITer [168] and CluSTeR [169] use LSTM-based temporal path encoders to learn temporal order relationships.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [168]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [169]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Probably not a substantial claim. 169
- It may state two separate claims as one. 114
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenMost knowledge graphs reviewed in the paper suffer from incompleteness, and this severely limits the metric of KG application to downstream tasks.
“In addition, most KGs reviewed in this paper are suffering from the problem of incompleteness, and it severely limits the metric of KG application to downstream tasks.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenExperimental results illustrate the effectiveness of LLM-based methods in DKGR.
“Experimental results illustrate the effectiveness of LLM-based methods in DKGR.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenEarly work on knowledge graph reasoning mainly focused on static knowledge graph reasoning.
“Early work on KGR mainly focus on SKGR.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenKnowledge graph reasoning techniques have evolved from static learning methods to temporal learning methods.
“With the development of KGs, KGR techniques have also evolved from static learning methods to temporal learning methods.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
FindingreasoningLarge language models incorporating knowledge graph information show promise for knowledge graph reasoning tasks, capturing rich semantic information and leveraging pre-trained knowledge.
“In conclusion, large language models incorporating knowledge graph information show promise for knowledge graph reasoning tasks, capturing rich semantic information and leveraging pre-trained knowledge.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenGNN-based methods for knowledge graph reasoning can effectively capture local graph structure and complex relationships, making them a suitable choice for various applications.
“In conclusion, GNN-based methods for knowledge graph reasoning can effectively capture local graph structure and complex relationships, making them a suitable choice for various applications.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenTranslation-based methods face difficulties in modeling complex relationships and handling noisy or incomplete data.
“However, they face difficulties in modeling complex relationships and handling noisy or incomplete data.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingreasoningMultiple works have subsequently been proposed for dynamic knowledge graph reasoning and temporal knowledge graph reasoning.
“To this end, multiple works are subsequently proposed for DKGR and TKGR.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenGNN-based methods may face challenges related to scalability, over-smoothing, computational complexity, and parameter tuning.
“However, they may face challenges related to scalability, over-smoothing, computational complexity, and parameter tuning.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenTranslation-based methods for knowledge graph reasoning are simple, computationally efficient, and scalable, making them suitable for a wide range of applications.
“In conclusion, Translation-based methods for knowledge graph reasoning are simple, computationally efficient, and scalable, making them suitable for a wide range of applications.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenStatic knowledge graph reasoning methods based on neural network models suffer from interpretability and reliability problems and cannot be adopted in some real-world scenarios such as medical, finance, and military, which have high reliability demands.
“The above static knowledge graph reasoning method all based on neural network models, which suffer the interpretable and unreliable problems, and can not be adopted in some real-world scenarios such as medical, finance, and military which have high reliability demands.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenLarge language model-based methods may face challenges related to scalability, memory limitations, computational complexity, and prompt design.
“However, they may face challenges related to scalability, memory limitations, computational complexity, and prompt design.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
FindingreasoningExisting KGs face challenges in unifying different granularities and types of knowledge and modeling their interactions, with RDF/OWL-based knowledge modeling being overly complex and prone to redundancy in rapidly evolving scenarios.
“the demand for a representation that supports continuous business iteration while effectively avoiding combinatorial explosion and redundant construction, challenges the existing KGs in unifying different granularities and types of knowledge and modeling their interactions, with RDF/OWL-based knowledge modeling being overly complex and prone to redundancy in rapidly evolving scenarios”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Findingnone givenEvent-centric knowledge is updated very quickly, and it is difficult for LLMs to learn from constant addition of new event-centric knowledge.
“Moreover, event-centric knowledge is updated very quickly, and it is difficult for LLMs to learn from the constant addition of new event-centric knowledge.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
FindingreasoningIntegration of financial KGs with LLMs enhances LLMs' ability to perform financial domain tasks and allows fact-consistency checks ensuring factual accuracy of LLM-generated content.
“This integration not only enhances the ability of LLMs to perform tasks in the financial domain but also allows for fact-consistency checks, ensuring the factual accuracy of the content generated by LLMs.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenKGs express semantic information of entities by recording their types, attributes, descriptions, and relations between them.
“KGs express the semantic information of entities by recording their types, attributes, and descriptions, as well as relations between them.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenCurrent KGs cannot effectively handle and directly compute numerical knowledge.
“ineffective handling and direct computation of numerical knowledge through KGs”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenWith formal evolution of KGs, knowledge reasoning techniques for DKGs and TKGs have received more attention but still remain to be improved.
“With the formal evolution of KGs, knowledge reasoning techniques for DKGs and TKGs have received more attention, but still remain to be improved.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingcitationSome follow-up works propose various automatic prompt generation methods to further improve probing performances of LLMs.
“Moreover, some follow-up works propose various automatic prompt generation methods to further improve probing performances of LLMs [189], [190], [191], [192], [193].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [189]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [190]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [191]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenTKGs tend to have longer time scopes and factual knowledge in TKGs is much more time-sensitive.
“Relatively, TKGs tend to have longer time scopes and the factual knowledge in TKGs is much more time-sensitive.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenLack of flexibility: storage structure and query method of a KG are relatively fixed, difficult to adapt to various data structures and query requirements.
“Lack of flexibility: The storage structure and query method of a KG are relatively fixed, and it is difficult to adapt to various data structures and query requirements.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingnone givenBoth KGs and LLMs can be used as knowledge sources for downstream applications, e.g., question answering.
“both of them can be used as knowledge sources for downstream applications, e.g., question answering.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
FindingreasoningIn healthcare, KGs amalgamate patient records, medical literature, and drug information, enabling enhanced diagnosis, smart treatments, and drug discovery.
“Knowledge graphs amalgamate patient records, medical literature, and drug information, paving the way for enhanced diagnosis, smart treatments, and drug discovery by elucidating relationships between diseases, symptoms, medications, and patient histories.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingreasoningSome LLMs and large-scale KGs use the same data sources.
“Some LLMs and large-scale KGs even use the same data sources.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingreasoningEvent-driven quantitative investment formulates investment strategies based on relationships and patterns identified within KGs.
“One practical application of this is event-driven quantitative investment, where investment strategies are formulated based on the relationships and patterns identified within the KGs.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingnone givenKGs and LLMs have different representation forms to store knowledge and different ways of performing knowledge reasoning.
“In addition to their respective limitations, KGs and LLMs have different representation forms to store knowledge and different ways of performing knowledge reasoning.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingnone givenTraining LLMs requires large amounts of textual data, often obtained from publicly available Internet websites.
“The training of LLMs requires large amounts of textual data, which are often obtained from publicly available Internet websites.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
FindingreasoningOne of the main advantages of KGs is their explainability; it is easier to know how answers are inferred over a KG.
“Meanwhile, one of the main advantages of KGs is their explainability.It would be easier to know how the answers are inferred over a KG.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Findingnone givenLLMs are black-box models in nature; it is difficult to know the basis of answers and reasoning process.
“LLM vs SKG: LLMs are black-box models in nature.It is difficult to know the basis of the answers given by an LLM and the corresponding reasoning process.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper may give no reason why it holds.
Findingnone givenAn SKG will give a consistent answer to a query no matter how many times this query is performed.
“Moreover, regardless of knowledge updating and revision, an SKG will give a consistent answer to a query no matter how many times this query is performed.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
FindingcitationThe largest GPT3 model has a parametric count of 175B and costs 10 million dollars for a single training session.
“For example, the largest GPT3 model [196] has a parametric count of 175B and costs 10 million dollars for a single training session.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [196]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper may give no reason why it holds.
Findingnone givenRecent advances have prompted a shift from SKGs to more dynamic structures like DKGs and TKGs.
“Recent advances have prompted a shift from SKGs to more dynamic structures like DKGs and TKGs, aiming to accurately represent and reason over the dynamic nature of real-world knowledge.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenThe application of static and temporal logical rules to KG reasoning tasks remains an open avenue for exploration.
“Yet, the application of static and temporal logical rules to KG reasoning tasks remains an open avenue for exploration.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingcitationSome LLMs can further improve their performances on open-domain QA after fine-tuning.
“Some literature shows that such LLMs can further improve their performances on opendomain QA after fine-tuning [194].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [194]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingnone givenFinancial information extraction targets financial entities, relatively stable concepts, dynamically evolving knowledge, temporal information, and financial events.
“In this context, information extraction targets various elements, including financial entities (e.g., stocks, bonds, corporations), relatively stable concepts (e.g., market indices, financial instruments), dynamically evolving knowledge (e.g., stock prices, economic indicators), temporal information (e.g., trade dates), and financial events (e.g., mergers, acquisitions, dividends announcements).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenReasoning techniques for DKGs and TKGs are still nascent, with temporal knowledge completion and extrapolation emerging as notable endeavors.
“However, reasoning techniques for DKGs and TKGs are still nascent, with temporal knowledge completion and extrapolation emerging as notable endeavors.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenDynamically updated financial KGs can keep LLMs current with real-time financial knowledge.
“Through dynamically updated financial knowledge graphs, LLMs can be kept current with real-time financial knowledge.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenWikipedia is the most important training corpus for many LLMs like BERT and also the main data source for general KGs, e.g., DBpedia and YAGO.
“For example, Wikipedia is the most important training corpus for a lot of LLMs like BERT, and also the main data source for general KGs, e.g., DBpedia, and YAGO.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenIn legal domain, KGs consolidate statutes, case law, and legal doctrines, aiding legal research, case preparation, and regulatory compliance.
“In the legal domain, knowledge graphs consolidate statutes, case law, and legal doctrines, aiding in legal research, case preparation, and regulatory compliance by structuring and analyzing the relationships between different legal entities and concepts.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
FindingcitationLLMs are trained on large text corpora via self-supervised learning and may not have access to structured data that can help them learn about event temporal relations.
“This is because LLMs are trained on large text corpora via self-supervised learning methods and may not have access to structured data that can help them learn about event temporal relations [198].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [198]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenSome existing works have demonstrated substantial improvements in static knowledge graph reasoning tasks by applying first-order logical rules.
“Some existing works have demonstrated substantial improvements in static knowledge graph reasoning tasks by applying first-order logical rules.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingnone givenLLMs are trained on text data to obtain character-level or word-level embeddings of entities, which can represent semantics of entities.
“On the other hand, LLMs are trained on text data to obtain character-level embeddings or word-level embeddings of entities, which can also represent the semantics of entities.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenCurrent KGs cannot directly and accurately model higher-order logic knowledge or apply it in higher-order knowledge reasoning.
“the inability to directly and accurately model higher-order logic knowledge and apply it in higher-order knowledge reasoning”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
FindingreasoningBoth KGs and LLMs have data sources from massive amounts of unstructured data.
“both of their data sources come from massive amounts of unstructured data”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenResearch on knowledge reasoning in SKGs, DKGs, and TKGs has attracted widespread interest.
“In recent years, research on knowledge reasoning in SKGs, DKGs, and TKGs has attracted widespread interest.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenKGs have widespread applications beyond finance, notably in healthcare, transportation, retail, manufacturing, legal, and personalized services.
“Knowledge graphs have widespread applications beyond finance, notably in healthcare, transportation, retail, manufacturing, legal, and personalized services.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenExisting knowledge reasoning techniques mainly focus on SKGs.
“The existing knowledge reasoning techniques mainly focus on SKGs.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenNeural-symbolic knowledge reasoning remains to be explored.
“Besides, neural-symbolic knowledge reasoning also remains to be explored.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingreasoningFinancial KGs integrated with LLMs enable intelligent QA systems tailored for finance.
“Financial knowledge graphs can also be integrated with large language models to enable intelligent QA systems tailored for the finance sector.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingcitationPrevious studies have shown that masking/natural language generation probing paradigms can perform well on some knowledge probing benchmarks like LAMA.
“Previous studies have shown that such paradigms can perform well on some knowledge probing benchmarks like LAMA [188].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [188]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
FindingcitationAlthough LLMs obtain decent knowledge probing performances on LAMA, some follow-up works propose more difficult and domain-specific probing datasets for LLMs and demonstrate that current LLMs are not reliable in factual knowledge extraction, contrary to the perspective that LLMs can be seen as knowledge bases.
“And although LLMs obtain decent knowledge probing performances on LAMA, some follow-up works propose more difficult and domain-specific probing datasets [199], [200] for LLMs and demonstrate that current LLMs are not reliable in factual knowledge extraction [201], [202], which is contrary to the perspective that LLMs can be seen as knowledge bases.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [199]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [200]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [201]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
FindingreasoningLLMs have limited editability; it is difficult for LLMs to frequently learn new knowledge and information due to unaffordable training cost.
“And LLMs have limited editability, that is to say it is difficult for LLMs to frequently learn new knowledge and information due to their unaffordable training cost.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenReasoning over EKGs is largely unexplored.
“It is also worth noting that reasoning over EKGs is largely unexplored.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds.
Findingnone givenA considerable amount of logical knowledge is implied in KGs, encompassing first-order or temporal logical rules between relations and events.
“Besides factual knowledge, a considerable amount of logical knowledge is implied in KGs, encompassing a vast number of first-order or temporal logical rules between relations and events.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
Findingnone givenKG-related techniques, like knowledge extraction and reasoning, have evolved with the change in form of KGs.
“KG-related techniques, like knowledge extraction and reasoning, have also evolved with the change in the form of KGs.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenConstruction of large-scale KGs relies on information extraction from unstructured open data.
“The construction of large-scale KGs also relies on information extraction from unstructured open data.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
Findingnone givenSince emergence of KG technology, form of KGs is gradually changing.
“Since the emergence of the technology of KG, the form of KGs is gradually changing.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenIn transportation, KGs structure data on routes, traffic conditions, and vehicle statuses, enabling intelligent systems to optimize route planning, manage traffic efficiently, and predict maintenance needs.
“In transportation, knowledge graphs structure data encompassing routes, traffic conditions, and vehicle statuses, empowering intelligent systems to optimize route planning, manage traffic efficiently, and predict maintenance needs.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenSocial KGs modeling users' cognition and preferences have enabled personalized services across education, psychotherapy, and personalized recommendations.
“Through social knowledge graphs modeling users' cognition and preferences, personalized services have burgeoned across sectors like education, psychotherapy, and personalized recommendations.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
FindingreasoningExtracted financial knowledge is organized into a KG, transforming unstructured financial data into high-quality structured financial knowledge.
“This process transforms massive amounts of unstructured financial data into high-quality, structured financial knowledge, which is then effectively represented and made easily accessible through the KG.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
FindingreasoningIn manufacturing, KGs assimilate data on product components, manufacturing processes, and supply chains, supporting predictive maintenance, quality control, and optimized production planning.
“Within manufacturing, knowledge graphs assimilate data on product components, manufacturing processes, and supply chains, supporting predictive maintenance, quality control, and optimized production planning by analyzing relationships between machine performances, material availability, and production schedules.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenHow to develop an EKG embedding model to model events has never been discussed in previous research.
“However, how to develop an EKG embedding model to model events, a new kind of knowledge element, has never been discussed in previous research.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenLarge-scale KGs are often the main knowledge sources of some downstream applications, e.g., a KBQA system.
“Large-scale KGs are often the main knowledge sources of some downstream applications, e.g., a knowledge base question answering (KBQA) system.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
FindingreasoningBoth KGs and LLMs can represent entity semantics and store correlations between entities.
“both of them can represent entity semantics, and store correlations between entities”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenThe reliability of knowledge is ensured by quality assessment for a KG, especially for small-scale domain-specific KGs.
“while the reliability of knowledge is ensured by quality assessment for a KG, especially for small-scale domain-specific KGs.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingcitationBERT has been proven to do remarkably well on open-domain QA.
“For instance, BERT has been proven to do remarkably well on open-domain QA [188].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [188]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
FindingreasoningLLMs have achieved noticeable success on many NLP tasks, but they still struggle with event-centric tasks.
“LLMs have achieved noticeable success on many NLP tasks, but they still struggle with event-centric tasks.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenWhen the core tensor is a hyper-diagonal matrix, Tucker decomposition is a special case of CP decomposition.
“When the core tensor is a hyper-diagonal matrix, Tucker decomposition is a special case of CP decomposition.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenRule mining uses observed co-occurrences of frequent patterns in KGs to determine logical rules, which can transfer reasoning to unseen facts.
“Rule mining uses observed co-occurrences of frequent patterns in KGs to determine logical rules, which can transfer reasoning to unseen facts.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenIn LLM-based dynamic knowledge graph reasoning methods, entities and relations of edges in KGs are usually converted into natural language as input to LLMs, and the understanding ability of LLMs benefits these models.
“In the LLMbased methods, the entities and relations of the edges in KGs are usually converted into natural language, serving as the input of LLMs, and the powerful understanding ability of LLMs benefits these models.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Premisenone givenPrevious methods usually represent relations and entities based on a large amount of training data, whereas few-shot knowledge graph reasoning mainly relies on transferring and adapting learned knowledge.
“To learn the representation of the components in KGs, previous methods usually represent relations and entities based on a large amount of training data.In contrast, few-shot knowledge graph reasoning mainly relies on transferring and adapting learned knowledge.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
InterpretationreasoningDefinition 4 subsumes Definition 3.
“Thus, Definition 4 subsumes Definition 3.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
InterpretationreasoningGNN-based DKGR methods capture transferable knowledge in DKGs through rich structure information and transfer it to new entities and relations, obtaining trusted representations for reasoning tasks over DKGs, such as inductive link prediction.
“Because of the advantages above, GNN-based DKGR methods capture the transferable knowledge in DKGs through rich structure information and transfer it to new entities and relations, obtaining trusted representations for reasoning tasks over DKGs, such as inductive link prediction.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenIn GNN-based dynamic knowledge graph reasoning methods, the source of inductive ability can be divided into four categories: the structure of graphs, relation rules, embedding aggregators, and meta-learning.
“In the GNN-based methods, they use GNN or its variants to model emerging entities and relations and the source of the inductive ability can be further divided into four categories: the structure of graphs, relation rules, embedding aggregators and meta-learning.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenGNN-based methods may face challenges related to computational complexity and over-smoothing, and they are restricted by the original framework of GNN.
“However, GNN-based methods may face challenges related to computational complexity and over-smoothing, and they are restricted by the original framework of GNN.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenA separate version of a dynamic knowledge graph can be viewed as a static knowledge graph.
“It is worth noting that a separate version of a DKG can be viewed as an SKG.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
InterpretationcitationOnce the types and relations in KGs are fixed, the dimension of nodes in INDIGO's node-annotated graph does not depend on the input KG, making the inductive capabilities of GNN fully exploited.
“Once the types and relations in KGs are fixed, the dimension of nodes in the node-annotated graph does not depend on the input KG, making the inductive capabilities of GNN fully exploited.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [116]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may state two separate claims as one.
Interpretationnone givenNeural-symbolic methods for knowledge graph reasoning offer a more interpretable and explainable way of reasoning, making them suitable for applications that require transparency and understanding.
“In conclusion, neural-symbolic methods for knowledge graph reasoning offer a more interpretable and explainable way of reasoning, making them suitable for various applications that require transparency and understanding.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Premisenone givenCurrent LLM-based works research how to integrate KG-specific knowledge into the inductive ability of LLMs and attempt to convert from a data-driven way to a knowledge-driven way.
“Current LLM-based works research how to integrate KG-specific knowledge into the inductive ability of LLMs and attempt to convert from a data-driven way to a knowledge-driven way.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenThe pre-trained LLMs have shown that factual knowledge inside KGs can be recovered from PLMs, so LLM-based methods convert edges or relation paths connecting subject and object into natural language form.
“In conclusion, the pre-trained LLMs have shown that factual knowledge inside KGs can be recovered from PLMs, so LLM-based methods convert edges or relation paths connecting subject and object into natural language form.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationKEPLER encodes textual entity descriptions with BERT as their embeddings and aligns them to the symbol space of KGs, then jointly optimizes the knowledge embedding objective and the masked language modeling objective.
“For example, KEPLER [129] encodes textual entity descriptions with BERT as their embeddings and aligns them to the symbol space of KGs, then KEPLER jointly optimizes the knowledge embedding objective and the masked language modeling (MLM) objective.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [129]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim.
InterpretationreasoningThe formal evolution of knowledge graphs can be divided into four stages: static KGs, dynamic KGs, temporal KGs, and event KGs.
“Based on this observation, we divide the formal evolution of KGs into four stages, corresponding to the emergence of static KGs (SKGs), dynamic KGs (DKGs), the temporal KGs (KGs) stage, and event KGs (EKGs), respectively.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationGMUC leverages Gaussian metric learning to capture uncertain semantic information and to complete few-shot uncertain knowledge graphs.
“GMUC [144] leverages Gaussian metric learning to capture uncertain semantic information and to complete few-shot uncertain knowledge graphs.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [144]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationMeta-KGR proposes a meta-based RL framework, where the learned meta-knowledge on normal relations provides well-initialized parameters of new models for few-shot relations and the multi-hop reasoning offers interpretability for the results.
“Meta-KGR [137] proposes a meta-based RL framework, where the learned meta-knowledge on normal relations provides well-initialized parameters of new models for fewshot relations and the multi-hop reasoning offers interpretability for the results.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [137]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenTranslation-based reasoning methods can be divided into two types: reasoning with explicitly represented time information and implicitly represented time information.
“Translation-based reasoning methods can be divided into two types: reasoning with explicitly represented time information and implicitly represented time information.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationTensor decomposition-based completion methods can be divided into CP decomposition methods and Tucker decomposition methods.
“The tensor decomposition-based completion methods can be divided into CP decomposition methods [147] and Tucker decomposition methods [148].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [147]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [148]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThe BERT in BERTRL is used as a score function to score the probability that the candidate relational triple is true.
“The BERT in BERTRL is used as a score function to score the probability that the candidate relational triple is true.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [130]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenTemporal knowledge graph completion methods aim to understand the time information and integrate it into the semantic and structural information in the knowledge graph.
“The temporal knowledge graph completion methods aim to understand the time information and integrate it into the semantic and structural information in the knowledge graph.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenSome temporal knowledge graphs are extracted from event news but do not effectively represent event information due to their entity-centric representations.
“On the other hand, some TKGs are extracted from event news, but do not effectively represent event information due to their entity-centric representations.”
Quote in the paperNot a substantial claim- Rests on an assumption: Entity-centric knowledge graphs are unable to elegantly represent the event information that appears in news texts.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenLLM-based DKGR methods are classified into two categories: triple-level methods and path-level methods.
“In Figure 11, LLM-based DKGR methods are classified into two categories: triple-level methods and path-level methods.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationBi-Link searches for relational prompts according to learned syntactical patterns via BERT and comes up with probabilistic syntax prompts for link predictions, and uses contrastive learning for bidirectional linking between forward prediction and backward prediction to express symmetric relations.
“Bi-Link [131] searches for relational prompts according to learned syntactical patterns via BERT and comes up with probabilistic syntax prompts for link predictions.Bi-Link also uses contrastive learning for bidirectional linking between forward prediction and backward prediction to express symmetric relations.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [131]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenGNN-based methods are under an encoder-decoder framework and are able to take advantage of the connectivity structure to generate the representation of emerging entities and relations.
“In conclusion, GNN-based methods are under an encoder-decoder framework and are able to take advantage of the connectivity structure to generate the representation of emerging entities and relations.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenEvent knowledge graphs can facilitate downstream event-related applications such as financial quantitative investments and text generation.
“Furthermore, EKG can facilitate downstream event-related applications such as financial quantitative investments and text generation.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationBefore the proposal of LLMs, DKRL explores the continuous bag-of-words (CBOW) model to maximize the likelihood of predicting the description text of entities.
“Before the proposal of LLMs, DKRL [128] explores the continuous bag-of-words (CBOW) model to maximize the likelihood of predicting the description text of entities.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [128]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationRMPI conducts relational message passing over subgraphs for fully-inductive KGC and further proposes new techniques on graph transformation, graph pruning, relation-aware neighborhood attention, and addressing empty subgraphs.
“Combining GraIL and PathCon, RMPI [121] conducts relational message passing over subgraphs for fully-inductive KGC and further proposes new techniques on graph transformation, graph pruning, relation-aware neighborhood attention, addressing empty subgraphs, etc.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [121]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenTemporal knowledge graphs offer a more comprehensive view of data over time, which is useful for a wide range of applications, including temporal query answering and predictive analysis.
“Overall, TKGs offer a more comprehensive view of data over time, which is useful for a wide range of applications, including temporal query answering, and predictive analysis.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds.
Interpretationnone givenEarly static knowledge graph reasoning approaches are not applicable to other types of knowledge graphs.
“However, these approaches are not applicable to other types of KGs.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationBased on Meta-KGR, FIRE further performs heterogeneous structure encoding and knowledge-aware search space pruning in the reinforcement learning process, outperforming Meta-KGR.
“Based on Meta-KGR, FIRE [138] further performs heterogeneous structure encoding and knowledge-aware search space pruning in the reinforcement learning process, outperforming Meta-KGR.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [138]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenA dynamic knowledge graph that is no longer updated will degenerate into a static knowledge graph.
“And a DKG that is no longer updated will also degenerate into an SKG.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationADK-KG uses pre-trained entity and relation embeddings and the optimized parameters can be fast adapted for few-shot relations.
“ADK-KG [141] uses pre-trained entity and relation embeddings and the optimized parameters can be fast adapted for few-shot relations.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [141]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenDynamic knowledge graphs cannot be applied in some applications such as historical analysis, trend analysis, and forecasting, due to the loss of historical data.
“However, DKGs can not be applied in some applications such as historical analysis, trend analysis and forecasting, due to the loss of historical data.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationDRUM further attaches the found rules with confidence scores by bidirectional RNNs.
“DRUM [118] further attaches the found rules with confidence scores by bidirectional RNNs.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [118]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
InterpretationcitationCompared to CP decomposition, Tucker decomposition has better reasoning performance, but its decomposition efficiency is lower due to the operations involving the core tensor.
“Compared to CP decomposition, Tucker decomposition has better reasoning performance, but its decomposition efficiency is lower due to the operations involving the core tensor.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationP-INT leverages the paths that can expressively encode the relation of two few-shot entities and calculates the interactions of the paths.
“P-INT [140] leverages the paths that can expressively encode the relation of two few-shot entities and calculates the interactions of the paths.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [140]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationBERTRL concatenates the paths consisting of constructed triples into textual information and combines it with the pre-trained prior knowledge, forming rule-like reasoning evidence.
“BERTRL [130] concatenates the paths consisting of constructed triples into textual information and combines it with the pre-trained prior knowledge, forming rule-like reasoning evidence.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [130]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationTAE-ILP considers the valid time intervals of knowledge and uses the Integer Linear Programming technique to restrict the temporal knowledge of shared head entities to non-overlapping time intervals.
“TAE-ILP [155] considers the valid time intervals of knowledge and uses the Integer Linear Programming technique to restrict the temporal knowledge of shared head entities to non-overlapping time intervals.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [155]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationGraIL proposes to learn entity-independent relational semantics and aggregates the representation of nodes by GNN, so GraIL can be naturally generalized to unseen nodes.
“GraIL [114] proposes to learn entity-independent relational semantics and aggregates the representation of nodes by GNN, so GraIL can be naturally generalized to unseen nodes.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [114]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationGEN proposes an inductive learning module to extrapolate knowledge in the support set and then considers interrelationships between unseen entities in the transductive learning module.
“GEN [139] proposes an inductive learning module to extrapolate knowledge in the support set and then considers interrelationships between unseen entities in the transductive learning module.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [139]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationYao et al. proposes a data augmentation technique from inter-task view to generate new tasks for few-shot knowledge graph completion, and from intra-task view to enrich the support or query set for an individual task.
“Yao et al. [145] proposes a data augmentation technique from inter-task view to generate new tasks for few-shot knowledge graph completion, and from intra-task view to enrich the support or query set for an individual task.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [145]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenBoth static or dynamic knowledge graphs only record the knowledge graph at a certain time or the latest state, and cannot reflect the evolution process of the relations between entities at different times.
“Both static or dynamic knowledge graphs only record the knowledge graph at a certain time or the latest state, and cannot reflect the evolution process of the relations between entities at different times.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationTAE incorporates the temporal information of relationships using a temporal matrix to learn relationship representations that contain temporal information.
“The time-aware embedding (TAE) incorporates the temporal information of relationships using a temporal matrix to learn relationship representations that contain temporal information.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [154]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
InterpretationreasoningLLM-based models like KG-BERT, StAR, and CKBC can also be used in DKGR since they are able to deal with unseen entities via the pre-trained prior knowledge in LLMs.
“LLM-based models mentioned in Section 4.1.4like KG-BERT, StAR, CKBC can also be used in DKGR since they are able to deal with unseen entities via the pre-trained prior knowledge in LLMs.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Premisenone givenCP decomposition decomposes high-dimensional tensors into a series of rank tensors, and Tucker decomposition considers the core tensor, which represents the main properties of the original tensor.
“The former decomposes high-dimensional tensors into a series of rank tensors, and the latter considers the core tensor, which represents the main properties of the original tensor.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationTemporal knowledge graph reasoning includes two parts: temporal knowledge graph completion (explaining the TKG at some past time) and temporal knowledge graph prediction (predicting the state of TKG at a given future time).
“The temporal knowledge graph reasoning includes two parts as shown in Figure 12: The temporal knowledge graph completion(explaining the TKG at some past time), and the temporal knowledge graph prediction (predicting the state of TKG at a given future time) [146].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [146]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
InterpretationreasoningLLMs enable LLM-based DKGs methods to have language comprehension skills and be able to deal with emerging entities and relations in the semantic space.
“LLMs enable LLM-based DKGs methods to have language comprehension skills and be able to deal with emerging entities and relations in the semantic space.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
PremisereasoningDifferent from static or dynamic knowledge graphs, the temporal knowledge graph records the valid time of knowledge.
“Different from them, the temporal knowledge graph records the valid time of knowledge.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
PremisecitationLacroix et al. represented the temporal knowledge graph as a four-dimensional tensor and extended ComplEX to temporal knowledge graph reasoning, proposing the CP decomposition method TComplEX.
“Lacroix et al. [149] represented the temporal knowledge graph as a four-dimensional tensor and extends the ComplEX [92] to the temporal knowledge graph reasoning, proposing the CP decomposition method TComplEX.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [149]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [92]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationTACT categorizes topology-aware correlations between relations into seven topological patterns, and learns their importance in an entity-independent manner for inductive link prediction.
“TACT [119] categorizes topology-aware correlations between relations into seven topological patterns, and learns their importance in an entity-independent manner for inductive link prediction.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [119]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationTIMEPLEX considers the periodicity scores and temporal dependency scores of the relations in the reasoning procedure.
“Based on [150], TIMEPLEX [153] considers the periodicity scores and temporal dependency scores of the relations in the reasoning procedure.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [153]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenExisting dynamic knowledge graph reasoning methods are categorized according to their modeling perspectives into GNN-based methods and LLM-based methods.
“We categorized the existing methods according to their modeling perspectives: GNN-based methods and LLMbased methods.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
InterpretationcitationIn KEPLER, knowledge embeddings provide factual knowledge for PLMs, while informative text data also benefit knowledge embeddings.
“In KEPLER, knowledge embeddings provide factual knowledge for PLMs, while informative text data also benefit knowledge embeddings.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [129]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationFSRL proposes to discover facts of new relations with few-shot references, which is more suitable for practical scenarios than one-shot and zero-shot learning.
“However, FSRL [134] thinks works of one-shot and zeroshot learning limit the generalizability of models and do not fully use the supervisory information, so FSRL proposes to discover facts of new relations with few-shot references which is more suitable for practical scenarios.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [134]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenMethods for temporal knowledge graph reasoning are classified into two categories: completion methods and prediction methods.
“In this section, we classify the methods for temporal knowledge graph reasoning into two categories: completion methods and prediction methods.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds.
Interpretationnone givenThe dynamic properties in few-shot learning have not been widely researched.
“However, the dynamic properties in few-shot learning have not been widely researched.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenLLM-based DKGR methods may face the shortcomings of high GPU memory and the static property of LLMs may not catch up with the dynamic property of DKGs for the rapid update of DKGs.
“However, LLMbased DKGR methods may face the shortcomings of high GPU memory and the static property of LLMs may not catch up with the dynamic property of DKGs for the rapid update of DKGs.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationGMatching is the first to propose the task of predicting long-tail relations and formulate it as one-shot relational learning.
“GMatching [132] is the first to propose the task of predicting longtail relations and formulate it as one-shot relational learning.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [132]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationPathCon leverages relational context and relational paths to directly pass relational messages among edges iteratively to aggregate neighborhood information, and is applicable to inductive settings since nodes temporarily store messages from their neighbor edges.
“PathCon [120] leverages relational context and relational paths to directly pass relational messages among edges iteratively to aggregate neighborhood information.PathCon is applicable to the inductive settings since nodes temporarily store the messages from their neighbor edges.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [120]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
InterpretationreasoningMeta-learning for the few-shot setting aims to capture transferable relation-specific meta-information and is suitable and well-performing for dynamic knowledge graphs, since emerging relations usually have few links.
“Meta-learning for the few-shot setting aims to capture transferable relation-specific meta-information and is suitable and well-performing for dynamic knowledge graphs, since emerging relations usually have few links.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenGNN-based dynamic knowledge graph reasoning methods are categorized into four categories according to four sources of their inductive ability.
“In Figure 10, we categorize the GNN-based methods into four categories, according to four sources of their inductive ability.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationROLAND views the node embeddings at different GNN layers as hierarchical node states and then recurrently updates them, easily repurposing any static GNN to dynamic graphs.
“ROLAND [123] views the node embeddings at different GNN layers as hierarchical node states and then recurrently updates them, easily repurposing any static GNN to dynamic graphs.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [123]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationREFORM points out that plenty of errors could be inevitably incorporated in most existing large-scale KGs and proposes an error mitigation module to study error-aware few-shot KG completion.
“REFORM [143] points out that plenty of errors could be inevitably incorporated in most existing large-scale KGs and proposes an error mitigation module to study error-aware few-shot KG completion.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [143]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
InterpretationcitationGMatching learns a matching metric to discover similar triples for target triples, and once trained can be adapted to any new relations without fine-tuning, achieving one-shot learning.
“GMatching learns a matching metric to discover similar triples for target triples.Once trained, GMatching can be adapted to any new relations without fine-tuning, achieving one-shot learning.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [132]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationMaKEr and MorsE propose a problem called inductive knowledge graph embedding and train knowledge graph embedding models based on meta-learning on a set of entities that can generalize to unseen entities for either in-KG (link prediction) or out-of-KG tasks (question answering).
“MaKEr [126] and MorsE [127] propose a problem called inductive knowledge graph embedding.They train knowledge graph embedding models based on metalearning on a set of entities that can generalize to unseen entities for either in-KG(i.e., link prediction) or out-of-KG tasks(i.e., question answering).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [126]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [127]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationSE-GNN studies KGE extrapolation problems from a data-relevant and model-independent view and proposes a GNN-based KGE method modeling the semantic evidence.
“SE-GNN [124] studies KGE extrapolation problems from a data-relevant and model-independent view and proposes a GNN-based KGE method modeling the semantic evidence.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [124]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationNiu et al. proposes a gated neighbor aggregator to filter the noise neighbors, capturing the most valuable contextual semantics of few-shot relations, and considers complex relations simultaneously.
“Niu et al. [142] proposes a gated neighbor aggregator to filter the noise neighbors, capturing the most valuable contextual semantics of few-shot relations, and considers complex relations simultaneously.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [142]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenFew-shot DKG reasoning is a relatively new research area and the meta-learning approach fixes the challenges of data limitation, to a certain extent.
“In conclusion, few-shot DKG reasoning is a relatively new research area and the meta-learning approach fixes the challenges of data limitation, to a certain extent.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenTensor decomposition-based completion methods learn the evolution law of the entire graph.
“The tensor decomposition-based completion methods learn the evolution law of the entire graph.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisereasoningGNN and its variants have been widely used for dynamic knowledge reasoning in dynamic knowledge graphs because GNN can model entities and relations based on connecting structure and has the potential to handle knowledge out of distribution.
“GNN and its variants have been widely used for dynamic knowledge reasoning in dynamic knowledge graphs (DKGs), since GNN can model entities and relations based on the connecting structure and has the potential to handle knowledge out of distribution.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenNeural-symbolic methods may face challenges related to scalability, computational complexity, implementation complexity, and sensitivity to data quality.
“However, they may face challenges related to scalability, computational complexity, implementation complexity, and sensitivity to data quality.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenThe temporal knowledge graph is represented as a sequence of static snapshots, which can be modeled as a sequence of matrices or high-dimensional tensors.
“As the temporal knowledge graph is represented as a sequence of static snapshots, which can be modeled as a sequence of matrices or high-dimensional tensors.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenLLM-based dynamic knowledge graph reasoning methods can be categorized into triple-level methods (depending on one single edge) and path-level methods (depending on paths composed of edges).
“They can be categorized into two groups: depending on one single edge (triple-level) and depending on paths composed of edges (path-level).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationFor zero-shot (new-added) relations, ZS-GAN is able to generate text category representations from text descriptions by setting adversarial learning goals.
“For zero-shot(new-added) relations, ZS-GAN [133] is able to generate text category representations from text descriptions by setting adversarial learning goals.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [133]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationINDIGO constructs a node-annotated graph, where nodes represent pairs of constants and two nodes are connected only if their pairs share a constant, and the original KG is fully encoded into a GNN in a transparent way.
“INDIGO [116] constructs a node-annotated graph, where nodes represent pairs of constants and two nodes are connected only if their pairs share a constant, and the original KG is fully encoded into a GNN in a transparent way.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [116]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenThe proposal of Large Language Models indicates that general semantic knowledge which widely exists in open source corpus can be encoded into the parameters of LLMs via pre-training and fine-tuning.
“The proposal of Large Language Models (LLMs) indicates that general semantic knowledge which widely exists in open source corpus can be encoded into the parameters of LLMs via pre-training and fine-tuning.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenTemporal knowledge graph completion methods can be divided into tensor decomposition-based completion methods and translation-based completion methods.
“The temporal knowledge graph completion methods can be divided into two parts: tensor decomposition-based completion methods and translation-based completion methods.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationFAAN formally proposes the notion of dynamic properties in few-shot KG completion for the first time and designs an adaptive attention network to adapt dynamic entity representations in different tasks.
“FAAN [135] formally proposes the notion of dynamic properties in few-shot KG completion for the first time and designs an adaptive attention network to adapt dynamic entity representations in different tasks.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [135]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationCoMPILE further considers the directed nature of the extracted subgraph structure to enable a sufficient flow of relation information, and can naturally handle asymmetric and anti-symmetric relations in subgraphs.
“Following GraIL, CoMPILE [115] further considers the directed nature of the extracted subgraph structure to enable a sufficient flow of relation information.Therefore, CoMPILE can naturally handle asymmetric and anti-symmetric relations in subgraphs.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [115]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationxERTE collects temporal paths from the target entity and propagates attention scores along the paths while continuously expanding the query subgraph.
“xERTE [170] collects temporal paths from the target entity and propagates attention scores along the paths while continuously expanding the query subgraph.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [170]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Interpretationnone givenKGs serve as a repository containing both logical and factual knowledge, providing a richer source of information.
“From the perspective of knowledge-driven LLM reasoning, KGs serve as a repository containing both logical and factual knowledge, providing a richer source of information.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenLLMs are the most powerful parameter knowledge form, excelling in generativity and adaptability, handling diverse tasks, but can be opaque in decision-making.
“LLMs are the most powerful parameter knowledge form, which excels in generativity and adaptability, handling diverse tasks, but can be opaque in decision-making.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenSequence neural network-based prediction methods consist of snapshot encoders and temporal encoders: snapshot encoders extract representations of entities at different times from the snapshot sequence; temporal encoders integrate the snapshot representations to learn the entity evolution information from them.
“Sequence neural network-based prediction methods consist of snapshot encoders and temporal encoders: snapshot encoders extract representations of entities at different times from the snapshot sequence; temporal encoders integrate the snapshot representations to learn the entity evolution information from them.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenThe temporal Point Process (TPP) is a probabilistic method for predicting future events.
“The temporal Point Process (TPP) is a probabilistic method for predicting future events.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenIn TPP-based prediction methods, the expected existence probability of knowledge at time t is represented as the product of the conditional intensity function and the survival function, i.e., f(t) = S(t)λ(t).
“In TPP-based prediction methods, the expected existence probability of knowledge at time t is represented as the product of the conditional intensity function and the survival function, i.e., f (t) = S(t)λ(t).”
Quote in the paperNot a substantial claimProbably not a substantial claim.
Premisenone givenIn an L-length temporal walk, the adjacent temporal edges should satisfy the temporal-ordered constraint t1 ≤ t2 ≤ ... ≤ tL, ensuring that the walk contains the temporal dependency information between entities.
“In an L-length temporal walk (v 1 , v 2 , t 1 ), (v 2 , v 3 , t 2 ), ..., (v L , v L+1 , t L ), the adjacent temporal edges should satisfy the temporal-ordered constraint t 1 ≤ t 2 ≤ ... ≤ t L , ensuring that the walk contains the temporal dependency information between entities.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenKGs significantly contribute to data organization and analysis across disparate sectors.
“In summation, KGs significantly contribute to data organization and analysis across disparate sectors.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenPattern induction capabilities of LLMs present new opportunities for neural-symbolic reasoning.
“In terms of knowledge inference, the pattern induction capabilities of LLMs present new opportunities for neural-symbolic reasoning.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
InterpretationreasoningQuality control and maintenance are crucial in knowledge engineering, affecting KG usability in real-world applications because it is hard to ensure completeness and correctness of extracted knowledge.
“Quality control and maintenance are crucial in knowledge engineering, affecting KG usability in real-world applications because it is hard to ensure the completeness and correctness of extracted knowledge.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationTOKEI designs the hierarchical temporal matrix that is adaptable to different time granularities (e.g., year-month-day or year-quarter-month-week-day).
“Considering time information in knowledge graphs can be represented at different granularities, TOKEI [159] designs the hierarchical temporal matrix that is adaptable to different time granularities (e.g., year-month-day or yearquarter-month-week-day).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [159]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
Interpretationnone givenAs forms of KGs evolve, corresponding techniques still face various challenges and open problems.
“However, as the forms of KGs have evolving, the corresponding techniques still face various challenges and open problems in the future.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationTLogic considers the temporal properties of multi-hop relation reasoning and proposes the Cyclic Temporal Logical Rule.
“TLogic [167] considers the temporal properties of multi-hop relation reasoning and proposes the Cyclic Temporal Logical Rule, represented as:”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [167]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenThe TPP-based prediction methods treat the occurrences and disappearances of relations between entities as sequences of events, where the event probability depends on the historical evolution characteristics of relevant entities.
“The TPP-based prediction methods treat the occurrences and disappearances of relations between entities as sequences of events, where the event probability depends on the historical evolution characteristics of relevant entities.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenFor effectively learning the evolution of temporal knowledge graphs in a data-driven approach rather than the pre-defined conditional intensity function, neural temporal point processes have become a popular research direction for TPP-based prediction methods.
“For effectively learning the evolution of temporal knowledge graphs in a data-driven approach rather than the pre-defined conditional intensity function, neural temporal point processes have become a popular research direction for TPP-based prediction methods.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationTA-TRANSE takes into account that time sequences at different granularities are of unequal lengths, such as [1989] and [1989, January, 16th], and uses the LSTM to encode the time sequences as the temporal information of knowledge.
“TA-TRANSE [160] takes into account that time sequences at different granularities are of unequal lengths, such as [1989] and [1989, January, 16th].It uses the LSTM to encode the time sequences as the temporal information of knowledge.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [160]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenThe aforementioned temporal knowledge graph completion methods ignore the correlation between temporal information.
“However, the aforementioned methods ignore the correlation between temporal information.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationRE_NET aggregates the representations of entity neighbors in historical time steps, concatenates them with the vector representations of the head entity s and relation r, encodes the evolving information through RNN to obtain the latest representation of the tail entity, which is used to predict the correct entity in the next time step.
“RE_NET [177] aggregates the representations of entity neighbors in historical time steps, concatenates them with the vector representations of the head entity s and relation r, encodes the evolving information through RNN to obtain the latest representation of the tail entity, which is used to predict the correct entity in the next time step.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [177]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenTemporal knowledge graph prediction methods can be further categorized into three types: path-based prediction methods, point process-based prediction methods, and sequence network-based prediction methods.
“These methods can be further categorized into three types: path-based prediction methods, point process-based prediction methods, and sequence networkbased prediction methods.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenLLMs provide new perspectives on addressing quality control and maintenance challenges by leveraging parameterized knowledge learned from vast corpora for KGs' quality control and maintenance in an unsupervised way.
“The advent of LLMs provides new perspectives on addressing these challenges, which leverages parameterized knowledge of LLMs learned from vast corpora for KGs' quality control and maintenance in an unsupervised way.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationT-GAP designs an interpretable mechanism: starting from the target entity u in the incomplete knowledge (u, r, ?, t), T-GAP iteratively expands the subgraph using attention pruning strategies and updates the representations and attention scores of each entity in the subgraph through a time-aware graph neural network.
“T-GAP [165] designs an interpretable mechanism: starting from the target entity u in the incomplete knowledge (u, r, ?, t), T-GAP iteratively expands the subgraph using attention pruning strategies and updates the representations and attention scores of each entity in the subgraph through a time-aware graph neural network.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [165]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
Interpretationnone givenBy complementing each other, both KGs and LLMs have the potential to achieve superior performance and broader application scenarios.
“By complementing each other, both entities have the potential to achieve superior performance and broader application scenarios.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationKnow-evolve treats transient knowledge (u, r, v, t) as a probability event and uses a loss function based on a multivariate Rayleigh point process to model the event probability.
“It treats transient knowledge (u, r, v, t) as a probability event.It uses a loss function based on a multivariate Rayleigh point process to model the event probability.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [171]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationCEN considers the length diversity and temporal variability of temporal patterns, encodes multiple lengths using a relation-aware graph convolutional network to model the length diversity, and trains the model online to address temporal variability.
“CEN [179] considers the length diversity and temporal variability of temporal patterns.It encodes multiple lengths using a relation-aware graph convolutional network to model the length diversity and trains the model online to address temporal variability.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [179]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationRE-GCN uses a relation-aware graph convolutional network (RGCN) to encode snapshot features in the knowledge graph and then learns the evolution patterns of features through a recurrent neural network.
“To better learn the topological features of knowledge graphs at each stage, RE-GCN [178] uses a relation-aware graph convolutional network (RGCN) to encode snapshot features in the knowledge graph and then learns the evolution patterns of features through a recurrent neural network.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [178]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim.
Interpretationnone givenRecent advancements in neural or symbolic reasoning have highlighted the potential of integrating neural networks' data-driven learning with symbolic reasoning's structured logic to enhance reasoning on various KGs.
“Recent advancements in neural or symbolic reasoning have highlighted the potential of integrating neural networks' data-driven learning with symbolic reasoning's structured logic, to enhance reasoning on various KGs.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationM2DNE learns entity representations by modeling evolutionary trends at both macro and micro levels.
“M 2 DNE [174] learns entity representations by modeling evolutionary trends at both macro and micro levels.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [174]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence.
InterpretationreasoningThere is significant potential for integration between KGs and LLMs.
“In summary, despite the distinct characteristics and functionalities of KGs and LLMs, there is significant potential for integration between the two, as illustrated in Figure 15.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenIn finance, knowledge extraction, knowledge reasoning, and intelligent QA systems combining KGs with LLMs play a vital role.
“Specifically, knowledge extraction, knowledge reasoning, and intelligent QA systems that combine KGs with LLMs play a vital role in this domain.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationxERTE designs a temporal relation graph attention mechanism to guide expansion in the direction that benefits query prediction and the expanded subgraph can be viewed as an explanation for predicting the entity.
“xERTE designs a temporal relation graph attention mechanism to guide expansion in the direction that benefits query prediction and the expanded subgraph can be viewed as an explanation for predicting the entity.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [170]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationDyRep uses neural networks to model the conditional intensity function λ(u,v)k(t), which calculates the probability of the existence of associated knowledge between entities (u,v) at time t (k denotes the relation type).
“DyRep uses neural networks to model the conditional intensity function λ (u,v) k (t), which calculates the probability of the existence of associated knowledge between entities (u,v) at time t (k denotes the relation type).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [173]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
InterpretationreasoningLLMs can offer better extendability and expressibility to different kinds of downstream tasks and thus have a broader range of application scenarios.
“By contrast, LLMs can offer better extendability and expressibility to different kinds of downstream tasks and thus have a broader range of application scenarios.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationTRESCAL extends the static knowledge graph reasoning method RESCAL to temporal knowledge graph reasoning and considers that the information of relations evolves over time, with the relation-temporal matrix W r,t trained at different temporal information.
“TRESCAL [156] extends the static knowledge graph reasoning method RESCAL [90] to temporal knowledge graph reasoning.TRESCAL considers that the information of relations evolves over time, and the temporal information depends on the existence of the relationship, i.e., the relation-temporal matrix W r,t is trained at different temporal information.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [156]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [90]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may state two separate claims as one.
InterpretationreasoningThe finance sector benefits from KGs by streamlining information extraction, enabling sophisticated knowledge reasoning, and enhancing user interaction through integration with LLMs.
“In conclusion, the finance sector benefits immensely from knowledge graphs by streamlining information extraction, enabling sophisticated knowledge reasoning, and enhancing user interaction through the integration of large language models.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
PremisecitationDANE, DACHA, and HIP also design structure-temporal self-attention mechanisms, which are applied to the entity and relation prediction tasks.
“Moreover, DANE [184], DACHA [185], HIP [186] also design structuretemporal self-attention mechanisms, which are applied to the entity and relation prediction tasks.”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [184]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [185]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [186]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThe path-based prediction methods of temporal knowledge graphs believe that the temporal walks in the graph reflect the evolution rules of knowledge.
“The path-based prediction methods of temporal knowledge graphs believe that the temporal walks [166] in the graph reflect the evolution rules of knowledge.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [166]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenLLMs can offer unsupervised quality control and maintenance for KGs, ensuring quality and accuracy of knowledge.
“Additionally, LLMs can offer unsupervised quality control and maintenance for KGs, ensuring the quality and accuracy of knowledge.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationRecurrent neural networks suffer from the problem of information forgetting when encoding long-distance temporal information and perform poorly in multi-step prediction tasks.
“However, recurrent neural networks suffer from the problem of information forgetting when encoding long-distance temporal information and perform poorly in multi-step prediction tasks [181].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [181]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim.
InterpretationreasoningKGs and LLMs represent contrasting paradigms in knowledge representation.
“Knowledge Graphs and Large Language Models represent contrasting paradigms in knowledge representation.”
Quote in the paperSubstantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenKGs are the most representative symbolic knowledge form, providing interpretability through structured information, yet may lack flexibility.
“KGs are the most representative symbolic knowledge form, which provides interpretability through structured information, yet may lack flexibility.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationDySAT proposes a structural-temporal attention mechanism: the structure self-attention mechanism extracts features from the entity neighborhoods in each snapshot and aggregates them with weights, while the temporal self-attention mechanism captures the evolution law by flexibly weighting the historical entity representations of multiple time steps.
“Furthermore, DySAT [181] proposes a structural-temporal attention mechanism.The structure self-attention mechanism extracts features from the entity neighborhoods in each snapshot and aggregates them with weights, while the temporal self-attention mechanism captures the evolution law by flexibly weighting the historical entity representations of multiple time steps.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [181]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationTeMP uses R-GCN as the snapshot encoder to extract the historical vector sequence of the target entity s, x s,t-τ , . . ., x s,t-1 , x s,t ; based on the self-attention mechanism, the temporal encoder aggregates the historical vector sequence with weights to obtain the vector representation z s,t of entity s at time t.
“TeMP [183] uses R-GCN [99] as the snapshot encoder to extract the historical vector sequence of the target entity s, x s,t-τ , . . ., x s,t-1 , x s,t ; based on the self-attention mechanism, the temporal encoder aggregates the historical vector sequence with weights to obtain the vector representation z s,t of entity s at time t.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [183]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [99]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenTemporal knowledge graph prediction methods aim to learn the evolution patterns of TKG historical information to predict future states.
“Temporal knowledge graph prediction methods aim to learn the evolution patterns of TKG historical information to predict future states.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenBased on the types of temporal encoders, sequence neural network-based prediction methods can be divided into RNN-based temporal encoding methods and self-attention-based temporal encoding methods.
“Based on the types of temporal encoders, these methods can be divided into RNN-based temporal encoding methods and self-attention-based temporal encoding methods.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenThe interplay between KGs and advanced technologies like LLMs amplifies their application spectrum, propelling innovation and efficiency.
“The interplay between KGs and advanced technologies like LLMs further amplifies their application spectrum, propelling innovation and efficiency.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationTIME2BOX and RTGE both design temporal smoothing mechanisms to constrain the change in adjacent time vectors.
“TIME2BOX [162] and RTGE [163] both design temporal smoothing mechanisms to constrain the change in adjacent time vectors.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [162]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [163]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenThe self-attention mechanism can effectively alleviate the forgetting problem in encoding long-distance time series.
“The selfattention mechanism can effectively alleviate the forgetting problem in encoding long-distance time series.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationATiSE considers uncertainty in the time functions and adds random noise to the representation of entities and relations to simulate random interference factors, and conducts reasoning by learning the parameters of a multi-dimensional Gaussian distribution composed of linear trend, periodic trend, and noise.
“Furthermore, ATiSE [8] considers uncertainty in the time functions and adds random noise to the representation of entities and relations to simulate random interference factors.It conducts reasoning by learning the parameters of a multi-dimensional Gaussian distribution composed of three factors: linear trend, periodic trend, and noise.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [8]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationTLogic learns the confidence of cyclic temporal logical rules through statistical frequency and selects high-confidence paths as reasoning rules.
“TLogic learns the confidence of cyclic temporal logical rules through statistical frequency and selects high-confidence paths as reasoning rules, such as:”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [167]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationDiachronic embedding regards representations of entity and relation as a series of time functions, which use parameterized Fourier functions to encode the entity and relation representations at time spots.
“Diachronic embedding [164] regards representations of entity and relation as a series of time functions, which use parameterized Fourier functions to encode the entity and relation representations at time spots.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [164]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenThe completion methods implicitly represented the time information, and model the evolution of entities or relations with time as functions, which reflects the evolution trend of each entity at each moment.
“The completion methods implicitly represented the time information, and model the evolution of entities or relations with time as functions, which reflects the evolution trend of each entity at each moment.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenMost knowledge extraction tasks are labeling tasks, while generative LLMs are good at generation tasks.
“This is because most of the knowledge extraction tasks are labeling tasks, while generative LLMs are good at generation tasks.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationTTransE learns the time representation based on the static knowledge reasoning method TransE, and combines the representation of entities, relations, and time information to calculate the confidence of the temporal knowledge.
“TTransE [156] learns the time representation based on the static knowledge reasoning method TransE, and combines the representation of entities, relations, and time information to calculate the confidence of the temporal knowledge.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [156]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim.
InterpretationreasoningThis fusion aims to overcome limitations of exclusively neural or symbolic approaches, particularly in representing dynamic and time-variant nature of real-world knowledge in DKGs and TKGs.
“This fusion aims to overcome limitations posed by exclusively neural or symbolic approaches, particularly in representing the dynamic and time-variant nature of real-world knowledge in DKGs and TKGs.”
Quote in the paperSubstantial claimProbably not a substantial claim.
PremisereasoningDue to the graph nature of temporal knowledge graphs, the sampled time-constrained random walk paths in temporal knowledge graphs can be viewed as multi-hop relations between entities to represent reasoning rules.
“Due to the graph nature of temporal knowledge graphs, the sampled timeconstrained random walk paths in temporal knowledge graphs can be viewed as multi-hop relations between entities to represent reasoning rules.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
PremisecitationHiSMatch uses relation-aware graph neural networks and recurrent neural networks to distinguish between graph sequences relevant to queries and those relevant to candidate entities and proposes a matching framework for temporal reasoning.
“HiSMatch [180] uses relation-aware graph neural networks and recurrent neural networks to distinguish between graph sequences relevant to queries and those relevant to candidate entities and proposes a matching framework for temporal reasoning.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [180]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenThe emergence of LLMs presents an opportunity to uncover underlying patterns in knowledge, aiding in reasoning tasks.
“Furthermore, the emergence of LLMs presents an opportunity to uncover underlying patterns in knowledge, aiding in reasoning tasks.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationThe Cyclic Temporal Logical Rule strictly follows the temporal-ordered constraint to collect temporal walks and represents the evolution feature of multi-hop relation reasoning.
“The Cyclic Temporal Logical Rule (CTL) strictly follows the temporal-ordered constraint to collect temporal walks and represents the evolution feature of multihop relation reasoning.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [167]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationHyTE designs the time hyperplane to reflect the entity and relation information at a specific time.
“HyTE [157] designs the time hyperplane to reflect the entity and relation information at a specific time.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [157]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenUtilizing text processing capabilities of LLMs, KGs can achieve more efficient unsupervised knowledge extraction during construction, enhancing automated building and editing capabilities.
“Utilizing the text processing capabilities of LLMs, KGs can achieve more efficient unsupervised knowledge extraction during their construction phase, thereby enhancing their automated building and editing capabilities.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Events are dynamic and temporal in nature, and relations between events and facts are often temporal or causal.
“Noteworthy, events are dynamic and tem- poral in nature and relations between events and facts are often temporal or causal ones.”
The paper relies on this without support.
Existing survey papers each only focus on technologies related to a single type of knowledge graph and thus do not study the difference and connection between the types of their target knowledge graphs.
“Although there are several survey papers focusing on knowledge graphs and the relevant techniques of knowledge extraction and KGR, they each only focus on technologies related to a single type of KGs and thus do not study the difference and connection between the types of their target KGs.”
The paper relies on this without support.
Entity-centric knowledge graphs are unable to elegantly represent the event information that appears in news texts.
“Nevertheless, entity-centric KGs are still unable to elegantly represent the event information that appears in news texts.”
The paper relies on this without support.
Traditional knowledge graph reasoning methods are under a closed-world assumption, so these models are designed for a fixed set of entities and relations and are unable to consider unseen components.
“Traditional knowledge graph reasoning methods are under a closed-world assumption, so these models are designed for a fixed set of entities and relations and are unable to consider unseen components.”
The paper relies on this without support.
New entities and relations emerge continuously in the ever-changing real world due to improvements to knowledge extraction techniques and refinement/enrichment of information.
“However, new entities and relations emerge continuously in the ever-changing real world due to several reasons, such as improvements to the knowledge extraction techniques and refinement/enrichment of information.”
The paper relies on this without support.
With the changing of dynamic knowledge graphs, there is a certain probability that unseen entities and relations are long-tail.
“With the changing of DKGs, there is a certain probability that unseen entities and relations are long-tail.”
The paper relies on this without support.
The representations of unseen relations and entities cannot be sufficiently trained given limited training instances in the few-shot setting.
“Therefore, the representations of unseen relations and entities cannot be sufficiently trained given limited training instances (fewshot setting).”
The paper relies on this without support.
Subgraphs consisting of the local neighborhood of a particular triplet in dynamic knowledge graphs contain the logical evidence needed to deduce the relation between the target nodes.
“Subgraphs consisting of the local neighborhood of a particular triplet in DKGs have been proven to contain the logical evidence needed to deduce the relation between the target nodes.”
The paper relies on this without support.
Most existing knowledge extraction methods are supervised models needing a large amount of labeled data.
“Most of the existing knowledge extraction methods are supervised models needing a large amount of labeled data.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
The section guide assigns the definitions to Section 1 instead of Section 2
MinorThe article guide says Section 1 introduces the evolution, definitions, and notations, but Section 2 says it provides the notations and four definitions.
“Sec. 1 introduces the formal evolution of KGs, as well as relevant definitions and notations;”
“In this section, we first summarize the notation as shown in Table 1, then we will provide definitions of the four types of KGs”
The authors attributed to reference [46] do not match its entry
MinorThe main text attributes the subsequence-kernel approach in [46] to Tazvan et al., whereas reference [46] lists Bunescu and Mooney.
“Tazvan et al. [46] apply a kernel-based approach with subsequence patterns, showing effectiveness in two corpora.”
“46. R. C. Bunescu and R. J. Mooney, "Subsequence kernels for rela- tion extraction," in Proc. of NeurIPS, 2005.”
The authors attributed to TRE reference [50] do not match its entry
MinorThe text attributes TRE [50] to Wu et al., while reference [50] lists Alt, Marc, and Leonhard.
“Wu et al. [50] further develop TRE, a self-attentive architecture model.”
“50. C. Alt, H. Marc, and H. Leonhard, "Improving relation extraction by pre-trained language representations," 2019.”
The descriptions of event-extraction references [71] and [72] are reversed
MinorThe text assigns an RNN to [71] and CNNs to [72]. Their reference titles identify [71] as a convolutional-network paper and [72] as a recurrent-network paper.
“Nguyen et al. [71] employs an RNN for trigger detection, while Ghaeini et al. [72] uses CNNs with skip-gram models for context capture.”
“71. T. H. Nguyen and R. Grishman, "Modeling skip-grams for event detection with convolutional neural networks," in Proc. of EMNLP, 2016. 72. R. Ghaeini, X. Fern, L. Huang, and P. Tadepalli, "Event nugget detection with forward-backward recurrent neural networks," in Proc. of ACL, 2016.”
Table 2 gives different references for BERT and ELMo
MinorThe table labels BERT [85] and ELMo [86], while the main text consistently identifies them as BERT [37] and ELMo [36].
“Flair [35], BERT [85], ELMo [86] ...”
“LMs are divided into static and contextualized embeddings, with the former represented by GloVe [33] and word2vec [34], and the latter by advanced models like Flair [35], ELMo [36], and BERT [37].”
The cited reference for GHNN describes a different task
MinorThe text presents [172] as a Graph Hawkes Neural Network for future prediction, but the entry for [172] is titled as a graph-network paper on fake-news detection.
“The Graph Hawkes Neural Network (GHNN) [172] can effectively aggregate information from current entity neighbors to predict the future.”
“172. Y. Han, S. Karunasekera, and C. Leckie, "Graph neural networks with continual learning for fake news detection from social media," ArXiv preprint, 2020.”
Table 2 gives different references for the same static embeddings
MinorTable 2 cites [39], [40], and [84] for word2vec, GloVe, and fastText, respectively; the main text identifies them as [34], [33], and [38].
“word2vec [39], GloVe [40], [83], fastText [84]...”
“Word2vec [34], GloVe [33], and fastText [38] represent early milestones in word representation”
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
Vrandečić, D., & Krötzsch, M. (2014) · Communications of the ACM · doi:10.1145/2629489 · Cited by 3,367
Knowledge Graph Embedding: A Survey of Approaches and Applications
Wang, Q., Mao, Z., Wang, B., & Guo, L. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2754499 · Cited by 2,654
Yago: a core of semantic knowledge
Suchanek, F. M., Kasneci, G., & Weikum, G. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242667 · Cited by 2,512
ConceptNet 5.5: An Open Multilingual Graph of General Knowledge
Speer, R., Chin, J., & Havasi, C. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11164 · Cited by 2,312
Fast and Accurate Entity Recognition with Iterated Dilated Convolutions
Strubell, E., Verga, P. W., Belanger, D., & McCallum, A. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1283 · Cited by 531
Coupled semi-supervised learning for information extraction
Carlson, J. A., Betteridge, J., Wang, R. C., Junior, E. R. H., & Mitchell, T. M. (2010) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1718487.1718501 · Cited by 420
Fellbaum, C. (2010) · Springer eBooks · doi:10.1007/978-90-481-8847-5_10 · Cited by 361
Linked data quality of DBpedia, Freebase, OpenCyc, Wikidata, and YAGO
Färber, M., Bartscherer, F., Menne, C., et al. (2017) · Semantic Web · doi:10.3233/sw-170275 · Cited by 352
Named Entity Recognition and Relation Extraction: State-of-the-Art
Nasar, Z., Jaffry, S. W., & Malik, M. K. (2022) · ACM Computing Surveys · doi:10.1145/3445965 · Cited by 245
HowNet - a hybrid language and knowledge resource
Dong, Z., & Dong, Q. (2004) · International Conference on Natural Language Processing and Knowledge Engineering (NLPKE) · doi:10.1109/nlpke.2003.1276017 · Cited by 212
Neural Models for Sequence Chunking
Zhai, F., Potdar, S., Xiang, B., & Zhou, B. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10995 · Cited by 131
MindMap: Knowledge graph prompting sparks graph of thoughts in large language models
Wen, Y., Wang, Z., & Sun, J. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.558 · Cited by 113
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases
Cao, B., Lin, H., Han, X., Sun, L., Yan, L., Liao, M., Xue, T., & Xu, J. (2021) · doi:10.18653/v1/2021.acl-long.146 · Cited by 105
Temporal Knowledge Graph Completion Based on Time Series Gaussian Embedding
Xu, C., Nayyeri, M., Alkhoury, F., Yazdi, H. S., & Lehmann, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62419-4_37 · Cited by 104
Self-citationWhat is Event Knowledge Graph: A Survey
Guan, S., Cheng, X., Bai, L., Zhang, F., Li, Z., Zeng, Y., Jin, X., & Guo, J. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3180362 · Cited by 86
Self-citationNamed Entity Recognition With Parallel Recurrent Neural Networks
Žukov-Gregorič, A., Bachrach, Y., & Coope, S. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2012 · Cited by 68
UMLS users and uses: a current overview
Amos, L., Anderson, D. P., Brody, S., Ripple, A., & Humphreys, B. L. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa084 · Cited by 48
Segment-Level Sequence Modeling using Gated Recursive Semi-Markov Conditional Random Fields
Zhuo, J., Cao, Y., Zhu, J., Zhang, B., & Nie, Z. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1134 · Cited by 36
Meng, Z., Liu, F., Shareghi, E., Su, Y., Collins, C., & Collier, N. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.329 · Cited by 25
DBpedia FlexiFusion the Best of Wikipedia > Wikidata > Your Data
Frey, J., Hofer, M., Obraczka, D., Lehmann, J., & Hellmann, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30796-7_7
Völkel, M., Krötzsch, M., Vrandecic, D., Haller, H., & Studer, R. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135863
Ontology Alignment for Linked Open Data
Jain, P., Hitzler, P., Sheth, A. P., Verma, K., & Yeh, P. Z. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-17746-0_26
EEG: Knowledge Base for Event Evolutionary Principles and Patterns
Li, Z., Zhao, S., Ding, X., & Liu, T. (2017) · Communications in Computer and Information Science · doi:10.1007/978-981-10-6805-8_4
Flagged first, then by citations
Research works printed but not linked: 167
- T. Steiner, R. Verborgh, R. Troncy, J. Gabarro, and R. Van de Walle, "Adding realtime coverage to the google knowledge graph," in Proc. of ISWC, 2012.
- S. Ji, S. Pan, E. Cambria, P. Marttinen, and P. S. Yu, "A survey on knowledge graphs: Representation, acquisition and applica- tions," ArXiv preprint, 2020.
- F. Mahdisoltani, J. Biega, and F. M. Suchanek, "YAGO3: A knowl- edge base from multilingual wikipedias," in Proc. of CIDR, 2015.
- M. Rospocher, M. Van Erp, P. Vossen, A. Fokkens, I. Aldabe, G. Rigau, A. Soroa, T. Ploeger, and T. Bogaard, "Building event- centric knowledge graphs from news," Journal of Web Semantics, 2016.
- J. Li, A. Sun, J. Han, and C. Li, "A survey on deep learning for named entity recognition," IEEE Transactions on Knowledge and Data Engineering, 2020.
- W. W. Denham, "The detection of patterns in alyawara nonverbal behavior," Ph.D. dissertation, 1973.
- S. Gottschalk and E. Demidova, "Eventkg: A multilingual event- centric temporal knowledge graph," in The Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3-7, 2018, Proceedings 15, 2018.
- X. Ding, Z. Li, T. Liu, and K. Liao, "Elg: an event logic graph," ArXiv preprint, 2019.
- A. Akbik, D. Blythe, and R. Vollgraf, "Contextual string embed- dings for sequence labeling," in Proc. of COLING, 2018.
- M. E. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. Zettlemoyer, "Deep contextualized word representations," in Proc. of NAACL, 2018.
- J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, "BERT: Pre- training of deep bidirectional transformers for language under- standing," in Proc. of NAACL, 2019.
- P. Bojanowski, E. Grave, A. Joulin, and T. Mikolov, "Enriching word vectors with subword information," Transactions of the Association for Computational Linguistics, 2017.
- P.-H. Li, R.-P. Dong, Y.-S. Wang, J.-C. Chou, and W.-Y. Ma, "Leveraging linguistic structures for named entity recognition with bidirectional recursive neural networks," in Proc. of EMNLP, 2017.
- M. Lewis, Y. Liu, N. Goyal, M. Ghazvininejad, A. Mohamed, O. Levy, V. Stoyanov, and L. Zettlemoyer, "BART: Denoising sequence-to-sequence pre-training for natural language genera- tion, translation, and comprehension," in Proc. of ACL, 2020.
- B. Athiwaratkun, C. Nogueira dos Santos, J. Krone, and B. Xiang, "Augmented natural language for generative sequence labeling," in Proc. of EMNLP, 2020.
- G. Paolini, B. Athiwaratkun, J. Krone, J. Ma, A. Achille, R. Anub- hai, C. N. dos Santos, B. Xiang, and S. Soatto, "Structured prediction as translation between augmented natural languages," in Proc. of ICLR, 2021.
- B. Rink and S. Harabagiu, "UTD: Classifying semantic relations by combining lexical and semantic resources," in Proc. of SemEval, 2010.
- R. C. Bunescu and R. J. Mooney, "Subsequence kernels for rela- tion extraction," in Proc. of NeurIPS, 2005.
- D. Zeng, K. Liu, S. Lai, G. Zhou, and J. Zhao, "Relation classifica- tion via convolutional deep neural network," in Proc. of COLING, 2014.
- D. Zeng, K. Liu, Y. Chen, and J. Zhao, "Distant supervision for relation extraction via piecewise convolutional neural networks," in Proc. of EMNLP, 2015.
- S. Wu and Y. He, "Enriching pre-trained language model with entity information for relation classification," in Proc. of CIKM, 2019.
- L. Baldini Soares, N. FitzGerald, J. Ling, and T. Kwiatkowski, "Matching the blanks: Distributional similarity for relation learn- ing," in Proc. of ACL, 2019.
- P.-L. Huguet Cabot and R. Navigli, "REBEL: Relation extraction by end-to-end language generation," in Proc. of EMNLP Findings, 2021.
- X. Zeng, S. He, D. Zeng, K. Liu, S. Liu, and J. Zhao, "Learning the extraction order of multiple relational facts in a sentence with reinforcement learning," in Proc. of EMNLP, 2019.
- M. Miwa and M. Bansal, "End-to-end relation extraction using LSTMs on sequences and tree structures," in Proc. of ACL, 2016.
- A. Katiyar and C. Cardie, "Going out on a limb: Joint extraction of entity mentions and relations without dependency trees," in Proc. of ACL, 2017.
- B. Yu, Z. Zhang, X. Shu, Y. Wang, T. Liu, B. Wang, and S. Li, "Joint extraction of entities and relations based on a novel decomposi- tion strategy," in Proc. of ECAI, 2020.
- Z. Wei, J. Su, Y. Wang, Y. Tian, and Y. Chang, "A novel cascade binary tagging framework for relational triple extraction," in Proc. of ACL, 2020.
- E. Markus and U. Adrian, "Span-based joint entity and relation extraction withtransformer pre-training," in Proc. of ECAI, 2020.
- D. Sui, X. Zeng, Y. Chen, K. Liu, and J. Zhao, "Joint entity and re- lation extraction with set prediction networks," IEEE Transactions on Neural Networks and Learning Systems, 2023.
- H. Ye, N. Zhang, S. Deng, M. Chen, C. Tan, F. Huang, and H. Chen, "Contrastive triple extraction with generative trans- former," in Proc. of AAAI, 2021.
- K.-H. Huang, S. Tang, and N. Peng, "Document-level entity- based extraction as template generation," in Proc. of EMNLP, 2021.
- O. Etzioni, M. J. Cafarella, D. Downey, S. Kok, A. Popescu, T. Shaked, S. Soderland, D. S. Weld, and A. Yates, "Web-scale information extraction in knowitall: (preliminary results)," in Proc. of WWW, 2004.
- Mausam, M. Schmitz, S. Soderland, R. Bart, and O. Etzioni, "Open language learning for information extraction," in Proc. of EMNLP, 2012.
- X. Dong, E. Gabrilovich, G. Heitz, W. Horn, N. Lao, K. Murphy, T. Strohmann, S. Sun, and W. Zhang, "Knowledge vault: a web- scale approach to probabilistic knowledge fusion," in Proc. of KDD, 2014.
- A. Carlson, J. Betteridge, B. Kisiel, B. Settles, E. R. H. Jr., and T. M. Mitchell, "Toward an architecture for never-ending language learning," in Proc. of AAAI, 2010.
- T. M. Mitchell, W. W. Cohen, E. R. H. Jr., P. P. Talukdar, J. Bet- teridge, A. Carlson, B. D. Mishra, M. Gardner, B. Kisiel, J. Krish- namurthy, N. Lao, K. Mazaitis, T. Mohamed, N. Nakashole, E. A. Platanios, A. Ritter, M. Samadi, B. Settles, R. C. Wang, D. Wijaya, A. Gupta, X. Chen, A. Saparov, M. Greaves, and J. Welling, "Never-ending learning," in Proc. of AAAI, 2015.
- J. Pustejovsky, J. M. Castano, R. Ingria, R. Sauri, R. J. Gaizauskas, A. Setzer, G. Katz, and D. R. Radev, "Timeml: Robust specification of event and temporal expressions in text." New directions in question answering, vol. 3, pp. 28-34, 2003.
- N. Chambers, "Event schema induction with a probabilistic entity-driven model," in Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013, pp. 1797- 1807.
- Q. Ning, B. Zhou, Z. Feng, H. Peng, and D. Roth, "Cogcomptime: A tool for understanding time in natural language," in Proceed- ings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 2018, pp. 72-77.
- S. Vashishtha, A. Poliak, Y. K. Lal, B. Van Durme, and A. S. White, "Temporal reasoning in natural language inference," in Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, pp. 4070-4078.
- T. H. Nguyen and R. Grishman, "Modeling skip-grams for event detection with convolutional neural networks," in Proc. of EMNLP, 2016.
- R. Ghaeini, X. Fern, L. Huang, and P. Tadepalli, "Event nugget detection with forward-backward recurrent neural networks," in Proc. of ACL, 2016.
- T. H. Nguyen and R. Grishman, "Graph convolutional networks with argument-aware pooling for event detection," in Proc. of AAAI, 2018.
- L. Du, X. Ding, K. Xiong, T. Liu, and B. Qin, "ExCAR: Event graph knowledge enhanced explainable causal reasoning," in Proc. of ACL, 2021.
- S. Yang, D. Feng, L. Qiao, Z. Kan, and D. Li, "Exploring pre- trained language models for event extraction and generation," in Proc. of ACL, 2019.
- Z. Tang, G. Hahn-Powell, and M. Surdeanu, "Exploring inter- pretability in event extraction: Multitask learning of a neural event classifier and an explanation decoder," in Proc. of ACL, 2020.
- M. Chen, Y. Cao, K. Deng, M. Li, K. Wang, J. Shao, and Y. Zhang, "ERGO: Event relational graph transformer for document-level event causality identification," in Proc. of COLING, 2022.
- H. Li, T. Mo, H. Fan, J. Wang, J. Wang, F. Zhang, and W. Li, "KiPT: Knowledge-injected prompt tuning for event detection," in Proc. of COLING, 2022.
- L. Du, X. Ding, Y. Zhang, T. Liu, and B. Qin, "A graph enhanced BERT model for event prediction," in Proc. of ACL Findings, 2022.
- Y. Zhou, X. Geng, T. Shen, G. Long, and D. Jiang, "Eventbert: A pre-trained model for event correlation reasoning," in Proceedings of the ACM Web Conference 2022, 2022.
- S. Fincke, S. Agarwal, S. Miller, and E. Boschee, "Language model priming for cross-lingual event extraction," in Proc. of AAAI, 2022.
- R. Han, X. Ren, and N. Peng, "ECONET: Effective continual pretraining of language models for event temporal reasoning," in Proc. of EMNLP, 2021.
- X. Ma and E. Hovy, "End-to-end sequence labeling via bi- directional LSTM-CNNs-CRF," in Proc. of ACL, 2016.
- C. Wang, K. Cho, and D. Kiela, "Code-switched named entity recognition with embedding attention," in Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching, 2018.
- X. Li, J. Feng, Y. Meng, Q. Han, F. Wu, and J. Li, "A unified MRC framework for named entity recognition," in Proc. of ACL, 2020.
- C. Xia, C. Zhang, T. Yang, Y. Li, N. Du, X. Wu, W. Fan, F. Ma, and P. Yu, "Multi-grained named entity recognition," in Proc. of ACL, 2019.
- C. Wang, X. Liu, Z. Chen, H. Hong, J. Tang, and D. Song, "Deep- Struct: Pretraining of language models for structure prediction," in Proc. of ACL Findings, 2022.
- H. Yan, T. Gui, J. Dai, Q. Guo, Z. Zhang, and X. Qiu, "A unified generative framework for various NER subtasks," in Proc. of ACL, 2021.
- Y. Chen, S. Liu, S. He, K. Liu, and J. Zhao, "Event extraction via bidirectional long short-term memory tensor neural networks," in Proc. of CCL, 2016.
- M. Nickel, V. Tresp, and H.-P. Kriegel, "A iee-way model for collective learning on multi-relational data." in ICML, 2011.
- B. Yang, W. Yih, X. He, J. Gao, and L. Deng, "Embedding entities and relations for learning and inference in knowledge bases," in Proc. of ICLR, 2015.
- T. Trouillon, J. Welbl, S. Riedel, É. Gaussier, and G. Bouchard, "Complex embeddings for simple link prediction," in Proc. of ICML, 2016.
- S. M. Kazemi and D. Poole, "Simple embedding for link predic- tion in knowledge graphs," in Proc. of NeurIPS, 2018.
- A. Bordes, N. Usunier, A. García-Durán, J. Weston, and O. Yakhnenko, "Translating embeddings for modeling multi- relational data," in Proc. of NeurIPS, 2013.
- Z. Wang, J. Zhang, J. Feng, and Z. Chen, "Knowledge graph embedding by translating on hyperplanes," in Proc. of AAAI, 2014.
- Y. Lin, Z. Liu, M. Sun, Y. Liu, and X. Zhu, "Learning entity and relation embeddings for knowledge graph completion," in Proc. of AAAI, 2015.
- Z. Sun, Z. Deng, J. Nie, and J. Tang, "Rotate: Knowledge graph embedding by relational rotation in complex space," in Proc. of ICLR, 2019.
- T. N. Kipf and M. Welling, "Semi-supervised classification with graph convolutional networks," in Proc. of ICLR, 2017.
- M. Schlichtkrull, T. N. Kipf, P. Bloem, R. v. d. Berg, I. Titov, and M. Welling, "Modeling relational data with graph convolutional networks," in European semantic web conference, 2018.
- S. Vashishth, S. Sanyal, V. Nitin, and P. P. Talukdar, "Composition- based multi-relational graph convolutional networks," in Proc. of ICLR, 2020.
- W. Liu, P. Zhou, Z. Zhao, Z. Wang, Q. Ju, H. Deng, and P. Wang, "K-BERT: enabling language representation with knowledge graph," in Proc. of AAAI, 2020.
- L. Yao, C. Mao, and Y. Luo, "Kg-bert: Bert for knowledge graph completion," ArXiv preprint, 2019.
- B. Kim, T. Hong, Y. Ko, and J. Seo, "Multi-task learning for knowl- edge graph completion with pre-trained language models," in Proc. of COLING, 2020.
- B. Wang, T. Shen, G. Long, T. Zhou, Y. Wang, and Y. Chang, "Structure-augmented text representation learning for efficient knowledge graph completion," in Proc. of WWW, 2021.
- J. Ju, D. Yang, and J. Liu, "Commonsense knowledge base com- pletion with relational graph attention network and pre-trained language model," in Proc. of CIKM, 2022.
- L. Wang, W. Zhao, Z. Wei, and J. Liu, "SimKGC: Simple con- trastive knowledge graph completion with pre-trained language models," in Proc. of ACL, 2022.
- Z. Zhang, X. Han, Z. Liu, X. Jiang, M. Sun, and Q. Liu, "ERNIE: Enhanced language representation with informative entities," in Proc. of ACL, 2019.
- S. Guo, Q. Wang, L. Wang, B. Wang, and L. Guo, "Jointly embed- ding knowledge graphs and logical rules," in Proc. of EMNLP, 2016.
- --, "Knowledge graph embedding with iterative guidance from soft rules," in Proc. of AAAI, 2018.
- Q. Wang, J. Liu, Y. Luo, B. Wang, and C.-Y. Lin, "Knowledge base completion via coupled path ranking," in Proc. of ACL, 2016.
- R. Das, S. Dhuliawala, M. Zaheer, L. Vilnis, I. Durugkar, A. Kr- ishnamurthy, A. Smola, and A. McCallum, "Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning," in Proc. of ICLR, 2018.
- K. Teru, E. Denis, and W. Hamilton, "Inductive relation predic- tion by subgraph reasoning," in Proc. of ICML, 2020.
- S. Mai, S. Zheng, Y. Yang, and H. Hu, "Communicative message passing for inductive relation reasoning," in Proc. of AAAI, 2021.
- S. Liu, B. C. Grau, I. Horrocks, and E. V. Kostylev, "INDIGO: gnn-based inductive knowledge graph completion using pair- wise encoding," in Proc. of NeurIPS, 2021.
- F. Yang, Z. Yang, and W. W. Cohen, "Differentiable learning of logical rules for knowledge base reasoning," in Proc. of NeurIPS, 2017.
- A. Sadeghian, M. Armandpour, P. Ding, and D. Z. Wang, "DRUM: end-to-end differentiable rule mining on knowledge graphs," in Proc. of NeurIPS, 2019.
- J. Chen, H. He, F. Wu, and J. Wang, "Topology-aware correlations between relations for inductive link prediction in knowledge graphs," in Proc. of AAAI, 2021.
- H. Wang, H. Ren, and J. Leskovec, "Relational message passing for knowledge graph completion," in Proc. of KDD, 2021.
- Y. Geng, J. Chen, W. Zhang, J. Z. Pan, M. Chen, H. Chen, and S. Jiang, "Relational message passing for fully inductive knowledge graph completion," ArXiv preprint, 2022.
- P. Wang, J. Han, C. Li, and R. Pan, "Logic attention based neighborhood aggregation for inductive knowledge graph em- bedding," in Proc. of AAAI, 2019.
- J. You, T. Du, and J. Leskovec, "ROLAND: graph learning frame- work for dynamic graphs," in Proc. of KDD, 2022.
- R. Li, Y. Cao, Q. Zhu, G. Bi, F. Fang, Y. Liu, and Q. Li, "How does knowledge graph embedding extrapolate to unseen data: A semantic evidence view," in Proc. of AAAI, 2022.
- Y. Zhang, W. Wang, W. Chen, J. Xu, A. Liu, and L. Zhao, "Meta-learning based hyper-relation feature modeling for out- of-knowledge-base embedding," in Proc. of CIKM, 2021.
- M. Chen, W. Zhang, Z. Yao, X. Chen, M. Ding, F. Huang, and H. Chen, "Meta-learning based knowledge extrapolation for knowledge graphs in the federated setting," ArXiv preprint, 2022.
- M. Chen, W. Zhang, Y. Zhu, H. Zhou, Z. Yuan, C. Xu, and H. Chen, "Meta-knowledge transfer for inductive knowledge graph embedding," in Proc. of SIGIR, 2022.
- R. Xie, Z. Liu, J. Jia, H. Luan, and M. Sun, "Representation learning of knowledge graphs with entity descriptions," in Proc. of AAAI, 2016.
- X. Wang, T. Gao, Z. Zhu, Z. Zhang, Z. Liu, J. Li, and J. Tang, "KEPLER: A unified model for knowledge embedding and pre- trained language representation," Transactions of the Association for Computational Linguistics, 2021.
- H. Zha, Z. Chen, and X. Yan, "Inductive relation prediction by BERT," in Proc. of AAAI, 2022.
- B. Peng, S. Liang, and M. Islam, "Bi-link: Bridging inductive link predictions from text via contrastive learning of transformers and prompts," ArXiv preprint, 2022.
- W. Xiong, M. Yu, S. Chang, X. Guo, and W. Y. Wang, "One-shot relational learning for knowledge graphs," in Proc. of EMNLP, 2018.
- P. Qin, X. Wang, W. Chen, C. Zhang, W. Xu, and W. Y. Wang, "Generative adversarial zero-shot relational learning for knowl- edge graphs," in Proc. of AAAI, 2020.
- C. Zhang, H. Yao, C. Huang, M. Jiang, Z. Li, and N. V. Chawla, "Few-shot knowledge graph completion," in Proc. of AAAI, 2020.
- J. Sheng, S. Guo, Z. Chen, J. Yue, L. Wang, T. Liu, and H. Xu, "Adaptive Attentional Network for Few-Shot Knowledge Graph Completion," in Proc. of EMNLP, 2020.
- M. Chen, W. Zhang, W. Zhang, Q. Chen, and H. Chen, "Meta relational learning for few-shot link prediction in knowledge graphs," in Proc. of EMNLP, 2019.
- X. Lv, Y. Gu, X. Han, L. Hou, J. Li, and Z. Liu, "Adapting meta knowledge graph information for multi-hop reasoning over few- shot relations," in Proc. of EMNLP, 2019.
- C. Zhang, L. Yu, M. Saebi, M. Jiang, and N. Chawla, "Few-shot multi-hop relation reasoning over knowledge bases," in Proc. of EMNLP Findings, 2020.
- J. Baek, D. B. Lee, and S. J. Hwang, "Learning to extrapolate knowledge: Transductive few-shot out-of-graph link prediction," in Proc. of NeurIPS, 2020.
- J. Xu, J. Zhang, X. Ke, Y. Dong, H. Chen, C. Li, and Y. Liu, "P-INT: A path-based interaction model for few-shot knowledge graph completion," in Proc. of EMNLP Findings, 2021.
- Y. Zhang, Y. Qian, Y. Ye, and C. Zhang, "Adapting distilled knowledge for few-shot relation reasoning over knowledge graphs," in Proc. of SDM, 2022.
- G. Niu, Y. Li, C. Tang, R. Geng, J. Dai, Q. Liu, H. Wang, J. Sun, F. Huang, and L. Si, "Relational learning with gated and attentive neighbor aggregator for few-shot knowledge graph completion," in Proc. of SIGIR, 2021.
- S. Wang, X. Huang, C. Chen, L. Wu, and J. Li, "REFORM: error- aware few-shot knowledge graph completion," in Proc. of CIKM, 2021.
- J. Zhang, T. Wu, and G. Qi, "Gaussian metric learning for few- shot uncertain knowledge graph completion," in Proc. of DAS- FAA, 2021.
- Y. Yao, Z. Zhang, Y. Xu, and C. Li, "Data augmentation for few- shot knowledge graph completion from hierarchical perspec- tive," in Proc. of COLING, 2022.
- F. L. Hitchcock, "The expression of a tensor or a polyadic as a sum of products," Journal of Mathematics and Physics, 1927.
- T. Lacroix, G. Obozinski, and N. Usunier, "Tensor decompositions for temporal knowledge base completion," in Proc. of ICLR, 2020.
- V. Tresp, Y. Ma, S. Baier, and Y. Yang, "Embedding learning for declarative memories," in The Semantic Web: 14th International Conference, ESWC 2017, Portoro, Slovenia, May 28-June 1, 2017, Proceedings, Part I 14, 2017.
- Y. Ma, V. Tresp, and E. A. Daxberger, "Embedding models for episodic knowledge graphs," Journal of Web Semantics, 2019.
- P. Jain, S. Rathi, Mausam, and S. Chakrabarti, "Temporal Knowl- edge Base Completion: New Algorithms and Evaluation Proto- cols," in Proc. of EMNLP, 2020.
- T. Jiang, T. Liu, T. Ge, L. Sha, S. Li, B. Chang, and Z. Sui, "Encoding temporal information for time-aware link prediction," in Proc. of EMNLP, 2016.
- T. Jiang, T. Liu, T. Ge, L. Sha, B. Chang, S. Li, and Z. Sui, "Towards time-aware knowledge graph completion," in Proc. of COLING, 2016.
- J. Leblay and M. W. Chekol, "Deriving validity time in knowl- edge graph," in Proc. of WWW, 2018.
- S. S. Dasgupta, S. N. Ray, and P. Talukdar, "HyTE: Hyperplane- based temporally aware knowledge graph embedding," in Proc. of EMNLP, 2018.
- C. Xu, M. Nayyeri, F. Alkhoury, H. Shariat Yazdi, and J. Lehmann, "TeRo: A time-aware knowledge graph embedding via temporal rotation," in Proc. of COLING, 2020.
- J. Leblay, M. W. Chekol, and X. Liu, "Towards temporal knowl- edge graph embeddings with arbitrary time precision," in Proc. of CIKM, 2020.
- A. García-Durán, S. Dumančić, and M. Niepert, "Learning se- quence encoders for temporal knowledge graph completion," in Proc. of EMNLP, 2018.
- C. Xu, Y.-Y. Chen, M. Nayyeri, and J. Lehmann, "Temporal knowledge graph completion using a linear temporal regularizer and multivector embeddings," in Proc. of NAACL, 2021.
- L. Cai, K. Janowicz, B. Yan, R. Zhu, and G. Mai, "Time in a box: advancing knowledge graph completion with temporal scopes," in Proceedings of the 11th on Knowledge Capture Conference, 2021.
- Y. Xu, S. Sun, Y. Miao, D. Yang, X. Meng, Y. Hu, K. Wang, H. Song, and C. Miao, "Time-aware graph embedding: A tem- poral smoothness and task-oriented approach," ArXiv preprint, 2020.
- R. Goel, S. M. Kazemi, M. Brubaker, and P. Poupart, "Diachronic embedding for temporal knowledge graph completion," in Proc. of AAAI, 2020.
- J. Jung, J. Jung, and U. Kang, "Learning to walk across time for interpretable temporal knowledge graph completion," in Proc. of KDD, 2021.
- G. H. Nguyen, J. B. Lee, R. A. Rossi, N. K. Ahmed, E. Koh, and S. Kim, "Dynamic network embeddings: From random walks to temporal random walks," in IEEE International Conference on Big Data, Big Data 2018, Seattle, WA, USA, December 10-13, 2018, 2018.
- Y. Liu, Y. Ma, M. Hildebrandt, M. Joblin, and V. Tresp, "Tlogic: Temporal logical rules for explainable link forecasting on tempo- ral knowledge graphs," in Proc. of AAAI, 2022.
- H. Sun, J. Zhong, Y. Ma, Z. Han, and K. He, "TimeTraveler: Rein- forcement learning for temporal knowledge graph forecasting," in Proc. of EMNLP, 2021.
- Z. Li, X. Jin, S. Guan, W. Li, J. Guo, Y. Wang, and X. Cheng, "Search from history and reason for future: Two-stage reasoning on temporal knowledge graphs," in Proc. of ACL, 2021.
- Z. Han, P. Chen, Y. Ma, and V. Tresp, "Explainable subgraph reasoning for forecasting on temporal knowledge graphs," in Proc. of ICLR, 2021.
- R. Trivedi, H. Dai, Y. Wang, and L. Song, "Know-evolve: Deep temporal reasoning for dynamic knowledge graphs," in Proc. of ICML, 2017.
- Y. Han, S. Karunasekera, and C. Leckie, "Graph neural networks with continual learning for fake news detection from social media," ArXiv preprint, 2020.
- R. Trivedi, M. Farajtabar, P. Biswal, and H. Zha, "Dyrep: Learning representations over dynamic graphs," in Proc. of ICLR, 2019.
- Y. Lu, X. Wang, C. Shi, P. S. Yu, and Y. Ye, "Temporal network embedding with micro-and macro-dynamics," in Proc. of CIKM, 2019.
- X. Chang, X. Liu, J. Wen, S. Li, Y. Fang, L. Song, and Y. Qi, "Continuous-time dynamic graph learning via neural interaction processes," in Proc. of CIKM, 2020.
- N. Park, F. Liu, P. Mehta, D. Cristofor, C. Faloutsos, and Y. Dong, "Evokg: Jointly modeling event time and network structure for reasoning over temporal knowledge graphs," in Proc. of WSDM, 2022.
- W. Jin, M. Qu, X. Jin, and X. Ren, "Recurrent event net- work: Autoregressive structure inferenceover temporal knowl- edge graphs," in Proc. of EMNLP, 2020.
- Z. Li, X. Jin, W. Li, S. Guan, J. Guo, H. Shen, Y. Wang, and X. Cheng, "Temporal knowledge graph reasoning based on evo- lutional representation learning," in Proc. of SIGIR, 2021.
- Z. Li, S. Guan, X. Jin, W. Peng, Y. Lyu, Y. Zhu, L. Bai, W. Li, J. Guo, and X. Cheng, "Complex evolutional pattern learning for temporal knowledge graph reasoning," in Proc. of ACL, 2022.
- Z. Li, Z. Hou, S. Guan, X. Jin, W. Peng, L. Bai, Y. Lyu, W. Li, J. Guo, and X. Cheng, "HiSMatch: Historical structure matching based temporal knowledge graph reasoning," in Proc. of EMNLP Findings, 2022.
- A. Sankar, Y. Wu, L. Gou, W. Zhang, and H. Yang, "Dysat: Deep neural representation learning on dynamic graphs via self- attention networks," in Proc. of WSDM, 2020.
- C. Xu, M. Nayyeri, Y.-Y. Chen, and J. Lehmann, "Geometric alge- bra based embeddings for static and temporal knowledge graph completion," IEEE Transactions on Knowledge and Data Engineering, 2022.
- J. Wu, M. Cao, J. C. K. Cheung, and W. L. Hamilton, "TeMP: Temporal message passing for temporal knowledge graph com- pletion," in Proc. of EMNLP, 2020.
- Z. Xu, Z. Ou, Q. Su, J. Yu, X. Quan, and Z. Lin, "Embedding dy- namic attributed networks by modeling the evolution processes," in Proc. of COLING, 2020.
- L. Chen, X. Tang, W. Chen, Y. Qian, Y. Li, and Y. Zhang, "Dacha: A dual graph convolution based temporal knowledge graph representation learning method using historical relation," ACM Transactions on Knowledge Discovery from Data (TKDD), 2021.
- Y. He, P. Zhang, L. Liu, Q. Liang, W. Zhang, and C. Zhang, "Hip network: Historical information passing network for extrapola- tion reasoning on temporal knowledge graph." in Proc. of IJCAI, 2021.
- B. AlKhamissi, M. Li, A. Celikyilmaz, M. Diab, and M. Ghazvininejad, "A review on language models as knowledge bases," ArXiv preprint, 2022.
- F. Petroni, T. Rocktäschel, S. Riedel, P. Lewis, A. Bakhtin, Y. Wu, and A. Miller, "Language models as knowledge bases?" in Proc. of EMNLP, 2019.
- Z. Jiang, F. F. Xu, J. Araki, and G. Neubig, "How can we know what language models know?" Transactions of the Association for Computational Linguistics, 2020.
- Z. Bouraoui, J. Camacho-Collados, and S. Schockaert, "Inducing relational knowledge from BERT," in Proc. of AAAI, 2020.
- A. Haviv, J. Berant, and A. Globerson, "BERTese: Learning to speak to BERT," in Proc. of EACL, 2021.
- T. Shin, Y. Razeghi, R. L. Logan IV, E. Wallace, and S. Singh, "AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts," in Proc. of EMNLP, 2020.
- Z. Zhong, D. Friedman, and D. Chen, "Factual probing is [MASK]: Learning vs. learning to recall," in Proc. of NAACL, 2021.
- D. Su, Y. Xu, G. I. Winata, P. Xu, H. Kim, Z. Liu, and P. Fung, "Generalizing question answering system with pre-trained lan- guage model fine-tuning," in Proceedings of the 2nd Workshop on Machine Reading for Question Answering, 2019.
- E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell, "On the dangers of stochastic parrots: Can language models be too big?" in Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, 2021.
- T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhari- wal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei, "Language models are few-shot learners," in Proc. of NeurIPS, 2020.
- B. Dhingra, J. R. Cole, J. M. Eisenschlos, D. Gillick, J. Eisenstein, and W. W. Cohen, "Time-aware language models as temporal knowledge bases," Transactions of the Association for Computational Linguistics, 2022.
- R. Han, X. Ren, and N. Peng, "ECONET: Effective continual pretraining of language models for event temporal reasoning," in Proc. of EMNLP, 2021.
- M. Sung, J. Lee, S. Yi, M. Jeon, S. Kim, and J. Kang, "Can language models be biomedical knowledge bases?" in Proc. of EMNLP, 2021.
- N. Poerner, U. Waltinger, and H. Schütze, "E-BERT: Efficient- yet-effective entity embeddings for BERT," in Proc. of EMNLP Findings, 2020.
- J. Sun, C. Xu, L. Tang, S. Wang, C. Lin, Y. Gong, H.-Y. Shum, and J. Guo, "Think-on-graph: Deep and responsible reasoning of large language model with knowledge graph," ArXiv preprint, 2023.
Cited by
Sorted by citations
A Survey of Large Language Models for Financial Applications: Progress, Prospects and ChallengesPreprint
Nie, Y., Kong, Y., Dong, X., Mulvey, J. M., Poor, H. V., Wen, Q., & Zohren, S. (2024) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2406.11903 · Cited by 287
Unlocking the Power of Large Language Models for Entity Alignment
Jiang, X., Shen, Y., Shi, Z., Xu, C., Wei, L., Li, Z., Guo, J. H., Shen, H., & Wang, Y. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.408 · Cited by 46
Self-citationLarge Language Models for Financial and Investment Management: Applications and Benchmarks
Kong, Y., Nie, Y., Dong, X., Mulvey, J. M., Poor, H. V., Wen, Q., & Zohren, S. (2024) · The Journal of Portfolio Management · doi:10.3905/jpm.2024.1.645 · Cited by 40
Sy, C. Y., Maceda, L. L., Canon, M. J. P., & Flores, N. M. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150323 · Cited by 25
RuleRAG: Rule-Guided Retrieval-Augmented Generation with Language Models for Question AnsweringPreprint
Chen, Z., Xu, C., Wang, D., Huang, Z., Dou, Y., Jiang, X., & Guo, J. (2024) · arXiv (Cornell University) · doi:10.13140/rg.2.2.32179.64806 · Cited by 18
Self-citationSynergizing a knowledge graph and large language model for relay catalysis pathway recommendation
Fu, F., Li, Q., Wang, F., Hu, J., Wang, T., Liu, Y., Xu, W., Lin, Z., Gong, F., Fan, Q., et al. (2025) · National Science Review · doi:10.1093/nsr/nwaf271 · Cited by 16
Self-citationNatural Evolution-based Dual-Level Aggregation for Temporal Knowledge Graph Reasoning
Chen, B., Xiao, C., & Zhou, F. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.543 · Cited by 10
A Survey of Link Prediction in N-ary Knowledge Graphs
Wei, J., Guan, S., Li, D., Hou, Z., Su, M., Guo, Y., Jin, X., Guo, J., & Cheng, X. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1451 · Cited by 10
Self-citationCong, Y., Yu, S., Chu, J., Huang, Y., Ding, N., Fang, C., & Wang, S. J. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103131 · Cited by 9
Self-citationThe New Quant: A Survey of Large Language Models in Financial Prediction and TradingPreprint
Fu, W. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.05533 · Cited by 9
Modeling reconfigurable supply chains using knowledge graphs: towards Supply Chain 5.0
Saidi, C., Hamani, N., Benaissa, M., Rolf, B., Reggelin, T., & Lang, S. (2025) · Production Engineering · doi:10.1007/s11740-025-01342-1 · Cited by 7
Cho, N., Srishankar, N., Cecchi, L., & Watson, W. (2024) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3677052.3698597 · Cited by 6
ATOM: AdapTive and OptiMized dynamic temporal knowledge graph construction using LLMs
Lairgi, Y., Moncla, L., Benabdeslem, K., Cazabet, R., & Cléau, P. (2026) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2026.findings-eacl.49 · Cited by 5
Ai, K., Karr, J. A., Jiang, M., Chawla, N. V., & Wang, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.05524 · Cited by 4
Liu, J., Peng, L., Yan, X., Zhang, L., Yang, C., Tao, Y., Tan, A. Y. X., Xu, T., Guo, S., Wang, H., et al. (2026) · Communications in Transportation Research · doi:10.26599/commtr.2026.9640023 · Cited by 3
ATOM: AdapTive and OptiMized dynamic temporal knowledge graph construction using LLMsPreprint
Lairgi, Y., Moncla, L., Benabdeslem, K., Cazabet, R., & Cléau, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.22590 · Cited by 3
Benchmarking Large Language Models for Knowledge Graph ValidationPreprint
Shami, F., Marchesin, S., & Silvello, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.10748 · Cited by 3
Wang, H., Wang, Z., Zhang, Y., Wang, B., & Wu, B. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.224 · Cited by 2
Enterprise violation risk deduction combining generative AI and event evolution graph
Zhong, C., Li, P., Wang, J., Xiong, X., Lv, Z., Zhou, X., & Zhao, Q. (2024) · Expert Systems · doi:10.1111/exsy.13622 · Cited by 2
Xiong, X., Wang, H., Wu, K., Yang, Z., Zhao, H., Wang, H., Liu, H., & Xiong, D. (2026) · doi:10.36227/techrxiv.177155935.57684125/v1 · Cited by 2
Wang, Q., Sun, J., Liu, G., Zhang, J., Gui, S., & Wang, Q. (2024) · International Conference on Robotics, Intelligent Control and Artificial Intelligence (RICAI) · doi:10.1109/ricai64321.2024.10911232 · Cited by 1
GraphRAG for Human Centricity in Supply Chain Reconfiguration
Saidi, C., Yaddaden, A., Hamani, N., & Benaissa, M. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-97992-7_69 · Cited by 1
Harnessing large language models to build knowledge graphs from earthquake news
Bautista, L. R. P., Vilches‐Blázquez, L. M., & Jiménez, S. (2025) · International Journal of Digital Earth · doi:10.1080/17538947.2025.2594950 · Cited by 1
Large language model (LLM) assisted causal knowledge graph generation framework for survey data
Rawal, A., Johnson, K., Martinez, R., & Mitchell, C. (2026) · Journal of Engineering Design · doi:10.1080/09544828.2026.2620966 · Cited by 1
Sassi, N., & Jaziri, W. (2026) · Scientific Reports · doi:10.1038/s41598-026-54449-5 · Cited by 1
Dynamic Knowledge Graph Asset PricingPreprint
Li, V. X., & Tan, Y. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4841921 · Cited by 1
Interpreting at Write Time: A Policy Ablation for Multi-Goal Agent MemoryPreprint
Sadowski, A., & Chudziak, J. A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.02897 · Cited by 1
Enhancing Factual Knowledge Retrieval Capabilities of Small Language Models for Natural Hazard
Bautista, L. R. P., Jiménez, S., & Vilches‐Blázquez, L. M. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-06760-9_2
High Performance Computing on CRESCO infrastructure: research activities and results 2023
Macchiagodena, M., Pagliai, M., & Procacci, P. (2025) · Florence Research (University of Florence)
Marrero, R. A. M. (2025) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Monte Carlo simulation for reactor calculations to medical terbium-161 production
Spagnuolo, L., Lepore1, L., Gandolfo, G., & Capogni, M. (2024) · IRIS Research product catalog (Sapienza University of Rome)
Measurement Data Management System Based on Graph Computing
Qiu, B., Meng, L., Liu, Q., Shen, Y., & Yuan, S. (2025) · Journal of big data and computing. · doi:10.62517/jbdc.202501416
Self-citationGil, J. P., Coquery, E., Samuel, J., & Gesquière, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.18654
Białczyk, K. M. (2025) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Knowledge representation evolution: From knowledge graphs to knowledge augmentation
Wang, H., & Wang, M. Y. (2026) · Journal of Terminology and Knowledge Engineering · doi:10.3724/jtke-20260001
Risk-Controlled Event-Driven Cascading Updates for Knowledge Graph Consistency Restoration
Ni, B., Ge, Q., Fu, H., Rossi, R. A., Liu, X., Xu, J., & Derr, T. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.2111
Revolutionizing Recommender Systems With GANs, LLMs, and Knowledge Graphs
Kodadi, S., Chetlapalli, H., Deevi, D. P., Dondapati, K., Wisdom, D. D., & Ankora, C. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7262-4.ch002
Commonsense Reasoning in Computer Vision: Foundations, Recent Advancements, and Future DirectionsPreprint
Mahmud, B. U., Barua, S., Hong, G. Y., Gupta, A., & Liu, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.05257
A Comprehensive Review on Synapse: A GraphRAG-Based Context-Aware Research Assistant
Tijare, P. P., Khairkar, P. A., Dhok, B., Chinchamalatpure, K., Gawali, A., & Dhote, D. (2026) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2026.85389
Graph Neural Networks for Automatic Term Generation: Defining and Exploring Terminological Graph
Fujii, T., Hazem, A., & Kageura, K. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.1507
An, C., Hao, Z., Yin, H., Yang, Q., & Li, Z. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840652
Metadata
- Authors
- Jiang, X., Xu, C., Shen, Y., Sun, X., Tang, L., Wang, S., Chen, Z., Wang, Y., & Guo, J.
- Affiliations
- Chinese Academy of Sciences (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2310.04835
- OpenAlex
- W4387559455
- Semantic Scholar
- 999e2ef54a779ba31043190d5726b55ee2b4281f
- Cited by
- 42
- References
- 1
- Citations by year
- 2026: 15 · 2025: 16 · 2024: 11
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (91646120, U1836206, 62172393, U21B2046)
- National Key Research and Development Program of China
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- knowledge graphs, dynamic knowledge graphs, temporal knowledge graphs, event knowledge graph, knowledge extraction, knowledge reasoning, knowledge engineering, financial analysis, large language models, knowledge representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review