The DOI matches its Crossref record; 122 of the 122 references it cites were found in a registry or an index; 10 of the 30 sources its claims cite were checked for support.
Scholarly knowledge graphs through structuring scholarly communication: a review
Open accessAbstract
The necessity for scholarly knowledge mining and management has grown significantly as academic literature and its linkages to authors produce enormously. Information extraction, ontology matching, and accessing academic components with relations have become more critical than ever. Therefore, with the advancement of scientific literature, scholarly knowledge graphs have become critical to various applications where semantics can impart meanings to concepts. The objective of study is to report a literature review regarding knowledge graph construction, refinement and utilization in scholarly domain. Based on scholarly literature, the study presents a complete assessment of current state-of-the-art techniques. We presented an analytical methodology to investigate the existing status of scholarly knowledge graphs(SKG) by structuring scholarly communication. This review paper investigates the field of applying machine learning, rule-based learning, and natural language processing tools and approaches to construct SKG. It further presents the review of knowledge graph utilization and refinement to provide a view of current research efforts. In addition, we offer existing applications and challenges across the board in construction, refinement and utilization collectively. This research will help to identify frontier trends of SKG which will motivate future researchers to carry forward their work.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This review surveys scholarly knowledge graphs (SKGs) across construction, utilization, and refinement, synthesizing machine learning, NLP, rule-based, ontology, and embedding approaches. It reports that SKG research remains fragmented, with translation-based embeddings most common for refinement and no standard evaluation protocol.
Key findings
- The review organizes SKG work into three areas: construction (information extraction, construction-method-level creation, knowledge fusion), utilization (querying, visualization, graph-to-text, dashboards), and refinement (translation-based, multiplicative, and deep-learning embeddings).
- Construction is dominated by entity/relation extraction; reported resources include AI-KG with 820K research entities and 14M RDF triples from 333K AI publications, AIDA with 21M papers and patents, MAKG with 210 million publications and 8 billion triples, and OAG with 0.7 billion entities and 2 billion relationships.
- Refinement results vary by task: Trans4E performed best for AIDA link prediction, TransD for DBLP/AIDA/MAG and CORD-19 association analysis, RotatE-SM for author recommendation, HolE for anti-symmetric relations in AceKG, ComplEx with 93.66% hit rate for a social-good SKG, and ConvTransE for biomedical treatment prediction.
- Utilization applications include graph-to-text generation (GraphWriter, Graformer), visualization/dashboards (AIDA dashboard, SciKGraph, Covid-KG), question answering (JarvisQA, CL-scholar), and recommendation/ranking; ResearchFlow found 89.8% of topics first evolved in academia before industry.
Methods
- Literature review guided by research questions on SKG construction (KGC), utilization (KGU), and refinement (KGR), with automatic searches in ACM Digital Library, Springer, ScienceDirect, IEEE Xplore, and Google Scholar, plus prominent conferences such as ISWC, TPDL, WWW, JCDL, CEUR, SAC, CIKM, and KDD.
- Search string: “TOPIC=(Knowledge graph) AND (Scholarly OR scientific OR literature OR Academic)”; time span 2015–2021; language English. The search found 2772 relevant items in the first round, narrowed to 1630 after duplicate removal, 527 after title screening, more than 140 after abstract review, and 70 after full-text review.
- Studies were analyzed and tabulated by extraction level, input/field, extraction fact, entities/relations, knowledge domain, approach, tasks, source/tool integration, metrics, and applications; embedding studies were tabulated by embedding type, dataset, task, best-performing model, evaluation metrics, and application.
Limitations
- The paper states that there is no common standard evaluation protocol or benchmark set for SKGs; manual annotation and gold-standard construction are costly and limit scalability; domain-specific extraction requires experts and is costlier and limited; OpenIE produces generic/noisy triples needing normalization; coreference resolution is often ignored; extraction from unstructured sources such as images, tables, and pseudocode is limited; and metadata suffers from incompleteness, affiliation ambiguity, author disambiguation, and citation-count mismatch.
- The paper also states that ontology use assumes expert input, leading to bias toward precision and higher cost, while OpenIE cannot distinguish different surface forms for the same object or relation, resulting in poor aggregation.
- Evident from the text: the review’s search is restricted to English-language work from 2015–2021 in selected digital libraries and conferences, and it does not report a formal systematic-review protocol or meta-analysis, so coverage may miss non-English, older, or differently indexed work.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
10 of 30 cited sources checked · 6 supported · 0 flagged · accuracy not yet measured
- Findingreasoning
No survey paper focuses on the concept of knowledge graphs in the scholarly domain.
“In the literature, many comprehensive survey papers for knowledge graph [1], domain-specific knowledge graphs such as smart grids [2], industrial products [3], manufacturing and production [4] biomedical domain [5] and knowledge graphs with recommendation engines [6] exist, whereas no survey paper focuses on concept of knowledge graphs in scholarly domain.”
Quote in the paperSubstantial claim2 of 3 sources checked- cites [1] Gutierrez Claudio, Sequeda Juan F (2021) Knowledge graphs. Communications of the ACM 64(3):96–104 source
The citation [1] appears beside the sentence’s discussion of general knowledge-graph surveys, not beside its assertion that no survey covers the scholarly domain. The retrieved passages from the Supplemental Material for Knowledge Graphs Introduction list related works but do not assess whether a scholarly-domain survey exists (searched: scholarly domain, survey paper, scientific literature). (LLM, conf=0.72)
Experimental — accuracy not yet measured - cites [2] Wang Jian, Wang Xi, Ma Chaoqun, Kou Lei (2021) A survey on the development status and application prospects of knowledge graph in smart grids. IET Generation, Transmission & Distribution 15(3):383–407 source
- cites [6] Qin Chuan, Zhu Hengshu, Zhuang Fuzhen, Guo Qingyu, Zhang Qi, Zhang Le, Wang Chao, Chen Enhong, Xiong Hui (2020) A survey on knowledge graph-based recommender systems. Scientia Sinica Informationis 50(7):937–956 source
- Premisecitation
Manual evaluation via domain experts and annotators is a quality metric that usually predicts accuracy with the agreement of human annotators.
“Manual evaluation via domain experts and annotators is the quality metric that usually predict accuracy with the agreement of the human annotators.”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [59] Sayantan Basu, Sinchani Chakraborty, Atif Hassan, Sana Siddique, and Ashish Anand. ERLKG: Entity Representation Learning and Knowledge Graph based association analysis of COVID-19 through mining of unstructured biomedical corpora. pages 127–137, 2020 source
Section 4.5 (page not provided) describes ratings by two physicians and reports their inter-rater agreement; Section 5.3 compares physician ratings with model scores. The paper supports expert evaluation and agreement as parts of its evaluation, but does not say that annotator agreement usually predicts accuracy or is the quality metric. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites [52] Rabah A. Al-Zaidy and C. Lee Giles. Extracting semantic relations for scholarly knowledge base construction. In 12th IEEE International Conference on Semantic Computing, ICSC 2018, Laguna Hills, CA, USA, January 31 - February 2, 2018, pages 56–63. IEEE Computer Society, 2018 source
- Findingreasoning
Machine learning approaches have been used in generic automatic pipelines to construct knowledge graphs.
“On the other hand, these approaches have been used in generic automatic pipelines as well to construct knowledge graphs.”
Quote in the paperNot a substantial claim - Findingown data
A majority of studies have considered sentences from full-text of scientific articles rather than only abstract or title.
“A majority of studies have considered sentences from full-text of scientific articles rather than only abstract or title.”
Quote in the paperNot a substantial claim - Findingnone given
Various algorithms of machine learning and deep learning approaches are combined with linguistic approaches for information extraction and similarity measure tasks.
“In the literature, various algorithms of machine learning and deep learning approaches are combined with linguistic approaches for the information extraction as well as similarity measure tasks.”
Quote in the paperNot a substantial claim
- Findingnone given
Semi-automatic methods provide extractions with a modest level of precision and noise.
“However, these methods provide extractions with a modest level of precision and noise.”
Quote in the paperNot a substantial claim - Findingown data
The majority of work in information extraction from scientific documents has been published on entity and relation level extraction.
“Table 3 shows that the majority of work has been published on entity and relation level extraction.”
Quote in the paperNot a substantial claim - Findingnone given
There are research works that define the domain semi-automatically in order to retrieve a subset of manually defined types.
“There are research that define the domain semi-automatically in order to retrieve a subset of manually defined types.”
Quote in the paperNot a substantial claim - Findingnone given
Machine learning approaches are used to solve extraction level problems using word vectorization and feature extraction methods without considering contextual information.
“These approaches are used to solve the extraction level problems using word vectorization and feature extraction methods without considering the contextual information.”
Quote in the paperNot a substantial claim - Findingnone given
With a few exceptions, these studies rely on the manual effort of annotation which requires experts to extract background knowledge.
“With a few exceptions, these studies rely on the manual effort of annotation which requires experts to extract background knowledge.”
Quote in the paperSubstantial claim - Premisecitation
Scholarly knowledge graph provides services such as intelligent contextual recommendation and ranking [113, 114] by discovering information from scientific articles.
“Scholarly knowledge graph provides services such as intelligent contextual recommendation and ranking [113, 114] by discovering information from the scientific articles.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [113] Chenyan Xiong, Russell Power, and Jamie Callan. Explicit semantic ranking for academic search via knowledge graph embedding. Proceedings of the 26th international conference on world wide web, International World Wide Web Conferences Steering Committee, 3052558:1271–1279, 2017 source
- cites [114] Li Xinyi, Chen Yifan, Pettit Benjamin, De Rijke Maarten (2019) Personalised reranking of paper recommendations using paper content and user behavior. ACM Transactions on Information Systems 37(3):23 source
- Premisecitation
Some studies conducted casual and subjective evaluation with survey questions and research questions [70, 74, 76] of the KG structure without using precise evaluation measures.
“Some studies, for example, conducted a casual and subjective evaluation with the help of survey questions and research questions [70, 74, 76] of the KG structure without using precise evaluation measures.”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [70] Afshin Sadeghi, Christoph Lange, Maria Esther Vidal, and Sören Auer. Integration of scholarly communication metadata using knowledge graphs. In: Kamps, J., Tsakonas, G., Manolopoulos, Y., Iliadis, L., Karydis, I. (eds) Research and Advanced Technology for Digital Libraries. TPDL Lecture Notes in Computer Science, 10450:328–341, 2017 source
- cites [74] Penev Lyubomir, Dimitrova Mariya, Senderov Viktor, Zhelezov Georgi, Georgiev Teodor, Stoev Pavel, Simov Kiril (2019) OpenBiodiv: A knowledge graph for literature-extracted linked open data in biodiversity science. Publications 7(2):1–16 source
Checked before — its earlier verdict is held back until a new check runs.
- cites [76] Sahar Vahdati, Guillermo Palma, Rahul Jyoti Nath, Christoph Lange, Sören Auer, and Maria Esther Vidal. Unveiling scholarly communities over knowledge graphs. In: Méndez, E., Crestani, F., Ribeiro, C., David, G., Lopes, J. (eds) Digital Libraries for Open Knowledge. TPDL. Lecture Notes in Computer Science, 11057:103–115, 2018 source
- Interpretationreasoning
Components of literature surveys, such as survey tables published in scientific publications, do not conform to the FAIR criteria.
“Because of the publishing style, components of literature surveys, such as survey tables published in scientific publications, do not conform to the FAIR criteria.”
Quote in the paperSubstantial claim - Premisecitation
Author disambiguation is one of the intensive research interests in scholarly knowledge graphs.
“Second, author is an important entity in SKG and disambiguation [61] of this particular entity is one of the intensive research interest.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Nie Zhiwei, Liu Yuanji, Yang Luyi, Li Shunning, Pan Feng (2021) Construction and Application of Materials Knowledge Graph Based on Author Disambiguation: Revisiting the Evolution of LiFePO4. Advanced Energy Materials 2003580:1–5
- It may state two separate claims as one. 47
- Probably not a substantial claim. 163
- The quote only partly states this claim. 1
It may state two separate claims as one.
PremisecitationMany comprehensive survey papers exist for knowledge graphs generally and for domain-specific knowledge graphs such as smart grids, industrial products, manufacturing and production, biomedical domain, and recommendation engines.
“In the literature, many comprehensive survey papers for knowledge graph [1], domain-specific knowledge graphs such as smart grids [2], industrial products [3], manufacturing and production [4] biomedical domain [5] and knowledge graphs with recommendation engines [6] exist”
Quote in the paperSubstantial claim2 of 3 sources checked- cites [1] Gutierrez Claudio, Sequeda Juan F (2021) Knowledge graphs. Communications of the ACM 64(3):96–104 source
- cites [2] Wang Jian, Wang Xi, Ma Chaoqun, Kou Lei (2021) A survey on the development status and application prospects of knowledge graph in smart grids. IET Generation, Transmission & Distribution 15(3):383–407 source
- cites [6] Qin Chuan, Zhu Hengshu, Zhuang Fuzhen, Guo Qingyu, Zhang Qi, Zhang Le, Wang Chao, Chen Enhong, Xiong Hui (2020) A survey on knowledge graph-based recommender systems. Scientia Sinica Informationis 50(7):937–956 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationSPAR is widely used in various projects and publications such as [74].
“To fill the gap between domain-specific and semantic publishing ontology, Semantic Publishing and Referencing Ontology (SPAR) is widely used in various projects and publication such as [74].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [74] Penev Lyubomir, Dimitrova Mariya, Senderov Viktor, Zhelezov Georgi, Georgiev Teodor, Stoev Pavel, Simov Kiril (2019) OpenBiodiv: A knowledge graph for literature-extracted linked open data in biodiversity science. Publications 7(2):1–16 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
FindingcitationThe embedding vectors contain rich information about entities and relationships and learned embeddings can be used in tasks such as entity classification and link prediction/ knowledge graph completion.
“The embedding vectors contain rich information about entities and relationships and learned embeddings can be used in tasks such as entity classification and link prediction/ knowledge graph completion [97].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [97] Rossi Andrea, Firmani Donatella, Matinata Antonio, Merialdo Paolo, Barbosa Denilson (2020) Knowledge graph embedding for link prediction: A comparative analysis. ACM Transactions on Knowledge Discovery from Data (TKDD) 15(2):1–49 source
Section 2 (p. 3) says KG embeddings represent entities and relationships, embody the graph’s semantics, and can identify new links, supporting the link-prediction portion. The passages found do not establish their use for entity classification; the classifiers described in Section 3.3 (p. 9) score facts or predict missing entities rather than classify entities. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThere are various conceptual models classified into groups from representation of specific research areas to describing structure of scholarly documents, rhetorical elements and bibliographies [80, 112].
“There are various conceptual models that are classified into groups from representation of specific research areas to describing structure of the scholarly documents, rhetorical elements and bibliographies [80, 112].”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [80] Angelo A. Salatino, Francesco Osborne, and Enrico Motta. Ontology extraction and usage in the scholarly knowledge domain. In Giuseppe Cota, Marilena Daquino, and Gian Luca Pozzato, editors, Applications and Practices in Ontology Design, Extraction, and Reasoning, volume 49 of Studies on the Semantic Web, pages 91–106. IOS Press, 2020 source
Section 2.1, “Ontologies of research areas” (page not available), describes models for specific research fields, including computer science, medicine, and physics. The passages do not establish the claimed grouping extending to scholarly-document structure, rhetorical elements, and bibliographies. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites [112] Pertsas Vayianos, Constantopoulos Panos (2017) Scholarly Ontology: modelling scholarly practices. International Journal on Digital Libraries 18(3):173–190 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationNanopublications, i.e., a fine-grained, machine-interpretable, semantic and interlinked representation for article information, provenance and assertions, are presented as an RDF graph.
“To provide simplification and standardization, nanopublications [128], i.e., a fine-grained, machine-interpretable, semantic and interlinked representation for article information (sections, text, figures, tables, formula, footnote and review comments), provenance and assertions is presented as an RDF graph.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [128] Cristina Iulia Bucur, Tobias Kuhn, and Davide Ceolin. A Unified Nanopublication Model for Effective and User-Friendly Access to the Elements of Scientific Publishing. Knowledge Engineering and Knowledge Management: 22nd International Conference, EKAW 2020 Lecture Notes in Computer Science, 12387:104–119, 2020 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
InterpretationcitationTable metadata extraction possesses diverse challenges due to lack of standardization.
“For example, table metadata extraction [126] possess diverse challenges due to lack of standardization.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [126] Allard Oelen, Markus Stocker, and Sören Auer. Creating a Scholarly Knowledge Graph from Survey Article Tables. In: Ishita, E., Pang, N.L.S., Zhou, L. (eds) Digital Libraries at Times of Massive Societal Transition. ICADL 2020 Lecture Notes in Computer Science, 12504:373–389, 2020 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenVarious data-driven machine learning algorithms have been widely used in scholarly knowledge graph knowledge acquisition, construction and extracting critical information from vast data sets.
“Various data-driven machine learning algorithms have been widely used in scholarly knowledge graph’s knowledge acquisition, construction and extracting critical information from vast data set.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenChallenges such as heterogeneity and scalability have been handled efficiently with the help of linked data sets of scholarly documents.
“It has been noticed that, challenges such as heterogeneity and scalability have been handled efficiently with the help of linked data sets of scholarly documents.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenMost open scholarly graphs investigate either implicit or explicit representation, and combining them in a unified knowledge graph remains a challenge.
“It is observed that most of the open scholarly graph investigates either the implicit or explicit representation and combining them in an unified knowledge graph remains a challenge.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenA number of open scholarly infrastructures do not offer services related to bibliographic data such as article citation and need to collaborate with bibliographic databases directly to support digital libraries.
“A number of open scholarly infrastructures do not offer services related to bibliographic data such as article citation and required to collaborate with bibliographic databases directly to support digital libraries.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataThe majority of work has considered several domain-specific ontologies and supplemented the data sources by providing patterns with unique instances.
“The majority of work has considered several domain-specific ontologies and supplemented the data sources by providing patterns with unique instances, as seen in Table 5.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenMachine learning approaches have outperformed human baselines in many specific cases but do not properly integrate with prior knowledge of fine-tuned pre-trained data for interpreting the model's behavior.
“Though machine learning approaches outperformed human baselines in many specific cases but not properly integrates with prior knowledge of fine-tuned pre-trained data for interpreting the model’s behavior.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenAs far as concept level extraction is concerned, a handful of studies are focused on extraction of phrases.
“As far as concept level extraction is concerned, a handful studies are focused on extraction of phrases.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenThere are only a few research works on fact representation.
“There are only a few research on fact representation that have been published.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenThere are only a few research works that focus on extracting relationships between items from scholarly literature.
“However, there are only a few research that focus on extracting relationships between items from scholarly literature.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenStudies have used approaches to find new types from unlabeled data.
“Studies, on the other hand, have used approaches to find new types from unlabeled data.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
FindingreasoningEach submission in the literature seems to have its own methodology (techniques and phases) and seeks to achieve separate key goals in the knowledge graph construction process.
“Although majority of the approaches are based on supervised and unsupervised learning methods, it is worth noting that each submission seems to have its own methodology (techniques and phases) and seeks to achieve separate key goals in the knowledge graph construction process.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenAll the translation-based models depict entities solely on the basis of structural data, ignoring the richness of multi-source data contained in the entity's name, description, category, relationship type and prior knowledge.
“However, all the translation-based models depict entities solely on the basis of structural data, ignoring the richness of multi-source data contained in the entity’s name, description, category, relationship type and prior knowledge.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenA rule-based approach gathers key scholarly information in the form of patterns, leveraging regular expressions in title, abstract, research problems, application areas, and citation information.
“A rule-based approach gathers key scholarly information in the form of patterns, leveraging regular expressions in title, abstract, research problems, application areas, and citation information.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenThe construction process incorporates top-down, bottom-up and mixed ways of building knowledge graphs.
“The construction process incorporates top-down, bottom-up and mixed way of building knowledge graphs.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
FindingreasoningThe latter produces nosier outcomes but can handle huge corpora of scientific documents.
“In comparison, the latter produces nosier outcomes but can handle huge corpora of scientific documents.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenCurrent approaches utilizing existing ontologies and vocabularies to annotate the context at long text level are semantically far from each other.
“These current approaches utilizing existing ontologies and vocabularies to annotate the context at long text level that are semantically far from each other.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds.
Findingnone givenMost of the existing approaches for author collaboration focus on semantic similarities using bibliographic metadata such as publication counts and citation network analysis.
“Most of the existing approaches for author collaboration focus on semantic similarities using bibliographic metadata such as publication counts and citation network analysis.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenThere are some efforts where the advantages of both rule-based techniques are combined and presented the final form of reasoning to achieve the goal of completing multiple tasks.
“There are some efforts where the advantages of both techniques are combined and presented the final form of reasoning to achieve the goal of completing multiple tasks.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenVarious studies handle these tasks with the help of OpenIE tools where each KG is generated.
“Various studies handle these tasks with the help of OpenIE tools where each KG is generated.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenThe first way to populate knowledge graph generates high-quality and validated outcomes with improved precision-recall analysis.
“The first way to populate knowledge graph generates high-quality and validated outcomes with improved precision-recall analysis.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
FindingreasoningAs a result of using extractor framework, a huge number of entities and relationships referring to the same concept is detected.
“As a result of using extractor framework, a huge number of entities and relationships referring to the same concept is detected.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenThese approaches abandon relevant metadata information such as author organization and venues attended, affecting the quality of the recommendations.
“However, these approaches abandon relevant metadata information such as author organization and venues attended, affecting the quality of the recommendations.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenA wide range of studies using natural language processing techniques can be found that applied over a collection of scientific articles.
“A wide range of studies using natural language processing techniques can be found that applied over a collection of scientific articles.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenDomain-independent KGs are generic within-sentence extraction.
“However, domain-independent KGs are generic within-sentence extraction.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenAn article leads to high number of entities when full-text is considered for annotation.
“In addition, an article leads to high number of entities when full-text is considered for annotation.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingnone givenResolving syntax complexities and elimination of ambiguated text are also the part of the NLP extraction pipelines.
“Resolving syntax complexities and elimination of ambiguated text are also the part of the NLP extraction pipelines.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenNLP techniques are widely employed since most strategies rely on the popular pre-trained language model and its modifications to do the extraction task.
“Second, NLP techniques are widely employed since most strategies rely on the popular pre-trained language model and its modifications to do the extraction task.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
FindingreasoningThe first way to populate knowledge graph suffers from limited scalability issue as well as manual effort consuming.
“However, it suffers from limited scalability issue as well as manual effort consuming.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenVery few studies are using extractor framework such as OpenIE, DyGIE++ and RnnOIE to automatically extract the entities.
“In addition, very few studies are using extractor framework such as OpenIE, DyGIE++ and RnnOIE to automatically extract the entities.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenTranslation-based models are the widely used in this domain.
“It has been observed that, translation-based models are the widely used in this domain.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenTechniques like deep neural networks and word2vec are employed to obtain precise syntactic analysis.
“For instance, techniques like deep neural networks and word2vec are employed to obtain precise syntactic analysis.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenFor speeding up the extraction process in scientific publications, a collection of natural language processing algorithms supporting OpenIE and ontologies is used to generate an end-to-end automatic pipeline for the generation of knowledge graphs.
“For speeding up the extraction process in scientific publications, a collection of natural language processing algorithms supporting OpenIE and ontologies is used to generate an end-to-end automatic pipeline for the generation of knowledge graphs.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenIn order to generate the knowledge graph, issues such as multiple entities refer to same concept, redundant relationships and generic entities are addressed.
“In order to generate the knowledge graph, issues such as multiple entities refer to same concept, redundant relationships and generic entities are addressed.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingnone givenKnowledge graph embedding models a triple of the form <Head,relation,Tail> as input, computes matching score and predict the validity of each triplet.
“The knowledge graph embedding models a triple of the form <Head,relation,Tail> as input, computes matching score and predict the validity of each triplet.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenGraph processing capacity and computational powers of graph databases is utilized with the help of graph structure.
“Graph processing capacity and computational powers of graph databases is utilized with the help of graph structure.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenOpen domain IE has been used to treat any noun phrase as a candidate entity and any verb phrase as a relation candidate.
“Open domain IE, on the other hand, has been used to treat any noun phrase as a candidate entity and any verb phrase as a relation candidate.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingreasoningA number of studies used Neo4j for data storage, querying and visualization considerably as compared to the native triple storage platforms.
“On the other hand, a number of studies used Neo4j for data storage, querying and visualization considerably as compared to the native triple storage platforms.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.
Findingnone givenThe knowledge graph construction can be classified into categories based on the method used: machine learning, NLP, pattern-based, hybrid and rule-based approaches.
“The knowledge graph construction can be classified into following categories based on the method used:First, studies that intended towards KG development utilizing machine learning techniques to leverage contextual data.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenThe performances of existing models drop when they are applied as an embedding learner for entity typing in the task of scholar profiling.
“In addition, the performances of existing models drop when they are applied as an embedding learner for entity typing in the task of scholar profiling.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenGraphDB is highly efficient in storing and accessing graph database and allows exploring RDF classes to access instances.
“GraphDB is highly efficient in storing and accessing graph database and allows exploring RDF classes to access instances.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenKnowledge graphs have been facilitated with open extraction tools such as OpenIE to feature the knowledge resources.
“In addition, Knowledge graph have been facilitated with open extraction tools such as OpenIE to feature the knowledge resources.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenThis service suffers from the challenge of sparsity in data due to insufficient interactions.
“However, this service suffers from the challenge of sparsity in data due to insufficient interactions.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenSeveral domain-specific ontologies have been widely employed to cover all of the data in various sections of the study.
“Second, several domain-specific ontologies have been widely employed to cover all of the data in various sections of the study.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenPattern-based acquisition methods are utilized to acquire salient phrases from research contributions and attain phrasal granularity.
“Pattern-based acquisition methods are utilized to acquire the salient phrases from research contributions and attain phrasal granularity.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenTable 7 presents embedding methods that extract triples where paper and author are the head entity primarily whereas venue, author, field are the tail entity used to generate triple types.
“Table 7 presents embedding methods that extract triples where paper and author are the head entity primarily whereas venue, author, field are the tail entity used to generate triple types.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
FindingreasoningThe extracted information is too generic and require further normalization to remove overlapping and redundancy of extracted information.
“However, the extracted information is too generic and require further normalization to remove overlapping and redundancy of extracted information.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenOne of the applications of Knowledge Graph Embedding models has been reported to give link predictions, which may also be viewed as a foundation for recommendation services.
“One of the applications of Knowledge Graph Embedding models has been reported to give link predictions, which may also be viewed as a foundation for recommendation services.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenIn general, knowledge graph embedding model can be categorizes such as translation-distance-based model, neural network-based model and multiplicative model.
“In general, knowledge graph embedding model can be categorizes such as translation-distance-based model, neural network-based model and multiplicative model.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingreasoningEvaluation and standardization becomes difficult during application on larger scale due to domain-independence and misclassification.
“Moreover, evaluation and standardization becomes difficult during application on larger scale due to domain-independence and misclassification.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingnone givenManually curated rule generation and mappings result in gold standard data, however this curation can be skewed toward certain well-known issues and limited to the expert domain.
“Furthermore, manually curated rule generation and mappings result in gold standard data, however this curation can be skewed toward certain well-known issues and limited to the expert domain.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenFusion of visual semantics and textual semantics have gradually emerged as new direction in knowledge graphs also.
“Fusion of visual semantics and textual semantics have gradually emerged as new direction in knowledge graphs also.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenStudies lack coverage for important entity types (e.g., affiliations) and domains (e.g., physics).
“In addition, studies lack coverage for important entity types (e.g., affiliations) and domains (e.g., physics).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenCNN-based models such as ConvE embedded 2D convolution leads to long training time due to numerous parameters.
“CNN-based models such as ConvE embedded 2D convolution leads to long training time due to numerous parameters.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataFew papers focus majorly on operation for retrieving and manipulations, on the other hand rest focus on storage and visualization as shown in Table 6.
“Few papers focus majorly on operation for retrieving and manipulations, on the other hand rest focus on storage and visualization as shown in Table 6.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenTypically two types of directions have been used in the literature to populate the knowledge graph either by human experts or by applying linguistics techniques and machine learning approaches.
“Typically two types of directions have been used in the literature to populate the knowledge graph either by human experts or by applying linguistics techniques and machine learning approaches.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
FindingreasoningThe general construction of KG has been customized to fit various use-cases of the scholarly domain.
“Aiming to fill this gap between knowledge exploitation ways in the defined domain, the general construction of KG has been customized to fit in various use-cases of the scholarly domain.”
Quote in the paperSubstantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenThe basic structure of a large knowledge graph can be easily shown with a limited perspective, but portraying cross-linked sources and exploratory tasks is cumbersome.
“The basic structure of a large knowledge graph can be easily shown with a limited perspective, but portraying cross-linked sources and exploratory tasks is cumbersome.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Findingnone givenNeo4j query language named Cypher is easy to use as compared to GRAPHQL and various plugins are also available to extend its functionality.
“As Neo4j query language named Cypher is easy to use as compared to GRAPHQL and various plugins are also available to extend its functionality.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenIn the literature, three types of embedding methods such as translational embedding method and multiplicative and deep learning-based models are used.
“In the literature, three types of embedding methods such as translational embedding method and multiplicative and deep learning-based models are used.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingnone givenCitation data is useful for quantifying bibliometric and trend analysis but offers less information about the content of the paper.
“Citation data, for example, is useful for quantifying bibliometric and trend analysis but offers less information about the content of the paper.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenNeural network models have not gained much popularity in spite of gaining recognizable performance.
“Second, Neural network models have not gained much popularity in spite of gaining recognizable performance.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenConsideration of coreference resolution is also being ignored till date during information extraction and its applications.
“Besides, consideration of coreference resolution is also being ignored till date during information extraction and its applications.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenMost of the studies in this section analyzed natural language using basic extraction, mapping, tagging, and parsing technologies.
“It is worth mentioning that most of the studies in this section analyzed natural language using basic extraction, mapping, tagging, and parsing technologies.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenKnowledge graphs not only measure semantic similarity based on information gained from large corpora but also calculate the semantic path distance between two concepts.
“Knowledge graphs not only measures semantic similarity based on the information gained from large corpora, but also calculates the semantic path distance present between two concepts.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
PremisereasoningKnowledge graphs combine the capabilities of concept classes and their instances with the help of ontology and capture in-depth semantic relationships to find similar articles.
“Knowledge graphs combine the capabilities of concept classes and their instances with the help of ontology and capture in-depth semantic relationships to find similar article.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductown dataThe first round of searching found 2772 relevant items, and after duplicate removal the selected articles were narrowed to 1630.
“2772 items were found relevant through first round searching and after removal of duplicates, selected articles were narrowed down to 1630.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenMeasurement of quality in terms of correctness and completeness is accomplished by sampling with human moderators or crowdsourcing platforms.
“Measurement of quality (correctness and completeness) is accomplished by sampling with human moderators or crowdsourcing platforms.”
Quote in the paperNot a substantial claim- Rests on an assumption: The rapid growth of scholarly metadata has been largely contributed by humans, which generates blatant errors.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenTo automatically construct knowledge graphs, three categories-domain-specific, domain-independent, and cross-domain information extraction-can be considered, where input text and output format are crucial.
“In order to automatically construct knowledge graphs, three categories such as domain-specific and domain-independent and cross-domain information extraction can be considered where input text and output format is crucial.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenThe usage of ontology assumes expert input, which leads to bias behavior in favor of precision and increases the cost.
“The usage of ontology assumes expert input, which leads to bias behavior in favor of precision and increases the cost.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
InterpretationreasoningThe combination of machine learning, deep learning and linguistic approaches makes comparing approaches complicated and normalization of the learning process even more challenging.
“This makes comparing approaches complicated, and a normalization of the learning process even more challenging.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Premisenone givenAll knowledge graph implementations differ in architecture, technology used, and functionality, making it difficult to reach a consensus and define a knowledge graph.
“However, all these implementations differ in architecture, technology used and functionality, making it difficult to reach a consensus and define a knowledge graph.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationExternal data sources such as DBpedia, which extracts information from Wikipedia, are integrated in the scholarly domain to create extended relationships and support cross-domain text classification tasks.
“Usage of external data sources such as DBpedia, which extracts information from Wikipedia is integrated in scholarly domain to create extended relationships and support cross-domain text classification tasks [39].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [39] M. Ramakrishna Murty, J. V. R. Murthy, P. V. G. D. Prasad Reddy, and Suresh Chandra Satapathy. A survey of cross-domain text categorization techniques. In 1st International Conference on Recent Advances in Information Technology, RAIT 2012, Dhanbad, India, March 15-17, 2012, pages 499–504. IEEE, 2012 source
Probably not a substantial claim.
Premisenone givenThe scholarly document-centric paradigm has been critiqued for not allowing automated knowledge processing, categorization, and reasoning.
“The scholarly document-centric paradigm, on the other hand, has been critiqued for not allowing for automated knowledge processing, categorization, and reasoning.”
Quote in the paperSubstantial claimProbably not a substantial claim.
PremisereasoningInformation extraction of scientific entities and connections is required for organizing scientific information into structured knowledge bases.
“As a result, Information extraction (IE) of scientific entities and connections is required for organizing scientific information into structured knowledge bases.”
Quote in the paperSubstantial claim- Rests on an assumption: Document and keyword-based information retrieval systems are no longer adequate to explore the insights of the scholarly domain.
- Rests on an assumption: Automatic knowledge curation from scholarly components such as text, tables, figures, algorithms, and charts is not easy due to improper structure.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductown dataThe review's automatic literature search was conducted in ACM Digital Library, Springer, ScienceDirect, IEEE Xplore, and Google Scholar.
“An automatic search was conducted in this study, taking into account digital libraries such as the ACM Digital Library, Springer, ScienceDirect and IEEE xplore. In addition, Google Scholar also produced a robust base of primary literature relevant to the keywords.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds.
PremisereasoningTraditional graph-based approaches that only deal with structural analysis cannot perform effectively due to the large quantity and dimensionality of scholarly data.
“Due to the large quantity and dimensionality of scholarly data, traditional graph-based approaches that only deal with structural analysis cannot perform effectively.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductown dataA next-level title search to meet relevance criteria filtered the articles to 527.
“Then a next level search was conducted on title to meet the relevance criteria and 527 articles were filtered.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenRecent advancements in knowledge-graph-based representation research focus on knowledge acquisition, knowledge graph creation, triple extraction, triple classification, and knowledge graph completion.
“Recent advancements in the field of knowledge graph-based representation research focuses on the knowledge acquisition, knowledge graph creation, triple extraction, triple classification, knowledge graph completion.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisereasoningDomain-specific information extraction presents a specific set of scientific concepts that cannot generalize across various domains well.
“This paradigm presents specific set of scientific concepts that can not generalize across various domains well.”
Quote in the paperNot a substantial claim- Rests on an assumption: Most scientific documents do not share a common set of concepts.
Probably not a substantial claim. The paper may give no reason why it holds.
Premisenone givenKnowledge graphs are useful for determining semantic relatedness by taking into account the hierarchical structure of the scholarly network and all forms of semantic relationships between concepts.
“Knowledge graphs are useful for determining semantic relatedness by taking into account the hierarchical structure of the scholarly network as well as all forms of semantic relationships between concepts.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationScholarly documents can be retrieved by crawling and extracting using structural and content-based features.
“Scholarly documents can be retrieved by crawling and extracting using structural and content-based features [19].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [19] Kong Xiangjie, Jiang Huizhen, Yang Zhuo, Zhenzhen Xu, Xia Feng, Tolba Amr (2016) Exploiting publication contents and collaboration networks for collaborator recommendation. PLoS ONE 11(2):1–13 source
Checked before — its earlier verdict is held back until a new check runs.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductown dataThe first-level basic search used the keywords TOPIC=(Knowledge graph) AND (Scholarly OR scientific OR literature OR Academic), with time span 2015-2021 and language English.
“For the first level basic search, we investigated for different keywords for such as “TOPIC=( Knowledge graph) AND (Scholarly OR scientific OR literature OR Academic); Time Span: 2015-2021; Language: English”.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds.
Premisenone givenInformation extraction from scientific texts is a critical step in creating fine-grained scholarly knowledge graphs that characterize and connect scholarly articles.
“Information extraction (IE) from scientific texts is a critical step in creating fine-grained scholarly knowledge graphs that characterize and connect scholarly articles.”
Quote in the paperNot a substantial claim- Rests on an assumption: Automatic knowledge curation from scholarly components such as text, tables, figures, algorithms, and charts is not easy due to improper structure.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenGenerating a scholarly network is challenging due to the varied nature of scholarly data models.
“Despite the fact that valid information is easily accessed through the web and open data, generating scholarly network is challenging due to the varied nature of the scholarly data models.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
InterpretationreasoningIt is easy to derive entity and relations from the corpus using semi-automatic approaches.
“It is easy to derive entity and relations from the corpus using these semi-automatic approaches.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductown dataMore than 140 research articles were examined on the basis of abstract and 70 on the basis of full text.
“We examined more than 140 research articles refined on the basis of abstract and 70 on the basis of full-text of the paper.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenOne feature of knowledge graphs is their emphasis on metadata, such as titles, abstracts, authors, and organization contained in research articles.
“One of the features of Knowledge graphs is their emphasis on metadata, such as titles, abstracts, authors, and organization contained in research articles.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenOpen Information Extraction (OIE) is a way to generate machine readable though domain-independent representation of information in the form of triples and propositions.
“Unlike conventional IE technique, Open Information Extraction (OIE) is a way to generate machine readable though domain-independent representation of information in the form of triples and proposition.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds.
InterpretationreasoningHybrid reasoning, which incorporates the use of ontologies, knowledge completion methods, and schema construction, improves performance of KG creation.
“Hybrid reasoning, which incorporates the use of ontologies, knowledge completion methods, and schema construction, is critical and improves performance of KG creation.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenThe title of a scientific publication follows grammatical rules and includes scientific terminology at certain locations.
“The title of a scientific publications, for example, follows grammatical rules and includes scientific terminology at certain locations.”
Quote in the paperNot a substantial claim- Rests on an assumption: The title of a scientific publication follows grammatical rules and includes scientific terminology at certain locations.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Premisenone givenMAG is a heterogeneous and attributed knowledge graph containing metadata of more than 242M scientific publications, including citations, authors, institutions, journals, conferences, and fields of study.
“MAG: A heterogeneous and attributed knowledge graph containing the metadata of more than 242M scientific publications, including citations, authors, institutions, journals, conferences, and fields of study.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenOntologies are essential aspects of academic knowledge networks that conceptualize scientific semantic communication.
“Ontologies are essential aspects of academic knowledge networks that conceptualize scientific semantic communication.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
InterpretationreasoningKnowledge graphs augmented by deep learning and NLP techniques better examine topological relationships and semantic meanings respectively, resulting in notable success in comprehending difficulties in the scholarly domain and retrieving relevant solutions.
“Technically, KG augmented by deep learning and NLP techniques better examines topological relationships and semantic meanings respectively, resulting in notable success in comprehending difficulties in scholarly domain and retrieving relevant solutions.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
InterpretationreasoningBecause the scholarly network has billions of nodes and edges, feature engineering and vector-based representation are becoming increasingly popular methods for processing raw data.
“Because the scholarly network has billions of nodes and edges, feature engineering and vector-based representation are becoming increasingly popular methods for processing raw data.”
Quote in the paperNot a substantial claim- Rests on an assumption: The scholarly network has billions of nodes and edges.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenQuality evaluations of ontology are required to meet the criteria of construction of a knowledge graph.
“It is observed that quality evaluations of ontology is required to meet the criteria of construction of knowledge graph.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
InterpretationreasoningThe link prediction task helps to improve the recommender system's accuracy and diversity.
“Therefore, the link prediction task helps to improve the recommender system’s accuracy and diversity.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationSoftware Ontology (SO) is used in [60] to extract software mentions by employing a neural network-based classifier in scientific documents.
“In the literature, Software Ontology (SO) is used in [60] that extracts software mentions by employing neural network-based classifier in the scientific documents.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [60] David Schindler, Benjamin Zapilko, and Frank Krüger. Investigating Software Usage in the Social Sciences: A Knowledge Graph Approach. In: , et al. The Semantic Web. ESWC 2020. Lecture Notes in Computer Science, 12123:271–286, 2020 source
Checked before — its earlier verdict is held back until a new check runs.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenThe goal of knowledge integration is to create ontology and taxonomy to represent hierarchical structure.
“The goal of knowledge integration is to create ontology and taxonomy to represent hierarchical structure.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenIn scholarly knowledge graphs, ontologies are core elements that conceptualize scientific semantic communication.
“In scholarly knowledge graphs, ontologies are the core elements that conceptualizes scientific semantic communication.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenOIE focuses on smaller but denser corpora rather than bigger and sparse corpora.
“It focuses on smaller but denser corpora rather than bigger and sparse corpora.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenLimited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.
“It is crucial to highlight that limited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.”
Quote in the paperNot a substantial claim- Rests on an assumption: Limited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.
Probably not a substantial claim. The paper may give no reason why it holds.
Premisenone givenScientific publications require automatic processing from human-readable format to machine-readable format.
“Scientific publications require automatic processing from human-readable format to machine-readable format.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenRecommendation can be interpreted as a knowledge graph completion problem where various translational and semantic matching-based embedding methods outperformed.
“Recommendation can be interpreted as a knowledge graph completion problem where various translational and semantic matching-based embedding methods outperformed.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenIn general, NLP tasks such as document summarization, fact verification and retrieval require taking huge data and pruning over different document contexts.
“In general, NLP tasks such as document summarization, fact verification and retrieval requires to take huge data and pruning need to be perform over different document contexts.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenThe preset entity and relationship model graph may considerably improve the building quality and application efficiency of knowledge graphs in the scholarly domain.
“The preset entity and relationship model graph may considerably improve the building quality and application efficiency of knowledge graphs in the scholarly domain.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenUse of common ontologies and general metadata from schema.org is required to ensure the quality of the knowledge graph.
“Use of common ontologies and general metadata from schema.org is required to ensure the quality of the knowledge graph.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisereasoningSemantic web technologies enable the display of domain information in machine-readable ways.
“Semantic web technologies, which describe domain knowledge using diverse concepts such as ontologies, Open Information extraction (OpenIE) tools and query processing languages, enable the display of domain information in machine-readable ways.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenRules can be predicted by applying statistical reasoning approach directly to filter, select and organize candidate tuples.
“Second, rules can be predicted by applying statistical reasoning approach directly to filter, select and organize candidate tuples as shown in Fig. 4c.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenKnowledge graphs are integrated as an information source to improve recommendations and inherently provide more interpretability in knowledge representation.
“In the literature, knowledge graphs are integrated as an information source to improve recommendations and inherently provides more interpretability in knowledge representation.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenDuring construction of scholarly knowledge graphs, erroneous facts about entities and/or relationships may be collected, especially when using information from heterogeneous sources with varied properties.
“During the construction of SKG, erroneous facts about entities and/or relationships may be collected. This technique is prone to errors, especially when using information collected from data sources of heterogeneous sources with variety of properties.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Interpretationnone givenApplying a gold standard produces extremely accurate and reusable findings but is expensive to construct.
“Applying gold standard, on the other hand, produces extremely accurate and reusable findings, but it is expensive to construct.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
InterpretationreasoningOpenIE is unable to distinguish different surface forms for the same object or relation, resulting in poor aggregation performance.
“However, it is unable to distinguish different surface forms for the same object or relation, resulting in poor aggregation performance.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenKnowledge graph construction incorporates standard NLP tasks such as semantic role labeling, part-of-speech tagging, and chunking to get the best system along with pre-trained model.
“Knowledge graph construction incorporates standard NLP tasks such as semantic role labeling, part-of-speech tagging, and chunking to get the best system along with pre-trained model as shown in Fig. 4b.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenSemantic enrichment entails the incorporation of metadata from scientific publications from many perspectives, compared to methods focusing exclusively on keywords or feature extraction.
“Semantic enrichment entails the incorporation of metadata from scientific publications from many perspectives, as compared to the method that focuses exclusively on keywords or feature extraction.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationTo evaluate correctness of classification assigned to concepts in NG-PL [52], a subset of 1000 entities was annotated by six human annotators.
“To evaluate the correctness (Is the information correct?) of the classification assigned to the concepts in NG-PL [52], subset of 1000 entities are annotated by six human annotators.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [52] Rabah A. Al-Zaidy and C. Lee Giles. Extracting semantic relations for scholarly knowledge base construction. In 12th IEEE International Conference on Semantic Computing, ICSC 2018, Laguna Hills, CA, USA, January 31 - February 2, 2018, pages 56–63. IEEE Computer Society, 2018 source
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenThe description of various concepts and objects, as well as their relationships, is used in the formation and understanding of ontology.
“The description of various concepts and objects, as well as their relationships, is used in the formation and understanding of ontology.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
PremisereasoningSince knowledge graphs have emerged as a technology with broad application areas, it seeks integration with standard third-party resources such as ontology and vocabularies.
“Since knowledge graphs have emerged as an technology with broad application areas, it seeks integration with standard third-party resources such as ontology and vocabularies.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenCertain filtering issues such as sparsity, diversity and cold-start have not been taken into account in scholarly knowledge graph recommendation.
“To best of our knowledge, certain filtering issues such as sparsity, diversity and cold-start have not been taken into account.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenNamed entities are used to represent general domains, and KGs are constructed through entity and relation extraction often.
“Named entities are used to represent general domains and KGs are constructed through entity and relation extraction often.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationGraph-based knowledge representation involves querying and reasoning mechanisms for transparent and interpretable explanations [103].
“Graph-based knowledge representation involves with querying and reasoning mechanisms for transparent and (human and machine) interpretable explanations [103].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [103] Rui Zhang, Dimitar Hristovski, Dalton Schutte, Andrej Kastrin, and Marcelo Fiszman. Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID- 19 . The COVID-19 resource centre is hosted on Elsevier Connect , the company ’ s public news and information . (January), 2020
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationIn [59], two subsets from the dataset were created to provide ratings by physicians to analyze relatedness of entities and to finalize the embedding method.
“In [59], two subset from data set are created to provide ratings by physicians to analyze relatedness of entities and to finalize embedding method.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [59] Sayantan Basu, Sinchani Chakraborty, Atif Hassan, Sana Siddique, and Ashish Anand. ERLKG: Entity Representation Learning and Knowledge Graph based association analysis of COVID-19 through mining of unstructured biomedical corpora. pages 127–137, 2020 source
Checked before — its earlier verdict is held back until a new check runs.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenAs we are transitioning from big data to semantic data, KGs play an important role as critical component of semantic web.
“As we are transitioning from big data to semantic data, KGs play an important role as critical component of semantic web.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenOIE models rely on unsupervised information extraction techniques and are pre-trained on heterogeneous datasets.
“OIE models relay on unsupervised information extraction techniques and pre-trained on heterogeneous datasets.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenThese applications are limited to the expert's domain, and because the expert knowledge base is heavily reliant on experts' experiences, it is difficult to transform it across domains.
“These applications are limited to the expert’s domain, and because the expert knowledge base is heavily reliant on experts’ experiences, it is difficult to transform it across domains.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds.
Interpretationnone givenGenerating a natural language description from KG makes the stored information more accessible to a wider group of end users in terms of question responding and interpretability.
“These researches have been included in this section because generating a natural language description from KG makes the stored information more accessible to a wider group of end users in terms of question responding and interpretability.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenCORD-19 contains information about 63,000 research articles related to COVID-19, SARS-CoV-2 and other similar corona viruses.
“CORD-19: The COVID-19 Open Research Dataset (CORD-19) contains information about 63,000 research articles, related to COVID-19, SARS-CoV-2 and other similar corona viruses and from the Allen Institute for AI.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenRules play a crucial role in automated reasoning and finding inferences.
“Rules plays crucial role in automated reasoning and finding inferences.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenInformation extraction of scientific documents requires understanding of the full document, unlike traditional sentence-level extraction.
“Information extraction of scientific documents is different from the traditional extraction methods as the understanding of full document is required compared to sentence level extraction.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenAccuracy, AUC, Hits@k and MRR are better choices for evaluation during refinement.
“Other metrics, e.g., accuracy, area under curve (AUC), Hits@k and MRR, etc. are observed as better choice for evaluation during refinement.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenSemSur is a comprehensive ontology for capturing the content of computer science articles and representing it in a semantic and machine interpretable format.
“SemSur (Semantic Survey Ontology) is a new ontology for modeling components of research contributions in the domain of Semantic Web. It is a comprehensive ontology for capturing the content of computer science articles and represent it in a semantic and machine interpretable format.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenPrecision and recall are frequently used in information extraction and knowledge graph construction with machine learning methods.
“With respect to evaluation methods, precision and recall are quite frequently used in information extraction as well as knowledge graph construction with machine learning methods.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationComputer Science Ontology [80] is an ontology for describing higher-level Computer Science study fields, as well as sub-topics and words that go with them.
“Similarly, Computer Science Ontology [80] is an ontology for describing higher-level Computer Science study fields, as well as the sub-topics and words that go with them.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [80] Angelo A. Salatino, Francesco Osborne, and Enrico Motta. Ontology extraction and usage in the scholarly knowledge domain. In Giuseppe Cota, Marilena Daquino, and Gian Luca Pozzato, editors, Applications and Practices in Ontology Design, Extraction, and Reasoning, volume 49 of Studies on the Semantic Web, pages 91–106. IOS Press, 2020 source
Checked before — its earlier verdict is held back until a new check runs.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenA mainstream technique in rule-based reasoning is to formalize the problem and obtain inferences as per predefined rules.
“A mainstream technique in rule-based reasoning is to formalize the problem and to obtain the inferences as per predefined rules.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenManual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.
“However, manual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.”
Quote in the paperNot a substantial claim- Rests on an assumption: Manual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
InterpretationreasoningThe knowledge graph's reasoning capacity is reduced by its insufficient integration of subjective information from the literature.
“However, the knowledge graph’s reasoning capacity is reduced by its insufficient integration of subjective information from the literature.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
InterpretationreasoningThe fundamental benefit of using openIE paradigms is that they can be simply applied to big corpora with no need for training data.
“The fundamental benefit of using openIE paradigms is that they can be simply applied to big corpora with no need for training data.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenKnowledge fusion helps in generating metadata from various data sources.
“Knowledge fusion helps in generating metadata from various data sources as well.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationFOAF ontology is used in [71, 73] to materialize implicit knowledge about the social relationships of authors and scientists.
“A Friend Of A Friend (FOAF) ontology is used in [71, 73] to materialize implicit knowledge about the social relationships of authors and scientists.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [71] Francisco Abad-Navarro, José Antonio Bernabé-Diaz, Alexander García-Castro, and Jesualdo Tomás Fernandez-Breis. Semantic publication of agricultural scientific literature using property graphs. Applied Sciences, 10(3), 2020 source
- cites [73] Zárate Marcos, Rosales Pablo, Braun Germán, Lewis Mirtha, Fillottrani Pablo Rubén, Delrieux Claudio (2019) OceanGraph: Some Initial Steps Toward a Oceanographic Knowledge Graph. Communications in Computer and Information Science 1029:33–40 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenVarious scholarly knowledge graphs have built their own datasets by crawling data from various digital libraries, including Web Of Science, GRID, PharmaGKB, Dimensions among others.
“Various scholarly knowledge graphs have built their own datasets by crawling data from various digital libraries, including Web Of Science, GRID, PharmaGKB, Dimensions among others.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenSubjects and objects are also used to identify concepts and their attributes in scientific statements guided by the ontology.
“However, subjects and objects also used to identify concepts and their attributes in scientific statements guided by the ontology.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenRules are commonly utilized to express links and dependencies between entities in datasets and to capture underlying patterns in data.
“To express links and dependencies between entities in datasets and to capture the underlying patterns in data, rules are commonly utilized.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
InterpretationreasoningThe domain-specific extraction process requires domain experts and annotators, which makes the extraction process costlier and limited.
“The domain-specific extraction process requires domain experts and annotators, which makes the extraction process costlier and limited.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenTo understand the ability of a model's mechanism, extensively labeled data and a pre-trained model are required.
“To understand the ability of model’s mechanism, extensively labeled data and pre-trained model is required.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Premisenone givenOntology allows refinement of the structure of knowledge and reduces conceptual ambiguity.
“Ontology allows refinement of structure of knowledge and reduces conceptual ambiguity.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenStudies based on knowledge extraction from unstructured data sources such as images, tables and pseudocode of an algorithm are limited to date.
“Studies based on knowledge extraction from unstructured data sources such as images, tables and pseudocode of an algorithm is limited to date.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisenone givenThrough tracing over a knowledge graph, an XAI system assists stakeholders in conceptually understanding the workings of associated systems to achieve explainable outcomes and interpretability.
“Through tracing over KG, the XAI system assists stakeholders in conceptually understanding the workings of associated systems in order to achieve explainable outcomes and interpretability.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenThe level of data integration is immature and fragmented due to redundancy till now.
“The level of data integration is immature and fragmented due to redundancy till now.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Premisenone givenMany studies pay attention to extraction from structured or semi-structured data sources.
“Many studies pays attention to the extraction from structured or semi-structured data sources.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
InterpretationreasoningOverall, knowledge graph is an important advancement and has power to provide semantically structured information to huge scholarly domain.
“Overall, we are able to conclude that knowledge graph is an important advancement and have power to provide semantically structured information to huge scholarly domain.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenKnowledge graphs have emerged as the illustration of many real-time applications and implemented practically to classify entities and relationships.
“In recent time, knowledge graphs have been emerged as the illustration of many real-time applications and implemented practically to classify entities and relationships.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenMediating the quality of algorithmic outputs produced by knowledge graph construction module is a challenging task.
“Mediating the quality of algorithmic outputs produced by knowledge graph construction module is a challenging task.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper may give no reason why it holds.
InterpretationreasoningThe scientific information provided in the literature does not fulfill the FAIR Data Principles.
“The scientific information provided in the literature, on the other hand, does not fulfill the FAIR Data Principles.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenIt is improbable that involved algorithms will be evaluated based on human designed gold standard and human annotators in prospecting years.
“It is improbable that involved algorithms will be evaluated based on human designed gold standard and human annotators in prospecting years.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence.
Interpretationnone givenSeveral aspects of applying knowledge graph concepts into specific domains remain to be explored.
“However, efforts of applying such concepts into specific domains have been made in recent years, several aspects remain to be explored.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
PremisecitationFAIR guiding principle (Findable, Accessible, Interoperable, Reusable) [123] is an important scientific merit for Scientific knowledge graphs.
“FAIR guiding principle (Findable, Accessible, Interoperable, Reusable) [123] is the important scientific merit for Scientific knowledge graphs.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [123] Mark D. Wilkinson, Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, Niklas Blomberg, Jan Willem Boiten, Luiz Bonino da Silva Santos, Philip E. Bourne, Jildau Bouwman, Anthony J. Brookes, Tim Clark, Mercè Crosas, Ingrid Dillo, Olivier Dumon, Scott Edmunds, Chris T. Evelo, Richard Finkers, Alejandra Gonzalez-Beltran, Alasdair J.G. Gray, Paul Groth, Carole Goble, Jeffrey S. Grethe, Jaap Heringa, Peter A.C. t Hoen, Rob Hooft, Tobias Kuhn, Ruben Kok, Joost Kok, Scott J. Lusher, Maryann E. Martone, Albert Mons, Abel L. Packer, Bengt Persson, Philippe Rocca-Serr
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenMany scholarly ontologies are restricted over certain domain-specific entity sets.
“Many scholarly ontologies are restricted over certain domain-specific entity sets.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
InterpretationreasoningLack of a unique normalized identity of an author entity makes the problem more challenging for services such as expert finding and collaborator search.
“Lack of a unique normalized identity of an author entity makes the problem more challenging for certain services such as expert finding and collaborator search.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenMaintaining heterogeneity along with embedding in order to map links into low dimensional order is a great challenge.
“Maintaining heterogeneity along with embedding in order to map links into low dimensional order is a great challenge.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenKnowledge graph in scholarly domain is the specific area in which semantic representation of literature-based discovery is presented.
“In this context, knowledge graph in scholarly domain is the specific area in which semantic representation of literature-based discovery is presented.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenMetadata used in construction of knowledge graphs suffers from data incompleteness to different degrees such as affiliation ambiguity.
“Metadata used in construction of knowledge graphs suffers from data incompleteness to different degrees such as affiliation ambiguity.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenExtraction of structured knowledge is a challenge across the board, and one reason is data ingestion from multiple resources which makes the knowledge noisy and inconsistent.
“Extraction of structured knowledge is a challenge across the board and one of the reason for this is data ingestion from multiple resources which makes the knowledge noisy and inconsistent.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
InterpretationreasoningIntegration of information from heterogeneous sources can cause labor-intensive human annotations to train knowledge extraction systems.
“Integration of information from heterogeneous sources can cause labor-intensive human annotations to train knowledge extraction systems.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenResearchers seeking relevant information have to deal with multiple data sources as well as unstructured search.
“Another issue is that researchers seeking relevant information have to deal with multiple data sources as well as unstructured search.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenA unique and persistent identifier is required to identify relevant digital objects that possess human-readable label feature.
“Second, a unique and persistent identifier is required to identify the relevant digital objects that possess human-readable label feature.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Document and keyword-based information retrieval systems are no longer adequate to explore the insights of the scholarly domain.
“Document and keyword-based information retrieval systems are no longer adequate to explore the insights of the scholarly domain.”
The paper relies on this without support.
The rapid growth of scholarly metadata has been largely contributed by humans, which generates blatant errors.
“The rapid growth of scholarly metadata has been largely contributed by human which generates blatant errors.”
The paper relies on this without support.
Automatic knowledge curation from scholarly components such as text, tables, figures, algorithms, and charts is not easy due to improper structure.
“However, the knowledge presented in scholarly infrastructure resides in the form of text, tables, figures, algorithms, charts, etc., and automatic knowledge curation from these components is not easy due to improper structure.”
The paper relies on this without support.
Most scientific documents do not share a common set of concepts.
“Domain-specific IE refers to extraction with the intuition that most scientific documents does not share common set of concepts and target specifically semantic depth of certain concept.”
The paper relies on this without support.
The scholarly network has billions of nodes and edges.
“Because the scholarly network has billions of nodes and edges, feature engineering and vector-based representation are becoming increasingly popular methods for processing raw data.”
The paper relies on this without support.
The title of a scientific publication follows grammatical rules and includes scientific terminology at certain locations.
“The title of a scientific publications, for example, follows grammatical rules and includes scientific terminology at certain locations.”
The paper relies on this without support.
Limited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.
“It is crucial to highlight that limited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.”
The paper relies on this without support.
Manual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.
“However, manual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.”
The paper relies on this without support.
There is no common standard evaluation protocol and set of benchmarks for evaluating scholarly knowledge graphs.
“Although, there is no common standard evaluation protocol and set of benchmarks for the evaluation.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Aurora and SciKGraph are assigned the same reference
MinorThe paper cites [90] for Aurora, but its reference list identifies [90] as a paper about clustering and visualizing scientific fields, which the text separately associates with SciKGraph.
“Aurora [90] is proposed that exploits semantic representation of OpenResearch.org.”
“90. Tosi Mauro Dalle Lucca Julio Cesar dos Reis Understanding the evolution of a scientific field by clustering and visualizing knowledge graphs Journal of Information Science 2020 48 1 71 89 10.1177/0165551520937915”
Embedding-performance discussion points to the construction figure
MinorThe discussion directs readers to Fig. 4 for embedding-method performance, but Fig. 4 is captioned as a diagram of knowledge-graph creation approaches, not an embedding-performance comparison.
“Many studies have applied TransE, TransH, TransR, TransD and proposed embedding method to present the performance of embedding methods a shown in Fig. 4.”
“Figure: Fig. 4 Algorithmic view of a neural network-enabled KG creation, b natural language processing-enabled KG creation, c rule learning-based knowledge graph creation”
Opposite scoring directions are stated for plausible triples
MinorThe general description says training gives positive triples higher scores, while the translation-based model description says it minimizes a triple's score to bring its entities closer. These are opposite scoring conventions, but the paper does not distinguish them.
“Initially, positive and negative triple scores are created at random, and the loss function is optimized so that positive triples get higher scores than negative triples.”
“This approach maps the head entity and relation to be close to the embedding of the tail entity by minimizing the score of the triple.”
Citations
Cites
Graph Attention NetworksPreprint
Veličković, P., Casanova, A., Liò, P., Cucurull, G., Romero, A., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.17863/cam.48429 · Cited by 19,745
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
SciBERT: A Pretrained Language Model for Scientific Text
Beltagy, I., Lo, K., & Cohan, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1371 · Cited by 3,218
Knowledge Graph Embedding: A Survey of Approaches and Applications
Wang, Q., Mao, Z., Wang, B., & Guo, L. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2754499 · Cited by 2,654
Cui, P., Wang, X., Pei, J., & Zhu, W. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2849727 · Cited by 1,274
Mitzias, P., Riga, M., Waddington, S. N., Kontopoulos, E., Μεδίτσκος, Γ., Laurenson, P., & Kompatsiaris, I. Y. (2015) · Cited by 1,240
Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery
(2011) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/(issn)1942-4795 · Cited by 1,015
Luan, Y., He, L., Mari Ostendorf, E., & Hajishirzi, H. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1360 · Cited by 813
Mattioli, G., Dkhil, S. B., Saba, M. I., Malloci, G., Melis, C., Alippi, P., Filippone, F., Giannozzi, P., Thakur, A. K., Gaceur, M., et al. (2006) · Advanced Energy Materials · doi:10.1002/(issn)1614-6840 · Cited by 805
Knowledge Graph Embedding for Link Prediction
Rossi, A., Barbosa, D., Firmani, D., Matinata, A., & Merialdo, P. (2021) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3424672 · Cited by 601
Co-author Relationship Prediction in Heterogeneous Bibliographic Networks
Sun, Y., Barber, R., Gupta, M., Aggarwal, C. C., & Han, J. (2011) · 2011 International Conference on Advances in Social Networks Analysis and Mining · doi:10.1109/asonam.2011.112 · Cited by 445
Fact or Fiction: Verifying Scientific Claims
Wadden, D., Lin, S., Lo, K., Wang, L. L., van Zuylen, M., Cohan, A., & Hajishirzi, H. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.609 · Cited by 382
Construction of the Literature Graph in Semantic Scholar
Ammar, W., Groeneveld, D., Bhagavatula, C., Beltagy, I., Crawford, M., Downey, D., Dunkelberger, J., Elgohary, A., Feldman, S., Ha, V., et al. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3 (Industry Papers) · doi:10.18653/v1/n18-3011 · Cited by 358
Constructing knowledge graphs and their biomedical applications
Nicholson, D. N., & Greene, C. S. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.05.017 · Cited by 326
Explicit Semantic Ranking for Academic Search via Knowledge Graph Embedding
Xiong, C., Power, R., & Callan, J. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052558 · Cited by 301
Xia, F., Wang, W. W., Bekele, T. M., & Liu, H. (2017) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2016.2641460 · Cited by 268
Repurpose Open Data to Discover Therapeutics for COVID-19 Using Deep Learning
Zeng, X., Song, X. H., Ma, T., Pan, X., Zhou, Y., Hou, Y., Zhang, Z., Li, K., Karypis, G., & Cheng, F. (2020) · Journal of Proteome Research · doi:10.1021/acs.jproteome.0c00316 · Cited by 261
Information extraction and knowledge graph construction from geoscience literature
Wang, C., Ma, X., Chen, J., & Chen, J. (2017) · Computers & Geosciences · doi:10.1016/j.cageo.2017.12.007 · Cited by 228
Jaradeh, M. Y., Oelen, A., Farfar, K. E., Prinz, M., D’Souza, J., Kismihók, G., Stocker, M., & Auer, S. (2019) · International Conference on Knowledge Capture · doi:10.1145/3360901.3364435 · Cited by 226
Full‐text citation analysis: A new method to enhance scholarly networks
Liu, X., Zhang, J., & Guo, C. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22883 · Cited by 215
Mining advisor-advisee relationships from research publication networks
Wang, C., Han, J., Jia, Y., Tang, J., Zhang, D., Yu, Y., & Guo, J. (2010) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1835804.1835833 · Cited by 202
Text Generation from Knowledge Graphs with Graph Transformers
Koncel-Kedziorski, R., Bekal, D., Luan, Y., Lapata, M., & Hajishirzi, H. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1238 · Cited by 190
Towards a Knowledge Graph for Science
Auer, S., Kovtun, V., Prinz, M., Kasprzik, A., Stocker, M., & Vidal, M.-E. (2018) · International Conference on Web Intelligence, Mining and Semantics · doi:10.1145/3227609.3227689 · Cited by 187
Drug-Drug Interaction Prediction Based on Knowledge Graph Embeddings and Convolutional-LSTM Network
Karim, M. R., Cochez, M., Jares, J., Uddin, M., Beyan, O., & Decker, S. (2019) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3307339.3342161 · Cited by 161
SciREX: A Challenge Dataset for Document-Level Information Extraction
Jain, S., van Zuylen, M., Hajishirzi, H., & Beltagy, I. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.670 · Cited by 159
Knowledge Graphs in Manufacturing and Production: A Systematic Literature Review
Buchgeher, G., Gabauer, D., Martínez-Gil, J., & Ehrlinger, L. (2021) · IEEE Access · doi:10.1109/access.2021.3070395 · Cited by 158
OpenCitations, an infrastructure organization for open scholarship
Peroni, S., & Shotton, D. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00023 · Cited by 154
Gutierrez, C., & Sequeda, J. F. (2021) · Communications of the ACM · doi:10.1145/3418294 · Cited by 148
Applying weighted PageRank to author citation networks
Ding, Y. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21452 · Cited by 144
Li, X., Lyu, M., Wang, Z., Chen, C., & Zheng, P. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103449 · Cited by 138
Chen, H., & Luo, X. (2019) · Advanced Engineering Informatics · doi:10.1016/j.aei.2019.100959 · Cited by 133
Färber, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30796-7_8 · Cited by 126
Dessı̀, D., Osborne, F., Recupero, D. R., Buscaldi, D., & Motta, E. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.026 · Cited by 123
Domingo‐Fernándéz, D., Baksi, S., Schultz, B. T., Gadiya, Y., Karki, R., Raschka, T., Ebeling, C., Hofmann‐Apitius, M., & Kodamullil, A. T. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa834 · Cited by 121
COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation
Wang, Q., Li, M., Wang, X., Parulian, N. N., Han, G., Ma, J., Tu, J., Lin, Y., Zhang, R. H., Liu, W., et al. (2021) · doi:10.18653/v1/2021.naacl-demos.8 · Cited by 121
A survey on the development status and application prospects of knowledge graph in smart grids
Wang, J., Wang, X., Ma, C., & Kou, L. (2021) · IET Generation, Transmission & Distribution · doi:10.1049/gtd2.12040 · Cited by 111
Scientific Article Recommendation: Exploiting Common Author Relations and Historical Preferences
Xia, F., Liu, H., Lee, I., & Cao, L. (2016) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2016.2555318 · Cited by 109
MVCWalker: Random Walk-Based Most Valuable Collaborators Recommendation Exploiting Academic Factors
Xia, F., Chen, Z., Wang, W. W., Li, J., & Yang, L. T. (2014) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2014.2356505 · Cited by 108
AI-KG: An Automatically Generated Knowledge Graph of Artificial Intelligence
Dessı̀, D., Osborne, F., Recupero, D. R., Buscaldi, D., Motta, E., & Sack, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62466-8_9 · Cited by 96
KG-COVID-19: A Framework to Produce Customized Knowledge Graphs for COVID-19 Response
Reese, J., Unni, D. R., Callahan, T. J., Cappelletti, L., Ravanmehr, V., Carbon, S., Shefchek, K., Good, B. M., Balhoff, J. P., Fontana, T., et al. (2020) · Patterns · doi:10.1016/j.patter.2020.100155 · Cited by 94
Wang, R., Yan, Y., Wang, J., Jia, Y., Zhang, Y., Zhang, W., & Wang, X. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3269252 · Cited by 92
Can Scientific Impact Be Predicted?
Dong, Y., Johnson, R. A., & Chawla, N. V. (2016) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2016.2521657 · Cited by 84
COVID-19 Knowledge Graph: Accelerating Information Retrieval and Discovery for Scientific Literature
Wise, C., Calvo, M. R., Bhatia, P., Ioannidis, V. N., Karypus, G., Price, G., Song, X. H., Brand, R. M., & Kulkani, N. (2020) · doi:10.18653/v1/2020.knlp-1.1 · Cited by 81
Connected Research: The Potential of the PID Graph
Cousijn, H., Braukmann, R., Fenner, M. H., Ferguson, C., van Horik, R., Lammey, R., Meadows, A., & Lambert, S. C. (2021) · Patterns · doi:10.1016/j.patter.2020.100180 · Cited by 80
Hou, Y., Jochim, C., Gleize, M., Bonin, F., & Ganguly, D. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1513 · Cited by 79
Zhu, Y., Lin, Q., Lü, H., Shi, K., Qiu, P., & Niu, Z. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106744 · Cited by 71
Trans4E: Link prediction on scholarly knowledge graphs
Nayyeri, M., Cil, G. M., Vahdati, S., Osborne, F., Rahman, M., Angioni, S., Salatino, A. A., Recupero, D. R., Vassilyeva, N., Motta, E., et al. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.100 · Cited by 68
Exploiting Publication Contents and Collaboration Networks for Collaborator Recommendation
Kong, X., Jiang, H., Yang, Z., Xu, Z., Xia, F., & Tolba, A. (2016) · PLOS ONE · doi:10.1371/journal.pone.0148492 · Cited by 67
KGen: a knowledge graph generator from biomedical scientific literature
Rossanez, A., dos Reis, J. C., Torres, R. D. S., & de Ribaupierre, H. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01341-5 · Cited by 67
A survey on knowledge graph-based recommender systems
ZHANG, Q., ZHANG, L., QIN, C., WANG, C., ZHU, H., XIONG, H., CHEN, E., GUO, Q., & ZHUANG, F. (2020) · SCIENTIA SINICA Informationis · doi:10.1360/ssi-2019-0274 · Cited by 65
Domain-Independent Extraction of Scientific Concepts from Research Articles
Brack, A., D’Souza, J., Hoppe, A., Auer, S., & Ewerth, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45439-5_17 · Cited by 60
Context-aware Academic Collaborator Recommendation
Liu, Z., Xie, X., & Chen, L. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220050 · Cited by 56
ROBOKOP: an abstraction layer and user interface for knowledge graphs to support question answering
Morton, K. D., Wang, P., Bizon, C., Cox, S., Balhoff, J. P., Kebede, Y., Fecho, K., & Tropsha, A. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz604 · Cited by 55
Covid-on-the-Web: Knowledge Graph and Services to Advance COVID-19 Research
Michel, F., Gandon, F. L., Ah-Kane, V., Bobasheva, A., Cabrio, E., Corby, O., Gazzotti, R., Giboin, A., Marro, S., Mayer, T., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62466-8_19 · Cited by 53
KGTK: A Toolkit for Large Knowledge Graph Manipulation and Analysis
Ilievski, F., Garijo, D., Chalupsky, H., Divvala, N. T., Yao, Y., Rogers, C. M., Li, R., Liu, J., Singh, A., Schwabe, D., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62466-8_18 · Cited by 50
Web of Scholars: A Scholar Knowledge Graph
Liu, J., Ren, J. F., Zheng, W., Chi, L., Lee, I., & Xia, F. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401405 · Cited by 50
Personalised Reranking of Paper Recommendations Using Paper Content and User Behavior
Li, X., Chen, Y., Pettit, B., & Rijke, M. D. (2019) · ACM Transactions on Information Systems · doi:10.1145/3312528 · Cited by 46
Comprehensive Named Entity Recognition on CORD-19 with Distant or Weak SupervisionPreprint
Wang, X., Song, X., Li, B., Guan, Y., & Han, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12218 · Cited by 46
Conference Linked Data: The ScholarlyData Project
Nuzzolese, A. G., Gentile, A. L., Valentina Presutti, A., & Aldo Gangemi, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46547-0_16 · Cited by 45
Generate FAIR Literature Surveys with Scholarly Knowledge Graphs
Oelen, A., Jaradeh, M. Y., Stocker, M., & Auer, S. (2020) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3383583.3398520 · Cited by 44
SciKGraph: A knowledge graph approach to structure a scientific field
Tosi, M. D. L., & dos Reis, J. C. (2020) · Journal of Informetrics · doi:10.1016/j.joi.2020.101109 · Cited by 42
TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metrics
Hou, Y., Jochim, C., Gleize, M., Bonin, F., & Ganguly, D. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.59 · Cited by 40
Zhang, X., & Che, C. (2021) · Future Internet · doi:10.3390/fi13010014 · Cited by 37
Wang, W. W., Liu, J., Xia, F., King, I., & Tong, H. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3054159 · Cited by 35
OpenBiodiv: A Knowledge Graph for Literature-Extracted Linked Open Data in Biodiversity Science
Penev, L., Dimitrova, M., Senderov, V., Zhelezov, G., Georgiev, T., Stoev, P., & Simov, K. (2019) · Publications · doi:10.3390/publications7020038 · Cited by 34
Pattern-enhanced Named Entity Recognition with Distant Supervision
Wang, X., Guan, Y., Zhang, Y., Li, Q., & Han, J. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9378052 · Cited by 33
Scholarly Ontology: modelling scholarly practices
Pertsas, V., & Constantopoulos, P. (2017) · International Journal on Digital Libraries · doi:10.1007/s00799-016-0169-3 · Cited by 30
Open Information Extraction for Knowledge Graph Construction
Muhammad, I., Kearney, A., Gamble, C. L., Coenen, F., & Williamson, P. R. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-59028-4_10 · Cited by 30
OpenResearch: Collaborative Management of Scholarly Communication Metadata
Vahdati, S., Arndt, N., Auer, S., & Lange, C. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49004-5_50 · Cited by 29
Drug repurposing against Parkinson's disease by text mining the scientific literature
Zhu, Y., Jung, W., Wang, F., & Che, C. (2020) · Library Hi Tech · doi:10.1108/lht-08-2019-0170 · Cited by 29
Understanding the evolution of a scientific field by clustering and visualizing knowledge graphs
Tosi, M. D. L., & dos Reis, J. C. (2020) · Journal of Information Science · doi:10.1177/0165551520937915 · Cited by 28
Modeling Graph Structure via Relative Position for Text Generation from Knowledge Graphs
Schmitt, M., Ribeiro, L. F. R., Dufter, P., Gurevych, I., & Schütze, H. (2021) · Workshop on Graph Based Methods for Natural Language Processing · doi:10.18653/v1/2021.textgraphs-1.2 · Cited by 26
Combining Text Embedding and Knowledge Graph Embedding Techniques for Academic Search Engines.
Mai, G., Janowicz, K., & Yan, B. (2018) · Cited by 25
Automatic Textual Evidence Mining in COVID-19 LiteraturePreprint
Wang, X., Liu, W., Chauhan, A., Guan, Y., & Han, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12563 · Cited by 25
Facilitating the Analysis of COVID-19 Literature Through a Knowledge Graph
Steenwinckel, B., Vandewiele, G., Rausch, I., Heyvaert, P., Taelman, R., Colpaert, P., Simoens, P., Dimou, A., Turck, F. D., & Ongenae, F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62466-8_22 · Cited by 25
Investigating Software Usage in the Social Sciences: A Knowledge Graph Approach
Schindler, D., Zapilko, B., & Krüger, F. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-49461-2_16 · Cited by 24
Integrating Knowledge Graphs for Analysing Academia and Industry Dynamics
Angioni, S., Salatino, A. A., Osborne, F., Recupero, D. R., & Motta, E. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-55814-7_18 · Cited by 24
Scholarly data mining: A systematic review of its applications
Dridi, A., Gaber, M. M., Azad, R. M. A., & Bhogal, J. (2020) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1395 · Cited by 24
Embedding-Based Recommendations on Scholarly Knowledge Graphs
Nayyeri, M., Vahdati, S., Zhou, X., Yazdi, H. S., & Lehmann, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49461-2_15 · Cited by 23
D-REPR: A Language for Describing and Mapping Diversely-Structured Data Sources to RDF
Vũ, B. D., Pujara, J., & Knoblock, C. A. (2019) · International Conference on Knowledge Capture · doi:10.1145/3360901.3364449 · Cited by 21
Toward Representing Research Contributions in Scholarly Knowledge Graphs Using Knowledge Graph Cells
Vogt, L., D’Souza, J., Stocker, M., & Auer, S. (2020) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3383583.3398530 · Cited by 20
ResearchFlow: Understanding the Knowledge Flow Between Academia and Industry
Salatino, A. A., Osborne, F., & Motta, E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61244-3_16 · Cited by 20
A survey of cross-domain text categorization techniques
Ramakrishna Murty, M., Murthy, J. V. R., Prasad Reddy, P., & Satapathy, S. C. (2012) · 2012 1st International Conference on Recent Advances in Information Technology (RAIT) · doi:10.1109/rait.2012.6194629 · Cited by 17
Information Extraction from Scientific Literature for Method RecommendationPreprint
Luan, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00401 · Cited by 17
CitationIE: Leveraging the Citation Graph for Scientific Information Extraction
Viswanathan, V., Neubig, G., & Liu, P. (2021) · doi:10.18653/v1/2021.acl-long.59 · Cited by 17
CL Scholar: The ACL Anthology Knowledge Graph Miner
Singh, M., Dogga, P., Patro, S., Barnwal, D., Dutt, R., Haldar, R., Goyal, P., & Mukherjee, A. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-5004 · Cited by 16
Unveiling Scholarly Communities over Knowledge Graphs
Vahdati, S., Palma, G., Nath, R. J., Lange, C., Auer, S., & Vidal, M.-E. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00066-0_9 · Cited by 16
Extracting Semantic Relations for Scholarly Knowledge Base Construction
Al-Zaidy, R. A., & Giles, C. L. (2018) · 2018 IEEE 12th International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc.2018.00017 · Cited by 15
ConvCN: A CNN-Based Citation Network Embedding Algorithm towards Citation Recommendation
Pornprasit, C., Liu, X., Kertkeidkachorn, N., Kim, K.-S., Noraset, T., & Tuarob, S. (2020) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3383583.3398609 · Cited by 15
Identifying used methods and datasets in scientific publications
Färber, M., Albers, A., & Schüber, F. (2021) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000131503 · Cited by 15
Archiving research trends in LIS domain using profiling analysis
Kim, H., & Lee, J. Y. (2009) · Scientometrics · doi:10.1007/s11192-007-1998-z · Cited by 14
Question Answering on Scholarly Knowledge Graphs
Jaradeh, M. Y., Stocker, M., & Auer, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-54956-5_2 · Cited by 14
VeTo: Expert Set Expansion in Academia
Vergoulis, T., Chatzopoulos, S., Dalamagas, T., & Tryfonopoulos, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-54956-5_4 · Cited by 14
Integration of Scholarly Communication Metadata Using Knowledge Graphs
Sadeghi, A., Lange, C., Vidal, M.-E., & Auer, S. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67008-9_26 · Cited by 13
Giarelis, N., Kanakaris, N., & Karacapilidis, N. I. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61527-7_29 · Cited by 13
Zheng, A., Zhao, H., Luo, Z., Feng, C., Liu, X., & Ye, Y. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102638 · Cited by 13
Providing Research Graph Data in JSON-LD Using Schema.org
Wang, J., Aryani, A., Wyborn, L., & Evans, B. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3053052 · Cited by 12
Semantic Publication of Agricultural Scientific Literature Using Property Graphs
Abad-Navarro, F., Bernabé-Diaz, J. A., García-Castro, A., & Fernandez-Breis, J. T. (2020) · Applied Sciences · doi:10.3390/app10030861 · Cited by 12
Exploring Scholarly Data by Semantic Query on Knowledge Graph Embedding Space
Tran, H. N., & Takasu, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30760-8_14 · Cited by 11
Extracting Summary Knowledge Graphs from Long DocumentsPreprint
Wu, Z., Koncel-Kedziorski, R., Mari Ostendorf, E., & Hajishirzi, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.09162 · Cited by 11
Mining Scholarly Data for Fine-Grained Knowledge Graph Construction
Buscaldi, D., Dessı̀, D., Motta, E., Osborne, F., & Recupero, D. R. (2019) · Open Research Online - ORO (The Open University) · Cited by 10
Jiang, M., D’Souza, J., Auer, S., & Downie, J. S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64452-9_1 · Cited by 10
Demonstration of Faceted Search on Scholarly Knowledge Graphs
Heidari, G., Ramadan, A., Stocker, M., & Auer, S. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442442.3458605 · Cited by 10
Scalable, Semi-Supervised Extraction of Structured Information from Scientific Literature
Agrawal, K., Mittal, A., & Pudi, V. (2019) · doi:10.18653/v1/w19-2602 · Cited by 9
Creating a Scholarly Knowledge Graph from Survey Article Tables
Oelen, A., Stocker, M., & Auer, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-64452-9_35 · Cited by 9
Bucur, C.-I., Kuhn, T., & Ceolin, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-61244-3_7 · Cited by 8
Basu, S., Chakraborty, S., Hassan, A., Siddique, S., & Anand, A. (2020) · Proceedings of the First Workshop on Scholarly Document Processing · doi:10.18653/v1/2020.sdp-1.15 · Cited by 8
Towards Customizable Chart Visualizations of Tabular Data Using Knowledge Graphs
Wiens, V., Stocker, M., & Auer, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64452-9_6 · Cited by 8
Better Call the Plumber: Orchestrating Dynamic Information Extraction Pipelines
Jaradeh, M. Y., Singh, K., Stocker, M., Both, A., & Auer, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-74296-6_19 · Cited by 8
Generating Knowledge Graphs from Scientific Literature of Degenerative Diseases.
Rossanez, A., & dos Reis, J. C. (2019) · Cited by 7
OceanGraph: Some Initial Steps Toward a Oceanographic Knowledge Graph
Zárate, M., Rosales, P., Braun, G., Lewis, M., Fillottrani, P. R., & Delrieux, C. (2019) · Communications in Computer and Information Science · doi:10.1007/978-3-030-21395-4_3 · Cited by 6
Improving Access to Science for Social Good
Ali, M., Vahdati, S., Singh, S., Dasgupta, S., & Lehmann, J. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-43823-4_52 · Cited by 5
The AIDA Dashboard: Analysing Conferences with Semantic Technologies.
Angioni, S., Salatino, A. A., Osborne, F., Recupero, D. R., & Motta, E. (2020) · Open Research Online - ORO (The Open University) · Cited by 5
Springer LOD Conference Portal. Demo paper.
Birukou, A., Bryl, V., Eckert, K., Gromyko, A., & Kaindl, M. (2017) · ISWC (Posters, Demos & Industry Tracks) · Cited by 4
Ontology Extraction and Usage in the Scholarly Knowledge Domain1
Salatino, A. A., Osborne, F., & Motta, E. (2020) · Studies on the Semantic Web · doi:10.3233/ssw200037 · Cited by 3
Domain-Specific Automatic Scholar ProfilingBased on Wikipedia
Chuai, Z., Geng, Q., & Jin, J. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366424.3383565 · Cited by 2
Span Level Model for the Construction of Scientific Knowledge Graph
Trivedi, I., & Majhi, S. (2020) · International Conference on Computing, Communication and Security (ICCCS) · doi:10.1109/icccs49678.2020.9276945 · Cited by 2
Modeling Graph Structure via Relative Position for Text Generation from Knowledge GraphsPreprint
Schmitt, M., Ribeiro, L. F. R., Dufter, P., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09242
Multimodal Knowledge Graph for Deep Learning Papers and Code
Kannan, A. V., Fradkin, D., Akrotirianakis, I., Kulahcioglu, T., Canedo, A., Roy, A., Yu, S.-Y., Arnav, M., & Faruque, M. A. A. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3417439
COVID-19 Knowledge Graph: Accelerating Information Retrieval and Discovery for Scientific Literature
Wise, C., Ioannidis, V. N., Calvo, M. R., Song, X., Price, G., Kulkarni, N., Brand, R., Bhatia, P., & Karypis, G. (2020) · arXiv · doi:10.48550/arxiv.2007.12731
Fact or Fiction: Verifying Scientific Claims
Wadden, D., Lin, S., Lo, K., Wang, L. L., van Zuylen, M., Cohan, A., & Hajishirzi, H. (2020) · arXiv · doi:10.48550/arxiv.2004.14974
Flagged first, then by citations
Research works printed but not linked: 12
- Oelen Allard, Jaradeh Mohamad Yaser, Farfar Kheir Eddine, Stocker Markus, Auer Sören (2019) Comparing research contributions in a scholarly knowledge graph. In Daniel Garijo, Milan Markovic, Paul Groth, Idafen Santana-Pérez, and Khalid Belhajjame, editors, Proceedings of the Third International Workshop on Capturing Scientific Knowledge co-located with the 10th International Conference on Knowledge Capture (K-CAP 2019), Marina del Rey, California , November 19th, 2019, volume 2526 of CEUR Workshop Proceedings, pages 21–26. CEUR-WS.org
- Zhang Fanjin, Liu Xiao, Tang Jie, Dong Yuxiao, Yao Peiran, Zhang Jie, Gu Xiaotao, Wang Yan, Shao Bin, Li Rui, Wang Kuansan (2019) OAG: toward linking large-scale heterogeneous entity graphs. In Ankur Teredesai, Vipin Kumar, Ying Li, Rómer Rosales, Evimaria Terzi, and George Karypis, editors, Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4-8, 2019, pages 2585–2595. ACM
- Manghi Paolo, Houssos Nikos, Mikulicic Marko, Jörg Brigitte (2012) The data model of the openaire scientific communication e-infrastructure. In Juan Manuel Dodero, Manuel Palomo-Duarte, and Pythagoras Karampiperis, editors, Metadata and Semantics Research - 6th Research Conference, MTSR 2012, Cádiz, Spain, November 28-30, 2012. Proceedings, volume 343 of Communications in Computer and Information Science, pages 168–180. Springer
- Yaman Beyza, Pasin Michele, Freudenberg Markus (2019) Interlinking scigraph and dbpedia datasets using link discovery and named entity recognition techniques. OpenAccess Series in Informatics 70(15):1–8
- Tianwen Jiang, Tong Zhao, Bing Qin, Ting Liu, Nitesh V. Chawla, and Meng Jiang. The role of: A novel scientific knowledge graph representation and construction model. In Ankur Teredesai, Vipin Kumar, Ying Li, Rómer Rosales, Evimaria Terzi, and George Karypis, editors, Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4-8, 2019, pages 1634–1642. ACM, 2019
- James P. McCusker, Sabbir M. Rashid, Nkechinyere Agu, Kristin P. Bennett, and Deborah L. McGuinness (2018) The Whyis knowledge graph framework in action. Proceedings of the ISWC 2018 Posters & Demonstrations, Industry and Blue Sky Ideas Tracks co-located with 17th International Semantic Web Conference (ISWC), 2180(Sep)
- Sahar Vahdati, Natanael Arndt, Sören Auer, and Christoph Lange. Openresearch: Collaborative management of scholarly communication metadata. In Eva Blomqvist, Paolo Ciancarini, Francesco Poggi, and Fabio Vitali, editors, Knowledge Engineering and Knowledge Management - 20th International Conference, EKAW 2016, Bologna, Italy, November 19-23, 2016, Proceedings, volume 10024 of Lecture Notes in Computer Science, pages 778–793, 2016 · DOI
- Liebig Thorsten, Vialard Vincent, Opitz Michael (1963) Connecting the dots in million-nodes knowledge graphs with SemSpect. CEUR Workshop Proceedings 1–4:2017
- Rui Zhang, Dimitar Hristovski, Dalton Schutte, Andrej Kastrin, and Marcelo Fiszman. Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID- 19 . The COVID-19 resource centre is hosted on Elsevier Connect , the company ’ s public news and information . (January), 2020
- Veronika Henk, Sahar Vahdati, Mojataba Nayyeri, Mehdi Ali, Hamed Shariat Yazdi, and Jens Lehmann. Metaresearch Recommendations using Knowledge Graph Embeddings. The AAAI-19 Workshop on Recommender Systems and Natural Language Processing (RecNLP), 2019
- Mojtaba Nayyeri, Andrey Kravchenko, Simone Angioni, Angelo Salatino, and Diego Reforgiato. Link Prediction using Numerical Weights for Knowledge Graph Completion within the Scholarly Domain. pages 1–16
- Meister Vera G (1931) Towards a knowledge graph for a research group with focus on qualitative analysis of scholarly papers. Proceedings of the First Workshop on Enabling Open Semantic Science 71–76:2017
Cited by
Sorted by citations
Gan, L., Ye, B., Huang, Z., Xu, Y., Chen, Q., & Shu, Y. (2023) · Ocean & Coastal Management · doi:10.1016/j.ocecoaman.2023.106660 · Cited by 178
Cybersecurity knowledge graphs construction and quality assessment
Li, H., Shi, Z., Pan, C., Zhao, D., & Sun, N. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01205-1 · Cited by 50
EvAlignUX: Advancing UX Evaluation through LLM-Supported Metrics Exploration
Zheng, Q., Chen, M., Sharma, P., Tang, Y., Oswal, M., Liu, Y., & Huang, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714045 · Cited by 25
Challenges in building scholarly knowledge graphs for research assessment in open science
Manghi, P. (2024) · Quantitative Science Studies · doi:10.1162/qss_a_00322 · Cited by 20
Zhou, Y., Liu, Y., Ning, N., Wang, L., Zhang, Z., Gao, X., & Lu, N. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01299-7 · Cited by 20
A Knowledge-Guided Fusion Visualisation Method of Digital Twin Scenes for Mountain Highways
Tang, R., Zhu, J., Ying, R., Ding, Y., Wu, J., Guo, Y., & Xie, Y. (2023) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi12100424 · Cited by 18
DataChat : Prototyping a Conversational Agent for Dataset Search and Visualization
Fan, L., Lafia, S., Li, L., Yang, F., & Hemphill, L. (2023) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.820 · Cited by 13
A System to Ensure Information Trustworthiness in Artificial Intelligence Enhanced Higher Education
Khan, U. A., Kauttonen, J., Aunimo, L., & Alamäki, A. V. (2024) · Journal of Information Technology Education Research · doi:10.28945/5295 · Cited by 12
Liu, G., Sun, X., Li, H., Guo, Z., Li, Y., & Pi, S. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.126266 · Cited by 12
A deep learning classification framework for research methods of marine protected area management
Chen, M., & Xu, Z. (2024) · Journal of Environmental Management · doi:10.1016/j.jenvman.2024.122228 · Cited by 9
Langer, S., Neuhaus, F., & Nürnberger, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.21708 · Cited by 9
Knowledge Graphs in Smart Digital Libraries
Meesad, P., & Mingkhwan, A. (2024) · Studies in big data · doi:10.1007/978-3-031-69216-1_9 · Cited by 8
ESDC: An open Earth science data corpus to support geoscientific literature information extraction
Li, H., Yue, P., Tapete, D., Cigna, F., Wu, Q., Xiang, L., & Lu, B. (2024) · Science China Earth Sciences · doi:10.1007/s11430-023-1444-9 · Cited by 7
Topical Evolution and Thematic Progression of Research Frontiers: The Field of Knowledge Graphs
Hosseini, E., Shahbazi, A., & Dehbozorgi, A. (2025) · KNOWLEDGE ORGANIZATION · doi:10.31083/ko39497 · Cited by 7
A domain semantics-enhanced relation extraction model for identifying the railway safety risk
Wang, Y., Zhu, C., Guo, Q., & Ye, Y. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01075-7 · Cited by 7
GenAI as scholarly ally: patterns, pedagogy, and policies in graduate writing research
Гаманюк, В. А., Semerikov, S. O., & Shramko, Y. (2025) · Educational Technology Quarterly · doi:10.55056/etq.965 · Cited by 6
Zhang, J., & Jiang, S. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2387421 · Cited by 6
Gonzalez, A. D. D., Hughes, K. S., Yue, S., & Hayes, S. T. (2023) · International Conference on Information System and Data Mining (ICISDM) · doi:10.1145/3603765.3603771 · Cited by 6
Tian, S., Chen, Q., Comeau, D. C., Wilbur, W. J., & Lu, Z. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae672 · Cited by 5
Govindharajan, H., & Vijayakumar, S. (2024) · IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON) · doi:10.1109/uemcon62879.2024.10754778 · Cited by 4
Vijayakumar, S., & Louis, F. (2023) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg59574.2023.00011 · Cited by 4
Ontologies for Models and Algorithms in Applied Mathematics and Related Disciplines
Schembera, B., Wübbeling, F., Kleikamp, H., Biedinger, C., Fiedler, J., Reidelbach, M., Shehu, A., Schmidt, B., Koprucki, T., Iglezakis, D., et al. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-65990-4_14 · Cited by 4
Contri(e)ve: Context + Retrieve for Scholarly Question AnsweringPreprint
Shivashankar, K., & Steinmetz, N. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.09010 · Cited by 4
Borrelli, A., Angelis, V. D., Izzo, S., Giampaolo, F., & Piccialli, F. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.132156 · Cited by 3
Semantic Modeling of Ancient Chinese Guqin Books
Zhou, S., Meng, F., & Huang, Y. (2025) · KNOWLEDGE ORGANIZATION · doi:10.31083/ko38541 · Cited by 3
Ghaemi, H., Snyder, L. D., & Stocker, M. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730134 · Cited by 3
Knowledge graph augmentation: consistency, immutability, reliability, and context
Takan, S. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1542 · Cited by 3
Harnessing the Power of Language Models for Intelligent Digital Health Services
Garima, S., Morandé, S., & Shashank, S. (2024) · ITU Kaleidoscope Academic Conference (ITU K) · doi:10.23919/ituk62727.2024.10772761 · Cited by 3
SciKGDash: The Scientific Knowledge Graph Dashboard for Supporting Knowledge Curation
John, L., Auer, S., & Karras, O. (2025) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl67857.2025.00030 · Cited by 2
OntoDup: Governance-Aware Entity Matching for Scholarly Knowledge Graph Deduplication
Galán-Mena, J. A., López-Nores, M., Pulla-Sánchez, D., Guerrero-Vásquez, L. F., & Salgado-Guerrero, J. P. (2026) · Information · doi:10.3390/info17040325 · Cited by 2
Schaftner, S., & Gaedke, M. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3795080 · Cited by 2
Embedding Transportation Knowledge Graphs for Enhancing Traffic Prediction Models
Rashid, M. M., & Hasan, S. (2024) · doi:10.1145/3681772.3698214 · Cited by 1
Leveraging Knowledge Graphs for Paper Recommendation Systems
Mataoui, M., Bahloul, H., & Ziane, A. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-82150-9_18 · Cited by 1
A lightweight embedding method for knowledge graph quality evaluation
Chen, B., Li, H., Zhao, D., & Pan, C. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114013 · Cited by 1
OBE Oriented Constructing Method of Educational Knowledge Graph for Automatic Control Discipline
Ren, B., Wang, H., Cai, L., & Cai, Z. (2025) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3772056 · Cited by 1
Heidari, G., Stocker, M., & Auer, S. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4861-3_15 · Cited by 1
Examining Narrative Patterns in Disinformation and Trustworthy News: A Comparative Analysis
Mandravickaitė, J., & Krilavičius, T. (2026) · Social Sciences · doi:10.3390/socsci15040255 · Cited by 1
The LOPE Method: Improving Consistent Property Extraction for Scientific Knowledge Graphs Using LLMs
Schaftner, S., & Gaedke, M. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3795079 · Cited by 1
Transforming Library Services Using Artificial Intelligence for Knowledge Graphs
Mandal, P. S., Mandal, S., & Das, S. K. (2026) · DESIDOC Journal of Library & Information Technology · doi:10.14429/djlit.21993 · Cited by 1
Inga, E., Robles-Bykbaev, V., Lopez, D., & Oña, D. P. (2026) · Technologies · doi:10.3390/technologies14080458 · Cited by 1
Marković, M., Indukuri, G., Sripada, S. G., Vorland, C. J., Wilkinson, J., Robertson, C., Bolland, M. J., Grey, A. B., Brazzelli, M. G., & Avenell, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-42026-8_24 · Cited by 1
Knowledge graph completion for scholarly knowledge graph
Taufiqurrahman, T., Wiharja, K. R. S., & Wulandari, G. S. (2024) · Bulletin of Social Informatics Theory and Application · doi:10.31763/businta.v8i2.657 · Cited by 1
Bonagiri, K., Priyadharshini, L., Panneerselvi, R., Sahitya, P., Swamy, H., & P., V. (2024) · Asian Conference on Innovation in Technology (ASIANCON) · doi:10.1109/asiancon62057.2024.10837769 · Cited by 1
Schaftner, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.10768 · Cited by 1
dtreg: Describing Data Analysis in Machine-Readable Format in Python and RPreprint
Lezhnina, O., Prinz, M., & Stocker, M. (2025) · arXiv (Cornell University) · doi:10.34657/41018 · Cited by 1
Özetleme Mekanizması Kullanılarak Bilgi Çizgesine Yeni Eklentiler
Takan, S. (2023) · International Journal of Advances in Engineering and Pure Sciences · doi:10.7240/jeps.1244034
SRRS: Design and Development of a Scholarly Reciprocal Recommendation System
Verma, S., Harit, S., & Munjal, K. (2024) · Scientometrics · doi:10.1007/s11192-024-05143-8
Self-citationESDC: 一种用于支持地学文献信息抽取的开放地球科学数据语料库
李, 皓., 乐, 鹏., Tapete, D., Cigna, F., 吴, 秋., 向, 隆., & 卢, 宾. (2024) · SCIENTIA SINICA Terrae · doi:10.1360/n072023-0247
Advancing Cardiovascular Research: A Tailored Knowledge Graph Schema for Scholarly Data
Bitaraf, E., Jafarpour, M., Moeini, A., Shool, S., & Tara, M. (2025) · International Conference on Web Research (ICWR) · doi:10.1109/icwr65219.2025.11006231
A Comprehensive Taxonomy of Recommendation Systems Techniques Used in Scholarly Research
Ovono, G., Zuva, T., & Otunniyi, T. O. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-032-00715-5_4
Bougioukas, K. I. (2024) · Octopus · doi:10.57874/e7mr-3m04
Research Institute Knowledge Graph for Internal Organisation and Collaboration
Gottschalk, S., Wildemann, S., & Ilkou, E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-99554-5_21
A COMPREHENSIVE REVIEW OF INFORMATION SYSTEMS FOR SCIENTIFIC PROJECT ASSESSMENT
Amirova, A., Мутанович, М. Г., Toksanovna, A. S., Ussatova, O., & Aldasheva, L. (2025) · КазУТБ · doi:10.58805/kazutb.v.4.29-1143
Construction of Personnel Records Knowledge Graph Based on Multi-Source Heterogeneous Data Fusion
Luan, S., Wang, P., Wang, W., Gao, X., Sun, Y., & Zhang, X. (2025) · IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC) · doi:10.1109/imcec66174.2025.11332035
Kari, M. (2024) · Tampere University Institutional Repository (Tampere University)
A constructive graph model for handling the industrial threats using learning approaches
Gulhane, A. D., & Velmurugan, A. K. (2026) · Advances in Complex Systems · doi:10.1142/s179396232650011x
Rajabi, A., Schneider, J., & Schiffner, D. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-5009-8_21
Mapping scholarly knowledge: A systematic review of Knowledge Graphs for academic papers
Molina, A. A. R., Li, S., & Gong, J. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104842
Knowledge Graphs and Analysis for Research Communities
Reddy, G. L. K. A., Margabhandhu, A., Nayak, G. N., Chaudhari, A., & Sabherwal, S. (2026) · International Conference on Recent Advancement in Electrical, Computer and Communication Technologies (IECCT) · doi:10.1109/iecct68664.2026.11542161
Li, M. (2026) · Ingegneria Sismica · doi:10.65102/is20261284
Qiu, Y. (2026) · International Conference on Smart City and Sustainable Development · doi:10.1145/3821835.3821948
Sun, H., Zhao, L., Chen, Z., Li, J., Li, J., Hao, J., Lin, Y. D., & Qian, Q. (2026) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-026-00247-7
Nuevas formas de buscar y analizar con IA la información científica
Vega, W. P. C., Zambrano, C. M. T., Hermosa, E. M. M., Tóala Mosquera Md, M., & Piña, J. G. Z. (2026) · doi:10.67166/34zqjv63
Yin, C., & Zhang, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-10758357/v1
Dube, B. M., & Fonou-Dombeu, J. V. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10100324
Building Knowledge Graphs for Theses: A SurveyPreprint
Ruelas, D., Coyla, E., Aceituno, M., & Huaman, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.28648
Sulistyanto, T. H., Lusinto, W. H., Ratnasari, D., Yazid, Y., Utami, I. P., & Firdaus, F. (2026) · Aktual Jurnal Pengabdian Kepada Masyarakat · doi:10.58723/aktual.v4i3.875
Metadata
- Authors
- Verma, S., Bhatia, R., Harit, S., & Batish, S.
- Affiliations
- Punjab Engineering College (IN)
- Corresponding author
- Verma, Shilpa
- Bhatia, Rajesh
- Harit, Sandeep
- Batish, Sanjay
- Venue
- Complex & Intelligent Systems
- Published
- 2022-08-09
- Volume
- 9
- Issue
- 1
- Pages
- 1059-1095
- ISSN
- 2198-6053 (ISSN-L)
- 2199-4536
- PMC
- PMC9361271
- OpenAlex
- W4291745514
- Cited by
- 78
- References
- 114
- Citations by year
- 2026: 20 · 2025: 17 · 2024: 20 · 2023: 21
- FWCI
- 3.88
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Complex & Intelligent Systems (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Physical Sciences › Computer Science › Information Systems › Library Science and Information Systems
- Keywords
- scholarly knowledge graphs, knowledge graph construction, knowledge graph refinement, scholarly communication, information extraction, ontology mapping, academic literature, knowledge graph applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review