Cited by 78Semantic Web and OntologiesDigital Humanities and ScholarshipLibrary Science and Information Systems

The DOI matches its Crossref record; 122 of the 122 references it cites were found in a registry or an index; 10 of the 30 sources its claims cite were checked for support.

Scholarly knowledge graphs through structuring scholarly communication: a review

Open access
Verma, Shilpa, Bhatia, Rajesh, Harit, Sandeep, Batish, Sanjay·2023·Complex & Intelligent Systems

Abstract

The necessity for scholarly knowledge mining and management has grown significantly as academic literature and its linkages to authors produce enormously. Information extraction, ontology matching, and accessing academic components with relations have become more critical than ever. Therefore, with the advancement of scientific literature, scholarly knowledge graphs have become critical to various applications where semantics can impart meanings to concepts. The objective of study is to report a literature review regarding knowledge graph construction, refinement and utilization in scholarly domain. Based on scholarly literature, the study presents a complete assessment of current state-of-the-art techniques. We presented an analytical methodology to investigate the existing status of scholarly knowledge graphs(SKG) by structuring scholarly communication. This review paper investigates the field of applying machine learning, rule-based learning, and natural language processing tools and approaches to construct SKG. It further presents the review of knowledge graph utilization and refinement to provide a view of current research efforts. In addition, we offer existing applications and challenges across the board in construction, refinement and utilization collectively. This research will help to identify frontier trends of SKG which will motivate future researchers to carry forward their work.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

This review surveys scholarly knowledge graphs (SKGs) across construction, utilization, and refinement, synthesizing machine learning, NLP, rule-based, ontology, and embedding approaches. It reports that SKG research remains fragmented, with translation-based embeddings most common for refinement and no standard evaluation protocol.

Key findings

  • The review organizes SKG work into three areas: construction (information extraction, construction-method-level creation, knowledge fusion), utilization (querying, visualization, graph-to-text, dashboards), and refinement (translation-based, multiplicative, and deep-learning embeddings).
  • Construction is dominated by entity/relation extraction; reported resources include AI-KG with 820K research entities and 14M RDF triples from 333K AI publications, AIDA with 21M papers and patents, MAKG with 210 million publications and 8 billion triples, and OAG with 0.7 billion entities and 2 billion relationships.
  • Refinement results vary by task: Trans4E performed best for AIDA link prediction, TransD for DBLP/AIDA/MAG and CORD-19 association analysis, RotatE-SM for author recommendation, HolE for anti-symmetric relations in AceKG, ComplEx with 93.66% hit rate for a social-good SKG, and ConvTransE for biomedical treatment prediction.
  • Utilization applications include graph-to-text generation (GraphWriter, Graformer), visualization/dashboards (AIDA dashboard, SciKGraph, Covid-KG), question answering (JarvisQA, CL-scholar), and recommendation/ranking; ResearchFlow found 89.8% of topics first evolved in academia before industry.

Methods

  • Literature review guided by research questions on SKG construction (KGC), utilization (KGU), and refinement (KGR), with automatic searches in ACM Digital Library, Springer, ScienceDirect, IEEE Xplore, and Google Scholar, plus prominent conferences such as ISWC, TPDL, WWW, JCDL, CEUR, SAC, CIKM, and KDD.
  • Search string: “TOPIC=(Knowledge graph) AND (Scholarly OR scientific OR literature OR Academic)”; time span 2015–2021; language English. The search found 2772 relevant items in the first round, narrowed to 1630 after duplicate removal, 527 after title screening, more than 140 after abstract review, and 70 after full-text review.
  • Studies were analyzed and tabulated by extraction level, input/field, extraction fact, entities/relations, knowledge domain, approach, tasks, source/tool integration, metrics, and applications; embedding studies were tabulated by embedding type, dataset, task, best-performing model, evaluation metrics, and application.

Limitations

  • The paper states that there is no common standard evaluation protocol or benchmark set for SKGs; manual annotation and gold-standard construction are costly and limit scalability; domain-specific extraction requires experts and is costlier and limited; OpenIE produces generic/noisy triples needing normalization; coreference resolution is often ignored; extraction from unstructured sources such as images, tables, and pseudocode is limited; and metadata suffers from incompleteness, affiliation ambiguity, author disambiguation, and citation-count mismatch.
  • The paper also states that ontology use assumes expert input, leading to bias toward precision and higher cost, while OpenIE cannot distinguish different surface forms for the same object or relation, resulting in poor aggregation.
  • Evident from the text: the review’s search is restricted to English-language work from 2015–2021 in selected digital libraries and conferences, and it does not report a formal systematic-review protocol or meta-analysis, so coverage may miss non-English, older, or differently indexed work.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s40747-022-00806-6

Cites

122 of 122 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

10 of 30 cited sources checked · 6 supported · 0 flagged · accuracy not yet measured

  • Findingreasoning

    No survey paper focuses on the concept of knowledge graphs in the scholarly domain.

    “In the literature, many comprehensive survey papers for knowledge graph [1], domain-specific knowledge graphs such as smart grids [2], industrial products [3], manufacturing and production [4] biomedical domain [5] and knowledge graphs with recommendation engines [6] exist, whereas no survey paper focuses on concept of knowledge graphs in scholarly domain.”
    Quote in the paperSubstantial claim2 of 3 sources checked
    • cites [1] Gutierrez Claudio, Sequeda Juan F (2021) Knowledge graphs. Communications of the ACM 64(3):96–104 source

      The citation [1] appears beside the sentence’s discussion of general knowledge-graph surveys, not beside its assertion that no survey covers the scholarly domain. The retrieved passages from the Supplemental Material for Knowledge Graphs Introduction list related works but do not assess whether a scholarly-domain survey exists (searched: scholarly domain, survey paper, scientific literature). (LLM, conf=0.72)

      Experimental — accuracy not yet measured
    • cites [2] Wang Jian, Wang Xi, Ma Chaoqun, Kou Lei (2021) A survey on the development status and application prospects of knowledge graph in smart grids. IET Generation, Transmission & Distribution 15(3):383–407 source
    • cites [6] Qin Chuan, Zhu Hengshu, Zhuang Fuzhen, Guo Qingyu, Zhang Qi, Zhang Le, Wang Chao, Chen Enhong, Xiong Hui (2020) A survey on knowledge graph-based recommender systems. Scientia Sinica Informationis 50(7):937–956 source
  • Premisecitation

    Manual evaluation via domain experts and annotators is a quality metric that usually predicts accuracy with the agreement of human annotators.

    “Manual evaluation via domain experts and annotators is the quality metric that usually predict accuracy with the agreement of the human annotators.”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [59] Sayantan Basu, Sinchani Chakraborty, Atif Hassan, Sana Siddique, and Ashish Anand. ERLKG: Entity Representation Learning and Knowledge Graph based association analysis of COVID-19 through mining of unstructured biomedical corpora. pages 127–137, 2020 source

      Section 4.5 (page not provided) describes ratings by two physicians and reports their inter-rater agreement; Section 5.3 compares physician ratings with model scores. The paper supports expert evaluation and agreement as parts of its evaluation, but does not say that annotator agreement usually predicts accuracy or is the quality metric. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
    • cites [52] Rabah A. Al-Zaidy and C. Lee Giles. Extracting semantic relations for scholarly knowledge base construction. In 12th IEEE International Conference on Semantic Computing, ICSC 2018, Laguna Hills, CA, USA, January 31 - February 2, 2018, pages 56–63. IEEE Computer Society, 2018 source
  • Findingreasoning

    Machine learning approaches have been used in generic automatic pipelines to construct knowledge graphs.

    “On the other hand, these approaches have been used in generic automatic pipelines as well to construct knowledge graphs.”
    Quote in the paperNot a substantial claim
  • Findingown data

    A majority of studies have considered sentences from full-text of scientific articles rather than only abstract or title.

    “A majority of studies have considered sentences from full-text of scientific articles rather than only abstract or title.”
    Quote in the paperNot a substantial claim
  • Findingnone given

    Various algorithms of machine learning and deep learning approaches are combined with linguistic approaches for information extraction and similarity measure tasks.

    “In the literature, various algorithms of machine learning and deep learning approaches are combined with linguistic approaches for the information extraction as well as similarity measure tasks.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one. 47
  • Probably not a substantial claim. 163
  • The quote only partly states this claim. 1
  • It may state two separate claims as one.

    Premisecitation

    Many comprehensive survey papers exist for knowledge graphs generally and for domain-specific knowledge graphs such as smart grids, industrial products, manufacturing and production, biomedical domain, and recommendation engines.

    “In the literature, many comprehensive survey papers for knowledge graph [1], domain-specific knowledge graphs such as smart grids [2], industrial products [3], manufacturing and production [4] biomedical domain [5] and knowledge graphs with recommendation engines [6] exist”
    Quote in the paperSubstantial claim2 of 3 sources checked
    • cites [1] Gutierrez Claudio, Sequeda Juan F (2021) Knowledge graphs. Communications of the ACM 64(3):96–104 source
    • cites [2] Wang Jian, Wang Xi, Ma Chaoqun, Kou Lei (2021) A survey on the development status and application prospects of knowledge graph in smart grids. IET Generation, Transmission & Distribution 15(3):383–407 source
    • cites [6] Qin Chuan, Zhu Hengshu, Zhuang Fuzhen, Guo Qingyu, Zhang Qi, Zhang Le, Wang Chao, Chen Enhong, Xiong Hui (2020) A survey on knowledge graph-based recommender systems. Scientia Sinica Informationis 50(7):937–956 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    SPAR is widely used in various projects and publications such as [74].

    “To fill the gap between domain-specific and semantic publishing ontology, Semantic Publishing and Referencing Ontology (SPAR) is widely used in various projects and publication such as [74].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [74] Penev Lyubomir, Dimitrova Mariya, Senderov Viktor, Zhelezov Georgi, Georgiev Teodor, Stoev Pavel, Simov Kiril (2019) OpenBiodiv: A knowledge graph for literature-extracted linked open data in biodiversity science. Publications 7(2):1–16 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingcitation

    The embedding vectors contain rich information about entities and relationships and learned embeddings can be used in tasks such as entity classification and link prediction/ knowledge graph completion.

    “The embedding vectors contain rich information about entities and relationships and learned embeddings can be used in tasks such as entity classification and link prediction/ knowledge graph completion [97].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [97] Rossi Andrea, Firmani Donatella, Matinata Antonio, Merialdo Paolo, Barbosa Denilson (2020) Knowledge graph embedding for link prediction: A comparative analysis. ACM Transactions on Knowledge Discovery from Data (TKDD) 15(2):1–49 source

      Section 2 (p. 3) says KG embeddings represent entities and relationships, embody the graph’s semantics, and can identify new links, supporting the link-prediction portion. The passages found do not establish their use for entity classification; the classifiers described in Section 3.3 (p. 9) score facts or predict missing entities rather than classify entities. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    There are various conceptual models classified into groups from representation of specific research areas to describing structure of scholarly documents, rhetorical elements and bibliographies [80, 112].

    “There are various conceptual models that are classified into groups from representation of specific research areas to describing structure of the scholarly documents, rhetorical elements and bibliographies [80, 112].”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [80] Angelo A. Salatino, Francesco Osborne, and Enrico Motta. Ontology extraction and usage in the scholarly knowledge domain. In Giuseppe Cota, Marilena Daquino, and Gian Luca Pozzato, editors, Applications and Practices in Ontology Design, Extraction, and Reasoning, volume 49 of Studies on the Semantic Web, pages 91–106. IOS Press, 2020 source

      Section 2.1, “Ontologies of research areas” (page not available), describes models for specific research fields, including computer science, medicine, and physics. The passages do not establish the claimed grouping extending to scholarly-document structure, rhetorical elements, and bibliographies. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites [112] Pertsas Vayianos, Constantopoulos Panos (2017) Scholarly Ontology: modelling scholarly practices. International Journal on Digital Libraries 18(3):173–190 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Nanopublications, i.e., a fine-grained, machine-interpretable, semantic and interlinked representation for article information, provenance and assertions, are presented as an RDF graph.

    “To provide simplification and standardization, nanopublications [128], i.e., a fine-grained, machine-interpretable, semantic and interlinked representation for article information (sections, text, figures, tables, formula, footnote and review comments), provenance and assertions is presented as an RDF graph.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [128] Cristina Iulia Bucur, Tobias Kuhn, and Davide Ceolin. A Unified Nanopublication Model for Effective and User-Friendly Access to the Elements of Scientific Publishing. Knowledge Engineering and Knowledge Management: 22nd International Conference, EKAW 2020 Lecture Notes in Computer Science, 12387:104–119, 2020 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationcitation

    Table metadata extraction possesses diverse challenges due to lack of standardization.

    “For example, table metadata extraction [126] possess diverse challenges due to lack of standardization.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [126] Allard Oelen, Markus Stocker, and Sören Auer. Creating a Scholarly Knowledge Graph from Survey Article Tables. In: Ishita, E., Pang, N.L.S., Zhou, L. (eds) Digital Libraries at Times of Massive Societal Transition. ICADL 2020 Lecture Notes in Computer Science, 12504:373–389, 2020 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    Various data-driven machine learning algorithms have been widely used in scholarly knowledge graph knowledge acquisition, construction and extracting critical information from vast data sets.

    “Various data-driven machine learning algorithms have been widely used in scholarly knowledge graph’s knowledge acquisition, construction and extracting critical information from vast data set.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Challenges such as heterogeneity and scalability have been handled efficiently with the help of linked data sets of scholarly documents.

    “It has been noticed that, challenges such as heterogeneity and scalability have been handled efficiently with the help of linked data sets of scholarly documents.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Most open scholarly graphs investigate either implicit or explicit representation, and combining them in a unified knowledge graph remains a challenge.

    “It is observed that most of the open scholarly graph investigates either the implicit or explicit representation and combining them in an unified knowledge graph remains a challenge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    A number of open scholarly infrastructures do not offer services related to bibliographic data such as article citation and need to collaborate with bibliographic databases directly to support digital libraries.

    “A number of open scholarly infrastructures do not offer services related to bibliographic data such as article citation and required to collaborate with bibliographic databases directly to support digital libraries.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingown data

    The majority of work has considered several domain-specific ontologies and supplemented the data sources by providing patterns with unique instances.

    “The majority of work has considered several domain-specific ontologies and supplemented the data sources by providing patterns with unique instances, as seen in Table 5.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Machine learning approaches have outperformed human baselines in many specific cases but do not properly integrate with prior knowledge of fine-tuned pre-trained data for interpreting the model's behavior.

    “Though machine learning approaches outperformed human baselines in many specific cases but not properly integrates with prior knowledge of fine-tuned pre-trained data for interpreting the model’s behavior.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    As far as concept level extraction is concerned, a handful of studies are focused on extraction of phrases.

    “As far as concept level extraction is concerned, a handful studies are focused on extraction of phrases.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    There are only a few research works on fact representation.

    “There are only a few research on fact representation that have been published.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    There are only a few research works that focus on extracting relationships between items from scholarly literature.

    “However, there are only a few research that focus on extracting relationships between items from scholarly literature.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    Studies have used approaches to find new types from unlabeled data.

    “Studies, on the other hand, have used approaches to find new types from unlabeled data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingreasoning

    Each submission in the literature seems to have its own methodology (techniques and phases) and seeks to achieve separate key goals in the knowledge graph construction process.

    “Although majority of the approaches are based on supervised and unsupervised learning methods, it is worth noting that each submission seems to have its own methodology (techniques and phases) and seeks to achieve separate key goals in the knowledge graph construction process.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    All the translation-based models depict entities solely on the basis of structural data, ignoring the richness of multi-source data contained in the entity's name, description, category, relationship type and prior knowledge.

    “However, all the translation-based models depict entities solely on the basis of structural data, ignoring the richness of multi-source data contained in the entity’s name, description, category, relationship type and prior knowledge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    A rule-based approach gathers key scholarly information in the form of patterns, leveraging regular expressions in title, abstract, research problems, application areas, and citation information.

    “A rule-based approach gathers key scholarly information in the form of patterns, leveraging regular expressions in title, abstract, research problems, application areas, and citation information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    The construction process incorporates top-down, bottom-up and mixed ways of building knowledge graphs.

    “The construction process incorporates top-down, bottom-up and mixed way of building knowledge graphs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingreasoning

    The latter produces nosier outcomes but can handle huge corpora of scientific documents.

    “In comparison, the latter produces nosier outcomes but can handle huge corpora of scientific documents.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Current approaches utilizing existing ontologies and vocabularies to annotate the context at long text level are semantically far from each other.

    “These current approaches utilizing existing ontologies and vocabularies to annotate the context at long text level that are semantically far from each other.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Findingnone given

    Most of the existing approaches for author collaboration focus on semantic similarities using bibliographic metadata such as publication counts and citation network analysis.

    “Most of the existing approaches for author collaboration focus on semantic similarities using bibliographic metadata such as publication counts and citation network analysis.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    There are some efforts where the advantages of both rule-based techniques are combined and presented the final form of reasoning to achieve the goal of completing multiple tasks.

    “There are some efforts where the advantages of both techniques are combined and presented the final form of reasoning to achieve the goal of completing multiple tasks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    Various studies handle these tasks with the help of OpenIE tools where each KG is generated.

    “Various studies handle these tasks with the help of OpenIE tools where each KG is generated.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    The first way to populate knowledge graph generates high-quality and validated outcomes with improved precision-recall analysis.

    “The first way to populate knowledge graph generates high-quality and validated outcomes with improved precision-recall analysis.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingreasoning

    As a result of using extractor framework, a huge number of entities and relationships referring to the same concept is detected.

    “As a result of using extractor framework, a huge number of entities and relationships referring to the same concept is detected.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    These approaches abandon relevant metadata information such as author organization and venues attended, affecting the quality of the recommendations.

    “However, these approaches abandon relevant metadata information such as author organization and venues attended, affecting the quality of the recommendations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    A wide range of studies using natural language processing techniques can be found that applied over a collection of scientific articles.

    “A wide range of studies using natural language processing techniques can be found that applied over a collection of scientific articles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Domain-independent KGs are generic within-sentence extraction.

    “However, domain-independent KGs are generic within-sentence extraction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    An article leads to high number of entities when full-text is considered for annotation.

    “In addition, an article leads to high number of entities when full-text is considered for annotation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingnone given

    Resolving syntax complexities and elimination of ambiguated text are also the part of the NLP extraction pipelines.

    “Resolving syntax complexities and elimination of ambiguated text are also the part of the NLP extraction pipelines.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    NLP techniques are widely employed since most strategies rely on the popular pre-trained language model and its modifications to do the extraction task.

    “Second, NLP techniques are widely employed since most strategies rely on the popular pre-trained language model and its modifications to do the extraction task.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingreasoning

    The first way to populate knowledge graph suffers from limited scalability issue as well as manual effort consuming.

    “However, it suffers from limited scalability issue as well as manual effort consuming.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Very few studies are using extractor framework such as OpenIE, DyGIE++ and RnnOIE to automatically extract the entities.

    “In addition, very few studies are using extractor framework such as OpenIE, DyGIE++ and RnnOIE to automatically extract the entities.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Translation-based models are the widely used in this domain.

    “It has been observed that, translation-based models are the widely used in this domain.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Techniques like deep neural networks and word2vec are employed to obtain precise syntactic analysis.

    “For instance, techniques like deep neural networks and word2vec are employed to obtain precise syntactic analysis.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    For speeding up the extraction process in scientific publications, a collection of natural language processing algorithms supporting OpenIE and ontologies is used to generate an end-to-end automatic pipeline for the generation of knowledge graphs.

    “For speeding up the extraction process in scientific publications, a collection of natural language processing algorithms supporting OpenIE and ontologies is used to generate an end-to-end automatic pipeline for the generation of knowledge graphs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    In order to generate the knowledge graph, issues such as multiple entities refer to same concept, redundant relationships and generic entities are addressed.

    “In order to generate the knowledge graph, issues such as multiple entities refer to same concept, redundant relationships and generic entities are addressed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingnone given

    Knowledge graph embedding models a triple of the form <Head,relation,Tail> as input, computes matching score and predict the validity of each triplet.

    “The knowledge graph embedding models a triple of the form <Head,relation,Tail> as input, computes matching score and predict the validity of each triplet.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Graph processing capacity and computational powers of graph databases is utilized with the help of graph structure.

    “Graph processing capacity and computational powers of graph databases is utilized with the help of graph structure.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    Open domain IE has been used to treat any noun phrase as a candidate entity and any verb phrase as a relation candidate.

    “Open domain IE, on the other hand, has been used to treat any noun phrase as a candidate entity and any verb phrase as a relation candidate.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingreasoning

    A number of studies used Neo4j for data storage, querying and visualization considerably as compared to the native triple storage platforms.

    “On the other hand, a number of studies used Neo4j for data storage, querying and visualization considerably as compared to the native triple storage platforms.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.

    Findingnone given

    The knowledge graph construction can be classified into categories based on the method used: machine learning, NLP, pattern-based, hybrid and rule-based approaches.

    “The knowledge graph construction can be classified into following categories based on the method used:First, studies that intended towards KG development utilizing machine learning techniques to leverage contextual data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    The performances of existing models drop when they are applied as an embedding learner for entity typing in the task of scholar profiling.

    “In addition, the performances of existing models drop when they are applied as an embedding learner for entity typing in the task of scholar profiling.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    GraphDB is highly efficient in storing and accessing graph database and allows exploring RDF classes to access instances.

    “GraphDB is highly efficient in storing and accessing graph database and allows exploring RDF classes to access instances.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Knowledge graphs have been facilitated with open extraction tools such as OpenIE to feature the knowledge resources.

    “In addition, Knowledge graph have been facilitated with open extraction tools such as OpenIE to feature the knowledge resources.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    This service suffers from the challenge of sparsity in data due to insufficient interactions.

    “However, this service suffers from the challenge of sparsity in data due to insufficient interactions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Several domain-specific ontologies have been widely employed to cover all of the data in various sections of the study.

    “Second, several domain-specific ontologies have been widely employed to cover all of the data in various sections of the study.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Pattern-based acquisition methods are utilized to acquire salient phrases from research contributions and attain phrasal granularity.

    “Pattern-based acquisition methods are utilized to acquire the salient phrases from research contributions and attain phrasal granularity.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Table 7 presents embedding methods that extract triples where paper and author are the head entity primarily whereas venue, author, field are the tail entity used to generate triple types.

    “Table 7 presents embedding methods that extract triples where paper and author are the head entity primarily whereas venue, author, field are the tail entity used to generate triple types.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.

    Findingreasoning

    The extracted information is too generic and require further normalization to remove overlapping and redundancy of extracted information.

    “However, the extracted information is too generic and require further normalization to remove overlapping and redundancy of extracted information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    One of the applications of Knowledge Graph Embedding models has been reported to give link predictions, which may also be viewed as a foundation for recommendation services.

    “One of the applications of Knowledge Graph Embedding models has been reported to give link predictions, which may also be viewed as a foundation for recommendation services.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    In general, knowledge graph embedding model can be categorizes such as translation-distance-based model, neural network-based model and multiplicative model.

    “In general, knowledge graph embedding model can be categorizes such as translation-distance-based model, neural network-based model and multiplicative model.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingreasoning

    Evaluation and standardization becomes difficult during application on larger scale due to domain-independence and misclassification.

    “Moreover, evaluation and standardization becomes difficult during application on larger scale due to domain-independence and misclassification.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingnone given

    Manually curated rule generation and mappings result in gold standard data, however this curation can be skewed toward certain well-known issues and limited to the expert domain.

    “Furthermore, manually curated rule generation and mappings result in gold standard data, however this curation can be skewed toward certain well-known issues and limited to the expert domain.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Fusion of visual semantics and textual semantics have gradually emerged as new direction in knowledge graphs also.

    “Fusion of visual semantics and textual semantics have gradually emerged as new direction in knowledge graphs also.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Studies lack coverage for important entity types (e.g., affiliations) and domains (e.g., physics).

    “In addition, studies lack coverage for important entity types (e.g., affiliations) and domains (e.g., physics).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    CNN-based models such as ConvE embedded 2D convolution leads to long training time due to numerous parameters.

    “CNN-based models such as ConvE embedded 2D convolution leads to long training time due to numerous parameters.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingown data

    Few papers focus majorly on operation for retrieving and manipulations, on the other hand rest focus on storage and visualization as shown in Table 6.

    “Few papers focus majorly on operation for retrieving and manipulations, on the other hand rest focus on storage and visualization as shown in Table 6.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    Typically two types of directions have been used in the literature to populate the knowledge graph either by human experts or by applying linguistics techniques and machine learning approaches.

    “Typically two types of directions have been used in the literature to populate the knowledge graph either by human experts or by applying linguistics techniques and machine learning approaches.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim.

    Findingreasoning

    The general construction of KG has been customized to fit various use-cases of the scholarly domain.

    “Aiming to fill this gap between knowledge exploitation ways in the defined domain, the general construction of KG has been customized to fit in various use-cases of the scholarly domain.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    The basic structure of a large knowledge graph can be easily shown with a limited perspective, but portraying cross-linked sources and exploratory tasks is cumbersome.

    “The basic structure of a large knowledge graph can be easily shown with a limited perspective, but portraying cross-linked sources and exploratory tasks is cumbersome.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Neo4j query language named Cypher is easy to use as compared to GRAPHQL and various plugins are also available to extend its functionality.

    “As Neo4j query language named Cypher is easy to use as compared to GRAPHQL and various plugins are also available to extend its functionality.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    In the literature, three types of embedding methods such as translational embedding method and multiplicative and deep learning-based models are used.

    “In the literature, three types of embedding methods such as translational embedding method and multiplicative and deep learning-based models are used.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingnone given

    Citation data is useful for quantifying bibliometric and trend analysis but offers less information about the content of the paper.

    “Citation data, for example, is useful for quantifying bibliometric and trend analysis but offers less information about the content of the paper.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Neural network models have not gained much popularity in spite of gaining recognizable performance.

    “Second, Neural network models have not gained much popularity in spite of gaining recognizable performance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    Consideration of coreference resolution is also being ignored till date during information extraction and its applications.

    “Besides, consideration of coreference resolution is also being ignored till date during information extraction and its applications.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    Most of the studies in this section analyzed natural language using basic extraction, mapping, tagging, and parsing technologies.

    “It is worth mentioning that most of the studies in this section analyzed natural language using basic extraction, mapping, tagging, and parsing technologies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    Knowledge graphs not only measure semantic similarity based on information gained from large corpora but also calculate the semantic path distance between two concepts.

    “Knowledge graphs not only measures semantic similarity based on the information gained from large corpora, but also calculates the semantic path distance present between two concepts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisereasoning

    Knowledge graphs combine the capabilities of concept classes and their instances with the help of ontology and capture in-depth semantic relationships to find similar articles.

    “Knowledge graphs combine the capabilities of concept classes and their instances with the help of ontology and capture in-depth semantic relationships to find similar article.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Study design and conductown data

    The first round of searching found 2772 relevant items, and after duplicate removal the selected articles were narrowed to 1630.

    “2772 items were found relevant through first round searching and after removal of duplicates, selected articles were narrowed down to 1630.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Measurement of quality in terms of correctness and completeness is accomplished by sampling with human moderators or crowdsourcing platforms.

    “Measurement of quality (correctness and completeness) is accomplished by sampling with human moderators or crowdsourcing platforms.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The rapid growth of scholarly metadata has been largely contributed by humans, which generates blatant errors.
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    To automatically construct knowledge graphs, three categories-domain-specific, domain-independent, and cross-domain information extraction-can be considered, where input text and output format are crucial.

    “In order to automatically construct knowledge graphs, three categories such as domain-specific and domain-independent and cross-domain information extraction can be considered where input text and output format is crucial.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    The usage of ontology assumes expert input, which leads to bias behavior in favor of precision and increases the cost.

    “The usage of ontology assumes expert input, which leads to bias behavior in favor of precision and increases the cost.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Interpretationreasoning

    The combination of machine learning, deep learning and linguistic approaches makes comparing approaches complicated and normalization of the learning process even more challenging.

    “This makes comparing approaches complicated, and a normalization of the learning process even more challenging.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisenone given

    All knowledge graph implementations differ in architecture, technology used, and functionality, making it difficult to reach a consensus and define a knowledge graph.

    “However, all these implementations differ in architecture, technology used and functionality, making it difficult to reach a consensus and define a knowledge graph.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    External data sources such as DBpedia, which extracts information from Wikipedia, are integrated in the scholarly domain to create extended relationships and support cross-domain text classification tasks.

    “Usage of external data sources such as DBpedia, which extracts information from Wikipedia is integrated in scholarly domain to create extended relationships and support cross-domain text classification tasks [39].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [39] M. Ramakrishna Murty, J. V. R. Murthy, P. V. G. D. Prasad Reddy, and Suresh Chandra Satapathy. A survey of cross-domain text categorization techniques. In 1st International Conference on Recent Advances in Information Technology, RAIT 2012, Dhanbad, India, March 15-17, 2012, pages 499–504. IEEE, 2012 source
  • Probably not a substantial claim.

    Premisenone given

    The scholarly document-centric paradigm has been critiqued for not allowing automated knowledge processing, categorization, and reasoning.

    “The scholarly document-centric paradigm, on the other hand, has been critiqued for not allowing for automated knowledge processing, categorization, and reasoning.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim.

    Premisereasoning

    Information extraction of scientific entities and connections is required for organizing scientific information into structured knowledge bases.

    “As a result, Information extraction (IE) of scientific entities and connections is required for organizing scientific information into structured knowledge bases.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Document and keyword-based information retrieval systems are no longer adequate to explore the insights of the scholarly domain.
    • Rests on an assumption: Automatic knowledge curation from scholarly components such as text, tables, figures, algorithms, and charts is not easy due to improper structure.
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Study design and conductown data

    The review's automatic literature search was conducted in ACM Digital Library, Springer, ScienceDirect, IEEE Xplore, and Google Scholar.

    “An automatic search was conducted in this study, taking into account digital libraries such as the ACM Digital Library, Springer, ScienceDirect and IEEE xplore. In addition, Google Scholar also produced a robust base of primary literature relevant to the keywords.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Premisereasoning

    Traditional graph-based approaches that only deal with structural analysis cannot perform effectively due to the large quantity and dimensionality of scholarly data.

    “Due to the large quantity and dimensionality of scholarly data, traditional graph-based approaches that only deal with structural analysis cannot perform effectively.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Study design and conductown data

    A next-level title search to meet relevance criteria filtered the articles to 527.

    “Then a next level search was conducted on title to meet the relevance criteria and 527 articles were filtered.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Recent advancements in knowledge-graph-based representation research focus on knowledge acquisition, knowledge graph creation, triple extraction, triple classification, and knowledge graph completion.

    “Recent advancements in the field of knowledge graph-based representation research focuses on the knowledge acquisition, knowledge graph creation, triple extraction, triple classification, knowledge graph completion.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisereasoning

    Domain-specific information extraction presents a specific set of scientific concepts that cannot generalize across various domains well.

    “This paradigm presents specific set of scientific concepts that can not generalize across various domains well.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Most scientific documents do not share a common set of concepts.
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Premisenone given

    Knowledge graphs are useful for determining semantic relatedness by taking into account the hierarchical structure of the scholarly network and all forms of semantic relationships between concepts.

    “Knowledge graphs are useful for determining semantic relatedness by taking into account the hierarchical structure of the scholarly network as well as all forms of semantic relationships between concepts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Scholarly documents can be retrieved by crawling and extracting using structural and content-based features.

    “Scholarly documents can be retrieved by crawling and extracting using structural and content-based features [19].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [19] Kong Xiangjie, Jiang Huizhen, Yang Zhuo, Zhenzhen Xu, Xia Feng, Tolba Amr (2016) Exploiting publication contents and collaboration networks for collaborator recommendation. PLoS ONE 11(2):1–13 source

      Checked before — its earlier verdict is held back until a new check runs.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Study design and conductown data

    The first-level basic search used the keywords TOPIC=(Knowledge graph) AND (Scholarly OR scientific OR literature OR Academic), with time span 2015-2021 and language English.

    “For the first level basic search, we investigated for different keywords for such as “TOPIC=( Knowledge graph) AND (Scholarly OR scientific OR literature OR Academic); Time Span: 2015-2021; Language: English”.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Premisenone given

    Information extraction from scientific texts is a critical step in creating fine-grained scholarly knowledge graphs that characterize and connect scholarly articles.

    “Information extraction (IE) from scientific texts is a critical step in creating fine-grained scholarly knowledge graphs that characterize and connect scholarly articles.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Automatic knowledge curation from scholarly components such as text, tables, figures, algorithms, and charts is not easy due to improper structure.
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Generating a scholarly network is challenging due to the varied nature of scholarly data models.

    “Despite the fact that valid information is easily accessed through the web and open data, generating scholarly network is challenging due to the varied nature of the scholarly data models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationreasoning

    It is easy to derive entity and relations from the corpus using semi-automatic approaches.

    “It is easy to derive entity and relations from the corpus using these semi-automatic approaches.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Study design and conductown data

    More than 140 research articles were examined on the basis of abstract and 70 on the basis of full text.

    “We examined more than 140 research articles refined on the basis of abstract and 70 on the basis of full-text of the paper.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    One feature of knowledge graphs is their emphasis on metadata, such as titles, abstracts, authors, and organization contained in research articles.

    “One of the features of Knowledge graphs is their emphasis on metadata, such as titles, abstracts, authors, and organization contained in research articles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Open Information Extraction (OIE) is a way to generate machine readable though domain-independent representation of information in the form of triples and propositions.

    “Unlike conventional IE technique, Open Information Extraction (OIE) is a way to generate machine readable though domain-independent representation of information in the form of triples and proposition.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationreasoning

    Hybrid reasoning, which incorporates the use of ontologies, knowledge completion methods, and schema construction, improves performance of KG creation.

    “Hybrid reasoning, which incorporates the use of ontologies, knowledge completion methods, and schema construction, is critical and improves performance of KG creation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    The title of a scientific publication follows grammatical rules and includes scientific terminology at certain locations.

    “The title of a scientific publications, for example, follows grammatical rules and includes scientific terminology at certain locations.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The title of a scientific publication follows grammatical rules and includes scientific terminology at certain locations.
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisenone given

    MAG is a heterogeneous and attributed knowledge graph containing metadata of more than 242M scientific publications, including citations, authors, institutions, journals, conferences, and fields of study.

    “MAG: A heterogeneous and attributed knowledge graph containing the metadata of more than 242M scientific publications, including citations, authors, institutions, journals, conferences, and fields of study.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Ontologies are essential aspects of academic knowledge networks that conceptualize scientific semantic communication.

    “Ontologies are essential aspects of academic knowledge networks that conceptualize scientific semantic communication.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationreasoning

    Knowledge graphs augmented by deep learning and NLP techniques better examine topological relationships and semantic meanings respectively, resulting in notable success in comprehending difficulties in the scholarly domain and retrieving relevant solutions.

    “Technically, KG augmented by deep learning and NLP techniques better examines topological relationships and semantic meanings respectively, resulting in notable success in comprehending difficulties in scholarly domain and retrieving relevant solutions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationreasoning

    Because the scholarly network has billions of nodes and edges, feature engineering and vector-based representation are becoming increasingly popular methods for processing raw data.

    “Because the scholarly network has billions of nodes and edges, feature engineering and vector-based representation are becoming increasingly popular methods for processing raw data.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The scholarly network has billions of nodes and edges.
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Quality evaluations of ontology are required to meet the criteria of construction of a knowledge graph.

    “It is observed that quality evaluations of ontology is required to meet the criteria of construction of knowledge graph.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Interpretationreasoning

    The link prediction task helps to improve the recommender system's accuracy and diversity.

    “Therefore, the link prediction task helps to improve the recommender system’s accuracy and diversity.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Software Ontology (SO) is used in [60] to extract software mentions by employing a neural network-based classifier in scientific documents.

    “In the literature, Software Ontology (SO) is used in [60] that extracts software mentions by employing neural network-based classifier in the scientific documents.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [60] David Schindler, Benjamin Zapilko, and Frank Krüger. Investigating Software Usage in the Social Sciences: A Knowledge Graph Approach. In: , et al. The Semantic Web. ESWC 2020. Lecture Notes in Computer Science, 12123:271–286, 2020 source

      Checked before — its earlier verdict is held back until a new check runs.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    The goal of knowledge integration is to create ontology and taxonomy to represent hierarchical structure.

    “The goal of knowledge integration is to create ontology and taxonomy to represent hierarchical structure.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    In scholarly knowledge graphs, ontologies are core elements that conceptualize scientific semantic communication.

    “In scholarly knowledge graphs, ontologies are the core elements that conceptualizes scientific semantic communication.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    OIE focuses on smaller but denser corpora rather than bigger and sparse corpora.

    “It focuses on smaller but denser corpora rather than bigger and sparse corpora.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Limited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.

    “It is crucial to highlight that limited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Limited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Premisenone given

    Scientific publications require automatic processing from human-readable format to machine-readable format.

    “Scientific publications require automatic processing from human-readable format to machine-readable format.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    Recommendation can be interpreted as a knowledge graph completion problem where various translational and semantic matching-based embedding methods outperformed.

    “Recommendation can be interpreted as a knowledge graph completion problem where various translational and semantic matching-based embedding methods outperformed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    In general, NLP tasks such as document summarization, fact verification and retrieval require taking huge data and pruning over different document contexts.

    “In general, NLP tasks such as document summarization, fact verification and retrieval requires to take huge data and pruning need to be perform over different document contexts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    The preset entity and relationship model graph may considerably improve the building quality and application efficiency of knowledge graphs in the scholarly domain.

    “The preset entity and relationship model graph may considerably improve the building quality and application efficiency of knowledge graphs in the scholarly domain.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Use of common ontologies and general metadata from schema.org is required to ensure the quality of the knowledge graph.

    “Use of common ontologies and general metadata from schema.org is required to ensure the quality of the knowledge graph.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisereasoning

    Semantic web technologies enable the display of domain information in machine-readable ways.

    “Semantic web technologies, which describe domain knowledge using diverse concepts such as ontologies, Open Information extraction (OpenIE) tools and query processing languages, enable the display of domain information in machine-readable ways.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Rules can be predicted by applying statistical reasoning approach directly to filter, select and organize candidate tuples.

    “Second, rules can be predicted by applying statistical reasoning approach directly to filter, select and organize candidate tuples as shown in Fig. 4c.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    Knowledge graphs are integrated as an information source to improve recommendations and inherently provide more interpretability in knowledge representation.

    “In the literature, knowledge graphs are integrated as an information source to improve recommendations and inherently provides more interpretability in knowledge representation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    During construction of scholarly knowledge graphs, erroneous facts about entities and/or relationships may be collected, especially when using information from heterogeneous sources with varied properties.

    “During the construction of SKG, erroneous facts about entities and/or relationships may be collected. This technique is prone to errors, especially when using information collected from data sources of heterogeneous sources with variety of properties.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Interpretationnone given

    Applying a gold standard produces extremely accurate and reusable findings but is expensive to construct.

    “Applying gold standard, on the other hand, produces extremely accurate and reusable findings, but it is expensive to construct.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationreasoning

    OpenIE is unable to distinguish different surface forms for the same object or relation, resulting in poor aggregation performance.

    “However, it is unable to distinguish different surface forms for the same object or relation, resulting in poor aggregation performance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Knowledge graph construction incorporates standard NLP tasks such as semantic role labeling, part-of-speech tagging, and chunking to get the best system along with pre-trained model.

    “Knowledge graph construction incorporates standard NLP tasks such as semantic role labeling, part-of-speech tagging, and chunking to get the best system along with pre-trained model as shown in Fig. 4b.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Semantic enrichment entails the incorporation of metadata from scientific publications from many perspectives, compared to methods focusing exclusively on keywords or feature extraction.

    “Semantic enrichment entails the incorporation of metadata from scientific publications from many perspectives, as compared to the method that focuses exclusively on keywords or feature extraction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    To evaluate correctness of classification assigned to concepts in NG-PL [52], a subset of 1000 entities was annotated by six human annotators.

    “To evaluate the correctness (Is the information correct?) of the classification assigned to the concepts in NG-PL [52], subset of 1000 entities are annotated by six human annotators.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [52] Rabah A. Al-Zaidy and C. Lee Giles. Extracting semantic relations for scholarly knowledge base construction. In 12th IEEE International Conference on Semantic Computing, ICSC 2018, Laguna Hills, CA, USA, January 31 - February 2, 2018, pages 56–63. IEEE Computer Society, 2018 source
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    The description of various concepts and objects, as well as their relationships, is used in the formation and understanding of ontology.

    “The description of various concepts and objects, as well as their relationships, is used in the formation and understanding of ontology.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisereasoning

    Since knowledge graphs have emerged as a technology with broad application areas, it seeks integration with standard third-party resources such as ontology and vocabularies.

    “Since knowledge graphs have emerged as an technology with broad application areas, it seeks integration with standard third-party resources such as ontology and vocabularies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Certain filtering issues such as sparsity, diversity and cold-start have not been taken into account in scholarly knowledge graph recommendation.

    “To best of our knowledge, certain filtering issues such as sparsity, diversity and cold-start have not been taken into account.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    Named entities are used to represent general domains, and KGs are constructed through entity and relation extraction often.

    “Named entities are used to represent general domains and KGs are constructed through entity and relation extraction often.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Graph-based knowledge representation involves querying and reasoning mechanisms for transparent and interpretable explanations [103].

    “Graph-based knowledge representation involves with querying and reasoning mechanisms for transparent and (human and machine) interpretable explanations [103].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [103] Rui Zhang, Dimitar Hristovski, Dalton Schutte, Andrej Kastrin, and Marcelo Fiszman. Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID- 19 . The COVID-19 resource centre is hosted on Elsevier Connect , the company ’ s public news and information . (January), 2020
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    In [59], two subsets from the dataset were created to provide ratings by physicians to analyze relatedness of entities and to finalize the embedding method.

    “In [59], two subset from data set are created to provide ratings by physicians to analyze relatedness of entities and to finalize embedding method.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [59] Sayantan Basu, Sinchani Chakraborty, Atif Hassan, Sana Siddique, and Ashish Anand. ERLKG: Entity Representation Learning and Knowledge Graph based association analysis of COVID-19 through mining of unstructured biomedical corpora. pages 127–137, 2020 source

      Checked before — its earlier verdict is held back until a new check runs.

  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    As we are transitioning from big data to semantic data, KGs play an important role as critical component of semantic web.

    “As we are transitioning from big data to semantic data, KGs play an important role as critical component of semantic web.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    OIE models rely on unsupervised information extraction techniques and are pre-trained on heterogeneous datasets.

    “OIE models relay on unsupervised information extraction techniques and pre-trained on heterogeneous datasets.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    These applications are limited to the expert's domain, and because the expert knowledge base is heavily reliant on experts' experiences, it is difficult to transform it across domains.

    “These applications are limited to the expert’s domain, and because the expert knowledge base is heavily reliant on experts’ experiences, it is difficult to transform it across domains.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationnone given

    Generating a natural language description from KG makes the stored information more accessible to a wider group of end users in terms of question responding and interpretability.

    “These researches have been included in this section because generating a natural language description from KG makes the stored information more accessible to a wider group of end users in terms of question responding and interpretability.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    CORD-19 contains information about 63,000 research articles related to COVID-19, SARS-CoV-2 and other similar corona viruses.

    “CORD-19: The COVID-19 Open Research Dataset (CORD-19) contains information about 63,000 research articles, related to COVID-19, SARS-CoV-2 and other similar corona viruses and from the Allen Institute for AI.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Rules play a crucial role in automated reasoning and finding inferences.

    “Rules plays crucial role in automated reasoning and finding inferences.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Information extraction of scientific documents requires understanding of the full document, unlike traditional sentence-level extraction.

    “Information extraction of scientific documents is different from the traditional extraction methods as the understanding of full document is required compared to sentence level extraction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Accuracy, AUC, Hits@k and MRR are better choices for evaluation during refinement.

    “Other metrics, e.g., accuracy, area under curve (AUC), Hits@k and MRR, etc. are observed as better choice for evaluation during refinement.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    SemSur is a comprehensive ontology for capturing the content of computer science articles and representing it in a semantic and machine interpretable format.

    “SemSur (Semantic Survey Ontology) is a new ontology for modeling components of research contributions in the domain of Semantic Web. It is a comprehensive ontology for capturing the content of computer science articles and represent it in a semantic and machine interpretable format.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Precision and recall are frequently used in information extraction and knowledge graph construction with machine learning methods.

    “With respect to evaluation methods, precision and recall are quite frequently used in information extraction as well as knowledge graph construction with machine learning methods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Computer Science Ontology [80] is an ontology for describing higher-level Computer Science study fields, as well as sub-topics and words that go with them.

    “Similarly, Computer Science Ontology [80] is an ontology for describing higher-level Computer Science study fields, as well as the sub-topics and words that go with them.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [80] Angelo A. Salatino, Francesco Osborne, and Enrico Motta. Ontology extraction and usage in the scholarly knowledge domain. In Giuseppe Cota, Marilena Daquino, and Gian Luca Pozzato, editors, Applications and Practices in Ontology Design, Extraction, and Reasoning, volume 49 of Studies on the Semantic Web, pages 91–106. IOS Press, 2020 source

      Checked before — its earlier verdict is held back until a new check runs.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    A mainstream technique in rule-based reasoning is to formalize the problem and obtain inferences as per predefined rules.

    “A mainstream technique in rule-based reasoning is to formalize the problem and to obtain the inferences as per predefined rules.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Manual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.

    “However, manual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Manual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    The knowledge graph's reasoning capacity is reduced by its insufficient integration of subjective information from the literature.

    “However, the knowledge graph’s reasoning capacity is reduced by its insufficient integration of subjective information from the literature.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationreasoning

    The fundamental benefit of using openIE paradigms is that they can be simply applied to big corpora with no need for training data.

    “The fundamental benefit of using openIE paradigms is that they can be simply applied to big corpora with no need for training data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Knowledge fusion helps in generating metadata from various data sources.

    “Knowledge fusion helps in generating metadata from various data sources as well.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    FOAF ontology is used in [71, 73] to materialize implicit knowledge about the social relationships of authors and scientists.

    “A Friend Of A Friend (FOAF) ontology is used in [71, 73] to materialize implicit knowledge about the social relationships of authors and scientists.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [71] Francisco Abad-Navarro, José Antonio Bernabé-Diaz, Alexander García-Castro, and Jesualdo Tomás Fernandez-Breis. Semantic publication of agricultural scientific literature using property graphs. Applied Sciences, 10(3), 2020 source
    • cites [73] Zárate Marcos, Rosales Pablo, Braun Germán, Lewis Mirtha, Fillottrani Pablo Rubén, Delrieux Claudio (2019) OceanGraph: Some Initial Steps Toward a Oceanographic Knowledge Graph. Communications in Computer and Information Science 1029:33–40 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Various scholarly knowledge graphs have built their own datasets by crawling data from various digital libraries, including Web Of Science, GRID, PharmaGKB, Dimensions among others.

    “Various scholarly knowledge graphs have built their own datasets by crawling data from various digital libraries, including Web Of Science, GRID, PharmaGKB, Dimensions among others.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Subjects and objects are also used to identify concepts and their attributes in scientific statements guided by the ontology.

    “However, subjects and objects also used to identify concepts and their attributes in scientific statements guided by the ontology.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Rules are commonly utilized to express links and dependencies between entities in datasets and to capture underlying patterns in data.

    “To express links and dependencies between entities in datasets and to capture the underlying patterns in data, rules are commonly utilized.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Interpretationreasoning

    The domain-specific extraction process requires domain experts and annotators, which makes the extraction process costlier and limited.

    “The domain-specific extraction process requires domain experts and annotators, which makes the extraction process costlier and limited.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    To understand the ability of a model's mechanism, extensively labeled data and a pre-trained model are required.

    “To understand the ability of model’s mechanism, extensively labeled data and pre-trained model is required.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    Ontology allows refinement of the structure of knowledge and reduces conceptual ambiguity.

    “Ontology allows refinement of structure of knowledge and reduces conceptual ambiguity.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Studies based on knowledge extraction from unstructured data sources such as images, tables and pseudocode of an algorithm are limited to date.

    “Studies based on knowledge extraction from unstructured data sources such as images, tables and pseudocode of an algorithm is limited to date.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Through tracing over a knowledge graph, an XAI system assists stakeholders in conceptually understanding the workings of associated systems to achieve explainable outcomes and interpretability.

    “Through tracing over KG, the XAI system assists stakeholders in conceptually understanding the workings of associated systems in order to achieve explainable outcomes and interpretability.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    The level of data integration is immature and fragmented due to redundancy till now.

    “The level of data integration is immature and fragmented due to redundancy till now.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Many studies pay attention to extraction from structured or semi-structured data sources.

    “Many studies pays attention to the extraction from structured or semi-structured data sources.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.

    Interpretationreasoning

    Overall, knowledge graph is an important advancement and has power to provide semantically structured information to huge scholarly domain.

    “Overall, we are able to conclude that knowledge graph is an important advancement and have power to provide semantically structured information to huge scholarly domain.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    Knowledge graphs have emerged as the illustration of many real-time applications and implemented practically to classify entities and relationships.

    “In recent time, knowledge graphs have been emerged as the illustration of many real-time applications and implemented practically to classify entities and relationships.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Mediating the quality of algorithmic outputs produced by knowledge graph construction module is a challenging task.

    “Mediating the quality of algorithmic outputs produced by knowledge graph construction module is a challenging task.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationreasoning

    The scientific information provided in the literature does not fulfill the FAIR Data Principles.

    “The scientific information provided in the literature, on the other hand, does not fulfill the FAIR Data Principles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    It is improbable that involved algorithms will be evaluated based on human designed gold standard and human annotators in prospecting years.

    “It is improbable that involved algorithms will be evaluated based on human designed gold standard and human annotators in prospecting years.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence.

    Interpretationnone given

    Several aspects of applying knowledge graph concepts into specific domains remain to be explored.

    “However, efforts of applying such concepts into specific domains have been made in recent years, several aspects remain to be explored.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.

    Premisecitation

    FAIR guiding principle (Findable, Accessible, Interoperable, Reusable) [123] is an important scientific merit for Scientific knowledge graphs.

    “FAIR guiding principle (Findable, Accessible, Interoperable, Reusable) [123] is the important scientific merit for Scientific knowledge graphs.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [123] Mark D. Wilkinson, Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, Niklas Blomberg, Jan Willem Boiten, Luiz Bonino da Silva Santos, Philip E. Bourne, Jildau Bouwman, Anthony J. Brookes, Tim Clark, Mercè Crosas, Ingrid Dillo, Olivier Dumon, Scott Edmunds, Chris T. Evelo, Richard Finkers, Alejandra Gonzalez-Beltran, Alasdair J.G. Gray, Paul Groth, Carole Goble, Jeffrey S. Grethe, Jaap Heringa, Peter A.C. t Hoen, Rob Hooft, Tobias Kuhn, Ruben Kok, Joost Kok, Scott J. Lusher, Maryann E. Martone, Albert Mons, Abel L. Packer, Bengt Persson, Philippe Rocca-Serr

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Many scholarly ontologies are restricted over certain domain-specific entity sets.

    “Many scholarly ontologies are restricted over certain domain-specific entity sets.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    Lack of a unique normalized identity of an author entity makes the problem more challenging for services such as expert finding and collaborator search.

    “Lack of a unique normalized identity of an author entity makes the problem more challenging for certain services such as expert finding and collaborator search.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Maintaining heterogeneity along with embedding in order to map links into low dimensional order is a great challenge.

    “Maintaining heterogeneity along with embedding in order to map links into low dimensional order is a great challenge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Knowledge graph in scholarly domain is the specific area in which semantic representation of literature-based discovery is presented.

    “In this context, knowledge graph in scholarly domain is the specific area in which semantic representation of literature-based discovery is presented.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Metadata used in construction of knowledge graphs suffers from data incompleteness to different degrees such as affiliation ambiguity.

    “Metadata used in construction of knowledge graphs suffers from data incompleteness to different degrees such as affiliation ambiguity.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    Extraction of structured knowledge is a challenge across the board, and one reason is data ingestion from multiple resources which makes the knowledge noisy and inconsistent.

    “Extraction of structured knowledge is a challenge across the board and one of the reason for this is data ingestion from multiple resources which makes the knowledge noisy and inconsistent.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationreasoning

    Integration of information from heterogeneous sources can cause labor-intensive human annotations to train knowledge extraction systems.

    “Integration of information from heterogeneous sources can cause labor-intensive human annotations to train knowledge extraction systems.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    Researchers seeking relevant information have to deal with multiple data sources as well as unstructured search.

    “Another issue is that researchers seeking relevant information have to deal with multiple data sources as well as unstructured search.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    A unique and persistent identifier is required to identify relevant digital objects that possess human-readable label feature.

    “Second, a unique and persistent identifier is required to identify the relevant digital objects that possess human-readable label feature.”
    Quote in the paperNot a substantial claim
170 of 170
  • The paper relies on this without support.

    Document and keyword-based information retrieval systems are no longer adequate to explore the insights of the scholarly domain.

    “Document and keyword-based information retrieval systems are no longer adequate to explore the insights of the scholarly domain.”
  • The paper relies on this without support.

    The rapid growth of scholarly metadata has been largely contributed by humans, which generates blatant errors.

    “The rapid growth of scholarly metadata has been largely contributed by human which generates blatant errors.”
  • The paper relies on this without support.

    Automatic knowledge curation from scholarly components such as text, tables, figures, algorithms, and charts is not easy due to improper structure.

    “However, the knowledge presented in scholarly infrastructure resides in the form of text, tables, figures, algorithms, charts, etc., and automatic knowledge curation from these components is not easy due to improper structure.”
  • The paper relies on this without support.

    Most scientific documents do not share a common set of concepts.

    “Domain-specific IE refers to extraction with the intuition that most scientific documents does not share common set of concepts and target specifically semantic depth of certain concept.”
  • The paper relies on this without support.

    The scholarly network has billions of nodes and edges.

    “Because the scholarly network has billions of nodes and edges, feature engineering and vector-based representation are becoming increasingly popular methods for processing raw data.”
  • The paper relies on this without support.

    The title of a scientific publication follows grammatical rules and includes scientific terminology at certain locations.

    “The title of a scientific publications, for example, follows grammatical rules and includes scientific terminology at certain locations.”
  • The paper relies on this without support.

    Limited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.

    “It is crucial to highlight that limited human supervision regarding the need for hand-crafted rules or human-labeled data set is required.”
  • The paper relies on this without support.

    Manual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.

    “However, manual intervention is still an essential step as it helps create gold standard data set generation for evaluation purposes.”
  • The paper relies on this without support.

    There is no common standard evaluation protocol and set of benchmarks for evaluating scholarly knowledge graphs.

    “Although, there is no common standard evaluation protocol and set of benchmarks for the evaluation.”
9 of 9

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Aurora and SciKGraph are assigned the same reference

    Minor

    The paper cites [90] for Aurora, but its reference list identifies [90] as a paper about clustering and visualizing scientific fields, which the text separately associates with SciKGraph.

  • Embedding-performance discussion points to the construction figure

    Minor

    The discussion directs readers to Fig. 4 for embedding-method performance, but Fig. 4 is captioned as a diagram of knowledge-graph creation approaches, not an embedding-performance comparison.

  • Opposite scoring directions are stated for plausible triples

    Minor

    The general description says training gives positive triples higher scores, while the translation-based model description says it minimizes a triple's score to bring its entities closer. These are opposite scoring conventions, but the paper does not distinguish them.

3 of 3

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 12

  1. Oelen Allard, Jaradeh Mohamad Yaser, Farfar Kheir Eddine, Stocker Markus, Auer Sören (2019) Comparing research contributions in a scholarly knowledge graph. In Daniel Garijo, Milan Markovic, Paul Groth, Idafen Santana-Pérez, and Khalid Belhajjame, editors, Proceedings of the Third International Workshop on Capturing Scientific Knowledge co-located with the 10th International Conference on Knowledge Capture (K-CAP 2019), Marina del Rey, California , November 19th, 2019, volume 2526 of CEUR Workshop Proceedings, pages 21–26. CEUR-WS.org
  2. Zhang Fanjin, Liu Xiao, Tang Jie, Dong Yuxiao, Yao Peiran, Zhang Jie, Gu Xiaotao, Wang Yan, Shao Bin, Li Rui, Wang Kuansan (2019) OAG: toward linking large-scale heterogeneous entity graphs. In Ankur Teredesai, Vipin Kumar, Ying Li, Rómer Rosales, Evimaria Terzi, and George Karypis, editors, Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4-8, 2019, pages 2585–2595. ACM
  3. Manghi Paolo, Houssos Nikos, Mikulicic Marko, Jörg Brigitte (2012) The data model of the openaire scientific communication e-infrastructure. In Juan Manuel Dodero, Manuel Palomo-Duarte, and Pythagoras Karampiperis, editors, Metadata and Semantics Research - 6th Research Conference, MTSR 2012, Cádiz, Spain, November 28-30, 2012. Proceedings, volume 343 of Communications in Computer and Information Science, pages 168–180. Springer
  4. Yaman Beyza, Pasin Michele, Freudenberg Markus (2019) Interlinking scigraph and dbpedia datasets using link discovery and named entity recognition techniques. OpenAccess Series in Informatics 70(15):1–8
  5. Tianwen Jiang, Tong Zhao, Bing Qin, Ting Liu, Nitesh V. Chawla, and Meng Jiang. The role of: A novel scientific knowledge graph representation and construction model. In Ankur Teredesai, Vipin Kumar, Ying Li, Rómer Rosales, Evimaria Terzi, and George Karypis, editors, Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4-8, 2019, pages 1634–1642. ACM, 2019
  6. James P. McCusker, Sabbir M. Rashid, Nkechinyere Agu, Kristin P. Bennett, and Deborah L. McGuinness (2018) The Whyis knowledge graph framework in action. Proceedings of the ISWC 2018 Posters & Demonstrations, Industry and Blue Sky Ideas Tracks co-located with 17th International Semantic Web Conference (ISWC), 2180(Sep)
  7. Sahar Vahdati, Natanael Arndt, Sören Auer, and Christoph Lange. Openresearch: Collaborative management of scholarly communication metadata. In Eva Blomqvist, Paolo Ciancarini, Francesco Poggi, and Fabio Vitali, editors, Knowledge Engineering and Knowledge Management - 20th International Conference, EKAW 2016, Bologna, Italy, November 19-23, 2016, Proceedings, volume 10024 of Lecture Notes in Computer Science, pages 778–793, 2016 · DOI
  8. Liebig Thorsten, Vialard Vincent, Opitz Michael (1963) Connecting the dots in million-nodes knowledge graphs with SemSpect. CEUR Workshop Proceedings 1–4:2017
  9. Rui Zhang, Dimitar Hristovski, Dalton Schutte, Andrej Kastrin, and Marcelo Fiszman. Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID- 19 . The COVID-19 resource centre is hosted on Elsevier Connect , the company ’ s public news and information . (January), 2020
  10. Veronika Henk, Sahar Vahdati, Mojataba Nayyeri, Mehdi Ali, Hamed Shariat Yazdi, and Jens Lehmann. Metaresearch Recommendations using Knowledge Graph Embeddings. The AAAI-19 Workshop on Recommender Systems and Natural Language Processing (RecNLP), 2019
  11. Mojtaba Nayyeri, Andrey Kravchenko, Simone Angioni, Angelo Salatino, and Diego Reforgiato. Link Prediction using Numerical Weights for Knowledge Graph Completion within the Scholarly Domain. pages 1–16
  12. Meister Vera G (1931) Towards a knowledge graph for a research group with focus on qualitative analysis of scholarly papers. Proceedings of the First Workshop on Enabling Open Semantic Science 71–76:2017

Cited by

Sorted by citations

Metadata

Authors
Verma, S., Bhatia, R., Harit, S., & Batish, S.
Affiliations
Punjab Engineering College (IN)
Corresponding author
  • Verma, Shilpa
  • Bhatia, Rajesh
  • Harit, Sandeep
  • Batish, Sanjay
Venue
Complex & Intelligent Systems
Published
2022-08-09
Volume
9
Issue
1
Pages
1059-1095
ISSN
  • 2198-6053 (ISSN-L)
  • 2199-4536
OpenAlex
W4291745514
Cited by
78
References
114
Citations by year
2026: 20 · 2025: 17 · 2024: 20 · 2023: 21
FWCI
3.88
Type
journal article
Language
en
Open access
Locations
  • Complex & Intelligent Systems (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
  • Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
  • Physical Sciences › Computer Science › Information Systems › Library Science and Information Systems
Keywords
scholarly knowledge graphs, knowledge graph construction, knowledge graph refinement, scholarly communication, information extraction, ontology mapping, academic literature, knowledge graph applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review