The DOI matches its Crossref record; 66 of the 67 references it cites were found in a registry or an index; 1 of the 27 sources its claims cite were checked for support.
Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs
Open accessAbstract
The COVID-19 pandemic highlighted two critical barriers hindering rapid response to novel pathogens. These include inefficient use of existing biological knowledge about treatments, compounds, gene interactions, proteins, etc. to fight new diseases, and the lack of assimilation and analysis of the fast-growing knowledge about new diseases to quickly develop new treatments, vaccines, and compounds. Overcoming these critical challenges has the potential to revolutionize global preparedness for future pandemics. Accordingly, this article introduces a novel knowledge graph application that functions as both a repository of life science knowledge and an analytics platform capable of extracting time-sensitive insights to uncover evolving disease dynamics and, importantly, researchers' evolving understanding. Specifically, we demonstrate how to extract time-bounded key concepts, also leveraging existing ontologies, from evolving scholarly articles to create a single temporal connected source of truth specifically related to COVID-19. By doing so, current knowledge can be promptly accessed by both humans and machines, from which further understanding of disease outbreaks can be derived. We present key findings from the temporal analysis, applied to a subset of the resulting knowledge graph known as the temporal keywords knowledge graph, and delve into the detailed capabilities provided by this innovative approach.
Overview
CoChat Summary
TL;DR
The paper introduces a temporal knowledge graph and a TagGraph application built from COVID-19 literature and public biomedical sources, using monthly keyword co-occurrence snapshots and Role-Dynamics to trace evolving research topics. It reports interpretable roles and neighborhood patterns—such as machine learning rising and hydroxychloroquine declining—and a clinician/researcher survey motivating automated trend detection.
Key findings
- Temporal analysis of the TagGraph from March 2020 to March 2022 identified five roles; Role 0 and Role 2 correlate with centrality/importance (Role 0: PageRank 0.843, closeness 0.861, degree 0.866; Role 2: PageRank 0.691, closeness 0.637, degree 0.808, local clustering −0.823), Role 1 appears unrelated/noisy, and Roles 3 and 4 represent peripheral or isolated nodes.
- Case examples show “machine learning” had a steady progression in roles 2 and 0 over time, while “hydroxychloroquine” initially spiked in roles 0 and 2 and then degraded, with role 3 increasing.
- Top SARS-CoV-2 neighbor tags included ACE2, serology, MERS-CoV, spike protein, and transmission; top COVID-19 neighbor tags included mortality, social distancing, healthcare workers, lockdown, anxiety, and mental health.
- A survey of 26 clinicians and research scientists found 67% cited transmission/asymptomatic spread as information they wished they knew earlier, 54% used sources such as PubMed, news, CDC, and IDSA, and 30% had no seminal source; coding had bi-rater agreement of 0.72 and consensus score of 32%.
Methods
- The authors constructed a knowledge graph from public sources including Hetionet, Uniprot, CORD-19, Drug Repurposing Knowledge Graph, Gene Ontology, and MeSH, using the Linked Data lifecycle and GraphAware Hume, with NLP named entity recognition and entity relationship extraction.
- They built a TagGraph from author keywords, clustered synonymous tags using SPECTER embeddings and DBSCAN, computed monthly co-occurrence snapshots with association strength SA = c_ij / (s_i s_j), and applied ReFeX structural features plus RolX matrix factorization via Role-Dynamics.
- A qualitative survey with 26 participants (physicians, nurses, other health professionals, and Ph.D.-level researchers) used five open-response questions and thematic coding by three researchers under USF IRB Study #01211.
Limitations
- Stated: the TagGraph is only a small portion of a larger knowledge graph; tag cleanup and merging could improve with alternative clustering algorithms, ontologies, taxonomies, and dictionaries; roles are difficult to interpret; the analysis considered only directly connected nodes, postponing egonet analysis; and unexplored sources include patents, social media, news, country regulations, and WHO/healthcare communication.
- Stated/evident: survey coding agreement was limited, with bi-rater agreement of 0.72 and consensus score of 32%, attributed to 70 available codes and up to six codes per response.
- Evident from the text: the temporal analysis is bounded to March 2020–March 2022 and monthly snapshots, and results depend on author-provided keywords and the selected public data sources.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
0 Valid · 3 Not valid · 19 Not checked · 64 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Studies of previous infectious outbreaks show that public adherence to public health guidelines is greater when the scientific knowledge base surrounding the disease is stronger (Bults et al., 2011; Lin et al., 2011).”
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 1. Introduction
What the sources say
- Disputedcites Bults et al., 2011 sourceExperimental — accuracy not yet measured
Our copy reports the opposite direction: the Abstract (Results) states that 'Between May and August 2009, the level of knowledge regarding Influenza A (H1N1) increased, while perceived severity of the new flu, perceived self-efficacy, and intention to comply with preventive measures decreased', and Table 2 shows the knowledge summary score rising from 88% to 96% across the three surveys while intention to comply fell (e.g. willingness to be vaccinated 77% in June to 63% in August). In the multivariate models (Results, 'Factors associated with taking preventive measures and strong intention to comply (survey 3)'), knowledge is not among the significant predictors of either taking preventive measures or strong intention to comply; the Discussion attributes preventive behaviour to affective variables such as anxiety and to self-efficacy, perceived severity, perceived efficacy and trust in government information. Nowhere does the paper assert that adherence to guidelines is greater when the scientific knowledge base is stronger. (LLM, conf=0.65)
Checked by a reasoning model — may be wrong.
- Not checked yetcites Lin et al., 2011 source
Checked before — its earlier verdict is held back until a new check runs.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Role 0 and 2 shed light on aspects such as public and mental health, lockdown measures, and healthcare workers.”
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.2. Story telling from temporal analysis of TagGraphs
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“High-level insights from our survey show that modes of transmission, particularly the infectivity of asymptomatic persons, were particularly concerning.”
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.3. Establishing the critical need for KGs in pandemic response: a qualitative analysis of clinicians' resources and knowledge gathering of COVID-19
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In role 0, the same key terms appear at the top almost in all the time frames.”
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.2. Story telling from temporal analysis of TagGraphs
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By utilizing signal analysis, certain tags exhibit a clear and strong signal for role 0 and role 2, which remains consistent throughout the entire history sampling, including “SARS-CoV-2”, “COVID-19”, and “Coronavirus”.”
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.2. Story telling from temporal analysis of TagGraphs
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
26 more claims
Create a free account to see all 86 claims and to verify the 24 references still open.
- Probably not a substantial claim. 50
- It may state two separate claims as one. 17
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.1. Role interpretations
“Role 0 and Role 1 nodes are strongly connected and central”
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.1. Role interpretations
“they reflect noisy tags, i.e., tags that randomly appear in the network with no specific relevance of any type. The matrix factorization collected them under the same role 1.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.1. Role interpretations
“Role 0 and Role 2 are directly related to all the measures we extracted”
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.1. Role interpretations
“| | Local Clustering | −0.823 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.2. Story telling from temporal analysis of TagGraphs
“For example, Table 2 shows the results for “SARS-CoV-2” across 3 months.”
§ Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs > 3. Results > 3.2. Story telling from temporal analysis of TagGraphs
“| 2020-04 | 2020-05 | 2020-06 | 2020-07 |”
Citations
Cites
(1996) · Cited by 20,179
Dexamethasone in Hospitalized Patients with Covid-19
The RECOVERY Collaborative Group (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2021436 · Cited by 11,477
COVID-19: consider cytokine storm syndromes and immunosuppression
Mehta, P., McAuley, D. F., Brown, M., Sanchez, E., Tattersall, R. S., & Manson, J. J. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30628-0 · Cited by 9,664
Cryo-EM structure of the 2019-nCoV spike in the prefusion conformation
Wrapp, D., Wang, N., Corbett, K. S., Goldsmith, J. A., Hsieh, C.-L., Abiona, O., Graham, B. S., & McLellan, J. S. (2020) · Science · doi:10.1126/science.abb2507 · Cited by 8,897
UniProt: the Universal Protein Knowledgebase in 2023
The UniProt Consortium, Bateman, A., Martin, M.-J., Orchard, S., Magrane, M., Ahmad, S., Alpi, E., Bowler-Barnett, E. H., Britto, R., Bye-A-Jee, H., et al. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkac1052 · Cited by 7,210
Centers for Disease Control and Prevention
(2007) · Encyclopedia of Measurement and Statistics · doi:10.4135/9781412952644.n74 · Cited by 6,444
The proximal origin of SARS-CoV-2
Andersen, K. G., Rambaut, A., Lipkin, W. I., Holmes, E. C., & Garry, R. F. (2020) · Nature Medicine · doi:10.1038/s41591-020-0820-9 · Cited by 5,081
The Gene Ontology (GO) database and informatics resource
Gene Ontology Consortium (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh036 · Cited by 4,579
Temporal dynamics in viral shedding and transmissibility of COVID-19
He, X., Lau, E. H. Y., Wu, P., Deng, X., Wang, J., Hao, X., Lau, Y. C., Wong, J. Y., Guan, Y., Tan, X., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0869-5 · Cited by 4,247
Structural basis of receptor recognition by SARS-CoV-2
Shang, J., Ye, G., Shi, K., Wan, Y., Luo, C., Aihara, H., Geng, Q., Auerbach, A., & Li, F. (2020) · Nature · doi:10.1038/s41586-020-2179-y · Cited by 3,661
Hogan, A., Blomqvist, E., Cochez, M., D’amato, C., Melo, G. D., Gutierrez, C., Kirrane, S., Gayo, J. E. L., Navigli, R., Neumaier, S., et al. (2022) · ACM Computing Surveys · doi:10.1145/3447772 · Cited by 1,904
Age-dependent effects in the transmission and control of COVID-19 epidemics
Davies, N. G., Klepac, P., Liu, Y., Prem, K., Jit, M., CMMID COVID-19 working group, Pearson, C. A. B., Quilty, B. J., Kucharski, A. J., Gibbs, H., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0962-9 · Cited by 1,759
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712
Broad-spectrum antiviral GS-5734 inhibits both epidemic and zoonotic coronaviruses
Sheahan, T. P., Sims, A. C., Graham, R. L., Menachery, V. D., Gralinski, L. E., Case, J. B., Leist, S. R., Pyrc, K., Feng, J. Y., Trantcheva, I., et al. (2017) · Science Translational Medicine · doi:10.1126/scitranslmed.aal3653 · Cited by 1,571
Message Understanding Conference-6: a brief history
Grishman, R., & Sundheim, B. (1996) · Proceedings of the 16th conference on Computational linguistics - · doi:10.3115/992628.992709 · Cited by 1,408
Baum, A., Fulton, B. O., Wloga, E., Copin, R., Pascal, K. E., Russo, V., Giordano, S., Lanza, K., Negron, N., Ni, M., et al. (2020) · Science · doi:10.1126/science.abd0831 · Cited by 1,253
Ester, M., Kriegel, H., Sander, J., & Xu, X. (1996) · Knowledge Discovery and Data Mining · Cited by 1,131
Proceedings of the Second International Conference on Knowledge Discovery and Data Mining
Simoudis, E., Han, J., & Fayyad, U. M. (1996) · Cited by 1,121
SPECTER: Document-level Representation Learning using Citation-informed Transformers
Cohan, A., Feldman, S., Beltagy, I., Downey, D., & Weld, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.207 · Cited by 1,108
Potently neutralizing and protective human antibodies against SARS-CoV-2
Zost, S. J., Gilchuk, P., Case, J. B., Binshtein, E., Chen, R. E., Nkolola, J. P., Schäfer, A., Reidy, J. X., Trivette, A., Nargi, R. S., et al. (2020) · Nature · doi:10.1038/s41586-020-2548-6 · Cited by 1,041
How to normalize cooccurrence data? An analysis of some well‐known similarity measures
Eck, N. J. V., & Waltman, L. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21075 · Cited by 966
Su, H.-N., & Lee, P.-C. (2010) · Scientometrics · doi:10.1007/s11192-010-0259-8 · Cited by 916
K-BERT: Enabling Language Representation with Knowledge Graph
Liu, W., Zhou, P., Zhao, Z., Wang, Z., Ju, Q., Deng, H., & Wang, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i03.5681 · Cited by 894
Medical Subject Headings (MeSH).
(2000) · Europe PMC (PubMed Central) · Cited by 789
Systematic integration of biomedical knowledge prioritizes drugs for repurposing
Himmelstein, D. S., Lizee, A., Hessler, C., Brueggeman, L., Chen, S. L., Hadley, D., Green, A., Khankhanian, P., & Baranzini, S. E. (2017) · eLife · doi:10.7554/elife.26726 · Cited by 666 · cited 2×
“Leveraging these advances, KGs can help researchers tackle many biomedical problems, such as finding new treatments for existing drugs (Himmelstein et al., 2017), aiding efforts to diagnose patients (Choi et al.”
BackgroundGRAM: Graph-based Attention Model for Healthcare Representation Learning
Choi, E., Bahadori, M. T., Song, L., Stewart, W. F., & Sun, J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098126 · Cited by 637
Bults, M., Beaujean, D. J., de Zwart, O., Kok, G., van Empelen, P., van Steenbergen, J. E., Richardus, J. H., & Voeten, H. A. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-2 · Cited by 508 · cited 1×
“Studies of previous infectious outbreaks show that public adherence to public health guidelines is greater when the scientific knowledge base surrounding the disease is stronger (Bults et al., 2011; Lin et al., 2011).”
BackgroundSocial media for rapid knowledge dissemination: early experience from the COVID ‐19 pandemic
Chan, A. K. M., Nickson, C. P., Rudolph, J. W., Lee, A., & Joynt, G. M. (2020) · Anaesthesia · doi:10.1111/anae.15057 · Cited by 459
Luan, Y., He, L., Ostendorf, M., & Hajishirzi, H. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1360 · Cited by 422
Temporal Graph Networks for Deep Learning on Dynamic Graphs
Rossi, E., Chamberlain, B., Frasca, F., Eynard, D., Monti, F., & Bronstein, M. (2020) · arXiv · doi:10.48550/arxiv.2006.10637 · Cited by 382
RolX: structural role extraction & mining in large graphs
Henderson, K., Gallagher, B., Eliassi-Rad, T., Tong, H., Basu, S., Akoglu, L., Koutra, D., Faloutsos, C., & Li, L. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339723 · Cited by 376
Clements, J. M. (2020) · JMIR Public Health and Surveillance · doi:10.2196/19161 · Cited by 369
Closed environments facilitate secondary transmission of coronavirus disease 2019 (COVID-19)
Nishiura, H., Oshitani, H., Kobayashi, T., Saito, T., Sunagawa, T., Matsui, T., Wakita, T., MHLW COVID-19 Response Team, & Suzuki, M. (2020) · medRxiv · doi:10.1101/2020.02.28.20029272 · Cited by 338
Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion
Zhou, K., Zhao, W. X., Bian, S., Zhou, Y., Wen, J.-R., & Yu, J. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403143 · Cited by 321
It's who you know: graph mining using recursive structural features
Henderson, K., Gallagher, B., Li, L., Akoglu, L., Eliassi-Rad, T., Tong, H., & Faloutsos, C. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020512 · Cited by 223
COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation
Wang, Q., Li, M., Wang, X., Parulian, N. N., Han, G., Ma, J., Tu, J., Lin, Y., Zhang, R. H., Liu, W., et al. (2021) · doi:10.18653/v1/2021.naacl-demos.8 · Cited by 180
AttacKG: Constructing Technique Knowledge Graph from Cyber Threat Intelligence Reports
Li, Z., Zeng, J., Chen, Y., & Liang, Z. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-17140-6_29 · Cited by 179
Methodological Guidelines for Publishing Government Linked Data
Villazón-Terrazas, B. C., Vilches‐Blázquez, L. M., Corcho, Ó., & Gómez-Pérez, A. (2011) · Springer eBooks · doi:10.1007/978-1-4614-1767-5_2 · Cited by 172
Building and Using a Knowledge Graph to Combat Human Trafficking
Szekely, P. A., Knoblock, C. A., Slepicka, J., Philpot, A., Singh, A., Yin, C., Kapoor, D., Natarajan, P., Marcu, D., Knight, K. K., et al. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25010-6_12 · Cited by 136
Product Knowledge Graph Embedding for E-commerce
Xu, D., Ruan, C., Korpeoglu, E., Kumar, S., & Achan, K. (2020) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3336191.3371778 · Cited by 107
Lin, Y., Huang, L., Nie, S., Liu, Z., Yu, H., Yan, W., & Xu, Y. (2011) · BMC Infectious Diseases · doi:10.1186/1471-2334-11-128 · Cited by 101
Integration of three visualization methods based on co-word analysis
Yang, Y., Wu, M., & Cui, L. (2012) · Scientometrics · doi:10.1007/s11192-011-0541-4 · Cited by 91
AliMeKG: Domain Knowledge Graph Construction and Application in E-commerce
Li, F.-L., Chen, H., Xu, G., Qiu, T., Ji, F., Zhang, J., & Chen, H. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3412685 · Cited by 86
miRNA-disease association prediction with collaborative matrix factorization
Shen, Z., Zhang, Y.-H., Han, K., Nandi, A. K., Honig, B., & Huang, D.-S. (2017) · Complexity · doi:10.1155/2017/2498957 · Cited by 82
The Joy of Data - A Cookbook for Publishing Linked Government Data on the Web
Hyland, B., & Hyland-Wood, D. (2011) · Springer eBooks · doi:10.1007/978-1-4614-1767-5_1 · Cited by 66
Anticipating Stock Market of the Renowned Companies: A Knowledge Graph Approach
Liu, Y., Zeng, Q., Ordieres-Meré, J. B., & Yang, H. (2019) · Complexity · doi:10.1155/2019/9202457 · Cited by 61
Introduction to Linked Data and Its Lifecycle on the Web
Ngomo, A.-C. N., Auer, S., Lehmann, J., & Zaveri, A. J. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10587-1_1 · Cited by 61
Grishman, R. (2015) · IEEE Intelligent Systems · doi:10.1109/mis.2015.68 · Cited by 60
GenomicKB: a knowledge graph for the human genome
Feng, F., Tang, F., Gao, Y., Zhu, D., Li, T., Yang, S., Yao, Y., Huang, Y., & Liu, J. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac957 · Cited by 60
Keywords and co-occurrence patterns in the voynich manuscript: an information-theoretic analysis
Montemurro, M. A., & Zanette, D. H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066344 · Cited by 55
The evolution of interdisciplinarity in physics research
Pan, R. K., Sinha, S., Kaski, K., & Saramäki, J. (2012) · Scientific Reports · doi:10.1038/srep00551 · Cited by 54
Semantic Property Graph for Scalable Knowledge Graph Analytics
Purohit, S., Van, N., & Chin, G. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671547 · Cited by 51
Covid-on-the-Web: Knowledge Graph and Services to Advance COVID-19 Research
Michel, F., Gandon, F., Ah-Kane, V., Bobasheva, A., Cabrio, E., Corby, O., Gazzotti, R., Giboin, A., Marro, S., Mayer, T., et al. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-62466-8_19 · Cited by 46
“Role-Dynamics: Fast Mining of Large Dynamic Networks,”
Rossi, R., Gallagher, B., Neville, J., & Henderson, K. (2012) · Proceedings of the 21st International Conference on World Wide Web · doi:10.1145/2187980.2188234 · Cited by 31
COVID-19 Knowledge Graph from semantic integration of biomedical literature and databases
Chen, C., Ross, K. E., Gavali, S., Cowart, J. E., & Wu, C. H. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab694 · Cited by 31
Choudhury, N., Faisal, F., & Khushi, M. (2020) · Journal of Informetrics · doi:10.1016/j.joi.2020.101057 · Cited by 27
Discovering implicit entity relation with the gene-citation-gene network
Song, M., Han, N.-G., Kim, Y.-H., Ding, Y., & Chambers, T. (2013) · PLoS ONE · doi:10.1371/journal.pone.0084639 · Cited by 26
COVID-19 Open-Data a global-scale spatially granular meta-dataset for coronavirus disease
Wahltinez, O., Cheung, A., Alcantara, R., Cheung, D., Daswani, M., Erlinger, A., Lee, M., Yawalkar, P., Lê, P., Navarro, O. P., et al. (2022) · Scientific Data · doi:10.1038/s41597-022-01263-z · Cited by 26
Network graph representation of COVID-19 scientific publications to aid knowledge discovery
Cernile, G., Heritage, T., Sebire, N. J., Gordon, B., Schwering, T., Kazemlou, S., & Borecki, Y. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2020-100254 · Cited by 19
COVID-19 Knowledge Graph: Accelerating Information Retrieval and Discovery for Scientific Literature
Wise, C., Romero Calvo, M., Bhatia, P., Ioannidis, V., Karypus, G., Price, G., Song, X., Brand, R., & Kulkani, N. (2020) · Proceedings of Knowledgeable NLP: the First Workshop on Integrating Structured Knowledge and Neural Networks for NLP · doi:10.18653/v1/2020.knlp-1.1 · Cited by 11
Graph-Powered machine learning
Negro, A. (n.d.) · Cited by 9
Self-citationGovindapillai, S., Soon, L.-K., & Haw, S.-C. (2021) · F1000Research · doi:10.12688/f1000research.72843.1 · Cited by 5
Knowledge diffusion and complex . . . geographical industrial clusters
Canals, A. (n.d.) · Cited by 5
Author response: Systematic integration of biomedical knowledge prioritizes drugs for repurposing
Himmelstein, D. S., Lizee, A., Hessler, C., Brueggeman, L., Chen, S. L., Hadley, D., Green, A., Khankhanian, P., & Baranzini, S. E. (2017) · doi:10.7554/elife.26726.017 · Cited by 4
CORD-19: The COVID-19 Open Research Dataset
Wang, L. L., Lo, K., Chandrasekhar, Y., Reas, R., Yang, J., Burdick, D., Eide, D., Funk, K., Katsis, Y., Kinney, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.10706
(2014) · Research at the University of Copenhagen (University of Copenhagen)
Research works printed but not linked: 1
- Negro, 2023, Knowledge Graph Applied
Cited by
Liu, Q., Feng, S., Huang, M., & Bhatti, U. A. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10983-0 · Cited by 19
Learning entity-query dependency and query classification for temporal knowledge graph prediction
He, M., Zhu, L., & Bai, L. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128016 · Cited by 6
Responsible models and indicators: challenges from artificial intelligence
Zhang, Y. (2023) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2023.1305692 · Cited by 2
Biomedical knowledge graphs driving new target identification and novel drug discovery
Dou, P., Yang, X., Jiang, Y., Xie, X., Geng, X., Huang, H., Li, H., & Li, S. (2026) · Targetome · doi:10.48130/targetome-0026-0025 · Cited by 1
Garimella, R. (2024) · Journal of High School Science · doi:10.64336/001c.120720
Metadata
- Authors
- Negro, A., Montagna, F., Teng, M. N., Neal, T., Thomas, S., King, S., & Khan, R.
- Affiliations
- University of South Florida (US)
- Corresponding author
- Negro, Alessandro
- Neal, Tempestt
- Venue
- Frontiers in Research Metrics and Analytics
- Publisher
- Frontiers Media SA
- Published
- 2023-08-03
- Volume
- 8
- Pages
- 1204801-1204801
- ISSN
- 2504-0537 (ISSN-L)
- PMC
- PMC10435856
- OpenAlex
- W4385519666
- Semantic Scholar
- d57ea3156a6a98048ad43b35d404f4fe193ec1ba
- Cited by
- 6
- References
- 67
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 2 · 2023: 1
- FWCI
- 0.22
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Research Metrics and Analytics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (2028051)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- COVID-19 pandemic, temporal knowledge graphs, knowledge graph evolution, ontology (information science), pandemic preparedness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.