The DOI matches its Crossref record, with a small difference in title or year; 472 of the 472 references it cites were found in a registry or an index.
Systematic review and critical appraisal of prediction models for diagnosis and prognosis of COVID-19 infection
Open accessPreprint — published as 10.1136/bmj.m1328 · Paper page
Abstract
Objective: To review and critically appraise published and preprint reports of models that aim to predict either (i) presence of existing COVID-19 infection, (ii) future complications in individuals already diagnosed with COVID-19, or (iii) models to identify individuals at high risk for COVID-19 in the general population. Design: Rapid systematic review and critical appraisal of prediction models for diagnosis or prognosis of COVID-19 infection. Data sources: PubMed, EMBASE via Ovid, Arxiv, medRxiv and bioRxiv until 24 th March 2020. Study selection: Studies that developed or validated a multivariable COVID-19 related prediction model. Two authors independently screened titles, abstracts and full text. Data extraction: Data from included studies were extracted independently by at least two authors based on the CHARMS checklist, and risk of bias was assessed using PROBAST. Data were extracted on various domains including the participants, predictors, outcomes, data analysis, and prediction model performance. Results: 2696 titles were screened. Of these, 27 studies describing 31 prediction models were included for data extraction and critical appraisal. We identified three models to predict hospital admission from pneumonia and other events (as a proxy for covid-19 pneumonia) in the general population; 18 diagnostic models to detect COVID-19 infection in symptomatic individuals (13 of which were machine learning utilising computed tomography (CT) results); and ten prognostic models for predicting mortality risk, progression to a severe state, or length of hospital stay. Only one of these studies used data on COVID-19 cases outside of China. Most reported predictors of presence of COVID-19 in suspected patients included age, body temperature, and signs and symptoms. Most reported predictors of severe prognosis in infected patients included age, sex, features derived from CT, C-reactive protein, lactic dehydrogenase, and lymphocyte count. Estimated C-index estimates for the prediction models ranged from 0.73 to 0.81 in those for the general population (reported for all 3 general population models), from 0.81 to > 0.99 in those for diagnosis (reported for 13 of the 18 diagnostic models), and from 0.85 to 0.98 in those for prognosis (reported for 6 of the 10 prognostic models). All studies were rated at high risk of bias, mostly because of non-representative selection of control patients, exclusion of patients who had not experienced the event of interest by the end of the study, and poor statistical analysis, including high risk of model overfitting. Reporting quality varied substantially between studies. A description of the study population and intended use of the models was absent in almost all reports, and calibration of predictions was rarely assessed. Conclusion: COVID-19 related prediction models are quickly entering the academic literature, to support medical decision making at a time where this is urgently needed. Our review indicates proposed models are poorly reported and at high risk of bias. Thus, their reported performance is likely optimistic and using them to support medical decision making is not advised. We call for immediate sharing of the individual participant data from COVID-19 studies to support collaborative efforts in building more rigorously developed prediction models and validating (evaluating) existing models. The aforementioned predictors identified in multiple included studies could be considered as candidate predictors for new models. We also stress the need to follow methodological guidance when developing and validating prediction models, as unreliable predictions may cause more harm than benefit when used to guide clinical decisions. Finally, studies should adhere to the TRIPOD statement to facilitate validating, appraising, advocating and clinically using the reported models. Systematic review registration protocol: osf.io/ehc47/ , registration: osf.io/wy245 Summary boxes: What is already known on this topic: - The sharp recent increase in COVID-19 infections has put a strain on healthcare systems worldwide, necessitating efficient early detection, diagnosis of patients suspected of the infection and prognostication of COVID-19 confirmed cases. - Viral nucleic acid testing and chest CT are standard methods for diagnosing COVID-19, but are time-consuming. - Earlier reports suggest that the elderly, patients with comorbidity (COPD, cardiovascular disease, hypertension), and patients presenting with dyspnoea are vulnerable to more severe morbidity and mortality after COVID-19 infection. What this study adds: - We identified three models to predict hospital admission from pneumonia and other events (as a proxy for COVID-19 pneumonia) in the general population. - We identified 18 diagnostic models for COVID-19 detection in symptomatic patients. - 13 of these were machine learning models based on CT images. - We identified ten prognostic models for COVID-19 infected patients, of which six aimed to predict mortality risk in confirmed or suspected COVID-19 patients, two aimed to predict progression to a severe or critical state, and two aimed to predict a hospital stay of more than 10 days from admission. - Included studies were poorly reported compromising their subsequent appraisal, and recommendation for use in daily practice. All studies were appraised at high risk of bias, raising concern that the models may be flawed and perform poorly when applied in practice, such that their predictions may be unreliable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Medical guidelines rely on comprehensive systematic reviews, but the medical literature is growing at breakneck pace and the quality of the research is not universally adequate for summarization into policy 38 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [38]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Medical guidelines rely on comprehensive systematic reviews, but the medical literature is growing at breakneck pace and the quality of the research is not universally adequate for summarization into policy 38 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [38]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“within the first 15 months of the covid-19 pandemic, 381 prognostic prediction models for the disease were published.”
From PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods (2025) · cites this paper as [5]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Medical guidelines rely on comprehensive systematic reviews, but the medical literature is growing at breakneck pace and the quality of the research is not universally adequate for summarization into policy 38 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [38]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“At least 731 diagnostic and prognostic prediction model studies on covid-19 were published during the first 12 months of the pandemic.9”
From TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods (2024) · cites this paper as [9]
Experimental — accuracy not yet measured
In the citing paper
“Inadequate efforts were made to prioritise the health and safety of these workers, first in requiring precautions in their workplaces, and later in reducing structural barriers to accessing vaccines when they became available.”
From The Lancet Commission on lessons for the future from the COVID-19 pandemic (2022) · cites this paper as [262]
In the citing paper
“Other groups that have been disproportionately affected include people with comorbid medical conditions, particularly those with immunocompromised status; people living with physical disabilities or mental disorders; residents of congregant settings; and essential workers.”
From The Lancet Commission on lessons for the future from the COVID-19 pandemic (2022) · cites this paper as [262]
In the citing paper
“The inputs to the CDS model were Chest X-Ray (CXR) images, vital signs, demographic data, and lab values that were shown in previous publications to be predictive of COVID-19 patient outcomes18–21.”
From Federated learning for predicting clinical outcomes in patients with COVID-19 (2021) · cites this paper as [19]
In the citing paper
“older adults are particularly vulnerable to COVID-19 infection (4), especially if they are affected by comorbidities such as Alzheimer's disease (AD) (5).”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Machine learning predictive model for severe COVID-19
Kang, J., Chen, T., Luo, H., Luo, Y., Du, G., & Yang, M. J. (2021) · Infection Genetics and Evolution · doi:10.1016/j.meegid.2021.104737 · Cited by 42
RetractedLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Zhou, F., Yu, T., Du, R., Fan, G., Liu, Y., Liu, Z., Xiang, J., Wang, Y., Song, B., Gu, X., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30566-3 · Cited by 27,263
An interactive web-based dashboard to track COVID-19 in real time
Dong, E., Du, H., & Gardner, L. (2020) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30120-1 · Cited by 10,048
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationSeymour, C. W., Liu, V. X., Iwashyna, T. J., Brunkhorst, F. M., Rea, T. D., Scherag, A., Rubenfeld, G., Kahn, J. M., Shankar-Hari, M., Singer, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0288 · Cited by 3,939
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281
Self-citationLim, W. S. (2003) · Thorax · doi:10.1136/thorax.58.5.377 · Cited by 3,066
Calculating the sample size required for developing a clinical prediction model
Riley, R. D., Ensor, J., Snell, K. I. E., Harrell, F. E., Martin, G. P., Reitsma, J. B., Moons, K. G. M., Collins, G., & van Smeden, M. (2020) · BMJ · doi:10.1136/bmj.m441 · Cited by 2,917
Self-citationIntroduction to the Analysis of Survival Data in the Presence of Competing Risks
Austin, P. C., Lee, D. S., & Fine, J. P. (2016) · Circulation · doi:10.1161/circulationaha.115.017719 · Cited by 2,653
Automated detection of COVID-19 cases using deep neural networks with X-ray images
Öztürk, T., Talo, M., Yildirim, E. A., Baloğlu, U. B., Yıldırım, Ö., & Acharya, U. R. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103792 · Cited by 2,652
Calibration: the Achilles heel of predictive analytics
On behalf of Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative, Van Calster, B., McLernon, D. J., van Smeden, M., Wynants, L., & Steyerberg, E. W. (2019) · BMC Medicine · doi:10.1186/s12916-019-1466-7 · Cited by 2,650
Self-citationClinical, laboratory and imaging features of COVID-19: A systematic review and meta-analysis
Rodriguez-Morales, A. J., Cardona-Ospina, J. A., Gutiérrez-Ocampo, E., Villamizar-Peña, R., Holguin-Rivera, Y., Escalera-Antezana, J. P., Alvarado-Arnez, L. E., Bonilla-Aldana, D. K., Franco-Paredes, C., Henao-Martinez, A. F., et al. (2020) · Travel Medicine and Infectious Disease · doi:10.1016/j.tmaid.2020.101623 · Cited by 2,542
Apostolopoulos, I. D., & Mpesiana, T. A. (2020) · Physical and Engineering Sciences in Medicine · doi:10.1007/s13246-020-00865-4 · Cited by 2,338
Prevalence and impact of cardiovascular metabolic diseases on COVID-19 in China
Li, B., Yang, J., Zhao, F., Zhi, L., Wang, X., Liu, L., Bi, Z., & Zhao, Y. (2020) · Clinical Research in Cardiology · doi:10.1007/s00392-020-01626-9 · Cited by 2,109
Critical Care Utilization for the COVID-19 Outbreak in Lombardy, Italy
Grasselli, G., Pesenti, A., & Cecconi, M. (2020) · JAMA · doi:10.1001/jama.2020.4031 · Cited by 2,019
Moons, K. G. M., de Groot, J. A. H., Bouwmeester, W., Vergouwe, Y., Mallett, S., Altman, D. G., Reitsma, J. B., & Collins, G. S. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001744 · Cited by 2,018
Self-citationLi, L., Qin, L., Xu, Z., Yin, Y., Wang, X., Kong, B., Bai, J., Lu, Y., Fang, Z., Song, Q., et al. (2020) · Radiology · doi:10.1148/radiol.2020200905 · Cited by 1,927
Can AI help in screening viral and COVID-19 pneumonia?
Chowdhury, M. E. H., Rahman, T., Khandakar, A., Mazhar, R., Kadir, M. A., Mahbub, Z. B., Islam, K. R., Khan, M. S., Iqbal, A., Emadi, N. A., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3010287 · Cited by 1,913
Validation of a modified Early Warning Score in medical admissions
Subbe, C. P. (2001) · QJM · doi:10.1093/qjmed/94.10.521 · Cited by 1,788
Lippi, G., Plebani, M., & Henry, B. M. (2020) · Clinica Chimica Acta · doi:10.1016/j.cca.2020.03.022 · Cited by 1,741
A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19)
Wang, S., Kang, B., Ma, J., Zeng, X., Xiao, M., Guo, J., Cai, M., Yang, J., Li, Y., Meng, X., et al. (2021) · European Radiology · doi:10.1007/s00330-021-07715-1 · Cited by 1,694
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669
Self-citationReal-time tracking of self-reported symptoms to predict potential COVID-19
Menni, C., Valdes, A. M., Freidin, M. B., Sudre, C. H., Nguyen, L. H., Drew, D. A., Ganesh, S., Varsavsky, T., Cardoso, M. J., El-Sayed Moustafa, J. S., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0916-2 · Cited by 1,517
Steyerberg, E. W. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-77244-8 · Cited by 1,491
Self-citationLiang, W., Liang, H., Ou, L., Chen, B., Chen, A., Li, C., Li, Y., Guan, W., Sang, L., Lu, J., et al. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.2033 · Cited by 1,387
CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images
Khan, A. I., Shah, J. L., & Bhat, M. M. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105581 · Cited by 1,351
An interpretable mortality prediction model for COVID-19 patients
Li, Y., Zhang, H., Gonçalves, J. M., Xiao, Y., Wang, M., Guo, Y., Sun, C., Tang, X., Jing, L., Zhang, M., et al. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0180-7 · Cited by 1,328
Prediction models need appropriate internal, internal-external, and external validation
Steyerberg, E. W., & Harrell, F. E. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.04.005 · Cited by 1,304
Self-citationThe Clinical and Chest CT Features Associated With Severe and Critical COVID-19 Pneumonia
Li, K., Wu, J., Wu, F., Guo, D., Chen, L., Zheng, F., & Li, C. (2020) · Investigative Radiology · doi:10.1097/rli.0000000000000672 · Cited by 1,294
A Weakly-Supervised Framework for COVID-19 Classification and Lesion Localization From Chest CT
Zheng, C., Deng, X., Fu, Q., Zhou, Q., Feng, J., Ma, H., Liu, W., & Wang, X. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2995965 · Cited by 1,253
A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia
Xu, X., Jiang, X., Ma, C., Du, P., Li, X., Lv, S., Yu, L., Ni, Q., Chen, Y., Su, J., et al. (2020) · Engineering · doi:10.1016/j.eng.2020.04.010 · Cited by 1,209
Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network
Abbas, A., Abdelsamea, M. M., & Gaber, M. M. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01829-7 · Cited by 1,174
Artificial intelligence–enabled rapid diagnosis of patients with COVID-19
Mei, X., Lee, H.-C., Diao, K.-Y., Huang, M., Lin, B., Liu, C., Xie, Z., Ma, Y., Robson, P. M., Chung, M., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0931-3 · Cited by 1,084
Knight, S. R., Ho, A. Y. W., Pius, R., Buchan, I. E., Carson, G., Drake, T. M., Dunning, J. W., Fairfield, C. J., Gamble, C. L., Green, C., et al. (2020) · BMJ · doi:10.1136/bmj.m3339 · Cited by 1,039
A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19)Preprint
Wang, S., Kang, B., Ma, J., et al. (2020) · medRxiv · doi:10.1101/2020.02.14.20023028 · Cited by 1,035
Deep Learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) With CT Images
Song, Y., Zheng, S., Li, L., Zhang, X., Zhang, X., Huang, Z., Chen, J., Zhao, H., Wang, R., Chong, Y., et al. (2021) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3065361 · Cited by 978
Zhang, K., Liu, X., Shen, J., Li, Z., Sang, Y., Wu, X., Zha, Y., Liang, W., Wang, C., Wang, K., et al. (2020) · Cell · doi:10.1016/j.cell.2020.04.045 · Cited by 917
Yang, Y., Shen, C., Li, J., Yuan, J., Wei, J., Huang, F., Wang, F., Li, G., Li, Y., Xing, L., et al. (2020) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2020.04.027 · Cited by 872
Ardakani, A. A., Kanafi, A. R., Acharya, U. R., Khadem, N., & Mohammadi, A. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103795 · Cited by 864
Federated learning for predicting clinical outcomes in patients with COVID-19
Dayan, I., Roth, H. R., Zhong, A., Harouni, A., Gentili, A., Abidin, A. Z., Liu, A., Costa, A. B., Wood, B. J., Tsai, C.-S., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01506-3 · Cited by 842
Gozes, O., Frid-Adar, M., Greenspan, H. K., Browning, P. D., Zhang, H., Ji, W., Bernheim, A., & Siegel, E. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05037 · Cited by 840
Sample size for binary logistic prediction models: Beyond events per variable criteria
van Smeden, M., Moons, K. G. M., de Groot, J. A. H., Collins, P. G. S., Altman, D. G., Eijkemans, M. J. C., & Reitsma, J. B. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280218784726 · Cited by 820
Self-citationUçar, F., & Korkmaz, D. (2020) · Medical Hypotheses · doi:10.1016/j.mehy.2020.109761 · Cited by 768
Li, K., Fang, Y., Li, W., Pan, C., Qin, P., Zhong, Y., Liu, X., Huang, M., Liao, Y., & Li, S. (2020) · European Radiology · doi:10.1007/s00330-020-06817-6 · Cited by 732
Deep Learning-based Detection for COVID-19 from Chest CT using Weak LabelPreprint
Zheng, C., Deng, X., Fu, Q., et al. (2020) · medRxiv · doi:10.1101/2020.03.12.20027185 · Cited by 727
Klok, F. A., Boon, G. J. A. M., Barco, S., Endres, M., Geelhoed, J. J. M., Knauß, S., Rezek, S. A., Spruit, M. A., Vehreschild, J. J., & Siegerink, B. (2020) · European Respiratory Journal · doi:10.1183/13993003.01494-2020 · Cited by 712
Rahimzadeh, M., & Attar, A. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100360 · Cited by 695
Chen, J., Wu, L., Zhang, J., Zhang, L., Gong, D., Zhao, Y., Chen, Q., Huang, S., Yang, M., Yang, X., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-76282-0 · Cited by 685
Collins, G. S., Ogundimu, E. O., & Altman, D. G. (2016) · Statistics in Medicine · doi:10.1002/sim.6787 · Cited by 665
Singh, D., Kumar, V., Vaishali, & Kaur, M. (2020) · European Journal of Clinical Microbiology & Infectious Diseases · doi:10.1007/s10096-020-03901-z · Cited by 658
Vergouwe, Y., Steyerberg, E. W., Eijkemans, M. J. C., & Habbema, J. D. F. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.06.017 · Cited by 636
Self-citationPrediction for Progression Risk in Patients With COVID-19 Pneumonia: The CALL Score
Ji, D., Zhang, D., Xu, J., Zhu, C., Yang, T., Zhao, P., Chen, G., Cheng, G. Y.-M., Wang, Y., Bi, J., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa414 · Cited by 636
Critical care crisis and some recommendations during the COVID-19 epidemic in China
Xie, J., Tong, Z., Guan, X., Du, B., Qiu, H., & Slutsky, A. S. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-05979-7 · Cited by 628
AI4COVID-19: AI enabled preliminary diagnosis for COVID-19 from cough samples via an app
Imran, A., Posokhova, I., Qureshi, H. N., Masood, U., Riaz, M. S., Ali, K., John, C. N., Hussain, M. I., & Nabeel, M. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100378 · Cited by 621
Development and evaluation of an artificial intelligence system for COVID-19 diagnosis
Jin, C., Chen, W., Cao, Y., Xu, Z., Tan, Z., Zhang, X., Deng, L., Zheng, C., Zhou, J., Shi, H., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18685-1 · Cited by 611
Riley, R. D., Ensor, J., Snell, K. I. E., Debray, T. P. A., Altman, D. G., Moons, K. G. M., & Collins, G. S. (2016) · BMJ · doi:10.1136/bmj.i3140 · Cited by 585
Self-citationClift, A. K., Coupland, C. A. C., Keogh, R. H., Diaz‐Ordaz, K., Williamson, E., Harrison, E. M., Hayward, A. C., Hemingway, H., Horby, P., Mehta, N., et al. (2020) · BMJ · doi:10.1136/bmj.m3731 · Cited by 551
AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system
Wang, B., Jin, S., Yan, Q., Xu, H., Luo, C. W., Wei, L., Zhao, W. Z., Hou, X., Ma, W., Xu, Z., et al. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106897 · Cited by 548
Covid-19: What do we know about “long covid”?
Mahase, E. (2020) · BMJ · doi:10.1136/bmj.m2815 · Cited by 522
JCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentation
Wu, Y.-H., Gao, S.-H., Mei, J., Xu, J., Fan, D.-P., Zhang, R.-G., & Cheng, M.-M. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3058783 · Cited by 516
Gong, J., Ou, J., Qiu, X., Jie, Y., Chen, Y., Yuan, L., Cao, J., Tan, M., Xu, W., Zheng, F., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa443 · Cited by 513
Bello‐Chavolla, O. Y., Bahena-López, J. P., Antonio‐Villa, N. E., Vargas‐Vázquez, A., González-Díaz, A., Márquez‐Salinas, A., Fermín‐Martínez, C. A., Naveja, J. J., & Aguilar-Salinas, C. A. (2020) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgaa346 · Cited by 510
Yuan, M., Yin, W., Tao, Z., Tan, W., & Hu, Y. (2020) · PLoS ONE · doi:10.1371/journal.pone.0230548 · Cited by 503
Shi, Y., Xia, Y., Zhao, H., Wang, H., Zhao, R., & Sheng, J. (2020) · Critical Care · doi:10.1186/s13054-020-2833-7 · Cited by 496
A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis
Wang, S., Zha, Y., Li, W., Wu, Q., Li, X., Niu, M., Wang, M., Qiu, X., Li, H., He, Y., et al. (2020) · European Respiratory Journal · doi:10.1183/13993003.00775-2020 · Cited by 493
Lung Infection Quantification of COVID-19 in CT Images with Deep LearningPreprint
Shan, F., Gao, Y., Wang, J., Shi, W., Shi, N., Han, M., Xue, Z., Shen, D. G., & Shi, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04655 · Cited by 489
Jain, V., & Yuan, J.-M. (2020) · International Journal of Public Health · doi:10.1007/s00038-020-01390-7 · Cited by 484
Well-aerated Lung on Admitting Chest CT to Predict Adverse Outcome in COVID-19 Pneumonia
Colombi, D., Bodini, F. C., Petrini, M., Maffi, G., Morelli, N., Milanese, G., Silva, M., Sverzellati, N., & Michieletti, E. (2020) · Radiology · doi:10.1148/radiol.2020201433 · Cited by 456
Jiang, X., Coffee, M. P., Bari, A., Wang, J., Jiang, X., Huang, J., Shi, J., Dai, J., Cai, J., Zhang, T., et al. (2020) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2020.010691 · Cited by 454
Coronavirus (COVID-19) Classification using CT Images by Machine Learning MethodsPreprint
Barstuğan, M., Özkaya, U., & Öztürk, Ş. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.09424 · Cited by 449
Borghesi, A., & Maroldi, R. (2020) · La radiologia medica · doi:10.1007/s11547-020-01200-3 · Cited by 437
Clinical value of immune-inflammatory parameters to assess the severity of coronavirus disease 2019
Zhu, Z., Cai, T., Fan, L., Lou, K., Hua, X., Huang, Z., & Gao, G. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.04.041 · Cited by 435
A machine learning-based model for survival prediction in patients with severe COVID-19 infectionPreprint
Li, Y., Zhang, H., Gonçalves, J. M., et al. (2020) · medRxiv · doi:10.1101/2020.02.27.20028027 · Cited by 426
Minimum sample size for external validation of a clinical prediction model with a binary outcome
Riley, R. D., Debray, T. P. A., Collins, G. S., Archer, L., Ensor, J., van Smeden, M., & Snell, K. I. E. (2021) · Statistics in Medicine · doi:10.1002/sim.9025 · Cited by 400
Self-citationBai, H. X., Wang, R., Xiong, Z., Hsieh, B., Chang, K., Halsey, K., Tran, T. M. L., Choi, J. W., Wang, D.-C., Shi, L.-B., et al. (2020) · Radiology · doi:10.1148/radiol.2020201491 · Cited by 381
Shi, F., Xia, L., Shan, F., Song, B., Wu, D., Wei, Y., Yuan, H., Jiang, H., He, Y., Gao, Y., et al. (2021) · Physics in Medicine and Biology · doi:10.1088/1361-6560/abe838 · Cited by 379
Calibration of Risk Prediction Models: Impact on Decision-Analytic Performance
Van Calster, B., & Vickers, A. J. (2015) · Medical Decision Making · doi:10.1177/0272989x14547233 · Cited by 371
Using X-ray images and deep learning for automated detection of coronavirus disease
Asnaoui, K. E., & Chawki, Y. (2020) · Journal of Biomolecular Structure and Dynamics · doi:10.1080/07391102.2020.1767212 · Cited by 369
Chen, J., Wu, L., Zhang, J., et al. (2020) · medRxiv · doi:10.1101/2020.02.25.20021568 · Cited by 366
Machine learning based early warning system enables accurate mortality risk prediction for COVID-19
Gao, Y., Cai, G., Fang, W., Li, H., Wang, S., Chen, L., Yu, Y., Liu, D., Xu, S., Cui, P., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18684-2 · Cited by 358
Pourhomayoun, M., & Shakibi, M. (2021) · Smart Health · doi:10.1016/j.smhl.2020.100178 · Cited by 342
Apostolopoulos, I. D., Aznaouridis, S. I., & Tzani, M. A. (2020) · Journal of Medical and Biological Engineering · doi:10.1007/s40846-020-00529-4 · Cited by 341
Deep learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) with CT imagesPreprint
Song, Y., Zheng, S., Li, L., et al. (2020) · medRxiv · doi:10.1101/2020.02.23.20026930 · Cited by 332
Olsson, T., Terént, A., & Lind, L. (2004) · Journal of Internal Medicine · doi:10.1111/j.1365-2796.2004.01321.x · Cited by 320
Clinical features of COVID-19 mortality: development and validation of a clinical prediction model
Yadaw, A. S., Li, Y. C., Bose, S., Iyengar, R., Bunyavanich, S., & Pandey, G. S. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30217-x · Cited by 320
WWARN K13 Genotype-Phenotype Study Group (2019) · BMC Medicine · doi:10.1186/s12916-018-1207-3 · Cited by 319
COVID-19: a novel coronavirus and a novel challenge for critical care
Arabi, Y. M., Murthy, S., & Webb, S. A. R. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-05955-1 · Cited by 313
Feng, Z., Yu, Q., Yao, S., Luo, L., Zhou, W., Mao, X., Li, J. S. Y., Duan, J., Yan, Z., Yang, M. H., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18786-x · Cited by 313
Wang, K., Zuo, P., Liu, Y., Zhang, M., Zhao, X., Xie, S., Zhang, H., Chen, X., & Liu, C. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa538 · Cited by 308
Jin, S., Wang, B., Xu, H., et al. (2020) · medRxiv · doi:10.1101/2020.03.19.20039354 · Cited by 306
Prediction model and risk scores of ICU admission and mortality in COVID-19
Zhao, Z., Chen, A. L., Hou, W., Graham, J. M., Li, H., Richman, P. S., Thode, H. C., Singer, A. J., & Duong, T. Q. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236618 · Cited by 303
Haimovich, A. D., Ravindra, N. G., Stoytchev, S., Young, H. P., Wilson, F. P., van Dijk, D., Schulz, W. L., & Taylor, R. A. (2020) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2020.07.022 · Cited by 294
COVID-19 as the Leading Cause of Death in the United States
Woolf, S., Chapman, D., & Lee, J. H. (2020) · Journal of the American Medical Association (JAMA) · doi:10.1001/jama.2020.24865 · Cited by 281
Ko, H., Chung, H., Kang, W. S., Kim, K. W., Shin, Y., Kang, S., Lee, J. H., Kim, Y. J., Kim, N. Y., Jung, H., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/19569 · Cited by 279
Early triage of critically ill COVID-19 patients using deep learning
Liang, W., Yao, J., Chen, A., Lv, Q., Zanin, M., Liu, J., Wong, S., Li, Y., Lu, J., Liang, H., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-17280-8 · Cited by 274
Wu, X., Hui, H., Niu, M., Li, L., Wang, L., He, B., Yang, X., Li, L., Li, H., Tian, J., et al. (2020) · European Journal of Radiology · doi:10.1016/j.ejrad.2020.109041 · Cited by 268
Predictive Data Mining Models for Novel Coronavirus (COVID-19) Infected Patients’ Recovery
Muhammad, L. J., Islam, M. M., Usman, S. S., & Ayon, S. I. (2020) · SN Computer Science · doi:10.1007/s42979-020-00216-w · Cited by 264
EXPLAINABLE-BY-DESIGN APPROACH FOR COVID-19 CLASSIFICATION VIA CT-SCANPreprint
Angelov, P. P., & Soares, E. A. (2020) · medRxiv · doi:10.1101/2020.04.24.20078584 · Cited by 258
Vaid, A., Jaladanki, S. K., Xu, J., Teng, S., Kumar, A., Lee, S., Somani, S., Paranjpe, I., Freitas, J. K. D., Wanyan, T., et al. (2020) · doi:10.1101/2020.08.11.20172809 · Cited by 253
Open access epidemiological data from the COVID-19 outbreak
Xu, B., Kraemer, M. U. G., Xu, B., Gutierrez, B., Mekaru, S. R., Sewalk, K. C., Loskill, A., Wang, L., Cohn, E. L., Hill, S., et al. (2020) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30119-5 · Cited by 251
Myrstad, M., Ihle‐Hansen, H., Tveita, A. A., Andersen, E. L., Nygård, S., Tveit, A., & Berge, T. (2020) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/s13049-020-00764-3 · Cited by 244
Wu, G., Yang, P., Woodruff, H. C., Rao, X., Guiot, J., Frix, A.-N., Moutschen, M. P., Louis, R. E., Li, J., Li, J., et al. (2020) · European Respiratory Journal · doi:10.1183/13993003.01104-2020 · Cited by 243
Yue, H., Yu, Q., Liu, C., Huang, Y., Jiang, Z., Shao, C., Zhang, H., Ma, B., Wang, Y., Xie, G., et al. (2020) · Annals of Translational Medicine · doi:10.21037/atm-20-3026 · Cited by 241
Ning, W., Lei, S., Yang, J., Cao, Y., Jiang, P., Yang, Q., Zhang, J., Wang, X., Chen, F., Geng, Z., et al. (2020) · Nature Biomedical Engineering · doi:10.1038/s41551-020-00633-5 · Cited by 239
Vaid, A., Somani, S. S., Russak, A. J., Freitas, J. K. D., Chaudhry, F. F., Paranjpe, I., Johnson, K. W., Lee, S. J., Miotto, R., Zhao, S., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/24018 · Cited by 238
Estimation of risk factors for COVID-19 mortality - preliminary resultsPreprint
Caramelo, F. J., Ferreira, N. R., & Oliveiros, B. (2020) · medRxiv · doi:10.1101/2020.02.24.20027268 · Cited by 236
Menni, C., Valdes, A. M., Freidin, M. B., et al. (2020) · medRxiv · doi:10.1101/2020.04.05.20048421 · Cited by 232
Wang, C., Deng, R., Gou, L., Fu, Z., Zhang, X., Shao, F., Wang, G., Fu, W., Xiao, J., Ding, X. L., et al. (2020) · Annals of Translational Medicine · doi:10.21037/atm-20-3391 · Cited by 226
Predictive analytics in health care: how can we know it works?
Van Calster, B., Wynants, L., Timmerman, D., Steyerberg, E. W., & Collins, G. S. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz130 · Cited by 223
Self-citationPatient Trajectories Among Persons Hospitalized for COVID-19
Garibaldi, B. T., Fiksel, J., Muschelli, J., Robinson, M. L., Rouhizadeh, M., Perin, J., Schumock, G., Nagy, P. G., Gray, J., Malapati, H., et al. (2020) · Annals of Internal Medicine · doi:10.7326/m20-3905 · Cited by 223
Gupta, R. K., Harrison, E. M., Ho, A. Y. W., Docherty, A. B., Knight, S. R., van Smeden, M., Abubakar, I. I., Lipman, M. C. I., Quartagno, M., Pius, R., et al. (2021) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(20)30559-2 · Cited by 223
COVID-19 on Chest Radiographs: A Multireader Evaluation of an Artificial Intelligence System
Murphy, K., Smits, H., Knoops, A. J. G., Korst, M. B. J. M., Samson, T., Scholten, E. T., Schalekamp, S., Schaefer‐Prokop, C. M., Philipsen, R. H. H. M., Meijers, A., et al. (2020) · Radiology · doi:10.1148/radiol.2020201874 · Cited by 220
Zou, X., Li, S., Fang, M., Hu, M., Bian, Y., Ling, J., Yu, S., Jing, L., Li, D., & Huang, J. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004411 · Cited by 218
Liu, F., Zhang, Q., Huang, C., Shi, C., Wang, L., Shi, N., Fang, C., Shan, F., Mei, X., Shi, J. C., et al. (2020) · Theranostics · doi:10.7150/thno.45985 · Cited by 218
Ma, C., Gu, J., Hou, P., Zhang, L., Bai, Y., Guo, Z., Wu, H. Y., Zhang, B., Li, P., & Zhao, X. (2020) · medRxiv · doi:10.1101/2020.03.17.20037572 · Cited by 218
Galloway, J. B., Norton, S., Barker, R. D., Brookes, A., Carey, I., Clarke, B. D., Jina, R., Reid, C., Russell, M. D., Sneep, R., et al. (2020) · Journal of Infection · doi:10.1016/j.jinf.2020.05.064 · Cited by 206
IL-6–based mortality risk model for hospitalized patients with COVID-19
Laguna‐Goya, R., Utrero‐Rico, A., Talayero, P., Lasa‐Lázaro, M., Ramírez-Fernández, Á., Naranjo, L., Segura‐Tudela, A., Cabrera-Marante, Ó., de Frías, E. R., García-García, R., et al. (2020) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2020.07.009 · Cited by 206
Epidemiological and Clinical Predictors of COVID-19
Sun, Y., Koh, V. J. W., Marimuthu, K., Ng, O. T., Young, B. E., Vasoo, S. S., Chan, M., Lee, V. J., De, P. P., Barkham, T., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa322 · Cited by 202
Using Machine Learning to Predict ICU Transfer in Hospitalized COVID-19 Patients
Cheng, F.-Y., Joshi, H. N., Tandon, P., Freeman, R., Reich, D. L., Mazumdar, M., Kohli-Seth, R. D., Levin, M. A., Timsina, P., & Kia, A. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9061668 · Cited by 197
Gupta, R. K., Marks, M., Samuels, T. H. A., Luintel, A., Rampling, T., Chowdhury, H., Quartagno, M., Nair, A., Lipman, M. C. I., Abubakar, I. I., et al. (2020) · European Respiratory Journal · doi:10.1183/13993003.03498-2020 · Cited by 197
Development and Evaluation of an AI System for COVID-19 DiagnosisPreprint
Jin, C., Chen, W., Cao, Y., et al. (2020) · medRxiv · doi:10.1101/2020.03.20.20039834 · Cited by 194
Cecconi, M., Piovani, D., Brunetta, E., Aghemo, A., Greco, M., Ciccarelli, M., Angelini, C., Voza, A., Omodei, P., Vespa, E., et al. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9051548 · Cited by 194
Individualizing Risk Prediction for Positive Coronavirus Disease 2019 Testing
Jehi, L. E., Ji, X., Milinovich, A., Erzurum, S., Rubin, B. P., Gordon, S., Young, J. B., & Kattan, M. W. (2020) · CHEST Journal · doi:10.1016/j.chest.2020.05.580 · Cited by 190
Deep learning COVID-19 detection bias: accuracy through artificial intelligence
Vaid, S., Kalantar, R., & Bhandari, M. (2020) · International Orthopaedics · doi:10.1007/s00264-020-04609-7 · Cited by 189
Development of a prognostic model for mortality in COVID-19 infection using machine learning
Booth, A. L., Abels, E. A., & McCaffrey, P. (2020) · Modern Pathology · doi:10.1038/s41379-020-00700-x · Cited by 187
COVID-19 mortality risk assessment: An international multi-center study
Bertsimas, D., Lukin, G., Mingardi, L., Nohadani, O., Orfanoudaki, A., Stellato, B., Wiberg, H., González-García, S., Parra-Calderón, C. L., Robinson, K. J., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243262 · Cited by 187
Lassau, N., Ammari, S., Chouzenoux, É., Gortais, H., Hérent, P., Devilder, M., Soliman, S., Meyrignac, O., Talabard, M.-P., Lamarque, J.-P., et al. (2021) · Nature Communications · doi:10.1038/s41467-020-20657-4 · Cited by 187
Satıcı, C., Demirkol, M. A., Altunok, E. S., Gürsoy, B., Alkan, M., Kamat, S., Demirok, B., Sürmeli, C. D., Çalık, M., Çavuş, Z., et al. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.06.038 · Cited by 185
Early prediction of mortality risk among patients with severe COVID-19, using machine learning
Hu, C., Liu, Z., Jiang, Y., Shi, O., Zhang, X., Xu, K., Suo, C., Wang, Q., Song, Y., Yu, K., et al. (2020) · International Journal of Epidemiology · doi:10.1093/ije/dyaa171 · Cited by 183
POCOVID-Net: Automatic Detection of COVID-19 From a New Lung Ultrasound Imaging Dataset (POCUS)Preprint
Born, J., Brändle, G., Cossio, M., Disdier, M., Goulet, J., Roulin, J., & Wiedemann, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12084 · Cited by 182
Wu, J., Zhang, P., Zhang, L., Meng, W., Li, J., Tong, C., Li, Y., Cai, J., Yang, Z., Zhu, J., et al. (2020) · medRxiv · doi:10.1101/2020.04.02.20051136 · Cited by 178
Tuncer, T., Doğan, Ş., & Özyurt, F. (2020) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2020.104054 · Cited by 177
Scoring Systems for Predicting Mortality for Severe Patients with COVID-19
Shang, Y., Liu, T., Wei, Y., Li, J., Shao, L., Liu, M., Zhang, Y., Zhao, Z., Xu, H., Peng, Z., et al. (2020) · EClinicalMedicine · doi:10.1016/j.eclinm.2020.100426 · Cited by 172
A deep convolutional neural network for COVID-19 detection using chest X-rays
Bassi, P. R. A. S., & Attux, R. (2021) · Research on Biomedical Engineering · doi:10.1007/s42600-021-00132-9 · Cited by 171
COVID-19 early warning score: a multi-parameter screening tool to identify highly suspected patientsPreprint
Song, C., Xu, J., He, J., & Lu, Y. (2020) · medRxiv · doi:10.1101/2020.03.05.20031906 · Cited by 170
Hu, H., Yao, N., & Qiu, Y. (2020) · Academic Emergency Medicine · doi:10.1111/acem.13992 · Cited by 169
Bi, X., Su, Z., Yan, H., Du, J., Wang, J., Chen, L., Peng, M., Chen, S., Shen, B., & Li, J. (2020) · Platelets · doi:10.1080/09537104.2020.1760230 · Cited by 166
Borghesi, A., Zigliani, A., Golemi, S., Carapella, N., Maculotti, P., Farina, D., & Maroldi, R. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.05.021 · Cited by 163
Automated Quantification of CT Patterns Associated with COVID-19 from Chest CT
Chaganti, S., Greniér, P., Balachandran, A., Chabin, G., Cohen, S. L., Flohr, T. G., Georgescu, B., Grbić, S., Liu, S., Mellot, F., et al. (2020) · Radiology Artificial Intelligence · doi:10.1148/ryai.2020200048 · Cited by 163
Comparison of severity scores for COVID-19 patients with pneumonia: a retrospective study
Fan, G., Tu, C., Zhou, F., Liu, Z., Wang, Y., Song, B., Gu, X., Wang, Y., Wei, Y., Li, H., et al. (2020) · European Respiratory Journal · doi:10.1183/13993003.02113-2020 · Cited by 162
Xie, J., Hungerford, D., Chen, H., Abrams, S. T., Li, S., Wang, G., Wang, Y., Kang, H., Bonnett, L. J., Zheng, R., et al. (2020) · SSRN Electronic Journal · doi:10.1101/2020.03.28.20045997 · Cited by 162
Mahdy, L. N., Ezzat, K. A., Elmousalami, H. H., Aboul-Ella, H., & Hassanien, A. E. (2020) · medRxiv · doi:10.1101/2020.03.30.20047787 · Cited by 158
Yu, C., Lei, Q., Li, W., Wang, X., Liu, W. Y., Fan, X., & Li, W. (2020) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2020.05.002 · Cited by 154
Sun, L., Song, F., Shi, N., Liu, F., Li, S., Li, P., Zhang, W., Jiang, X., Zhang, Y., Sun, L., et al. (2020) · Journal of Clinical Virology · doi:10.1016/j.jcv.2020.104431 · Cited by 153
Association of liver abnormalities with in-hospital mortality in patients with COVID-19
Ding, Z., Li, G., Chen, L., Shu, C., Song, J., Wang, W., Wang, Y., Chen, Q., Jin, G.-N., Liu, T., et al. (2020) · Journal of Hepatology · doi:10.1016/j.jhep.2020.12.012 · Cited by 150
Lyu, P., Liu, X., Zhang, R., Shi, L., & Gao, J. (2020) · Investigative Radiology · doi:10.1097/rli.0000000000000689 · Cited by 149
Burdick, H., Lam, C., Mataraso, S. J., Siefkas, A. C., Braden, G. L., Dellinger, R. P., McCoy, A., Vincent, J., Green‐Saxena, A., Barnes, G., et al. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103949 · Cited by 149
Cheng, A., Liu, H., Wang, Y., Huang, L., Zhao, L., Zhang, C., Liu, X., Xu, R., Liu, F., Li, J., et al. (2020) · International Journal of Antimicrobial Agents · doi:10.1016/j.ijantimicag.2020.106110 · Cited by 148
Covino, M., Sandroni, C., Santoro, M. C., Sabia, L., Simeoni, B., Bocci, M. G., Ojetti, V., Candelli, M., Antonelli, M. M., Gasbarrini, A., et al. (2020) · Resuscitation · doi:10.1016/j.resuscitation.2020.08.124 · Cited by 146
Kostakis, I., Smith, G. B., Prytherch, D. R., Meredith, P., Price, C., Chauhan, A., Chauhan, A., Meredith, P., Mortlock, A., Schmidt, P., et al. (2020) · Resuscitation · doi:10.1016/j.resuscitation.2020.10.039 · Cited by 145
Covid-19: Is a second wave hitting Europe?
Looi, M.-K. (2020) · BMJ · doi:10.1136/bmj.m4113 · Cited by 144
Deep learning for predicting COVID-19 malignant progression
Fang, C., Bai, S., Chen, Q., Zhou, Y., Xia, L., Qin, L., Gong, S., Xie, X., Zhou, C., Tu, D., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102096 · Cited by 144
Nemati, M., Ansary, J., & Nemati, N. (2020) · Patterns · doi:10.1016/j.patter.2020.100074 · Cited by 139
Liu, S., Yao, N., Qiu, Y., & He, C. (2020) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2020.07.019 · Cited by 138
Classification and specific primer design for accurate detection of SARS-CoV-2 using deep learning
Lopez‐Rincon, A., Tonda, A. P., Mendoza‐Maldonado, L., Mulders, D. G. J. C., Molenkamp, R., Perez-Romero, C. A., Claassen, E., Garssen, J., & Kraneveld, A. D. (2021) · Scientific Reports · doi:10.1038/s41598-020-80363-5 · Cited by 137
Qi, X., Jiang, Z., Yu, Q., et al. (2020) · medRxiv · doi:10.1101/2020.02.29.20029603 · Cited by 135
Debray, T. P. A., Riley, R. D., Rovers, M. M., Reitsma, J. B., Moons, K. G. M., & Cochrane IPD Meta-analysis Methods group (2015) · PLoS Medicine · doi:10.1371/journal.pmed.1001886 · Cited by 134
Self-citationBuilding a COVID-19 vulnerability index
DeCaprio, D., Gartner, J., McCall, C. J., Burgess, T., Garcia, K. M., Kothari, S., & Sayed, S. (2020) · Journal of Medical Artificial Intelligence · doi:10.21037/jmai-20-47 · Cited by 134
Guan, X., Zhang, B., Fu, M., Li, M., Xu, Y., Zhu, Y., Peng, J., Guo, H., & Lu, Y. (2021) · Annals of Medicine · doi:10.1080/07853890.2020.1868564 · Cited by 134
Luo, M., Liu, J., Jiang, W., Yue, S., Liu, H., & Wei, S. (2020) · JCI Insight · doi:10.1172/jci.insight.139024 · Cited by 130
Gong, J., Ou, J., Qiu, X., et al. (2020) · medRxiv · doi:10.1101/2020.03.17.20037515 · Cited by 129
COVID-MobileXpert: On-Device COVID-19 Patient Triage and Follow-up using Chest X-rays
Li, X. S., Li, C., & Zhu, D. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313217 · Cited by 129
Developing a COVID-19 mortality risk prediction model when individual-level data are not available
Barda, N., Riesel, D., Akriv, A., Levy, J., Finkel, U., Yona, G., Greenfeld, D., Sheiba, S., Somer, J., Bachmat, E., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18297-9 · Cited by 129
Feng, C., Wang, L., Chen, X., Zhai, Y., Zhu, F., Hua, C., Wang, Y., Su, X., Huang, S., Tian, L. H., et al. (2021) · Annals of Translational Medicine · doi:10.21037/atm-20-3073 · Cited by 128
Chen, X., Tang, Y., Mo, Y., Li, S., Lin, D., Yang, Z., Yang, Z., Sun, H., Qiu, J., Liao, Y., et al. (2020) · European Radiology · doi:10.1007/s00330-020-06829-2 · Cited by 127
Radiomics Analysis of Computed Tomography helps predict poor prognostic outcome in COVID-19
Wu, Q., Wang, S., Li, L., Wu, Q., Qian, W., Hu, Y., Li, L., Zhou, X., Ma, H., Li, H., et al. (2020) · Theranostics · doi:10.7150/thno.46428 · Cited by 127
Pan, P., Li, Y., Xiao, Y., Han, B., Su, L., Su, M., Li, Y., Zhang, S., Jiang, D., Chen, X., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/23128 · Cited by 126
Development and Validation of a Nomogram for Assessing Survival in Patients With COVID-19 Pneumonia
Dong, Y., Sun, J., Li, Y.-X., Chen, Q., Liu, Q., Sun, Z., Pang, R., Chen, F., Xu, B., Manyande, A., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa963 · Cited by 125
Jehi, L. E., Ji, X., Milinovich, A., ERZURUM, S. C., Merlino, A. A., Gordon, S., Young, J. B., & Kattan, M. W. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237419 · Cited by 125
COVID-19: endemic doesn’t mean harmless
Katzourakis, A. (2022) · Nature · doi:10.1038/d41586-022-00155-x · Cited by 125
CovidAID: COVID-19 Detection Using Chest X-RayPreprint
Mangal, A., Kalia, S., Rajgopal, H., Rangarajan, K., Namboodiri, V. P., Banerjee, S., & Arora, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.09803 · Cited by 122
Lu, J., Hu, S., Fan, R., Liu, Z., Yin, X., Wang, Q., Lv, Q., Cai, Z., Li, H., Hu, Y., et al. (2020) · medRxiv · doi:10.1101/2020.02.20.20025510 · Cited by 122
Riley, R. D., Collins, P. G. S., Ensor, J., Archer, L., Booth, S., Mozumder, S. I., Rutherford, M. J., van Smeden, M., Lambert, P. C., & Snell, K. I. E. (2021) · Statistics in Medicine · doi:10.1002/sim.9275 · Cited by 116
Self-citationSmell and taste symptom‐based predictive model for COVID‐19 diagnosis
Roland, L. T., Gurrola, J. G., Loftus, P. A., Cheung, S. W., & Chang, J. L. (2020) · International Forum of Allergy & Rhinology · doi:10.1002/alr.22602 · Cited by 115
Nicholson, C., Wooster, L. T., Sigurslid, H. H., Li, R., Jiang, W., Tian, W., Cardenas, C. L. L., & Malhotra, R. K. (2021) · EClinicalMedicine · doi:10.1016/j.eclinm.2021.100765 · Cited by 115
Li, X., Ge, P., Zhu, J., Li, H., Graham, J., Singer, A. J., Richman, P. S., & Duong, T. Q. (2020) · PeerJ · doi:10.7717/peerj.10337 · Cited by 114
Xue, G., Gan, X., Wú, Z., Xie, D., Xiong, Y., Hua, L., Zhou, B., Zhou, N., Xiang, J., & Li, J. (2020) · International Immunopharmacology · doi:10.1016/j.intimp.2020.107065 · Cited by 112
Bradley, P. B., Frost, F. J., Tharmaratnam, K., Collaborators, N., & Wootton, D. G. (2020) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2020-000729 · Cited by 112
Bolourani, S., Brenner, M., Wang, P., McGinn, T. G., Hirsch, J. S., Barnaby, D. P., & Zanos, T. P. (2021) · Journal of Medical Internet Research · doi:10.2196/24246 · Cited by 111
Singh, K., Valley, T. S., Tang, S., Li, B. Y., Kamran, F., Sjoding, M. W., Wiens, J., Otles, E., Donnelly, J. P., Wei, M. Y., et al. (2021) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202006-698oc · Cited by 111
McElvaney, O. J., Hobbs, B. D., Qiao, D., McElvaney, O. F., Moll, M. R., McEvoy, N. L., Clarke, J., O’Connor, E., Walsh, S., Cho, M. H., et al. (2020) · EBioMedicine · doi:10.1016/j.ebiom.2020.103026 · Cited by 110
Gidari, A., Socio, G. V. D., Sabbatini, S., & Francisci, D. (2020) · Scandinavian Journal of Infectious Diseases · doi:10.1080/23744235.2020.1784457 · Cited by 109
Li, Z., Zheng, Z., Li, Y., Zhang, T., Gao, L., Jin, D., Sun, Y., Ye, X., Yu, L., Hu, Z.-Y., et al. (2020) · European Radiology · doi:10.1007/s00330-020-07042-x · Cited by 109
DeepCOVIDExplainer: Explainable COVID-19 Diagnosis Based on Chest X-ray ImagesPreprint
Karim, M. R., Döhmen, T., Rebholz‐Schuhmann, D., Decker, S., Cochez, M., & Beyan, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.04582 · Cited by 107
Pourhomayoun, M., & Shakibi, M. (2020) · medRxiv · doi:10.1101/2020.03.30.20047308 · Cited by 106
McRae, M. P., Simmons, G. W., Christodoulides, N. J., Lu, Z., Kang, S. K., Fenyö, D., Alcorn, T. M., Dapkins, I. P., Sharif, I., Vurmaz, D., et al. (2020) · Lab on a Chip · doi:10.1039/d0lc00373e · Cited by 106
A Novel Scoring System for Prediction of Disease Severity in COVID-19
Zhang, C., Qin, L., Li, K., Wang, Q. M., Zhao, Y., Xu, B., Liang, L., Dai, Y., Feng, Y., Sun, J., et al. (2020) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2020.00318 · Cited by 104
Toraih, E. A., Elshazli, R. M., Hussein, M. H., Elgaml, A., Amin, M. N., El‐Mowafy, M., El‐Mesery, M., Ellythy, A. M., Duchesne, J. C., Killackey, M. T., et al. (2020) · Journal of Medical Virology · doi:10.1002/jmv.26166 · Cited by 103
Jang, J. G., Hur, J., Hong, K. S., Lee, W., & Ahn, J. H. (2020) · Journal of Korean Medical Science · doi:10.3346/jkms.2020.35.e234 · Cited by 103
Martin, A. G., Nateqi, J., Gruarin, S., Munsch, N., Abdarahmane, I., Zobel, M., & Knapp, B. (2020) · Scientific Reports · doi:10.1038/s41598-020-75912-x · Cited by 103
Building a COVID-19 Vulnerability IndexPreprint
DeCapprio, D., Gartner, J., McCall, C. J., et al. (2020) · medRxiv · doi:10.1101/2020.03.16.20036723 · Cited by 100
Liu, L., Xie, J., Wu, W., Chen, H., Li, S., He, H., Yu, Y., Hu, M., Li, J., Zheng, R., et al. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30316-2 · Cited by 99
Ikemura, K., Bellin, E. Y., Yagi, Y., Billett, H. H., Saada, M., Simone, K., Stahl, L., Szymanski, J. M., Goldstein, D. Y., & Gil, M. R. (2021) · Journal of Medical Internet Research · doi:10.2196/23458 · Cited by 99
Zhou, Y., He, Y., Yang, H., He, Y., Wang, T., Zhu, C., Yao, R., & Liang, Z. (2020) · PLoS ONE · doi:10.1371/journal.pone.0233328 · Cited by 98
Bukhari, S. U. K., Bukhari, S. S. K., Syed, A., & Shah, S. S. H. (2020) · medRxiv · doi:10.1101/2020.03.26.20044610 · Cited by 97
Zhu, J., Ge, P., Jiang, C., Zhang, Y., Li, X., Zhao, Z., Zhang, L., & Duong, T. Q. (2020) · Journal of the American College of Emergency Physicians Open · doi:10.1002/emp2.12205 · Cited by 96
Coronavirus Detection and Analysis on Chest CT with Deep LearningPreprint
Gozes, O., Frid-Adar, M., Sagie, N., Zhang, H., Ji, W., & Greenspan, H. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.02640 · Cited by 94
Inflammatory phenotyping predicts clinical outcome in COVID-19
Burke, H., Freeman, A. T., Cellura, D., Stuart, B. L., Brendish, N. J., Poole, S., Borca, F., Phan, H. T. T., Sheard, N., Williams, S. V., et al. (2020) · Respiratory Research · doi:10.1186/s12931-020-01511-z · Cited by 92
Huang, H., Cai, S., Li, Y., Li, Y., Fan, Y., Li, L., Lei, C., Tang, X., Hu, F., Li, F., et al. (2020) · Frontiers in Medicine · doi:10.3389/fmed.2020.557453 · Cited by 91
Cited by
Sorted by citations
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718
Self-citationCoronavirus Disease 2019–COVID-19
Dhama, K., Sharun, K., Tiwari, R., Sircar, S., Bhat, S., Malik, Y. S., Singh, K. P., Chaicumpa, W., Bonilla‐Aldana, D. K., & Rodriguez-Morales, A. J. (2020) · Clinical Microbiology Reviews · doi:10.1128/cmr.00028-20 · Cited by 1,993
Immunology of COVID-19: Current State of the Science
Vabret, N., Britton, G. J., Gruber, C., Hegde, S., Kim, J., Kuksin, M., Levantovsky, R., Malle, L., Moreira, A., Park, M. D., et al. (2020) · Immunity · doi:10.1016/j.immuni.2020.05.002 · Cited by 1,623
Digital technologies in the public-health response to COVID-19
Budd, J., Miller, B. S., Manning, E. M., Lampos, V., Zhuang, M., Edelstein, M., Rees, G., Emery, V. C., Stevens, M. M., Keegan, N., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1011-4 · Cited by 1,195
An open source machine learning framework for efficient and transparent systematic reviews
van de Schoot, R., de Bruin, J., Schram, R., Zahedi, P., de Boer, J., Weijdema, F., Kramer, B., Huijts, M., Hoogerwerf, M., Ferdinands, G., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-020-00287-7 · Cited by 1,157
“NATuRe MAchiNe iNTelligeNce comparison with some of the existing systems, as shown in the last column of Table 1.”
Metadata
- Authors
- Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., Schuit, E., Smits, L. J., Snell, K. I., Steyerberg, E. W., Wallisch, C., & van Smeden, M.
- Affiliations
- Maastricht University (NL)
- Utrecht University (NL)
- Krankenhaus der Elisabethinen (AT)
- Medical University of Vienna (AT)
- Keele University (GB)
- Leiden University Medical Center (NL)
- Humboldt-Universität zu Berlin (DE)
- Corresponding author
- Wynants, Laure
- ORCID
- Venue
- BMJ
- Publisher
- openRxiv
- Published
- 2020-03-27
- Volume
- 369
- Pages
- m1328-m1328
- ISSN
- 1756-1833 (ISSN-L)
- PMC
- PMC7222643
- OpenAlex
- W3014524604
- Cited by
- 3,070
- References
- 433
- Citations by year
- 2026: 191 · 2025: 185 · 2024: 261 · 2023: 402 · 2022: 619 · 2021: 880 · 2020: 531
- FWCI
- 28.74
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- BMJ (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
- University of Birmingham Research Portal (University of Birmingham) (publishedVersion)
- St George's Online Research Archive (St George's University of London) (acceptedVersion)
- Leiden Repository (Leiden University) (submittedVersion, cc-by)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion, cc-by)
- Keele Research Repository (Keele University) (submittedVersion, cc-by)
- Lirias (KU Leuven) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- Research Publications (Maastricht University) (submittedVersion, cc-by)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- HighWire Press Open Archive (submittedVersion)
- Pure Amsterdam UMC (submittedVersion, cc-by)
- Research Explorer (The University of Manchester) (submittedVersion, cc-by)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Funders
- Cancer Research UK (27294, 16895, C49297/A27294, C49297)
- National Institute for Health and Care Research (SPCR-142, COVID-19, C49297/A27294)
- Department of Health and Social Care (COVID-19)
- European Commission (825746, HORIZON2020, COVID-19)
- ZonMw (91617050, 10430012010001, grant 91617050)
- Fonds Wetenschappelijk Onderzoek (G0B4716N)
- KU Leuven (C24/15/037)
- Vlaamse regering (C24/15/037)
- Oxford Health NHS Foundation Trust
- National Institutes of Health (COVID-19)
- NIHR Oxford Biomedical Research Centre (C49297/ A27294)
- NIHR School for Primary Care Research
- National Heart, Lung, and Blood Institute (R00HL141678)
- National Institute of General Medical Sciences (P20GM125498)
- Interreg
- Topics
- Health Sciences › Medicine › Infectious Diseases › COVID-19 Clinical Research Studies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
- Keywords
- COVID-19 pandemic, prediction model, diagnostic model, prognostic model, risk prediction, model validation, risk of bias, concordance index, diagnostic imaging, disease severity, mortality prediction, intensive care unit admission, hospitalization risk, overfitting, reporting quality, preprints, charm, PROBAST
- MeSH terms
- COVID-19, Hospitalization, Humans, Models, Theoretical, Pneumonia, Viral, Prognosis, Multivariate Analysis, Coronavirus, Coronavirus Infections, Disease Progression, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
