Cited by 623COVID-19 diagnosis using AIArtificial Intelligence in Healthcare and EducationRadiomics and Machine Learning in Medical Imaging

Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays

Open access
Brunese, Luca, Mercaldo, Francesco, Reginelli, Alfonso, Santone, Antonella·2020·Computer Methods and Programs in Biomedicine

Abstract

Background and objective Coronavirus disease (COVID-19) is an infectious disease caused by a new virus never identified before in humans. This virus causes respiratory disease (for instance, flu) with symptoms such as cough, fever and, in severe cases, pneumonia. The test to detect the presence of this virus in humans is performed on sputum or blood samples and the outcome is generally available within a few hours or, at most, days. Analysing biomedical imaging the patient shows signs of pneumonia. In this paper, with the aim of providing a fully automatic and faster diagnosis, we propose the adoption of deep learning for COVID-19 detection from X-rays. Method In particular, we propose an approach composed by three phases: the first one to detect if in a chest X-ray there is the presence of a pneumonia. The second one to discern between COVID-19 and pneumonia. The last step is aimed to localise the areas in the X-ray symptomatic of the COVID-19 presence. Results and conclusion Experimental analysis on 6,523 chest X-rays belonging to different institutions demonstrated the effectiveness of the proposed approach, with an average time for COVID-19 detection of approximately 2.5 seconds and an average accuracy equal to 0.97.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.cmpb.2020.105608

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 43

  1. [2]van der Hoek L. Pyrc K. Jebbink M.F. Vermeulen-Oost W. Berkhout R.J. Wolthers K.C. Wertheim-van Dillen P.M. Kaandorp J. Spaargaren J. Berkhout B. Identification of a new human coronavirus Nature medicine 10 4 2004 368 373 PMC7095789 15034574
  2. [3]Abroug F. Slim A. Ouanes-Besbes L. Kacem M.-A.H. Dachraoui F. Ouanes I. Lu X. Tao Y. Paden C. Caidi H. Family cluster of middle east respiratory syndrome coronavirus infections, tunisia, 2013 Emerging infectious diseases 20 9 2014 1527 25148113 PMC4178422
  3. [5]Wang C. Horby P.W. Hayden F.G. Gao G.F. A novel coronavirus outbreak of global health concern The Lancet 395 10223 2020 470 473 PMC7135038 31986257
  4. [6]Livingston E. Bucher K. Coronavirus disease 2019 (covid-19) in italy Jama 2020 32181795
  5. [7]Wang Y. Wang Y. Chen Y. Qin Q. Unique epidemiological and clinical features of the emerging 2019 novel coronavirus pneumonia (covid-19) implicate special control measures Journal of medical virology 92 6 2020 568 576 32134116 PMC7228347
  6. [8]Huff H.V. Singh A. Asymptomatic transmission during the covid-19 pandemic and implications for public health strategies Clinical Infectious Diseases 2020 PMC7314132 32463076
  7. [9]Day M. Covid-19: identifying and isolating asymptomatic people helped eliminate virus in italian village Bmj 368 187 2020 m1165 32205334
  8. [10]P. Romagnani, G. Gnone, F. Guzzi, S. Negrini, A. Guastalla, F. Annunziato, S. Romagnani, R. De Palma, The covid-19 infection: lessons from the italian experience (2020). PMC7257358 32472024
  9. [11]Bastolla U. How lethal is the novel coronavirus, and how many undetected cases there are? the importance of being tested. medRxiv 2020
  10. [12]Ng M.-Y. Lee E.Y. Yang J. Yang F. Li X. Wang H. Lui M.M.-s. Lo C.S.-Y. Leung B. Khong P.-L. Imaging profile of the covid-19 infection: radiologic findings and literature review Radiology: Cardiothoracic Imaging 2 1 2020 e200034 33778547 PMC7233595
  11. [13]Huang C. Wang Y. Li X. Ren L. Zhao J. Hu Y. Zhang L. Fan G. Xu J. Gu X. Clinical features of patients infected with 2019 novel coronavirus in wuhan, china The Lancet 395 10223 2020 497 506 PMC7159299 31986264
  12. [16]Sellers S.A. Dover K.L. Bailey A.G. Cheves A. Eason A.B. Popowitch E.B. Miller M.B. Wohl D.A. Dittmer D.P. Fischer W.A. Burden of respiratory viral infection in persons with human immunodeficiency virus Influenza and Other Respiratory Viruses 2020 PMC7298306 32153113
  13. [17]Long C. Xu H. Shen Q. Zhang X. Fan B. Wang C. Zeng B. Li Z. Li X. Li H. Diagnosis of the coronavirus disease (covid-19): rrt-pcr or ct? European Journal of Radiology 2020 108961 32229322 PMC7102545
  14. [18]Fang Y. Zhang H. Xie J. Lin M. Ying L. Pang P. Ji W. Sensitivity of chest ct for covid-19: comparison to rt-pcr Radiology 2020 200432 PMC7233365 32073353
  15. [19]Ai T. Yang Z. Hou H. Zhan C. Chen C. Lv W. Tao Q. Sun Z. Xia L. Correlation of chest ct and rt-pcr testing in coronavirus disease 2019 (covid-19) in china: a report of 1014 cases Radiology 2020 200642 PMC7233399 32101510
  16. [20]Brunese L. Mercaldo F. Reginelli A. Santone A. Neural networks for lung cancer detection through radiomic features 2019 International Joint Conference on Neural Networks (IJCNN) 2019 IEEE 1 10
  17. [22]Simonyan K. Zisserman A. Very deep convolutional networks for large-scale image recognition arXiv preprint arXiv:1409.1556 2014 · arXiv
  18. [24]Deng J. Dong W. Socher R. Li L.-J. Li K. Fei-Fei L. Imagenet: A large-scale hierarchical image database 2009 IEEE conference on computer vision and pattern recognition 2009 Ieee 248 255
  19. [25]Selvaraju R.R. Cogswell M. Das A. Vedantam R. Parikh D. Batra D. Grad-cam: Visual explanations from deep networks via gradient-based localization Proceedings of the IEEE international conference on computer vision 2017 618 626
  20. [26]Mercaldo F. Santone A. Deep learning for image-based mobile malware detection Journal of Computer Virology and Hacking Techniques 2020 1 15
  21. [27]Qi C.R. Su H. Mo K. Guibas L.J. Pointnet: Deep learning on point sets for 3d classification and segmentation Proceedings of the IEEE conference on computer vision and pattern recognition 2017 652 660
  22. [28]Litjens G. Kooi T. Bejnordi B.E. Setio A.A.A. Ciompi F. Ghafoorian M. Van Der Laak J.A. Van Ginneken B. Sánchez C.I. A survey on deep learning in medical image analysis Medical image analysis 42 2017 60 88 28778026
  23. [29]Cohen J.P. Morrison P. Dao L. Covid-19 image data collection arXiv 2003.11597 2020 · arXiv
  24. [30]Ozturk T. Talo M. Yildirim E.A. Baloglu U.B. Yildirim O. Acharya U.R. Automated detection of covid-19 cases using deep neural networks with x-ray images Computers in Biology and Medicine 2020 103792 32568675 PMC7187882
  25. [31]Wang X. Peng Y. Lu L. Lu Z. Bagheri M. Summers R.M. Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases Proceedings of the IEEE conference on computer vision and pattern recognition 2017 2097 2106
  26. [32]Jin F. Krishnan S. Sattar F. Adventitious sounds identification and extraction using temporal–spectral dominance-based features IEEE Transactions on Biomedical Engineering 58 11 2011 3078 3087 21712152
  27. [33]Flietstra B. Markuzon N. Vyshedskiy A. Murphy R. Automated analysis of crackles in patients with interstitial pulmonary fibrosis Pulmonary medicine 2011 2011 PMC3115658 21738873
  28. [36]Chen J. Wu L. Zhang J. Zhang L. Gong D. Zhao Y. Hu S. Wang Y. Hu X. Zheng B. Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: a prospective study medRxiv 2020 PMC7645624 33154542
  29. [37]Xu X. Jiang X. Ma C. Du P. Li X. Lv S. Yu L. Chen Y. Su J. Lang G. Deep learning system to screen coronavirus disease 2019 pneumonia arXiv preprint arXiv:2002.09334 2020 PMC7320702 32837749 · arXiv
  30. [38]H. Zhang, K.M. Saravanan, Y. Yang, M.T. Hossain, J. Li, X. Ren, Y. Wei, Deep learning based drug screening for novel coronavirus 2019-ncov (2020). PMC7266118 32488835
  31. [39]Beck B.R. Shin B. Choi Y. Park S. Kang K. Predicting commercially available antiviral drugs that may act on the novel coronavirus (2019-ncov), wuhan, china through a drug-target interaction deep learning model bioRxiv 2020 PMC7118541 32280433
  32. [40]Wang S. Kang B. Ma J. Zeng X. Xiao M. Guo J. Cai M. Yang J. Li Y. Meng X. A deep learning algorithm using ct images to screen for corona virus disease (covid-19) medRxiv 2020 PMC7904034 33629156
  33. [41]Hemdan E.E.-D. Shouman M.A. Karar M.E. Covidx-net: A framework of deep learning classifiers to diagnose covid-19 in x-ray images arXiv preprint arXiv:2003.11055 2020 · arXiv
  34. [42]Apostolopoulos I.D. Mpesiana T.A. Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks Physical and Engineering Sciences in Medicine 2020 1 PMC7118364 32524445
  35. [43]Narin A. Kaya C. Pamuk Z. Automatic detection of coronavirus disease (covid-19) using x-ray images and deep convolutional neural networks arXiv preprint arXiv:2003.10849 2020 PMC8106971 33994847 · arXiv
  36. [45]Song Y. Zheng S. Li L. Zhang X. Zhang X. Huang Z. Chen J. Zhao H. Jie Y. Wang R. Deep learning enables accurate diagnosis of novel coronavirus (covid-19) with ct images medRxiv 2020 PMC8851430 33705321
  37. [46]Zheng C. Deng X. Fu Q. Zhou Q. Feng J. Ma H. Liu W. Wang X. Deep learning-based detection for covid-19 from chest ct using weak label medRxiv 2020
  38. [47]Ardakani A.A. Kanafi A.R. Acharya U.R. Khadem N. Mohammadi A. Application of deep learning technique to manage covid-19 in routine clinical practice using ct images: Results of 10 convolutional neural networks Computers in Biology and Medicine 2020 103795 32568676 PMC7190523
  39. [48]Li L. Qin L. Xu Z. Yin Y. Wang X. Kong B. Bai J. Lu Y. Fang Z. Song Q. Artificial intelligence distinguishes covid-19 from community acquired pneumonia on chest ct Radiology 2020 200905 PMC7233473 32191588
  40. [49]Butt C. Gill J. Chun D. Babu B.A. Deep learning system to screen coronavirus disease 2019 pneumonia Applied Intelligence 2020 1 PMC7175452 38624372
  41. [50]Wang L. Wong A. Covid-net: A tailored deep convolutional neural network design for detection of covid-19 cases from chest radiography images arXiv preprint arXiv:2003.09871 2020 PMC7658227 33177550 · arXiv
  42. [51]X. Xu, X. Jiang, C. Ma, et al., Deep learning system to screen coronavirus disease 2019 pneumonia. arXiv preprint arXiv:2002.09334. (2020) PMC7320702 32837749 · arXiv
  43. [53]Brunese L. Mercaldo F. Reginelli A. Santone A. An ensemble learning approach for brain cancer detection exploiting radiomic features Computer methods and programs in biomedicine 185 2020 105134 31675644

Cited by

Sorted by citations

Authors
Brunese, L., Mercaldo, F., Reginelli, A., & Santone, A.
Affiliations
  • University of Molise (IT)
  • University of Campania "Luigi Vanvitelli" (IT)
Corresponding author
Mercaldo, Francesco
Venue
Computer Methods and Programs in Biomedicine
Publisher
Elsevier BV
Published
2020-11
Volume
196
Pages
105608
ISSN
0169-2607 (ISSN-L)
OpenAlex
W3036552116
Cited by
623
References
5
Citations by year
2026: 20 · 2025: 48 · 2024: 67 · 2023: 116 · 2022: 158 · 2021: 187 · 2020: 27
FWCI
59.42
Type
journal article
Language
en
Open access
Locations
  • Computer Methods and Programs in Biomedicine (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • Archivio Istituzionale della Ricerca - Università degli Studi della Campania "Luigi Vanvitelli" (submittedVersion)
  • Archivio Istituzionale della Ricerca - Università degli Studi del Molise (submittedVersion)
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
Keywords
COVID-19 detection, chest radiography, pneumonia detection, explainable deep learning, lesion localization, automated diagnosis, lung disease
MeSH terms
Betacoronavirus, Deep Learning, COVID-19, SARS-CoV-2, Algorithms, Humans, Image Processing, Computer-Assisted, Lung Diseases, Pneumonia, Viral, Radiographic Image Interpretation, Computer-Assisted, Radiography, Thoracic, X-Rays, Reproducibility of Results, Neural Networks, Computer, Coronavirus Infections, Pandemics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review