Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays
Open accessAbstract
Background and objective Coronavirus disease (COVID-19) is an infectious disease caused by a new virus never identified before in humans. This virus causes respiratory disease (for instance, flu) with symptoms such as cough, fever and, in severe cases, pneumonia. The test to detect the presence of this virus in humans is performed on sputum or blood samples and the outcome is generally available within a few hours or, at most, days. Analysing biomedical imaging the patient shows signs of pneumonia. In this paper, with the aim of providing a fully automatic and faster diagnosis, we propose the adoption of deep learning for COVID-19 detection from X-rays. Method In particular, we propose an approach composed by three phases: the first one to detect if in a chest X-ray there is the presence of a pneumonia. The second one to discern between COVID-19 and pneumonia. The last step is aimed to localise the areas in the X-ray symptomatic of the COVID-19 presence. Results and conclusion Experimental analysis on 6,523 chest X-rays belonging to different institutions demonstrated the effectiveness of the proposed approach, with an average time for COVID-19 detection of approximately 2.5 seconds and an average accuracy equal to 0.97.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In 2020, DL is playing an increasingly vital role in early diagnosis of the novel coronavirus (COVID-19).
“In 2020, DL is playing an increasingly vital role in early diagnosis of the novel coronavirus (COVID-19) [29, 46–48].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [46]
Several convolutional neural network approaches for automatic detection from X-ray images in COVID-19 and pulmonary disease showed excellent performance.
“In the area of COVID-19 and pulmonary disease, several convolutional neural network approaches have been proposed for automatic detection from X-ray images which showed an excellent performance [46, 276–279].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [46]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · see citing works
Early transmission dynamics in Wuhan, China, of novel coronavirus-infected pneumonia
Li, Q., Guan, X., Wu, P., Wang, X., Zhou, L., Tong, Y., Ren, R., Leung, K. S. M., Lau, E. H. Y., Wong, J. Y., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2001316 · Cited by 16,575 · see citing works
Hui, D. S., I Azhar, E., Madani, T. A., Ntoumi, F., Kock, R., Dar, O., Ippolito, G., Mchugh, T. D., Memish, Z. A., Drosten, C., et al. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.01.009 · Cited by 3,809 · see citing works
Bulten, W., Pinckaers, H., van Boven, H., Vink, R., de Bel, T., van Ginneken, B., van der Laak, J., Hulsbergen-van de Kaa, C., & Litjens, G. (2020) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30739-9 · Cited by 705 · see citing works
Holmes, K. V. (2003) · New England Journal of Medicine · doi:10.1056/nejmp030078 · Cited by 330 · see citing works
Flagged first, then by citations
Research works printed but not linked: 43
- [2]van der Hoek L. Pyrc K. Jebbink M.F. Vermeulen-Oost W. Berkhout R.J. Wolthers K.C. Wertheim-van Dillen P.M. Kaandorp J. Spaargaren J. Berkhout B. Identification of a new human coronavirus Nature medicine 10 4 2004 368 373 PMC7095789 15034574
- [3]Abroug F. Slim A. Ouanes-Besbes L. Kacem M.-A.H. Dachraoui F. Ouanes I. Lu X. Tao Y. Paden C. Caidi H. Family cluster of middle east respiratory syndrome coronavirus infections, tunisia, 2013 Emerging infectious diseases 20 9 2014 1527 25148113 PMC4178422
- [5]Wang C. Horby P.W. Hayden F.G. Gao G.F. A novel coronavirus outbreak of global health concern The Lancet 395 10223 2020 470 473 PMC7135038 31986257
- [6]Livingston E. Bucher K. Coronavirus disease 2019 (covid-19) in italy Jama 2020 32181795
- [7]Wang Y. Wang Y. Chen Y. Qin Q. Unique epidemiological and clinical features of the emerging 2019 novel coronavirus pneumonia (covid-19) implicate special control measures Journal of medical virology 92 6 2020 568 576 32134116 PMC7228347
- [8]Huff H.V. Singh A. Asymptomatic transmission during the covid-19 pandemic and implications for public health strategies Clinical Infectious Diseases 2020 PMC7314132 32463076
- [9]Day M. Covid-19: identifying and isolating asymptomatic people helped eliminate virus in italian village Bmj 368 187 2020 m1165 32205334
- [10]P. Romagnani, G. Gnone, F. Guzzi, S. Negrini, A. Guastalla, F. Annunziato, S. Romagnani, R. De Palma, The covid-19 infection: lessons from the italian experience (2020). PMC7257358 32472024
- [11]Bastolla U. How lethal is the novel coronavirus, and how many undetected cases there are? the importance of being tested. medRxiv 2020
- [12]Ng M.-Y. Lee E.Y. Yang J. Yang F. Li X. Wang H. Lui M.M.-s. Lo C.S.-Y. Leung B. Khong P.-L. Imaging profile of the covid-19 infection: radiologic findings and literature review Radiology: Cardiothoracic Imaging 2 1 2020 e200034 33778547 PMC7233595
- [13]Huang C. Wang Y. Li X. Ren L. Zhao J. Hu Y. Zhang L. Fan G. Xu J. Gu X. Clinical features of patients infected with 2019 novel coronavirus in wuhan, china The Lancet 395 10223 2020 497 506 PMC7159299 31986264
- [16]Sellers S.A. Dover K.L. Bailey A.G. Cheves A. Eason A.B. Popowitch E.B. Miller M.B. Wohl D.A. Dittmer D.P. Fischer W.A. Burden of respiratory viral infection in persons with human immunodeficiency virus Influenza and Other Respiratory Viruses 2020 PMC7298306 32153113
- [17]Long C. Xu H. Shen Q. Zhang X. Fan B. Wang C. Zeng B. Li Z. Li X. Li H. Diagnosis of the coronavirus disease (covid-19): rrt-pcr or ct? European Journal of Radiology 2020 108961 32229322 PMC7102545
- [18]Fang Y. Zhang H. Xie J. Lin M. Ying L. Pang P. Ji W. Sensitivity of chest ct for covid-19: comparison to rt-pcr Radiology 2020 200432 PMC7233365 32073353
- [19]Ai T. Yang Z. Hou H. Zhan C. Chen C. Lv W. Tao Q. Sun Z. Xia L. Correlation of chest ct and rt-pcr testing in coronavirus disease 2019 (covid-19) in china: a report of 1014 cases Radiology 2020 200642 PMC7233399 32101510
- [20]Brunese L. Mercaldo F. Reginelli A. Santone A. Neural networks for lung cancer detection through radiomic features 2019 International Joint Conference on Neural Networks (IJCNN) 2019 IEEE 1 10
- [22]Simonyan K. Zisserman A. Very deep convolutional networks for large-scale image recognition arXiv preprint arXiv:1409.1556 2014 · arXiv
- [24]Deng J. Dong W. Socher R. Li L.-J. Li K. Fei-Fei L. Imagenet: A large-scale hierarchical image database 2009 IEEE conference on computer vision and pattern recognition 2009 Ieee 248 255
- [25]Selvaraju R.R. Cogswell M. Das A. Vedantam R. Parikh D. Batra D. Grad-cam: Visual explanations from deep networks via gradient-based localization Proceedings of the IEEE international conference on computer vision 2017 618 626
- [26]Mercaldo F. Santone A. Deep learning for image-based mobile malware detection Journal of Computer Virology and Hacking Techniques 2020 1 15
- [27]Qi C.R. Su H. Mo K. Guibas L.J. Pointnet: Deep learning on point sets for 3d classification and segmentation Proceedings of the IEEE conference on computer vision and pattern recognition 2017 652 660
- [28]Litjens G. Kooi T. Bejnordi B.E. Setio A.A.A. Ciompi F. Ghafoorian M. Van Der Laak J.A. Van Ginneken B. Sánchez C.I. A survey on deep learning in medical image analysis Medical image analysis 42 2017 60 88 28778026
- [29]Cohen J.P. Morrison P. Dao L. Covid-19 image data collection arXiv 2003.11597 2020 · arXiv
- [30]Ozturk T. Talo M. Yildirim E.A. Baloglu U.B. Yildirim O. Acharya U.R. Automated detection of covid-19 cases using deep neural networks with x-ray images Computers in Biology and Medicine 2020 103792 32568675 PMC7187882
- [31]Wang X. Peng Y. Lu L. Lu Z. Bagheri M. Summers R.M. Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases Proceedings of the IEEE conference on computer vision and pattern recognition 2017 2097 2106
- [32]Jin F. Krishnan S. Sattar F. Adventitious sounds identification and extraction using temporal–spectral dominance-based features IEEE Transactions on Biomedical Engineering 58 11 2011 3078 3087 21712152
- [33]Flietstra B. Markuzon N. Vyshedskiy A. Murphy R. Automated analysis of crackles in patients with interstitial pulmonary fibrosis Pulmonary medicine 2011 2011 PMC3115658 21738873
- [36]Chen J. Wu L. Zhang J. Zhang L. Gong D. Zhao Y. Hu S. Wang Y. Hu X. Zheng B. Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: a prospective study medRxiv 2020 PMC7645624 33154542
- [37]Xu X. Jiang X. Ma C. Du P. Li X. Lv S. Yu L. Chen Y. Su J. Lang G. Deep learning system to screen coronavirus disease 2019 pneumonia arXiv preprint arXiv:2002.09334 2020 PMC7320702 32837749 · arXiv
- [38]H. Zhang, K.M. Saravanan, Y. Yang, M.T. Hossain, J. Li, X. Ren, Y. Wei, Deep learning based drug screening for novel coronavirus 2019-ncov (2020). PMC7266118 32488835
- [39]Beck B.R. Shin B. Choi Y. Park S. Kang K. Predicting commercially available antiviral drugs that may act on the novel coronavirus (2019-ncov), wuhan, china through a drug-target interaction deep learning model bioRxiv 2020 PMC7118541 32280433
- [40]Wang S. Kang B. Ma J. Zeng X. Xiao M. Guo J. Cai M. Yang J. Li Y. Meng X. A deep learning algorithm using ct images to screen for corona virus disease (covid-19) medRxiv 2020 PMC7904034 33629156
- [41]Hemdan E.E.-D. Shouman M.A. Karar M.E. Covidx-net: A framework of deep learning classifiers to diagnose covid-19 in x-ray images arXiv preprint arXiv:2003.11055 2020 · arXiv
- [42]Apostolopoulos I.D. Mpesiana T.A. Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks Physical and Engineering Sciences in Medicine 2020 1 PMC7118364 32524445
- [43]Narin A. Kaya C. Pamuk Z. Automatic detection of coronavirus disease (covid-19) using x-ray images and deep convolutional neural networks arXiv preprint arXiv:2003.10849 2020 PMC8106971 33994847 · arXiv
- [45]Song Y. Zheng S. Li L. Zhang X. Zhang X. Huang Z. Chen J. Zhao H. Jie Y. Wang R. Deep learning enables accurate diagnosis of novel coronavirus (covid-19) with ct images medRxiv 2020 PMC8851430 33705321
- [46]Zheng C. Deng X. Fu Q. Zhou Q. Feng J. Ma H. Liu W. Wang X. Deep learning-based detection for covid-19 from chest ct using weak label medRxiv 2020
- [47]Ardakani A.A. Kanafi A.R. Acharya U.R. Khadem N. Mohammadi A. Application of deep learning technique to manage covid-19 in routine clinical practice using ct images: Results of 10 convolutional neural networks Computers in Biology and Medicine 2020 103795 32568676 PMC7190523
- [48]Li L. Qin L. Xu Z. Yin Y. Wang X. Kong B. Bai J. Lu Y. Fang Z. Song Q. Artificial intelligence distinguishes covid-19 from community acquired pneumonia on chest ct Radiology 2020 200905 PMC7233473 32191588
- [49]Butt C. Gill J. Chun D. Babu B.A. Deep learning system to screen coronavirus disease 2019 pneumonia Applied Intelligence 2020 1 PMC7175452 38624372
- [50]Wang L. Wong A. Covid-net: A tailored deep convolutional neural network design for detection of covid-19 cases from chest radiography images arXiv preprint arXiv:2003.09871 2020 PMC7658227 33177550 · arXiv
- [51]X. Xu, X. Jiang, C. Ma, et al., Deep learning system to screen coronavirus disease 2019 pneumonia. arXiv preprint arXiv:2002.09334. (2020) PMC7320702 32837749 · arXiv
- [53]Brunese L. Mercaldo F. Reginelli A. Santone A. An ensemble learning approach for brain cancer detection exploiting radiomic features Computer methods and programs in biomedicine 185 2020 105134 31675644
Cited by
Sorted by citations
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906 · see citing works
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
van der Velden, B. H. M., Kuijf, H. J., Gilhuijs, K. G. A., & Viergever, M. A. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102470 · Cited by 1,328 · see citing works
Loh, H. W., Ooi, C. P., Seoni, S., Barua, P. D., Molinari, F., & Acharya, U. R. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.107161 · Cited by 734 · see citing works
Machine-learning-based disease diagnosis: a comprehensive review
Ahsan, M. M., Luna, S. A., & Siddique, Z. (2022) · Healthcare · doi:10.3390/healthcare10030541 · Cited by 603 · see citing works
Cabitza, F., Campagner, A., Soares, F., García de Guadiana-Romualdo, L., Challa, F., Sulejmani, A., Seghezzi, M., & Carobene, A. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106288 · Cited by 284 · see citing works
Nazir, S., Dickson, D. M., & Akram, M. U. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106668 · Cited by 283 · see citing works
Applications of artificial intelligence in battling against covid-19: A literature review
Tayarani N., M.-H. (2021) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110338 · Cited by 210 · see citing works
COVID-19 image classification using deep learning: Advances, challenges and opportunities
Aggarwal, P., Mishra, N. K., Fatimah, B., Singh, P., Gupta, A., & Joshi, S. D. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105350 · Cited by 168 · see citing works
EXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications
Ortigossa, E. S., Gonçalves, T., & Nonato, L. G. (2024) · IEEE Access · doi:10.1109/access.2024.3409843 · Cited by 124 · see citing works
A Review of Recent Advances in Deep Learning Models for Chest Disease Detection Using Radiography
Ait Nasser, A., & Akhloufi, M. A. (2023) · Diagnostics · doi:10.3390/diagnostics13010159 · Cited by 121 · see citing works
A systematic review on AI/ML approaches against COVID-19 outbreak
Dogan, O., Tiwari, S., Jabbar, M. A., & Guggari, S. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00424-8 · Cited by 87 · see citing works
Al-Timemy, A. H., Khushaba, R. N., Mosa, Z. M., & Escudero, J. (2021) · Studies in Systems, Decision and Control · doi:10.1007/978-3-030-69744-0_6 · Cited by 41 · see citing works
Study on IoT for SARS-CoV-2 with healthcare: present and future perspective
Rahman, A., Department of Computer Science and Engineering, N. I. O. T. E. A. R. (., Rahman, M., Kundu, D., Karim, M. R., Band, S. S., Sookhak, M., Department of Computer Science and Engineering, M. B. S. A. T. U., Department of Electrical and Electronic Engineering, N. I. O. T. E. A. R. (., Future Technology Research Center, C. O. F., et al. (2021) · Mathematical Biosciences and Engineering · doi:10.3934/mbe.2021475 · Cited by 22 · see citing works
- Authors
- Brunese, L., Mercaldo, F., Reginelli, A., & Santone, A.
- Affiliations
- University of Molise (IT)
- University of Campania "Luigi Vanvitelli" (IT)
- Corresponding author
- Mercaldo, Francesco
- Venue
- Computer Methods and Programs in Biomedicine
- Publisher
- Elsevier BV
- Published
- 2020-11
- Volume
- 196
- Pages
- 105608
- ISSN
- 0169-2607 (ISSN-L)
- PMC
- PMC7831868
- OpenAlex
- W3036552116
- Cited by
- 623
- References
- 5
- Citations by year
- 2026: 20 · 2025: 48 · 2024: 67 · 2023: 116 · 2022: 158 · 2021: 187 · 2020: 27
- FWCI
- 59.42
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Computer Methods and Programs in Biomedicine (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Archivio Istituzionale della Ricerca - Università degli Studi della Campania "Luigi Vanvitelli" (submittedVersion)
- Archivio Istituzionale della Ricerca - Università degli Studi del Molise (submittedVersion)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- COVID-19 detection, chest radiography, pneumonia detection, explainable deep learning, lesion localization, automated diagnosis, lung disease
- MeSH terms
- Betacoronavirus, Deep Learning, COVID-19, SARS-CoV-2, Algorithms, Humans, Image Processing, Computer-Assisted, Lung Diseases, Pneumonia, Viral, Radiographic Image Interpretation, Computer-Assisted, Radiography, Thoracic, X-Rays, Reproducibility of Results, Neural Networks, Computer, Coronavirus Infections, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review