An Efficient Mixture of Deep and Machine Learning Models for COVID-19 and Tuberculosis Detection Using X-Ray Images in Resource Limited Settings
Open accessThe DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Abstract
Clinicians in the frontline need to assess quickly whether a patient with symptoms indeed has COVID-19 or not. The difficulty of this task is exacerbated in low resource settings that may not have access to biotechnology tests. Furthermore, Tuberculosis (TB) remains a major health problem in several low- and middle-income countries and its common symptoms include fever, cough and tiredness, similarly to COVID-19. In order to help in the detection of COVID-19, we propose the extraction of deep features (DF) from chest X-ray images, a technology available in most hospitals, and their subsequent classification using machine learning methods that do not require large computational resources. We compiled a five-class dataset of X-ray chest images including a balanced number of COVID-19, viral pneumonia, bacterial pneumonia, TB, and healthy cases. We compared the performance of pipelines combining 14 individual state-of-the-art pre-trained deep networks for DF extraction with traditional machine learning classifiers. A pipeline consisting of ResNet-50 for DF computation and ensemble of subspace discriminant classifier was the best performer in the classification of the five classes, achieving a detection accuracy of 91.6+ 2.6% (accuracy + 95% Confidence Interval). Furthermore, the same pipeline achieved accuracies of 98.6+1.4% and 99.9+0.5% in simpler three-class and two-class classification problems focused on distinguishing COVID-19, TB and healthy cases; and COVID-19 and healthy images, respectively. The pipeline was computationally efficient requiring just 0.19 second to extract DF per X-ray image and 2 minutes for training a traditional classifier with more than 2000 images on a CPU machine. The results suggest the potential benefits of using our pipeline in the detection of COVID-19, particularly in resource-limited settings and it can run with limited computational resources.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“CNN has become the primary tool for automatic COVID-19 diagnosis in many hospitals around the world using chest X-ray images [256–260].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [257]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
RETRACTED ARTICLE: Deep learning system to screen coronavirus disease 2019 pneumonia
Butt, C., Gill, J., Chun, D., & Babu, B. A. (2023) · Applied Intelligence · doi:10.1007/s10489-020-01714-3 · Cited by 333
RetractedDeep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2008) · Journal of Machine Learning Research · Cited by 33,051
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380 · cited 1×
“v2 Sandler et al. [32] 224x224x3 Logits 154 3.5 10 ShuffleNet Zhang et al. [48] 224x224x3 node_202 172 1.4 11 GoogLeNet Szegedy et al. [49] 224x224x3 loss3-classifier 144 7 12 Xception Chollet et al. [50] 299x299x3 predictions 170 22.9 13 NASNet-Mobile Zoph et al. [51] 224x224x3 predictions 913 5.3 14 NASNet-Large Zop…”
InfluentialShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
Learning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00907 · Cited by 7,831
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
The epidemiology and pathogenesis of coronavirus disease (COVID-19) outbreak
Rothan, H. A., & Byrareddy, S. N. (2020) · Journal of Autoimmunity · doi:10.1016/j.jaut.2020.102433 · Cited by 5,840 · cited 1×
“e Acute Respiratory Syndrome (SARS). The most common symptoms of COVID-19 include fever, cough, difficulty in breathing, and tiredness, which may develop to pneumonia and potentially leading to death [1,2]. The symptoms of pulmonary diseases may be confused and there might be a misdiagnosis of COVID-19 cases with that…”
BackgroundIdentifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning
Kermany, D. S., Goldbaum, M., Cai, W., Valentim, C. C. S., Liang, H., Baxter, S. L., McKeown, A., Yang, G., Wu, X., Yan, F., et al. (2018) · Cell · doi:10.1016/j.cell.2018.02.010 · Cited by 4,842
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636 · cited 1×
“is study. Network name Reference Input size Fully connected layer No. of layer s No. of parameters in Million 1 AlexNet Krizhevsky et al. [44] 227x227x3 fc8 25 61 2 Inception-ResNet-v2 Szegedy et al. [45] 299x299x3 predictions 824 23.2 3 DenseNet-201 Huang et al. [31] 224x224x3 fc1000 708 20 4 ResNet-18 He et al. [46]…”
BackgroundInfluentialWang, L., Lin, Z. Q., & Wong, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-76550-z · Cited by 3,113
Survey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
Automated detection of COVID-19 cases using deep neural networks with X-ray images
Ozturk, T., Talo, M., Yildirim, E. A., Baloglu, U. B., Yildirim, O., & Rajendra Acharya, U. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103792 · Cited by 2,594
Apostolopoulos, I. D., & Mpesiana, T. A. (2020) · Physical and Engineering Sciences in Medicine · doi:10.1007/s13246-020-00865-4 · Cited by 2,338 · cited 2×
“Hence, it has been proposed for Computer Aided Diagnosis (CAD) for aiding COVID-19 detection [14–17] and TB screening [18,19].”
MethodNarin, A., Kaya, C., & Pamuk, Z. (2021) · Pattern Analysis and Applications · doi:10.1007/s10044-021-00984-y · Cited by 2,054 · cited 3×
“fiers. Classification Learner (CL) App. in Matlab 2019b was used to perform the classification. We utilized five-fold Cross Validation (CV) for analysis in this study to avoid overfitting, as done in [4,12,26]. To select the best classifier for the COVID-19 5-class dataset, we carried out a pilot study with multiple c…”
MethodResultDeep Learning for Health Informatics
Ravì, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636665 · Cited by 2,000
Xie, X., Zhong, Z., Zhao, W., Zheng, C., Wang, F., & Liu, J. (2020) · Radiology · doi:10.1148/radiol.2020200343 · Cited by 1,960 · cited 2×
“Radiology can be utilized to help in the detection of COVID-19 in images of Computerized Tomography (CT) [3,8–10] or X-rays [4,11,12] since darkened spots and also opacities that looks like ground glass, can be observed [3].”
MethodCan AI help in screening viral and COVID-19 pneumonia?
Chowdhury, M. E. H., Rahman, T., Khandakar, A., Mazhar, R., Kadir, M. A., Mahbub, Z. B., Islam, K. R., Khan, M. S., Iqbal, A., Emadi, N. A., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3010287 · Cited by 1,913 · cited 4×
“Finally, to investigate the performance of our proposed COVID-19 detection method for 2-class COVID-19 vs. normal, similar to [4,11,12].”
MethodResultInfluentialA deep learning algorithm using CT images to screen for Corona virus disease (COVID-19)
Wang, S., Kang, B., Ma, J., Zeng, X., Xiao, M., Guo, J., Cai, M., Yang, J., Li, Y., Meng, X., et al. (2021) · European Radiology · doi:10.1007/s00330-021-07715-1 · Cited by 1,677
CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images
Khan, A. I., Shah, J. L., & Bhat, M. M. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105581 · Cited by 1,312
A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19)Preprint
Wang, S., Kang, B., Ma, J., et al. (2020) · medRxiv · doi:10.1101/2020.02.14.20023028 · Cited by 1,035
Deep-COVID: Predicting COVID-19 from chest X-ray images using deep transfer learning
Minaee, S., Kafieh, R., Sonka, M., Yazdani, S., & Jamalipour Soufi, G. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101794 · Cited by 1,024
COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images
Hemdan, E. E., Shouman, M. A., & Karar, M. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11055 · Cited by 913
Ardakani, A. A., Kanafi, A. R., Acharya, U. R., Khadem, N., & Mohammadi, A. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103795 · Cited by 851
Lalmuanawma, S., Hussain, J., & Chhakchhuak, L. (2020) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110059 · Cited by 845
Ucar, F., & Korkmaz, D. (2020) · Medical Hypotheses · doi:10.1016/j.mehy.2020.109761 · Cited by 767
COVID-19 Image Data Collection
Cohen, J., Morrison, P., & Dao, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11597 · Cited by 722
Detection of Coronavirus Disease (COVID-19) Based on Deep Features
Sethy, P. K., & Behera, S. K. (2020) · Preprints.org · doi:10.20944/preprints202003.0300.v1 · Cited by 719
Rahimzadeh, M., & Attar, A. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100360 · Cited by 695 · cited 1×
“TL has been applied to COVID-19 detection from X-ray images [4,12,14–18,21,22,26– 28,35–38] where pretrained networks such as ResNet-50 [26,35,39], VGG-19 [16,40], DenseNet-201 [41] and Xception [39] has been used for COVID-19 detection with X-ray images.”
MethodAutomatic Tuberculosis Screening Using Chest Radiographs
Jaeger, S., Karargyris, A., Candemir, S., Folio, L., Siegelman, J., Callaghan, F., Xue, Z., Palaniappan, K., Singh, R. K., Antani, S., et al. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2284099 · Cited by 678
Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration
Candemir, S., Jaeger, S., Palaniappan, K., Musco, J. P., Singh, R. K., Xue, Z., Karargyris, A., Antani, S., Thoma, G., & McDonald, C. J. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2290491 · Cited by 674
Application of deep learning for fast detection of COVID-19 in X-Rays using nCOVnet
Panwar, H., Gupta, P. K., Siddiqui, M. K., Morales-Menendez, R., & Singh, V. (2020) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.109944 · Cited by 646
Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays
Brunese, L., Mercaldo, F., Reginelli, A., & Santone, A. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105608 · Cited by 623 · cited 1×
“TL has been applied to COVID-19 detection from X-ray images [4,12,14–18,21,22,26– 28,35–38] where pretrained networks such as ResNet-50 [26,35,39], VGG-19 [16,40], DenseNet-201 [41] and Xception [39] has been used for COVID-19 detection with X-ray images.”
MethodLoey, M., Smarandache, F., & M. Khalifa, N. E. (2020) · Symmetry · doi:10.3390/sym12040651 · Cited by 538
Deep Transfer Learning Based Classification Model for COVID-19 Disease
Pathak, Y., Shukla, P. K., Tiwari, A., Stalin, S., Singh, S., & Shukla, P. K. (2022) · IRBM · doi:10.1016/j.irbm.2020.05.003 · Cited by 460
Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks
Chen, H., Ni, D., Qin, J., Li, S., Yang, X., Wang, T., & Heng, P. A. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2425041 · Cited by 379
Using X-ray images and deep learning for automated detection of coronavirus disease
El Asnaoui, K., & Chawki, Y. (2021) · Journal of Biomolecular Structure and Dynamics · doi:10.1080/07391102.2020.1767212 · Cited by 360
Altan, A., & Karasu, S. (2020) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110071 · Cited by 358
Automatic Tuberculosis Screening using Chest Radiographs
Department of Electronics and Communication Engineering, V. T. M. T. D. R. D. S. E. C., Leopauline, S., Kalpana, R., Department of Electronics and Communication Engineering, V. T. M. T. D. R. D. S. E. C., Sharmila, P., & Department of Electronics and Communication Engineering, V. T. M. T. D. R. D. S. E. C. (2019) · International Journal of Engineering and Advanced Technology · doi:10.35940/ijeat.a1507.129219 · Cited by 273
Deep Learning on Chest X-ray Images to Detect and Evaluate Pneumonia Cases at the Era of COVID-19
Hammoudi, K., Benhabiles, H., Melkemi, M., Dornaika, F., Arganda-Carreras, I., Collard, D., & Scherpereel, A. (2021) · Journal of Medical Systems · doi:10.1007/s10916-021-01745-4 · Cited by 231
DFU_QUTNet: diabetic foot ulcer classification using novel deep convolutional neural network
Alzubaidi, L., Fadhel, M. A., Oleiwi, S. R., Al-Shamma, O., & Zhang, J. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-07820-w · Cited by 220
Luz, E., Silva, P., Silva, R., Silva, L., Guimarães, J., Miozzo, G., Moreira, G., & Menotti, D. (2022) · Research on Biomedical Engineering · doi:10.1007/s42600-021-00151-6 · Cited by 213
Sensor Applications and Physiological Features in Drivers’ Drowsiness Detection: A Review
Chowdhury, A., Shankaran, R., Kavakli, M., & Haque, M. M. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2807245 · Cited by 202
Predicted impact of the COVID-19 pandemic on global tuberculosis deaths in 2020
Glaziou, P. (2020) · medRxiv · doi:10.1101/2020.04.28.20079582 · Cited by 162
Karar, M. E., Hemdan, E. E., & Shouman, M. A. (2020) · Complex & Intelligent Systems · doi:10.1007/s40747-020-00199-4 · Cited by 159
Kumar, R., Arora, R., Bansal, V., Sahayasheela, V. J., Buckchash, H., Imran, J., Narayanan, N., Pandian, G. N., & Raman, B. (2020) · medRxiv · doi:10.1101/2020.04.13.20063461 · Cited by 158
Detection of COVID-19 using CXR and CT images using Transfer Learning and Haralick features
Perumal, V., Narayanan, V., & Rajasekar, S. J. S. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01831-z · Cited by 152
Computer aided diagnosis for suspect keratoconus detection
Issarti, I., Consejo, A., Jiménez‐García, M., Hershko, S., Koppen, C., & Rozema, J. J. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.04.024 · Cited by 111
Cao, Y., Liu, C., Liu, B., Brunette, M. J., Zhang, N., Sun, T., Zhang, P., Peinado, J., Garavito, E. S., Garcia, L. L., et al. (2016) · 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE) · doi:10.1109/chase.2016.18 · Cited by 104
Norouzifard, M., Nemati, A., GholamHosseini, H., Klette, R., Nouri‐Mahdavi, K., & Yousefi, S. (2018) · International Conference on Image and Vision Computing New Zealand (IVCNZ) · doi:10.1109/ivcnz.2018.8634671 · Cited by 41
Towards an Efficient Deep Learning Model for COVID-19 Patterns Detection in X-ray ImagesPreprint
Luz, E. J. D. S., Silva, P., Silva, R., et al. (2020) · arXiv (Cornell University) · Cited by 37
Research works printed but not linked: 1
- Van Der Maaten L (2013) Barnes-hut-sne. In: Proceedings of the International Conference on Learning Representations,
Cited by
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Applications of artificial intelligence in battling against covid-19: A literature review
Tayarani N., M.-H. (2021) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110338 · Cited by 210
Metadata
- Authors
- Al-Timemy, A. H., Khushaba, R. N., Mosa, Z. M., & Escudero, J.
- Affiliations
- University of Baghdad (IQ)
- The University of Sydney (AU)
- University of Edinburgh (GB)
- Corresponding author
- Al-Timemy, Ali H.
- Venue
- Studies in Systems, Decision and Control
- Publisher
- Springer International Publishing
- Published
- 2021
- Pages
- 77-100
- ISSN
- 2198-4182 (ISSN-L)
- 2198-4190
- OpenAlex
- W3043091553
- Cited by
- 41
- References
- 58
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 10 · 2023: 4 · 2022: 12 · 2021: 5
- FWCI
- 25.36
- Type
- book chapter
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Studies in systems, decision and control (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- COVID-19 detection, tuberculosis detection, chest X-ray images, deep feature extraction, ResNet50, resource-limited settings, pneumonia classification, computational efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.