AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system
Open accessPublished version of a preprint
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
The sudden outbreak of novel coronavirus 2019 (COVID-19) increased the diagnostic burden of radiologists. In the time of an epidemic crisis, we hope artificial intelligence (AI) to reduce physician workload in regions with the outbreak, and improve the diagnosis accuracy for physicians before they could acquire enough experience with the new disease. In this paper, we present our experience in building and deploying an AI system that automatically analyzes CT images and provides the probability of infection to rapidly detect COVID-19 pneumonia. The proposed system which consists of classification and segmentation will save about 30%–40% of the detection time for physicians and promote the performance of COVID-19 detection. Specifically, working in an interdisciplinary team of over 30 people with medical and/or AI background, geographically distributed in Beijing and Wuhan, we are able to overcome a series of challenges (e.g. data discrepancy, testing time-effectiveness of model, data security, etc.) in this particular situation and deploy the system in four weeks. In addition, since the proposed AI system provides the priority of each CT image with probability of infection, the physicians can confirm and segregate the infected patients in time. Using 1,136 training cases (723 positives for COVID-19) from five hospitals, we are able to achieve a sensitivity of 0.974 and specificity of 0.922 on the test dataset, which included a variety of pulmonary diseases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China
Huang, C., Wang, Y., Li, X., Ren, L., Zhao, J., Hu, Y., Zhang, L., Fan, G., Xu, J., Gu, X., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30183-5 · Cited by 48,884
Self-citationGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931 · cited 6×
“For the segmentation task, we considered several widely-used segmentation models such as fully convolutional networks (FCN-8s) [54], U-Net [31], V-Net [14] and 3D U-Net++ [32].”
InfluentialFully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
UNet++: A Nested U-Net Architecture for Medical Image Segmentation
Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N., & Liang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_1 · Cited by 9,610
Research works printed but not linked: 2
- He, 2015, Deep residual learning for image recognition, Comput. Sci.
- A. Paszke, S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, Z. Lin, A. Desmaison, L. Antiga, A. Lerer, Automatic differentiation in PyTorch, in: NIPS Workshop, 2017.
Cited by
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
U-Net and Its Variants for Medical Image Segmentation: A Review of Theory and Applications
Siddique, N., Paheding, S., Elkin, C. P., & Devabhaktuni, V. (2021) · IEEE Access · doi:10.1109/access.2021.3086020 · Cited by 1,960
Shi, F., Wang, J., Shi, J., Wu, Z., Wang, Q., Tang, Z., He, K., Shi, Y., & Shen, D. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.2987975 · Cited by 1,404
“propose an AI system for fast COVID-19 diagnosis [57] .”
BackgroundMethodInfluentialSelf-citationRoberts, M., Driggs, D., Thorpe, M., Gilbey, J., Yeung, M., Ursprung, S., Aviles-Rivero, A. I., Etmann, C., McCague, C., Beer, L., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00307-0 · Cited by 1,044
Roberts, M. T., Driggs, D., Thorpe, M., Gilbey, J., Yeung, M., Ursprung, S., Avilés-Rivero, A. I., Etmann, C., McCague, C., Beer, L., et al. (2020) · Apollo (University of Cambridge) · doi:10.17863/cam.64000 · Cited by 895
Amyar, A., Modzelewski, R., Li, H., & Ruan, S. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104037 · Cited by 612
Harmon, S. A., Sanford, T. H., Xu, S., Turkbey, E. B., Roth, H., Xu, Z., Yang, D., Myronenko, A., Anderson, V., Amalou, A., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-17971-2 · Cited by 587
Self-citationGolinelli, D., Boetto, E., Carullo, G., Nuzzolese, A. G., Landini, M. P., & Fantini, M. P. (2020) · Journal of Medical Internet Research · doi:10.2196/22280 · Cited by 574
Predicting the growth and trend of COVID-19 pandemic using machine learning and cloud computing
Tuli, S., Tuli, S., Tuli, R., & Gill, S. S. (2020) · Internet of Things · doi:10.1016/j.iot.2020.100222 · Cited by 496
A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis
Wang, S., Zha, Y., Li, W., Wu, Q., Li, X., Niu, M., Wang, M., Qiu, X., Li, H., Yu, H., et al. (2020) · European Respiratory Journal · doi:10.1183/13993003.00775-2020 · Cited by 490
Self-citationA Noise-Robust Framework for Automatic Segmentation of COVID-19 Pneumonia Lesions From CT Images
Wang, G., Liu, X., Li, C., Xu, Z., Ruan, J., Zhu, H., Meng, T., Li, K., Huang, N., & Zhang, S. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3000314 · Cited by 469
Self-citationThe Role of Imaging in the Detection and Management of COVID-19: A Review
Dong, D., Tang, Z., Wang, S., Hui, H., Gong, L., Lu, Y., Xue, Z., Liao, H., Chen, F., Yang, F., et al. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.2990959 · Cited by 401
Self-citationIbrahim, D. M., Elshennawy, N. M., & Sarhan, A. M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104348 · Cited by 401
Transfer learning techniques for medical image analysis: A review
Kora, P., Ooi, C. P., Faust, O., Raghavendra, U., Gudigar, A., Chan, W. Y., Meenakshi, K., Swaraja, K., Plawiak, P., & Rajendra Acharya, U. (2022) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2021.11.004 · Cited by 367
Accurate Screening of COVID-19 Using Attention-Based Deep 3D Multiple Instance Learning
Han, Z., Wei, B., Hong, Y., Li, T., Cong, J., Zhu, X., Wei, H., & Zhang, W. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2996256 · Cited by 325
Self-citationGunraj, H., Wang, L., & Wong, A. (2020) · Frontiers in Medicine · doi:10.3389/fmed.2020.608525 · Cited by 325
Nour, M., Cömert, Z., & Polat, K. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106580 · Cited by 316
Enhanced whale optimization algorithm for medical feature selection: A COVID-19 case study
Nadimi-Shahraki, M. H., Zamani, H., & Mirjalili, S. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105858 · Cited by 316
A Review on Deep Learning Techniques for the Diagnosis of Novel Coronavirus (COVID-19)
Islam, M. M., Karray, F., Alhajj, R., & Zeng, J. (2021) · IEEE Access · doi:10.1109/access.2021.3058537 · Cited by 292
Applications of artificial intelligence in battling against covid-19: A literature review
Tayarani N., M.-H. (2021) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110338 · Cited by 210
COVID-19 image classification using deep learning: Advances, challenges and opportunities
Aggarwal, P., Mishra, N. K., Fatimah, B., Singh, P., Gupta, A., & Joshi, S. D. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105350 · Cited by 168
“ResNet has been used by several authors for the detection of COVID-19 using CXR images [23,27,83,85,91], and CT images [30,32,117,133].”
Syrowatka, A., Kuznetsova, M., Alsubai, A., Beckman, A. L., Bain, P. A., Craig, K. J. T., Hu, J., Jackson, G. P., Rhee, K., & Bates, D. W. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00459-8 · Cited by 130
Machine learning to assist clinical decision-making during the COVID-19 pandemic
Debnath, S., Barnaby, D. P., Coppa, K., Makhnevich, A., Kim, E. J., Chatterjee, S., Tóth, V., Levy, T. J., Paradis, M. D., Cohen, S. L., et al. (2020) · Bioelectronic Medicine · doi:10.1186/s42234-020-00050-8 · Cited by 104
A systematic review on AI/ML approaches against COVID-19 outbreak
Dogan, O., Tiwari, S., Jabbar, M. A., & Guggari, S. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00424-8 · Cited by 87
A systematic collection of medical image datasets for deep learning
Li, J., Zhu, G., Hua, C., Feng, M., BasheerBennamoun, Li, P., Lu, X., Song, J., Shen, P., Xu, X., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.12864 · Cited by 61
Self-citationBlockchain-Federated-Learning and Deep Learning Models for COVID-19 Detection Using CT Imaging
Kumar, R., Khan, A. A., Kumar, J., Zakria, Golilarz, N. A., Zhang, S., Ting, Y., Zheng, C., & Wang, W. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3076767 · Cited by 57
“[53] 2D Unet++ and 2D-CNN COVID-19, viral, baterial and Pneu.”
Bayoudh, K., Hamdaoui, F., & Mtibaa, A. (2020) · Physical and Engineering Sciences in Medicine · doi:10.1007/s13246-020-00957-1 · Cited by 50
Metadata
- Authors
- Wang, B., Jin, S., Yan, Q., Xu, H., Luo, C., Wei, L., Zhao, W., Hou, X., Ma, W., Xu, Z., Zheng, Z., Sun, W., Lan, L., Zhang, W., Mu, X., Shi, C., Wang, Z., Lee, J., Jin, Z., Lin, M., Jin, H., Zhang, L., Guo, J., Zhao, B., Ren, Z., Wang, S., Xu, W., Wang, X., Wang, J., You, Z., & Dong, J.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2021-01
- Volume
- 98
- Pages
- 106897
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W3102469298
- Cited by
- 538
- References
- 53
- FWCI
- 50.88
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Funders
- National Natural Science Foundation of China (61532001)
- National Key Research and Development Program of China (2020YFC0845500)
- Tsinghua Initiative Scientific Research Program (20151080475)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.