The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Accurate Screening of COVID-19 Using Attention-Based Deep 3D Multiple Instance Learning
Abstract
Automated Screening of COVID-19 from chest CT is of emergency and importance during the outbreak of SARS-CoV-2 worldwide in 2020. However, accurate screening of COVID-19 is still a massive challenge due to the spatial complexity of 3D volumes, the labeling difficulty of infection areas, and the slight discrepancy between COVID-19 and other viral pneumonia in chest CT. While a few pioneering works have made significant progress, they are either demanding manual annotations of infection areas or lack of interpretability. In this paper, we report our attempt towards achieving highly accurate and interpretable screening of COVID-19 from chest CT with weak labels. We propose an attention-based deep 3D multiple instance learning (AD3D-MIL) where a patient-level label is assigned to a 3D chest CT that is viewed as a bag of instances. AD3D-MIL can semantically generate deep 3D instances following the possible infection area. AD3D-MIL further applies an attention-based pooling approach to 3D instances to provide insight into each instance's contribution to the bag label. AD3D-MIL finally learns Bernoulli distributions of the bag-level labels for more accessible learning. We collected 460 chest CT examples: 230 CT examples from 79 patients with COVID-19, 100 CT examples from 100 patients with common pneumonia, and 130 CT examples from 130 people without pneumonia. A series of empirical studies show that our algorithm achieves an overall accuracy of 97.9%, AUC of 99.0%, and Cohen kappa score of 95.7%. These advantages endow our algorithm as an efficient assisted tool in the screening of COVID-19.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China
Huang, C., Wang, Y., Li, X., Ren, L., Zhao, J., Hu, Y., Zhang, L., Fan, G., Xu, J., Gu, X., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30183-5 · Cited by 48,884 · cited 1×
“Clinical practice demonstrates that chest CT is an effective inspection strategy because it can characterize the standard features between the majority of COVID-19 cases, which show ground-glass opacities in the early stage and pulmonary consolidation in the late stage [1], [2].”
BackgroundLearning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Wang, L., Lin, Z. Q., & Wong, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-76550-z · Cited by 3,113
Solving the multiple instance problem with axis-parallel rectangles
Dietterich, T. G., Lathrop, R. H., & Lozano-Pérez, T. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(96)00034-3 · Cited by 2,866 · cited 1×
“One seminal work in this field was conducted by Dietterich et al. [22].”
BackgroundCT Imaging Features of 2019 Novel Coronavirus (2019-nCoV)
Chung, M., Bernheim, A., Mei, X., Zhang, N., Huang, M., Zeng, X., Cui, J., Xu, W., Yang, Y., Fayad, Z. A., et al. (2020) · Radiology · doi:10.1148/radiol.2020200230 · Cited by 2,751
Narin, A., Kaya, C., & Pamuk, Z. (2021) · Pattern Analysis and Applications · doi:10.1007/s10044-021-00984-y · Cited by 2,054
Robust object tracking with online multiple instance learning
Babenko, B., Yang, M.-H., & Belongie, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.226 · Cited by 2,007 · cited 1×
“…to various domains over the last 20 years, such as computer-aided diagnosis and detection [28]–[32], image classification/retrieval/annotation [33]–[36], text categorization [37], spam detection [38], object detection [25], unsupervised saliency object discovery [39], object tracking [40], etc.”
BackgroundA brief introduction to weakly supervised learning
Zhou, Z.-H. (2018) · National Science Review · doi:10.1093/nsr/nwx106 · Cited by 1,899
A Structured Self-attentive Sentence Embedding
Lin, Z., Feng, M., Santos, C. N. D., Yu, M., Xiang, B., Zhou, B., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.03130 · Cited by 1,743 · cited 1×
“The attention mechanism based deep learning framework is generally adopted in the fields of image captioning [46] and text analysis [47].”
MethodA deep learning algorithm using CT images to screen for Corona virus disease (COVID-19)
Wang, S., Kang, B., Ma, J., Zeng, X., Xiao, M., Guo, J., Cai, M., Yang, J., Li, Y., Meng, X., et al. (2021) · European Radiology · doi:10.1007/s00330-021-07715-1 · Cited by 1,677
Shi, F., Wang, J., Shi, J., Wu, Z., Wang, Q., Tang, Z., He, K., Shi, Y., & Shen, D. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.2987975 · Cited by 1,404
Support Vector Machines for Multiple-Instance Learning
Andrews, S. J., Tsochantaridis, I., & Hofmann, T. (2002) · neural information processing systems · Cited by 1,401
A Weakly-Supervised Framework for COVID-19 Classification and Lesion Localization From Chest CT
Wang, X., Deng, X., Fu, Q., Zhou, Q., Feng, J., Ma, H., Liu, W., & Zheng, C. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2995965 · Cited by 1,243
A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia
Xu, X., Jiang, X., Ma, C., Du, P., Li, X., Lv, S., Yu, L., Ni, Q., Chen, Y., Su, J., et al. (2020) · Engineering · doi:10.1016/j.eng.2020.04.010 · Cited by 1,209
Deep Learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) With CT Images
Song, Y., Zheng, S., Li, L., Zhang, X., Zhang, X., Huang, Z., Chen, J., Wang, R., Zhao, H., Chong, Y., et al. (2021) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3065361 · Cited by 957
Multiple instance learning: A survey of problem characteristics and applications
Carbonneau, M.-A., Cheplygina, V., Granger, E., & Gagnon, G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.009 · Cited by 740 · cited 2×
“are beneficial for MIL classifier [23].”
Chen, J., Wu, L., Zhang, J., Zhang, L., Gong, D., Zhao, Y., Chen, Q., Huang, S., Yang, M., Yang, X., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-76282-0 · Cited by 675
Gozes, O., Frid-Adar, M., Greenspan, H. K., Browning, P. D., Zhang, H., Ji, W., Bernheim, A., & Siegel, E. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05037 · Cited by 639
Attention-based Deep Multiple Instance Learning
Ilse, M., Tomczak, J. M., & Welling, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04712 · Cited by 636
EM-DD: An Improved Multiple-Instance Learning Technique
Zhang, Q., & Goldman, S. A. (2001) · neural information processing systems · Cited by 626
Image Categorization by Learning and Reasoning with Regions
Chen, Y., & Wang, J. Z. (2004) · doi:10.5555/1005332.1016789 · Cited by 621
Development and evaluation of an artificial intelligence system for COVID-19 diagnosis
Jin, C., Chen, W., Cao, Y., Xu, Z., Tan, Z., Zhang, X., Deng, L., Zheng, C., Zhou, J., Shi, H., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18685-1 · Cited by 592
AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system
Wang, B., Jin, S., Yan, Q., Xu, H., Luo, C., Wei, L., Zhao, W., Hou, X., Ma, W., Xu, Z., et al. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106897 · Cited by 538
Self-citationLung Infection Quantification of COVID-19 in CT Images with Deep Learning
Shan, F., Gao, Y., Wang, J., Shi, W., Shi, N., Han, M., Xue, Z., Shen, D. G., & Shi, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04655 · Cited by 490
Multiple-Instance Active Learning
Settles, B., Craven, M. W., & Ray, S. (2007) · neural information processing systems · Cited by 489
COVID-19 Screening on Chest X-ray Images Using Deep Learning based Anomaly Detection
Zhang, J., Xie, Y., Li, Y., Shen, C., & Xia, Y. (2020) · Europe PMC (PubMed Central) · Cited by 433
Serial Quantitative Chest CT Assessment of COVID-19: A Deep Learning Approach
Huang, L., Han, R., Ai, T., Yu, P., Kang, H., Tao, Q., & Xia, L. (2020) · Radiology: Cardiothoracic Imaging · doi:10.1148/ryct.2020200075 · Cited by 431
Estimating Uncertainty and Interpretability in Deep Learning for Coronavirus (COVID-19) Detection
Ghoshal, B., & Tucker, A. (2020) · Brunel University Research Archive (BURA) (Brunel University London) · doi:10.48550/arxiv.2003.10769 · Cited by 328
Weakly supervised histopathology cancer image segmentation and classification
Xu, Y., Zhu, J.-Y., Chang, E. I.-C., Lai, M., & Tu, Z. (2014) · Medical Image Analysis · doi:10.1016/j.media.2014.01.010 · Cited by 283
Content-Based Image Retrieval Using Multiple-Instance Learning
Zhang, Q., Goldman, S. A., Yu, W., & Fritts, J. E. (2002) · Cited by 243
Multiple instance learning for classification of dementia in brain MRI
Tong, T., Wolz, R., Gao, Q., Guerrero, R., Hajnal, J. V., & Rueckert, D. (2014) · Medical Image Analysis · doi:10.1016/j.media.2014.04.006 · Cited by 214
Feng, J., & Zhou, Z.-H. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10890 · Cited by 161
Unsupervised Object Class Discovery via Saliency-Guided Multiple Class Learning
Zhu, J.-Y., Wu, J., Xu, Y. L., Chang, E., & Tu, Z. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2353617 · Cited by 147
Melendez, J., van Ginneken, B., Maduskar, P., Philipsen, R. H. H. M., Reither, K., Breuninger, M., Adetifa, I., Maane, R., Ayles, H., & Sánchez, C. I. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2350539 · Cited by 136
Coronavirus Detection and Analysis on Chest CT with Deep LearningPreprint
Gozes, O., Frid-Adar, M., Sagie, N., Zhang, H., Ji, W., & Greenspan, H. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.02640 · Cited by 134
Multiple Instance Learning for Computer Aided Diagnosis
Fung, G., Dündar, M., Krishnapuram, B., & Rao, R. B. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0058 · Cited by 117
Image Annotation by Graph-Based Inference With Integrated Multiple/Single Instance Representations
Tang, J., Li, H., Qi, G.-J., & Chua, T. (2009) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2009.2037373 · Cited by 114
A multiple-instance learning framework for diabetic retinopathy screening
Quellec, G., Lamard, M., Abràmoff, M. D., Decencière, É., Laÿ, B., Erginay, A., Cochener, B., & Cazuguel, G. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.06.003 · Cited by 105
A Multiple Instance Learning Strategy for Combating Good Word Attacks on Spam Filters
Jorgensen, Z., Zhou, Y., & Inge, M. (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1390719 · Cited by 81
MILD: Multiple-Instance Learning via Disambiguation
Li, W.-J., & Yeung, D. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.58 · Cited by 77
Shi, F., Xia, L., Shan, F., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.09860 · Cited by 63
Robust Screening of COVID-19 from Chest X-ray via Discriminative Cost-Sensitive LearningPreprint
Li, T., Han, Z., Wei, B., Zheng, Y., Hong, Y., & Cong, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12592 · Cited by 59
Self-citationClassification of COPD with Multiple Instance Learning
Cheplygina, V., Sorensen, L., Tax, D. M. J., Pedersen, J. H., Loog, M., & de Bruijne, M. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.268 · Cited by 49
Explicit Document Modeling through Weighted Multiple-Instance Learning
Pappas, N., & Popescu-Belis, A. (2017) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5240 · Cited by 45
Confidence-Rated Multiple Instance Boosting for Object Detection
Ali, K., & Saenko, K. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.312 · Cited by 38
Computer-Aided Endoscopic Diagnosis Without Human-Specific Labeling
Wang, S., Cong, Y., Fan, H., Liu, L., Li, X., Yang, Y., Tang, Y., Zhao, H., & Yu, H. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2530141 · Cited by 24
Cited by
Roberts, M., Driggs, D., Thorpe, M., Gilbey, J., Yeung, M., Ursprung, S., Aviles-Rivero, A. I., Etmann, C., McCague, C., Beer, L., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00307-0 · Cited by 1,044
Self-citationRoberts, M. T., Driggs, D., Thorpe, M., Gilbey, J., Yeung, M., Ursprung, S., Avilés-Rivero, A. I., Etmann, C., McCague, C., Beer, L., et al. (2020) · Apollo (University of Cambridge) · doi:10.17863/cam.64000 · Cited by 895
Self-citationDevelopment and evaluation of an artificial intelligence system for COVID-19 diagnosis
Jin, C., Chen, W., Cao, Y., Xu, Z., Tan, Z., Zhang, X., Deng, L., Zheng, C., Zhou, J., Shi, H., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18685-1 · Cited by 592
AI4COVID-19: AI enabled preliminary diagnosis for COVID-19 from cough samples via an app
Imran, A., Posokhova, I., Qureshi, H. N., Masood, U., Riaz, M. S., Ali, K., John, C. N., Hussain, M. I., & Nabeel, M. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100378 · Cited by 621
Using artificial intelligence to improve public health: a narrative review
Olawade, D. B., Wada, O. J., David-Olawade, A. C., Kunonga, E., Abaire, O., & Ling, J. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1196397 · Cited by 274
Metadata
- Authors
- Han, Z., Wei, B., Hong, Y., Li, T., Cong, J., Zhu, X., Wei, H., & Zhang, W.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2020-08
- Volume
- 39
- Issue
- 8
- Pages
- 2584-2594
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W3026931681
- Cited by
- 325
- References
- 52
- FWCI
- 28.24
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.