The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Toward data‐efficient learning: A benchmark for COVID‐19 CT lung and infection segmentation
Open accessAbstract
Purpose: Accurate segmentation of lung and infection in COVID‐19 computed tomography (CT) scans plays an important role in the quantitative management of patients. Most of the existing studies are based on large and private annotated datasets that are impractical to obtain from a single institution, especially when radiologists are busy fighting the coronavirus disease. Furthermore, it is hard to compare current COVID‐19 CT segmentation methods as they are developed on different datasets, trained in different settings, and evaluated with different metrics. Methods: To promote the development of data‐efficient deep learning methods, in this paper, we built three benchmarks for lung and infection segmentation based on 70 annotated COVID‐19 cases, which contain current active research areas, for example, few‐shot learning, domain generalization, and knowledge transfer. For a fair comparison among different segmentation methods, we also provide standard training, validation and testing splits, evaluation metrics and, the corresponding code. Results: Based on the state‐of‐the‐art network, we provide more than 40 pretrained baseline models, which not only serve as out‐of‐the‐box segmentation tools but also save computational time for researchers who are interested in COVID‐19 lung and infection segmentation. We achieve average dice similarity coefficient (DSC) scores of 97.3%, 97.7%, and 67.3% and average normalized surface dice (NSD) scores of 90.6%, 91.4%, and 70.0% for left lung, right lung, and infection, respectively. Conclusions: To the best of our knowledge, this work presents the first data‐efficient learning benchmark for medical image segmentation, and the largest number of pretrained models up to now. All these resources are publicly available, and our work lays the foundation for promoting the development of deep learning methods for efficient COVID‐19 CT segmentation with limited data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132
The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
Clark, K., Vendt, B., Smith, K., Freymann, J., Kirby, J., Koppel, P., Moore, S., Phillips, S., Maffitt, D., Pringle, M., et al. (2013) · Journal of Digital Imaging · doi:10.1007/s10278-013-9622-7 · Cited by 4,599
Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR
Fang, Y., Zhang, H., Xie, J., Lin, M., Ying, L., Pang, P., & Ji, W. (2020) · Radiology · doi:10.1148/radiol.2020200432 · Cited by 3,354
Projecting the transmission dynamics of SARS-CoV-2 through the postpandemic period
Kissler, S. M., Tedijanto, C., Goldstein, E., Grad, Y. H., & Lipsitch, M. (2020) · Science · doi:10.1126/science.abb5793 · Cited by 2,611
Li, L., Qin, L., Xu, Z., Yin, Y., Wang, X., Kong, B., Bai, J., Lu, Y., Fang, Z., Song, Q., et al. (2020) · Radiology · doi:10.1148/radiol.2020200905 · Cited by 1,927
A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19)
Wang, S., Kang, B., Ma, J., Zeng, X., Xiao, M., Guo, J., Cai, M., Yang, J., Li, Y., Meng, X., et al. (2021) · European Radiology · doi:10.1007/s00330-021-07715-1 · Cited by 1,677
Self-citationThe Liver Tumor Segmentation Benchmark (LiTS)
Bilic, P., Christ, P., Li, H. B., Vorontsov, E., Ben-Cohen, A., Kaissis, G., Szeskin, A., Jacobs, C., Mamani, G. E. H., Chartrand, G., et al. (2019) · arXiv · doi:10.48550/arxiv.1901.04056 · Cited by 1,412
Self-citationShi, F., Wang, J., Shi, J., Wu, Z., Wang, Q., Tang, Z., He, K., Shi, Y., & Shen, D. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.2987975 · Cited by 1,404
Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images
Fan, D.-P., Zhou, T., Ji, G.-P., Zhou, Y., Chen, G., Fu, H., Shen, J., & Shao, L. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2996645 · Cited by 1,259
A Weakly-Supervised Framework for COVID-19 Classification and Lesion Localization From Chest CT
Wang, X., Deng, X., Fu, Q., Zhou, Q., Feng, J., Ma, H., Liu, W., & Zheng, C. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2995965 · Cited by 1,243
Zhang, K., Liu, X., Shen, J., Li, Z., Sang, Y., Wu, X., Zha, Y., Liang, W., Wang, C., Wang, K., et al. (2020) · Cell · doi:10.1016/j.cell.2020.04.045 · Cited by 917 · cited 2×
“Large-scale data remedies of lung and infection segmentation have been well studied [12], [13].”
BackgroundMethodSelf-citationAmyar, A., Modzelewski, R., Li, H., & Ruan, S. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104037 · Cited by 612
Chen, C., Dou, Q., Chen, H., Qin, J., & Heng, P. A. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2972701 · Cited by 441
Episodic Training for Domain Generalization
Li, D., Zhang, J., Yang, Y., Liu, C., Song, Y.-Z., & Hospedales, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00153 · Cited by 435
Serial Quantitative Chest CT Assessment of COVID-19: A Deep Learning Approach
Huang, L., Han, R., Ai, T., Yu, P., Kang, H., Tao, Q., & Xia, L. (2020) · Radiology: Cardiothoracic Imaging · doi:10.1148/ryct.2020200075 · Cited by 431
Data Augmentation Using Learned Transformations for One-Shot Medical Image Segmentation
Zhao, A., Balakrishnan, G., Durand, F., Guttag, J. V., & Dalca, A. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00874 · Cited by 430
MosMedData: data set of 1110 chest CT scans performed during the COVID-19 epidemic
Morozov, S. P., Andreychenko, A. E., Blokhin, I. A., Gelezhe, P. B., Gonchar, A. P., Nikolaev, A. E., Pavlov, N. A., Chernina, V. Y., & Gombolevskiy, V. A. (2020) · Digital Diagnostics · doi:10.17816/dd46826 · Cited by 391
Domain Generalization via Model-Agnostic Learning of Semantic Features
Dou, Q., Castro, D. C., Kamnitsas, K., & Glocker, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13580 · Cited by 381
Oudkerk, M., Büller, H. R., Kuijpers, D., van Es, N., Oudkerk, S. F., McLoud, T., Gommers, D., van Dissel, J., ten Cate, H., & van Beek, E. J. R. (2020) · Radiology · doi:10.1148/radiol.2020201629 · Cited by 343
Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysis
Zhou, Z., Sodha, V., Rahman Siddiquee, M. M., Feng, R., Tajbakhsh, N., Gotway, M. B., & Liang, J. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32251-9_42 · Cited by 327
MS-Net: Multi-Site Network for Improving Prostate Segmentation With Heterogeneous MRI Data
Liu, Q., Dou, Q., Yu, L., & Heng, P. A. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2974574 · Cited by 308
COVID-19 CT Lung and Infection Segmentation Dataset
Ma, J., Cheng, G., Wang, Y., An, X., Gao, J., Yu, Z., Zhang, M., Liu, X., Xueyuan, D., Cao, S., et al. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3757475 · Cited by 225
Self-citationZhang, K., Liu, X., Shen, J., Li, Z., Sang, Y., Wu, X., Zha, Y., Liang, W., Wang, C., Wang, K., et al. (2020) · Cell · doi:10.1016/j.cell.2020.08.029 · Cited by 218
Self-citation‘Squeeze & excite’ guided few-shot segmentation of volumetric images
Guha Roy, A., Siddiqui, S., Pölsterl, S., Navab, N., & Wachinger, C. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101587 · Cited by 166
Foust, A. M., Phillips, G. S., Chu, C. W., Daltro, P. A. N., Das, K. M., García‐Peña, P., Kilborn, T., Winant, A. J., & Lee, E. Y. (2020) · Radiology Cardiothoracic Imaging · doi:10.1148/ryct.2020200214 · Cited by 137
Cao, Y., Xu, Z., Feng, J., Jin, C., Han, X., Wu, H., & Shi, H. (2020) · Radiology Cardiothoracic Imaging · doi:10.1148/ryct.2020200082 · Cited by 106
Automatic Data Augmentation for 3D Medical Image Segmentation
Xu, J., Li, M., & Zhu, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59710-8_37 · Cited by 93
Domain Adaptation and Representation Transfer, and Distributed and Collaborative Learning
(2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60548-3 · Cited by 59
Data augmentation using learned transformations for one-shot medical image segmentationPreprint
Zhao, A. T., Balakrishnan, G., Durand, F., Guttag, J. V., & Dalca, A. V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09383 · Cited by 54
Kiser, K. J., Ahmed, S., Stieb, S., Mohamed, A., Elhalawani, H. M., Park, P. Y. S., Doyle, N. S., Wang, B. J., Barman, A., Zhao, L., et al. (2020) · Medical Physics · doi:10.1002/mp.14424 · Cited by 51
Domain Generalizer: A Few-Shot Meta Learning Framework for Domain Generalization in Medical Imaging
Khandelwal, P., & Yushkevich, P. A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60548-3_8 · Cited by 46
Mazzone, P. J., Gould, M. K., Arenberg, D. A., et al. (2020) · Radiology Imaging Cancer · doi:10.1148/rycan.2020204013 · Cited by 44
Wang, Y., Lu, X., Zhang, Y., Zhang, X., Wang, K., Liu, J., Li, X., Hu, R., Meng, X., Dou, S., et al. (2020) · EBioMedicine · doi:10.1016/j.ebiom.2020.102724 · Cited by 37
Self-citationAnnotation-Free Cardiac Vessel Segmentation via Knowledge Transfer from Retinal Images
Yu, F., Zhao, J., Gong, Y., Wang, Z., Li, Y., Yang, F., Dong, B., Li, Q., & Zhang, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32245-8_79 · Cited by 35
Coronavirus Disease 2019 Deep Learning Models: Methodologic Considerations
D'addario, A. M. V., de Paiva, J. P. Q., Chate, R. C., Machado, B. S., & Szarf, G. (2020) · Radiology · doi:10.1148/radiol.2020201178 · Cited by 35
Cited by
Jiao, R., Zhang, Y., Ding, L., Xue, B., Zhang, J., Cai, R., & Jin, C. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107840 · Cited by 345
Dou, Q., So, T. Y., Jiang, M., Liu, Q., Vardhanabhuti, V., Kaissis, G., Li, Z., Si, W., Lee, H. H. C., Yu, K., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00431-6 · Cited by 278
A systematic review on AI/ML approaches against COVID-19 outbreak
Dogan, O., Tiwari, S., Jabbar, M. A., & Guggari, S. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00424-8 · Cited by 87
Metadata
- Authors
- Ma, J., Wang, Y., An, X., Ge, C., Yu, Z., Chen, J., Zhu, Q., Dong, G., He, J., He, Z., Cao, T., Zhu, Y., Nie, Z., & Yang, X.
- Venue
- Medical Physics
- Publisher
- Wiley
- Published
- 2021-02-06
- Volume
- 48
- Issue
- 3
- Pages
- 1197-1210
- ISSN
- 0094-2405 (ISSN-L)
- 2473-4209
- OpenAlex
- W3108591672
- Cited by
- 261
- References
- 41
- FWCI
- 16.81
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.