The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation
Open accessAbstract
A common shortfall of supervised deep learning for medical imaging is the lack of labeled data, which is often expensive and time consuming to collect. This article presents a new semisupervised method for medical image segmentation, where the network is optimized by a weighted combination of a common supervised loss only for the labeled inputs and a regularization loss for both the labeled and unlabeled data. To utilize the unlabeled data, our method encourages consistent predictions of the network-in-training for the same input under different perturbations. With the semisupervised segmentation tasks, we introduce a transformation-consistent strategy in the self-ensembling model to enhance the regularization effect for pixel-level predictions. To further improve the regularization effects, we extend the transformation in a more generalized form including scaling and optimize the consistency loss with a teacher model, which is an averaging of the student model weights. We extensively validated the proposed semisupervised method on three typical yet challenging medical image segmentation tasks: 1) skin lesion segmentation from dermoscopy images in the International Skin Imaging Collaboration (ISIC) 2017 data set; 2) optic disk (OD) segmentation from fundus images in the Retinal Fundus Glaucoma Challenge (REFUGE) data set; and 3) liver segmentation from volumetric CT scans in the Liver Tumor Segmentation Challenge (LiTS) data set. Compared with state-of-the-art, our method shows superior performance on the challenging 2-D/3-D medical images, demonstrating the effectiveness of our semisupervised method for medical image segmentation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931
(2017) · Cited by 11,625
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Tarvainen, A., & Valpola, H. (2017) · arXiv · doi:10.48550/arxiv.1703.01780 · Cited by 4,275
Product Quantization for Nearest Neighbor Search
Jégou, H., Douze, M., & Schmid, C. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.57 · Cited by 2,956 · cited 2×
“4) Implementation of π operation: Multi-scale ensembling is shown to be effective for image recognition [25–27].”
BackgroundMethodAutoAugment: Learning Augmentation Strategies From Data
Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00020 · Cited by 2,733
Albumentations: fast and flexible image augmentations
Buslaev, A., Iglovikov, V. I., Khvedchenya, E., Parinov, A., Druzhinin, M., & Kalinin, A. A. (2020) · Information · doi:10.3390/info11020125 · Cited by 2,714
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620
H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes
Li, X., Chen, H., Qi, X., Dou, Q., Fu, C.-W., & Heng, P.-A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2845918 · Cited by 2,473
Self-citationStatistical shape models for 3D medical image segmentation: A review
Heimann, T., & Meinzer, H.-P. (2009) · Medical Image Analysis · doi:10.1016/j.media.2009.05.004 · Cited by 1,417
The Liver Tumor Segmentation Benchmark (LiTS)
Bilic, P., Christ, P., Li, H. B., Vorontsov, E., Ben-Cohen, A., Kaissis, G., Szeskin, A., Jacobs, C., Mamani, G. E. H., Chartrand, G., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2022.102680 · Cited by 1,412
Self-citationThe Liver Tumor Segmentation Benchmark (LiTS)
Bilic, P., Christ, P., Li, H. B., Vorontsov, E., Ben-Cohen, A., Kaissis, G., Szeskin, A., Jacobs, C., Mamani, G. E. H., Chartrand, G., et al. (2019) · arXiv · doi:10.48550/arxiv.1901.04056 · Cited by 1,412
Self-citationTemporal Ensembling for Semi-Supervised Learning
Laine, S., & Aila, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02242 · Cited by 1,395
(2011) · Validated Numerics · doi:10.2307/j.ctvcm4g18.8 · Cited by 1,187
Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks
Yu, L., Chen, H., Dou, Q., Qin, J., & Heng, P.-A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2642839 · Cited by 1,140
Self-citationOrlando, J. I., Fu, H., Barbosa Breda, J., van Keer, K., Bathula, D. R., Diaz-Pinto, A., Fang, R., Heng, P.-A., Kim, J., Lee, J., et al. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101570 · Cited by 855
Self-citationRealistic Evaluation of Deep Semi-Supervised Learning Algorithms
Oliver, A., Odena, A., Raffel, C., Cubuk, E. D., & Goodfellow, I. J. (2018) · arXiv · doi:10.48550/arxiv.1804.09170 · Cited by 772
Applications of deep learning and reinforcement learning to biological data
Mahmud, M., Kaiser, M. S., Hussain, A., & Vassanelli, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2790388 · Cited by 765
Automatic skin lesion segmentation using deep fully convolutional networks with jaccard distance.
Yuan, Y., Chao, M., & Lo, Y.-C. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2695227 · Cited by 687
Superpixel Classification Based Optic Disc and Optic Cup Segmentation for Glaucoma Screening
Cheng, J., Liu, J., Xu, Y., Yin, F., Wong, D. W. K., Tan, N.-M., Tao, D., Cheng, C.-Y., Aung, T., & Wong, T. Y. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2247770 · Cited by 593
Harmonic Networks: Deep Translation and Rotation Equivariance
Worrall, D. E., Garbin, S. J., Turmukhambetov, D., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.758 · Cited by 563
Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learning
Sajjadi, M. S. M., Javanmardi, M., & Taşdizen, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04586 · Cited by 532
Group Equivariant Convolutional Networks
Cohen, T., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07576 · Cited by 524
Unsupervised Domain Adaptation in Brain Lesion Segmentation with Adversarial Networks
Kamnitsas, K., Baumgartner, C., Ledig, C., Newcombe, V., Simpson, J., Kane, A., Menon, D., Nori, A., Criminisi, A., Rueckert, D., et al. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_47 · Cited by 468
Weakly-supervised convolutional neural networks for multimodal image registration
Hu, Y., Modat, M., Gibson, E., Li, W., Ghavami, N., Bonmati, E., Wang, G., Bandula, S., Moore, C. M., Emberton, M., et al. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.07.002 · Cited by 458
Seo, H., Huang, C., Bassenne, M., Xiao, R., & Xing, L. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2948320 · Cited by 431
Self-citationSemi-supervised Learning for Network-Based Cardiac MR Image Segmentation
Bai, W., Oktay, O., Sinclair, M., Suzuki, H., Rajchl, M., Tarroni, G., Glocker, B., King, A., Matthews, P. M., & Rueckert, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66185-8_29 · Cited by 416
Disc-Aware Ensemble Network for Glaucoma Screening From Fundus Image
Fu, H., Cheng, J., Xu, Y., Zhang, C., Wong, D. W. K., Liu, J., & Cao, X. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2837012 · Cited by 394
Segmentation of retinal blood vessels using the radial projection and semi-supervised approach
You, X., Peng, Q., Yuan, Y., Cheung, Y.-M., & Lei, J. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.01.007 · Cited by 387
Deep Adversarial Networks for Biomedical Image Segmentation Utilizing Unannotated Images
Zhang, Y., Yang, L., Chen, J., Fredericksen, M., Hughes, D. P., & Chen, D. Z. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_47 · Cited by 379
Adversarial Learning for Semi-Supervised Semantic Segmentation
Hung, W.-C., Tsai, Y., Liou, Y.-T., Lin, Y., & Yang, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.07934 · Cited by 358
Fast AutoAugmentPreprint
Lim, S., Kim, I., Kim, T., Kim, C., & Kim, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.00397 · Cited by 290
Automatic 3D liver location and segmentation via convolutional neural network and graph cut
Lu, F., Wu, F., Hu, P., Peng, Z., & Kong, D. (2017) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-016-1467-3 · Cited by 284 · cited 1×
“Deep learning methods showed promising results on skin lesion segmentation, optic disc segmentation, and liver segmentation [44–48].”
MethodExploiting Cyclic Symmetry in Convolutional Neural NetworksPreprint
Dieleman, S., Fauw, J. D., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02660 · Cited by 283
Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Training
Mahmood, F., Chen, R., & Durr, N. J. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2842767 · Cited by 257 · cited 1×
“The lack of the labeled data motivates the study of methods that can be trained with limited supervision, such as semisupervised learning [4]–[6], weakly supervised learning [7]–[9], and unsupervised domain adaptation [10]–[12].”
BackgroundChlebus, G., Schenk, A., Moltz, J. H., van Ginneken, B., Hahn, H. K., & Meine, H. (2018) · Scientific Reports · doi:10.1038/s41598-018-33860-7 · Cited by 252
Tan, J. H., Acharya, U. R., Bhandary, S. V., Chua, K. C., & Sivaprasad, S. (2017) · Journal of Computational Science · doi:10.1016/j.jocs.2017.02.006 · Cited by 243
ASDNet: Attention Based Semi-supervised Deep Networks for Medical Image Segmentation
Nie, D., Gao, Y., Wang, L., & Shen, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00937-3_43 · Cited by 240
Abra`moff, M. D., Alward, W. L. M., Greenlee, E. C., Shuba, L., Kim, C. Y., Fingert, J. H., & Kwon, Y. H. (2007) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.06-1081 · Cited by 236
Semi-Supervised 3D Abdominal Multi-Organ Segmentation Via Deep Multi-Planar Co-Training
Zhou, Y., Wang, Y., Tang, P., Bai, S., Shen, W., Fishman, E. K., & Yuille, A. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00020 · Cited by 211
Automatic Liver Segmentation Using an Adversarial Image-to-Image Network
Yang, D., Xu, D., Zhou, S. K., Georgescu, B., Chen, M., Grbic, S., Metaxas, D., & Comaniciu, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_58 · Cited by 209
Lesion Border Detection in Dermoscopy Images Using Ensembles of Thresholding Methods
Emre Celebi, M., Wen, Q., Hwang, S., Iyatomi, H., & Schaefer, G. (2013) · Skin Research and Technology · doi:10.1111/j.1600-0846.2012.00636.x · Cited by 204
Improving Dermoscopic Image Segmentation With Enhanced Convolutional-Deconvolutional Networks
Yuan, Y., & Lo, Y.-C. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2787487 · Cited by 194
Kohli, M. D., Summers, R. M., & Geis, J. R. (2017) · Journal of Digital Imaging · doi:10.1007/s10278-017-9976-3 · Cited by 193
3D Semi-Supervised Learning with Uncertainty-Aware Multi-View Co-Training
Xia, Y., Liu, F., Yang, D., Cai, J., Yu, L., Zhu, Z., Xu, D., Yuille, A., & Roth, H. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093608 · Cited by 170
Self-citationDiscriminative Localization in CNNs for Weakly-Supervised Segmentation of Pulmonary Nodules
Feng, X., Yang, J., Laine, A. F., & Angelini, E. D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_65 · Cited by 168
Automatic Skin Lesion Analysis using Large-scale Dermoscopy Images and Deep Residual Networks
Bi, L., Kim, J., Ahn, E., & Feng, D. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04197 · Cited by 164
Weakly-supervised localization of diabetic retinopathy lesions in retinal fundus images
Gondal, W. M., Köhler, J. M., Grzeszick, R., Fink, G. A., & Hirsch, M. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296646 · Cited by 162
Semi-supervised Skin Lesion Segmentation via Transformation Consistent Self-ensembling ModelPreprint
Li, X., Yu, L., Chen, H., Fu, C., & Heng, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.03887 · Cited by 146
Self-citationSelf-supervised learning model for skin cancer diagnosis
Masood, A., Al-Jumaily, A. A., & Anam, K. (2015) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2015.7146798 · Cited by 106
Semi-supervised clustering for MR brain image segmentation
Portela, N. M., Cavalcanti, G. D. C., & Ren, T. I. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.046 · Cited by 92
Unsupervised Domain Adaptation for Automatic Estimation of Cardiothoracic Ratio
Dong, N., Kampffmeyer, M., Liang, X., Wang, Z., Dai, W., & Xing, E. P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_61 · Cited by 84
Factorised Spatial Representation Learning: Application in Semi-supervised Myocardial Segmentation
Chartsias, A., Joyce, T., Papanastasiou, G., Semple, S., Williams, M., Newby, D., Dharmakumar, R., & Tsaftaris, S. A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00934-2_55 · Cited by 75
ISIC 2017 - Skin Lesion Analysis Towards Melanoma DetectionPreprint
Berseth, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00523 · Cited by 75
Deep Semi-supervised Segmentation with Weight-Averaged Consistency Targets
Perone, C. S., & Cohen‐Adad, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00889-5_2 · Cited by 72
Semi-supervised Segmentation of Optic Cup in Retinal Fundus Images Using Variational Autoencoder
Sedai, S., Mahapatra, D., Hewavitharanage, S., Maetschke, S., & Garnavi, R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66185-8_9 · Cited by 69
Nie, D., Wang, L., Gao, Y., Lian, J., & Shen, D. G. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2870182 · Cited by 64
A Deep Residual Architecture for Skin Lesion Segmentation
Venkatesh, G. M., Naresh, Y. G., Little, S., & O'Connor, N. E. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01201-4_30 · Cited by 63
Semi-supervised Learning for Segmentation Under Semantic Constraint
Ganaye, P.-A., Sdika, M., & Benoit-Cattin, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00931-1_68 · Cited by 51
Semi-supervised Learning for Biomedical Image Segmentation via Forest Oriented Super Pixels(Voxels)
Gu, L., Zheng, Y., Bise, R., Sato, I., Imanishi, N., & Aiso, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66182-7_80 · Cited by 50
Deeply Supervised Rotation Equivariant Network for Lesion Segmentation in Dermoscopy Images
Li, X., Yu, L., Fu, C., & Heng, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01201-4_25 · Cited by 28
Self-citation
Cited by
Recent advances and clinical applications of deep learning in medical image analysis
Chen, X., Wang, X., Zhang, K., Fung, K.-M., Thai, T. C., Moore, K., Mannel, R. S., Liu, H., Zheng, B., & Qiu, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102444 · Cited by 1,080
Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation
Tajbakhsh, N., Jeyaseelan, L., Li, Q., Chiang, J. N., Wu, Z., & Ding, X. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101693 · Cited by 1,095
“Liskowski and Krawiec (2016) apply gamma correction of saturation and value of the HSV color space prior to segmenting retinal blood vessels.”
BackgroundResultInfluentialMedical image segmentation using deep learning: A survey
Wang, R., Lei, T., Cui, R., Zhang, B., Meng, H., & Nandi, A. K. (2022) · IET Image Processing · doi:10.1049/ipr2.12419 · Cited by 892
Deep semantic segmentation of natural and medical images: a review
Asgari Taghanaki, S., Abhishek, K., Cohen, J. P., Cohen-Adad, J., & Hamarneh, G. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09854-1 · Cited by 870
Semi-supervised Medical Image Segmentation through Dual-task Consistency
Luo, X., Chen, J., Song, T., & Wang, G. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17066 · Cited by 684
Metadata
- Authors
- Li, X., Yu, L., Chen, H., Fu, C.-W., Xing, L., & Heng, P.-A.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2021-02
- Volume
- 32
- Issue
- 2
- Pages
- 523-534
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W3031923721
- Cited by
- 543
- References
- 66
- FWCI
- 28.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.