The DOI matches its Crossref record; 125 of the 125 references it cites were found in a registry or an index.
Medical Image Segmentation Review: The Success of U-Net
Open accessAbstract
Automatic medical image segmentation is a crucial topic in the medical domain and successively a critical counterpart in the computer-aided diagnosis paradigm. U-Net is the most widespread image segmentation architecture due to its flexibility, optimized modular design, and success in all medical image modalities. Over the years, the U-Net model has received tremendous attention from academic and industrial researchers who have extended it to address the scale and complexity created by medical tasks. These extensions are commonly related to enhancing the U-Net's backbone, bottleneck, or skip connections, or including representation learning, or combining it with a Transformer architecture, or even addressing probabilistic prediction of the segmentation map. Having a compendium of different previously proposed U-Net variants makes it easier for machine learning researchers to identify relevant research questions and understand the challenges of the biological tasks that challenge the model. In this work, we discuss the practical aspects of the U-Net model and organize each variant model into a taxonomy. Moreover, to measure the performance of these strategies in a clinical application, we propose fair evaluations of some unique and famous designs on well-known datasets. Furthermore, we provide a comprehensive implementation library with trained models. In addition, for ease of future studies, we created an online list of U-Net papers with their possible official implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
NIH Image to ImageJ: 25 years of image analysis
Schneider, C. A., Rasband, W. S., & Eliceiri, K. W. (2012) · Nature Methods · doi:10.1038/nmeth.2089 · Cited by 64,638
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931 · cited 4×
“• Converges to lower loss [62] • Addressing gradient vanishing [121] • Faster convergence rate [60] • Feature reusability [61] • Multi-scale encoding [15] • Better boundary representation [123] • Fine-grained feature set [125] • Cross-modality representation [62] • Reducing computation burden of multi-scale representa…”
BackgroundMethodResultInfluentialUNet++: A Nested U-Net Architecture for Medical Image Segmentation
Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N., & Liang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_1 · Cited by 9,610
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513 · cited 4×
“[126] and should adapt the receptive fields to adjust optimally to different shapes and scales of complicated vessel structures in the input features.”
BackgroundMethodInfluentialThe multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Swin-Unet: Unet-like pure transformer for medical image segmentation
Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., & Wang, M. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-25066-8_9 · Cited by 5,640
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions
Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., & Shao, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00061 · Cited by 5,259 · cited 2×
“However, the local contextual information plays a pivotal role in high-resolutionvisiontasks,therefore,somestudiesinthevision Transfomerdomaintacklethisproblembyembeddingconvo-lutionoperationsintheirattentionmodule,e.g.,PVTv1[122], PVTv2[123],andUformer[124].”
UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation
Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N., & Liang, J. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2959609 · Cited by 4,402
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206 · cited 12×
“TransUNet[34]suffersfromparametersoverload withinMHSA,whichtreatsallimagetokenizationpositions equally.”
BackgroundMethodResultInfluentialSelf-citationImage segmentation using deep learning: A survey
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059968 · Cited by 3,796
UNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H. R., & Xu, D. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00181 · Cited by 3,586 · cited 7×
“UNETR [116] is a 3D segmentation network that directly utilizes volumetric data incorporating ViT solely at the encoder stage to capture global multi-scale contextual information in a 3D volumetric style which is usually of paramount importance in medical image segmentation domain.”
BackgroundMethodInfluentialUNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H., & Xu, D. (2021) · arXiv · doi:10.48550/arxiv.2103.10504 · Cited by 3,580
Road Extraction by Deep Residual U-Net
Zhang, Z., Liu, Q., & Wang, Y. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2802944 · Cited by 3,179 · cited 3×
“Residual U-Net [173], even with the Residual enhancements, is no exception to this rule.”
BackgroundMethodCancer and Radiation Therapy: Current Advances and Future Directions
Baskar, R., Lee, K. A., Yeo, R., & Yeoh, K.-W. (2012) · International Journal of Medical Sciences · doi:10.7150/ijms.3635 · Cited by 2,880
UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation
Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.-W., & Wu, J. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053405 · Cited by 2,774
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes
Li, X., Chen, H., Qi, X., Dou, Q., Fu, C.-W., & Heng, P.-A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2845918 · Cited by 2,473
Pvt v2: Improved baselines with pyramid vision transformer
Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., & Shao, L. (2022) · Computational Visual Media · doi:10.1007/s41095-022-0274-8 · Cited by 2,439 · cited 2×
“However, the local contextual information plays a pivotal role in high-resolutionvisiontasks,therefore,somestudiesinthevision Transfomerdomaintacklethisproblembyembeddingconvo-lutionoperationsintheirattentionmodule,e.g.,PVTv1[122], PVTv2[123],andUformer[124].”
Bernard, O., Lalande, A., Zotti, C., Cervenansky, F., Yang, X., Heng, P.-A., Cetin, I., Lekadir, K., Camara, O., Gonzalez Ballester, M. A., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2837502 · Cited by 2,431
MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentation
Ibtehaz, N., & Rahman, M. S. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.08.025 · Cited by 2,311
Uformer: A General U-Shaped Transformer for Image Restoration
Wang, Z., Cun, X., Bao, J., Zhou, W., Liu, J., & Li, H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01716 · Cited by 2,274
Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images
Hatamizadeh, A., Nath, V., Tang, Y., Yang, D., Roth, H. R., & Xu, D. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-08999-2_22 · Cited by 2,273
U-Net and Its Variants for Medical Image Segmentation: A Review of Theory and Applications
Siddique, N., Paheding, S., Elkin, C. P., & Devabhaktuni, V. (2021) · IEEE Access · doi:10.1109/access.2021.3086020 · Cited by 1,960
Bakas, S., Reyes, M., Jakab, A., Bauer, S., Rempfler, M., Crimi, A., Shinohara, R. T., Berger, C., Ha, S. M., Rozycki, M., et al. (2018) · Apollo - University of Cambridge Repository · doi:10.17863/cam.38755 · Cited by 1,441
Self-citationThe Medical Segmentation Decathlon
Antonelli, M., Reinke, A., Bakas, S., Farahani, K., Kopp-Schneider, A., Landman, B. A., Litjens, G., Menze, B., Ronneberger, O., Summers, R. M., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-30695-9 · Cited by 1,384
Self-citationMedical Transformer: Gated Axial-Attention for Medical Image Segmentation
Valanarasu, J. M. J., Oza, P., Hacihaliloglu, I., & Patel, V. M. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_4 · Cited by 1,248
Pattern Recognition and Machine Learning
(1971) · Springer eBooks · doi:10.1007/978-1-4615-7566-5 · Cited by 1,144
Wang, H., Cao, P., Wang, J., & Zaiane, O. R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20144 · Cited by 1,111
TransBTS: Multimodal Brain Tumor Segmentation Using Transformer
Wang, W., Chen, C., Ding, M., Yu, H., Zha, S., & Li, J. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_11 · Cited by 1,045
The Importance of Skip Connections in Biomedical Image Segmentation
Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., & Pal, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_19 · Cited by 984
Recurrent convolutional neural network for object recognition
Liang, M., & Hu, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298958 · Cited by 976
A Novel Focal Tversky Loss Function With Improved Attention U-Net for Lesion Segmentation
Abraham, N., & Khan, N. M. (2019) · 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019) · doi:10.1109/isbi.2019.8759329 · Cited by 873
Deep semantic segmentation of natural and medical images: a review
Asgari Taghanaki, S., Abhishek, K., Cohen, J. P., Cohen-Adad, J., & Hamarneh, G. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09854-1 · Cited by 870
Self-citationDUNet: A deformable network for retinal vessel segmentation
Jin, Q., Meng, Z., Pham, T. D., Chen, Q., Wei, L., & Su, R. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.04.025 · Cited by 867
Recurrent residual U-Net for medical image segmentation
Alom, M. Z., Yakopcic, C., Hasan, M., Taha, T. M., & Asari, V. K. (2019) · Journal of Medical Imaging · doi:10.1117/1.jmi.6.1.014006 · Cited by 850
Joint Optic Disc and Cup Segmentation Based on Multi-Label Deep Network and Polar Transformation
Fu, H., Cheng, J., Xu, Y., Wong, D. W. K., Liu, J., & Cao, X. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2791488 · Cited by 834
DoubleU-Net: A Deep Convolutional Neural Network for Medical Image Segmentation
Jha, D., Riegler, M. A., Johansen, D., Halvorsen, P., & Johansen, H. D. (2020) · 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS) · doi:10.1109/cbms49503.2020.00111 · Cited by 819
Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Wang, H., Zhu, Y., Green, B., Adam, H., Yuille, A., & Chen, L.-C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_7 · Cited by 809
Diffusion models in medical imaging: A comprehensive survey
Kazerouni, A., Aghdam, E. K., Heidari, M., Azad, R., Fayyaz, M., Hacihaliloglu, I., & Merhof, D. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102846 · Cited by 765
Self-citationCoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation
Xie, Y., Zhang, J., Shen, C., & Xia, Y. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87199-4_16 · Cited by 653
Simpson, A. L., Antonelli, M., Bakas, S., Bilello, M., Farahani, K., van Ginneken, B., Kopp‐Schneider, A., Landman, B. A., Litjens, G. J. S., Menze, B. H., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09063 · Cited by 643
The Laplacian Pyramid as a Compact Image Code
BURT, P. J., & ADELSON, E. H. (1987) · Readings in Computer Vision · doi:10.1016/b978-0-08-051581-6.50065-9 · Cited by 555
Fully Dense UNet for 2-D Sparse Photoacoustic Tomography Artifact Removal
Guan, S., Khan, A. A., Sikdar, S., & Chitnis, P. V. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2912935 · Cited by 538
Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge
Isensee, F., Kickingereder, P., Wick, W., Bendszus, M., & Maier-Hein, K. H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-75238-9_25 · Cited by 527
INet: Convolutional Networks for Biomedical Image Segmentation
Weng, W., & Zhu, X. (2021) · IEEE Access · doi:10.1109/access.2021.3053408 · Cited by 509
Wu, E., Wu, K., Daneshjou, R., Ouyang, D., Ho, D. E., & Zou, J. (2021) · Nature Medicine · doi:10.1038/s41591-021-01312-x · Cited by 494
MA-Net: A Multi-Scale Attention Network for Liver and Tumor Segmentation
Fan, T., Wang, G., Li, Y., & Wang, H. (2020) · IEEE Access · doi:10.1109/access.2020.3025372 · Cited by 490
Conditional Positional Encodings for Vision Transformers
Chu, X., Tian, Z., Zhang, B., Wang, X., & Shen, C. (2021) · arXiv · doi:10.48550/arxiv.2102.10882 · Cited by 489 · cited 1×
“One of the Transformer’s drawbacks mentioned earlier is their un-suitability for capturing local context [164], [165], which comes with the solution for lessening the computational complexity with patching operation.”
BackgroundAdvances in medical image analysis with vision Transformers: A comprehensive review
Azad, R., Kazerouni, A., Heidari, M., Aghdam, E. K., Molaei, A., Jia, Y., Jose, A., Roy, R., & Merhof, D. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103000 · Cited by 485
Self-citationBi-Directional ConvLSTM U-Net with Densley Connected Convolutions
Azad, R., Asadi-Aghbolaghi, M., Fathy, M., & Escalera, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00052 · Cited by 474
Self-citationA Noise-Robust Framework for Automatic Segmentation of COVID-19 Pneumonia Lesions From CT Images
Wang, G., Liu, X., Li, C., Xu, Z., Ruan, J., Zhu, H., Meng, T., Li, K., Huang, N., & Zhang, S. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3000314 · Cited by 469
RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans
Jin, Q., Meng, Z., Sun, C., Cui, H., & Su, R. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.605132 · Cited by 468
Kickingereder, P., Isensee, F., Tursunova, I., Petersen, J., Neuberger, U., Bonekamp, D., Brugnara, G., Schell, M., Kessler, T., Foltyn, M., et al. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30098-1 · Cited by 454
A probabilistic u-net for segmentation of ambiguous images
Kohl, S. A. A., Romera-Paredes, B., Meyer, C., De Fauw, J., Ledsam, J. R., Maier-Hein, K. H., Eslami, S. M. A., Rezende, D. J., & Ronneberger, O. (2018) · arXiv · doi:10.48550/arxiv.1806.05034 · Cited by 439
End-to-End Adversarial Retinal Image Synthesis
Costa, P., Galdran, A., Meyer, M. I., Niemeijer, M., Abramoff, M., Mendonca, A. M., & Campilho, A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2759102 · Cited by 432
SA-UNet: Spatial Attention U-Net for Retinal Vessel Segmentation
Guo, C., Szemenyei, M., Yi, Y., Wang, W., Chen, B., & Fan, C. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9413346 · Cited by 431
JCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentation
Wu, Y.-H., Gao, S.-H., Mei, J., Xu, J., Fan, D.-P., Zhang, R.-G., & Cheng, M.-M. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3058783 · Cited by 403
Mixed Transformer U-Net for Medical Image Segmentation
Wang, H., Xie, S., Lin, L., Iwamoto, Y., Han, X.-H., Chen, Y.-W., & Tong, R. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9746172 · Cited by 383
Why rankings of biomedical image analysis competitions should be interpreted with care
Maier-Hein, L., Eisenmann, M., Reinke, A., Onogur, S., Stankovic, M., Scholz, P., Arbel, T., Bogunovic, H., Bradley, A. P., Carass, A., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-07619-7 · Cited by 380
LocalViT: Analyzing Locality in Vision Transformers
Li, Y., Zhang, K., Cao, J., Timofte, R., Magno, M., Benini, L., & Van Goo, L. (2023) · 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342025 · Cited by 372
Axial Attention in Multidimensional Transformers
Ho, J., Kalchbrenner, N., Weissenborn, D., & Salimans, T. (2019) · arXiv · doi:10.48550/arxiv.1912.12180 · Cited by 370
Lung Cancer Detection and Classification with 3D Convolutional Neural Network (3D-CNN)
Alakwaa, W., Nassef, M., & Badr, A. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.080853 · Cited by 326
RIC-Unet: An Improved Neural Network Based on Unet for Nuclei Segmentation in Histology Images
Zeng, Z., Xie, W., Zhang, Y., & Lu, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2896920 · Cited by 280
Segmentation Outside the Cranial Vault Challenge
harrigr (2015) · Synapse · doi:10.7303/syn3193805 · Cited by 259
S3D-UNet: Separable 3D U-Net for Brain Tumor Segmentation
Chen, W., Liu, B., Peng, S., Sun, J., & Qiao, X. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11726-9_32 · Cited by 242
Nikolov, S., Blackwell, S., Zverovitch, A., Mendes, R. L., Livne, M., Fauw, J. D., Patel, Y., Meyer, C., Askham, H., Romera‐Paredes, B., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04430 · Cited by 235
Hashemi, S. R., Mohseni Salehi, S. S., Erdogmus, D., Prabhu, S. P., Warfield, S. K., & Gholipour, A. (2019) · IEEE Access · doi:10.1109/access.2018.2886371 · Cited by 212
Brain Tumor Segmentation and Survival Prediction Using 3D Attention UNet
Islam, M., Vibashan, V. S., Jose, V. J. M., Wijethilake, N., Uppal, U., & Ren, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46640-4_25 · Cited by 203
Robust liver vessel extraction using 3D U-Net with variant dice loss function
Huang, Q., Sun, J., Ding, H., Wang, X., & Wang, G. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.08.018 · Cited by 194
Attention Unet++: A Nested Attention-Aware U-Net for Liver CT Image Segmentation
Li, C., Tan, Y., Chen, W., Luo, X., Gao, Y., Jia, X., & Wang, Z. (2020) · 2020 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip40778.2020.9190761 · Cited by 187
Wang, J., Lv, P., Wang, H., & Shi, C. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106268 · Cited by 172
D-former: a U-shaped Dilated Transformer for 3D medical image segmentation
Wu, Y., Liao, K., Chen, J., Wang, J., Chen, D. Z., Gao, H., & Wu, J. (2023) · Neural Computing and Applications · doi:10.1007/s00521-022-07859-1 · Cited by 172
MFP-Unet: A novel deep learning based approach for left ventricle segmentation in echocardiography
Moradi, S., Oghli, M. G., Alizadehasl, A., Shiri, I., Oveisi, N., Oveisi, M., Maleki, M., & Dhooge, J. (2019) · Physica Medica · doi:10.1016/j.ejmp.2019.10.001 · Cited by 164
MISSFormer: An Effective Medical Image Segmentation Transformer
Huang, X., Deng, Z., Li, D., & Yuan, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.07162 · Cited by 163
Huang, H., Xie, S., Lin, L., Iwamoto, Y., Han, X., Chen, Y., & Tong, R. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/135 · Cited by 157
Dense Multi-path U-Net for Ischemic Stroke Lesion Segmentation in Multiple Image Modalities
Dolz, J., Ayed, I. B., & Desrosiers, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11723-8_27 · Cited by 154
Contextual Attention Network: Transformer Meets U-Net
Azad, R., Heidari, M., Wu, Y., & Merhof, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21014-3_39 · Cited by 144
Self-citationCR-Unet: A Composite Network for Ovary and Follicle Segmentation in Ultrasound Images
Li, H., Fang, J., Liu, S., Liang, X., Yang, X., Mai, Z., Manh, V., Wang, T., Chen, Z., & Ni, D. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2946092 · Cited by 142
Capsules for biomedical image segmentation
LaLonde, R., Xu, Z., Irmakci, I., Jain, S., & Bağcı, U. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101889 · Cited by 130
BiO-Net: Learning Recurrent Bi-directional Connections for Encoder-Decoder Architecture
Xiang, T., Zhang, C., Liu, D., Song, Y., Huang, H., & Cai, W. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59710-8_8 · Cited by 117
Mikeljevic, J. S., Haward, R., Johnston, C., Crellin, A. M., Dodwell, D. J., Jones, A., Pisani, P., & Forman, D. (2004) · British Journal of Cancer · doi:10.1038/sj.bjc.6601693 · Cited by 111
SCAU-Net: Spatial-Channel Attention U-Net for Gland Segmentation
Zhao, P., Zhang, J., Fang, W. J., & Deng, S. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.00670 · Cited by 105
End-to-end Res-Unet based reconstruction algorithm for photoacoustic imaging
Feng, J., Deng, J., Li, Z., Sun, Z., Dou, H., & Jia, K. (2020) · Biomedical Optics Express · doi:10.1364/boe.396598 · Cited by 85
Glioma Segmentation with Cascaded UNet
Lachinov, D., Vasiliev, E., & Турлапов, В. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11726-9_17 · Cited by 83
Frid-Adar, M., Ben-Cohen, A., Amer, R., & Greenspan, H. K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00946-5_17 · Cited by 82
GT U-Net: A U-Net Like Group Transformer Network for Tooth Root Segmentation
Li, Y., Wang, S., Wang, J., Zeng, G., Liu, W., Zhang, Q., Jin, Q., & Wang, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87589-3_40 · Cited by 82
Mu-net: Multi-scale U-net for two-photon microscopy image denoising and restoration
Lee, S., Negishi, M., Urakubo, H., Kasai, H., & Ishii, S. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.01.026 · Cited by 80
Fully Convolutional DenseNet with Multiscale Context for Automated Breast Tumor Segmentation
Hai, J., Qiao, K., Chen, J., Tan, H., Jingbo, X., Zeng, L., Shi, D., & Yan, B. (2019) · Journal of Healthcare Engineering · doi:10.1155/2019/8415485 · Cited by 74
Deep Frequency Re-calibration U-Net for Medical Image Segmentation
Azad, R., Bozorgpour, I. A., Asadi-Aghbolaghi, M., Merhof, D., & Escalera, S. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00366 · Cited by 73
Self-citationMicroaneurysms segmentation with a U-Net based on recurrent residual convolutional neural network
Kou, C., Li, W., Liang, W., et al. (2019) · Journal of medical imaging · doi:10.1117/1.jmi.6.2.025008 · Cited by 69
Orlando, J. I., Seebock, P., Bogunovic, H., Klimscha, S., Grechenig, C., Waldstein, S., Gerendas, B. S., & Schmidt-Erfurth, U. (2019) · 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019) · doi:10.1109/isbi.2019.8759581 · Cited by 65
DR-VNet: Retinal Vessel Segmentation via Dense Residual UNet
Karaali, A., Dahyot, R., & Sexton, D. J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-09037-0_17 · Cited by 53
Multi-scale feature pyramid fusion network for medical image segmentation
Zhang, B., Wang, Y., Ding, C., Deng, Z., Li, L., Qin, Z., Ding, Z., Bian, L., & Yang, C. (2022) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-022-02738-5 · Cited by 53
Double U-Net CycleGAN for 3D MR to CT image synthesis
Sun, B., Jia, S., Jiang, X., & Jia, F. (2022) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-022-02732-x · Cited by 51
GP-Unet: Lesion Detection from Weak Labels with a 3D Regression Network
Dubost, F., Bortsova, G., Adams, H. H. H., Ikram, M. A., Niessen, W. J., Vernooij, M. W., & de Bruijne, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_25 · Cited by 49
Improved U-Net Model for Nerve Segmentation
Zhao, H., & Sun, N. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71589-6_43 · Cited by 46
Projective Skip-Connections for Segmentation Along a Subset of Dimensions in Retinal OCT
Lachinov, D., Seeböck, P., Mai, J., Goldbach, F., Schmidt-Erfurth, U. M., & Bogunović, H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_41 · Cited by 44
Medical Image Denoising with Recurrent Residual U-Net (R2U-Net) base Auto-Encoder
Nasrin, S., Alom, M. Z., Burada, R., Taha, T. M., & Asari, V. K. (2019) · IEEE National Aerospace and Electronics Conference (NAECON) · doi:10.1109/naecon46414.2019.9057834 · Cited by 43
3D-UCaps: 3D Capsules Unet for Volumetric Image Segmentation
Nguyen, T., Hua, B., & Le, N. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_52 · Cited by 40
U-Net for SPECT Image Denoising
Reymann, M. P., Würfl, T., Ritt, P., Stimpel, B., Cachovan, M., Vija, A. H., & Maier, A. (2019) · IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC) · doi:10.1109/nss/mic42101.2019.9059879 · Cited by 25
U-Net with Spatial Pyramid Pooling for Drusen Segmentation in Optical Coherence Tomography
Asgari, R., Waldstein, S. M., Schlanitz, F. G., Baratsits, M., Schmidt-Erfurth, U. M., & Bogunović, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32956-3_10 · Cited by 24
Xu, C. G., Zhao, Y., & Liu, C. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.05.055 · Cited by 24
Qiu, D., Cheng, Y., & Wang, X. (2021) · Journal of Radiation Research and Applied Sciences · doi:10.1080/16878507.2021.1973760 · Cited by 23
Brain Tumour Segmentation Using Probabilistic U-Net
Savadikar, C., Kulhalli, R., & Garware, B. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72087-2_22 · Cited by 21
UC-GAN for MR to CT Image Synthesis
Wu, H., Jiang, X., & Jia, F. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32486-5_18 · Cited by 17
Effective Semantic Segmentation of Lung X-Ray Images using U-Net Architecture
Waiker, D., Baghel, P. D., Varma, K. R., & Sahu, S. P. (2020) · International Conference on Computing Methodologies and Communication (ICCMC) · doi:10.1109/iccmc48092.2020.iccmc-000112 · Cited by 15
MFAUNet: Multiscale feature attentive U‐Net for cardiac MRI structural segmentation
Li, D., Peng, Y., Guo, Y., & Sun, J. (2021) · IET Image Processing · doi:10.1049/ipr2.12406 · Cited by 15
ICA-Unet: An improved U-net network for brown adipose tissue segmentation
Wang, H., Wang, Z., Wang, J., Li, K., Geng, G., Kang, F., & Cao, X. (2022) · Journal of Innovative Optical Health Sciences · doi:10.1142/s1793545822500183 · Cited by 15
Fitzke, M., Whitley, D. B., Yau, W., Rodrigues, F. F., Fadeev, V., Bacmeister, C., Carter, C., Edwards, J., Lungren, M. P., & Parkinson, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.07856 · Cited by 14
Dense Dilated UNet: Deep Learning for 3D Photoacoustic Tomography Image ReconstructionPreprint
Guan, S., Hsu, K.-T., Eyassu, M., & Chitnis, P. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.03130 · Cited by 13
Klug, J., Leclerc, G., Dirren, E., Preti, M. G., Ville, D. V. D., & Carrera, E. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72084-1_16 · Cited by 1
Cited by
Advances in medical image analysis with vision Transformers: A comprehensive review
Azad, R., Kazerouni, A., Heidari, M., Aghdam, E. K., Molaei, A., Jia, Y., Jose, A., Roy, R., & Merhof, D. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103000 · Cited by 485
Self-citationDeep Learning for Medical Image-Based Cancer Diagnosis
Jiang, X., Hu, Z., Wang, S., & Zhang, Y. (2023) · Cancers · doi:10.3390/cancers15143608 · Cited by 345
Sun, G., Pan, Y., Kong, W., Xu, Z., Ma, J., Racharak, T., Nguyen, L.-M., & Xin, J. (2024) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2024.1398237 · Cited by 339
Beyond Self-Attention: Deformable Large Kernel Attention for Medical Image Segmentation
Azad, R., Niggemeier, L., Hüttemann, M., Kazerouni, A., Aghdam, E. K., Velichko, Y., Bagci, U., & Merhof, D. (2024) · 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv57701.2024.00132 · Cited by 254
Self-citationExploring scalable medical image encoders beyond text supervision
Pérez-García, F., Sharma, H., Bond-Taylor, S., Bouzid, K., Salvatelli, V., Ilse, M., Bannur, S., Castro, D. C., Schwaighofer, A., Lungren, M. P., et al. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-024-00965-w · Cited by 115
Metadata
- Authors
- Azad, R., Aghdam, E. K., Rauland, A., Jia, Y., Avval, A. H., Bozorgpour, A., Karimijafarbigloo, S., Cohen, J. P., Adeli, E., & Merhof, D.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024-12
- Volume
- 46
- Issue
- 12
- Pages
- 10076-10095
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4401725766
- Cited by
- 1,022
- References
- 125
- FWCI
- 139.84
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.