The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-Wise Perspective with Transformer
Open accessAbstract
Most recent semantic segmentation methods adopt a U-Net framework with an encoder-decoder architecture. It is still challenging for U-Net with a simple skip connection scheme to model the global multi-scale context: 1) Not each skip connection setting is effective due to the issue of incompatible feature sets of encoder and decoder stage, even some skip connection negatively influence the segmentation performance; 2) The original U-Net is worse than the one without any skip connection on some datasets. Based on our findings, we propose a new segmentation framework, named UCTransNet (with a proposed CTrans module in U-Net), from the channel perspective with attention mechanism. Specifically, the CTrans (Channel Transformer) module is an alternate of the U-Net skip connections, which consists of a sub-module to conduct the multi-scale Channel Cross fusion with Transformer (named CCT) and a sub-module Channel-wise Cross-Attention (named CCA) to guide the fused multi-scale channel-wise information to effectively connect to the decoder features for eliminating the ambiguity. Hence, the proposed connection consisting of the CCT and CCA is able to replace the original skip connection to solve the semantic gaps for an accurate automatic medical image segmentation. The experimental results suggest that our UCTransNet produces more precise segmentation performance and achieves consistent improvements over the state-of-the-art for semantic segmentation across different datasets and conventional architectures involving transformer or U-shaped framework. Code: https://github.com/McGregorWwww/UCTransNet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks
Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., & Hu, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01155 · Cited by 9,641
UNet++: A Nested U-Net Architecture for Medical Image Segmentation
Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N., & Liang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_1 · Cited by 9,610
Swin-Unet: Unet-like pure transformer for medical image segmentation
Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., & Wang, M. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-25066-8_9 · Cited by 5,640
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206 · cited 9×
“2021), and for Synapse we set it to 24 following (Chen et al. 2021).”
BackgroundMethodInfluentialRethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00681 · Cited by 4,008 · cited 2×
“Due to the success of Transformers in many computer vision fields, a new paradigm for medical image segmentation has recently evolved(Zheng et al. 2020; Zhang et al. 2021; Gao et al. 2021; Ji et al. 2021; Gao, Zhou, and Metaxas 2021; Zhang, Liu, and Hu 2021; Hatamizadeh et al. 2021).”
BackgroundUNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H. R., & Xu, D. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00181 · Cited by 3,586 · cited 2×
“Due to the success of Transformers in many computer vision fields, a new paradigm for medical image segmentation has recently evolved(Zheng et al. 2020; Zhang et al. 2021; Gao et al. 2021; Ji et al. 2021; Gao, Zhou, and Metaxas 2021; Zhang, Liu, and Hu 2021; Hatamizadeh et al. 2021).”
BackgroundUNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H., & Xu, D. (2021) · arXiv · doi:10.48550/arxiv.2103.10504 · Cited by 3,580
Instance Normalization: The Missing Ingredient for Fast Stylization
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08022 · Cited by 2,775
UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation
Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.-W., & Wu, J. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053405 · Cited by 2,774
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes
Li, X., Chen, H., Qi, X., Dou, Q., Fu, C.-W., & Heng, P.-A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2845918 · Cited by 2,473
MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentation
Ibtehaz, N., & Rahman, M. S. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.08.025 · Cited by 2,311
TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation
Zhang, Y., Liu, H., & Hu, Q. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_2 · Cited by 1,312
Medical Transformer: Gated Axial-Attention for Medical Image Segmentation
Valanarasu, J. M. J., Oza, P., Hacihaliloglu, I., & Patel, V. M. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_4 · Cited by 1,248
A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology
Kumar, N., Verma, R., Sharma, S., Bhargava, S., Vahadane, A., & Sethi, A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2677499 · Cited by 1,126
The Importance of Skip Connections in Biomedical Image Segmentation
Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., & Pal, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_19 · Cited by 984
Gland segmentation in colon histology images: The glas challenge contest
Sirinukunwattana, K., Pluim, J. P. W., Chen, H., Qi, X., Heng, P.-A., Guo, Y. B., Wang, L. Y., Matuszewski, B. J., Bruni, E., Sanchez, U., et al. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.08.008 · Cited by 979
A Multi-Organ Nucleus Segmentation Challenge
Kumar, N., Verma, R., Anand, D., Zhou, Y., Onder, O. F., Tsougenis, E., Chen, H., Heng, P.-A., Li, J., Hu, Z., et al. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2947628 · Cited by 553
UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation
Gao, Y., Zhou, M., & Metaxas, D. N. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87199-4_6 · Cited by 513
Alom, M. Z., Hasan, M. M., Yakopcic, C., Taha, T. M., & Asari, V. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06955 · Cited by 430
Domain Adaptive Relational Reasoning for 3D Multi-organ Segmentation
Fu, S., Lu, Y., Wang, Y., Zhou, Y., Shen, W., Fishman, E. K., & Yuille, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59710-8_64 · Cited by 161
Gao, Z., Hong, B., Zhang, X., Yang, L., Jia, C., Wu, J., Wang, C., Meng, D., & Li, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87237-3_29 · Cited by 75
Pyramid Attention Aggregation Network for Semantic Segmentation of Surgical Instruments
Ni, Z.-L., Bian, G., Wang, G.-A., Zhou, X.-H., Hou, Z., Chen, H., & Xie, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6850 · Cited by 67
Gland Segmentation in Colon Histology Images: The GlaS Challenge ContestPreprint
Sirinukunwattana, K., Pluim, J. P. W., Chen, H., Qi, X., Heng, P., Guo, Y. B., Wang, L. Y., Matuszewski, B. J., Bruni, E., Sanchez, U., et al. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000127185 · Cited by 35
Segmenting Medical MRI via Recurrent Decoding Cell
Wen, Y., Xie, K., & He, L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6932 · Cited by 16
Multi-Compound Transformer for Accurate Biomedical Image SegmentationPreprint
Ji, Y., Zhang, R., Wang, H., Li, Z., Wu, L., Zhang, S., & Luo, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14385 · Cited by 14
Self-citationA Multi-Branch Hybrid Transformer Networkfor Corneal Endothelial Cell SegmentationPreprint
Zhang, Y., Higashita, R., Fu, H., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07557 · Cited by 10
Cited by
Transformers in medical imaging: A survey
Shamshad, F., Khan, S., Zamir, S. W., Khan, M. H., Hayat, M., Khan, F. S., & Fu, H. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102802 · Cited by 1,296
Medical Image Segmentation Review: The Success of U-Net
Azad, R., Aghdam, E. K., Rauland, A., Jia, Y., Avval, A. H., Bozorgpour, A., Karimijafarbigloo, S., Cohen, J. P., Adeli, E., & Merhof, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3435571 · Cited by 1,022
U-Shape Transformer for Underwater Image Enhancement
Peng, L., Zhu, C., & Bian, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3276332 · Cited by 912
VM-UNet: Vision Mamba UNet for Medical Image Segmentation
Ruan, J., Li, J., & Xiang, S. (2025) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3767748 · Cited by 804
EMCAD: Efficient Multi-Scale Convolutional Attention Decoding for Medical Image Segmentation
Rahman, M. M., Munir, M., & Marculescu, R. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01118 · Cited by 524
Metadata
- Authors
- Wang, H., Cao, P., Wang, J., & Zaiane, O. R.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2022-06-28
- Volume
- 36
- Issue
- 3
- Pages
- 2441-2449
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W3197957534
- Cited by
- 1,111
- References
- 35
- FWCI
- 91.36
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.