The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation
Open accessAbstract
Automatic medical image segmentation has made great progress owing to the powerful deep representation learning. Inspired by the success of self-attention mechanism in Transformer, considerable efforts are devoted to designing the robust variants of encoder-decoder architecture with Transformer. However, the patch division used in the existing Transformer-based models usually ignores the pixel-level intrinsic structural features inside each patch. In this paper, we propose a novel deep medical image segmentation framework called Dual Swin Transformer U-Net (DS-TransUNet), which aims to incorporate the hierarchical Swin Transformer into both encoder and decoder of the standard U-shaped architecture. Our DS-TransUNet benefits from the self-attention computation in Swin Transformer and the designed dual-scale encoding, which can effectively model the non-local dependencies and multi-scale contexts for enhancing the semantic segmentation quality of varying medical images. Unlike many prior Transformer-based solutions, the proposed DS-TransUNet adopts a well-established dual-scale encoding mechanism that utilizes dual-scale encoders based on Swin Transformer to extract the coarse and fine-grained feature representations of different semantic scales. Meanwhile, a well-designed Transformer Interactive Fusion (TIF) module is proposed to effectively perform the multi-scale information fusion through the self-attention mechanism. Furthermore, we introduce the Swin Transformer block into decoder to further explore the long-range contextual information during the up-sampling process. Extensive experiments across four typical tasks for medical image segmentation demonstrate the effectiveness of DS-TransUNet, and our approach significantly outperforms the state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Self-citationFeature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596 · cited 1×
“There exists some works trying to model long-range dependencies for convolution such as attention mechanism [9] [10] [11].”
BackgroundUNet++: A Nested U-Net Architecture for Medical Image Segmentation
Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N., & Liang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_1 · Cited by 9,610
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517
Coordinate Attention for Efficient Mobile Network Design
Hou, Q., Zhou, D., & Feng, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01350 · Cited by 6,961
Swin-Unet: Unet-like pure transformer for medical image segmentation
Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., & Wang, M. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-25066-8_9 · Cited by 5,640
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions
Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., & Shao, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00061 · Cited by 5,259
Deep High-Resolution Representation Learning for Visual Recognition
Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang, X., et al. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2983686 · Cited by 4,894
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206 · cited 2×
“In medical image segmentation, TransUNet [17] proves that Transformer can be used as powerful encoders for medical image segmentation.”
MethodRethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00681 · Cited by 4,008 · cited 2×
“SEgmentation TRansformer (SETR) [16] shows that Transformer can achieve SOTA performance in segmentation tasks as encoder.”
MethodTschandl, P., Rosendahl, C., & Kittler, H. (2018) · Scientific Data · doi:10.1038/sdata.2018.161 · Cited by 3,628
Road Extraction by Deep Residual U-Net
Zhang, Z., Liu, Q., & Wang, Y. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2802944 · Cited by 3,179
Self-citationCCNet: Criss-Cross Attention for Semantic Segmentation
Huang, Z., Wang, X., Huang, L., Huang, C., Wei, Y., & Liu, W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00069 · Cited by 3,045
UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation
Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.-W., & Wu, J. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053405 · Cited by 2,774
H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes
Li, X., Chen, H., Qi, X., Dou, Q., Fu, C.-W., & Heng, P.-A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2845918 · Cited by 2,473
Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring
Nah, S., Kim, T. H., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.35 · Cited by 2,275
Bernal, J., Sánchez, F. J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., & Vilariño, F. (2015) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2015.02.007 · Cited by 2,191
CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification
Chen, C.-F. R., Fan, Q., & Panda, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00041 · Cited by 2,074
Segmenter: Transformer for Semantic Segmentation
Strudel, R., Garcia, R., Laptev, I., & Schmid, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00717 · Cited by 2,051
Kvasir-SEG: A Segmented Polyp Dataset
Jha, D., Smedsrud, P. H., Riegler, M. A., Halvorsen, P., de Lange, T., Johansen, D., & Johansen, H. D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-37734-2_37 · Cited by 1,661
A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection
Cai, Z., Fan, Q., Feris, R. S., & Vasconcelos, N. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_22 · Cited by 1,605
PraNet: Parallel Reverse Attention Network for Polyp Segmentation
Fan, D.-P., Ji, G.-P., Zhou, T., Chen, G., Fu, H., Shen, J., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59725-2_26 · Cited by 1,499
ResUNet++: An Advanced Architecture for Medical Image Segmentation
Jha, D., Smedsrud, P. H., Riegler, M. A., Johansen, D., Lange, T. D., Halvorsen, P., & D. Johansen, H. (2019) · 2019 IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism46123.2019.00049 · Cited by 1,330
TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation
Zhang, Y., Liu, H., & Hu, Q. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_2 · Cited by 1,312
Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer
Silva, J., Histace, A., Romain, O., Dray, X., & Granado, B. (2014) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-013-0926-3 · Cited by 1,309
Medical Transformer: Gated Axial-Attention for Medical Image Segmentation
Valanarasu, J. M. J., Oza, P., Hacihaliloglu, I., & Patel, V. M. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_4 · Cited by 1,248
Automated Polyp Detection in Colonoscopy Videos Using Shape and Context Information
Tajbakhsh, N., Gurudu, S. R., & Liang, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2487997 · Cited by 1,203
HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimation
Cheng, B., Xiao, B., Wang, J., Shi, H., Huang, T. S., & Zhang, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00543 · Cited by 1,023
Codella, N., Rotemberg, V., Tschandl, P., Celebi, M. E., Dusza, S., Gutman, D., Helba, B., Kalloo, A., Liopyris, K., Marchetti, M., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.03368 · Cited by 984
Gland segmentation in colon histology images: The glas challenge contest
Sirinukunwattana, K., Pluim, J. P. W., Chen, H., Qi, X., Heng, P.-A., Guo, Y. B., Wang, L. Y., Matuszewski, B. J., Bruni, E., Sanchez, U., et al. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.08.008 · Cited by 979
Weighted Res-UNet for High-Quality Retina Vessel Segmentation
Xiao, X., Lian, S., Luo, Z., & Li, S. (2018) · 2018 9th International Conference on Information Technology in Medicine and Education (ITME) · doi:10.1109/itme.2018.00080 · Cited by 963
A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images
Vázquez, D., Bernal, J., Sánchez, F. J., Fernández-Esparrach, G., López, A. M., Romero, A., Drozdzal, M., & Courville, A. (2017) · Journal of Healthcare Engineering · doi:10.1155/2017/4037190 · Cited by 866
DoubleU-Net: A Deep Convolutional Neural Network for Medical Image Segmentation
Jha, D., Riegler, M. A., Johansen, D., Halvorsen, P., & Johansen, H. D. (2020) · 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS) · doi:10.1109/cbms49503.2020.00111 · Cited by 819
Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl
Caicedo, J. C., Goodman, A., Karhohs, K. W., Cimini, B. A., Ackerman, J., Haghighi, M., Heng, C., Becker, T., Doan, M., McQuin, C., et al. (2019) · Nature Methods · doi:10.1038/s41592-019-0612-7 · Cited by 809
Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Wang, H., Zhu, Y., Green, B., Adam, H., Yuille, A., & Chen, L.-C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_7 · Cited by 809
Bi-Directional ConvLSTM U-Net with Densley Connected Convolutions
Azad, R., Asadi-Aghbolaghi, M., Fathy, M., & Escalera, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00052 · Cited by 474
Alom, M. Z., Hasan, M. M., Yakopcic, C., Taha, T. M., & Asari, V. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06955 · Cited by 430
Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning
Jha, D., Ali, S., Tomar, N. K., Johansen, H. D., Johansen, D., Rittscher, J., Riegler, M. A., & Halvorsen, P. (2021) · IEEE Access · doi:10.1109/access.2021.3063716 · Cited by 399
M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection
Wang, J., Wu, Z., Ouyang, W., Han, X., Chen, J., Jiang, Y.-G., & Li, S.-N. (2022) · Proceedings of the 2022 International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531415 · Cited by 368
Selective Feature Aggregation Network with Area-Boundary Constraints for Polyp Segmentation
Fang, Y., Chen, C., Yuan, Y., & Tong, K.-Y. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32239-7_34 · Cited by 353
FANet: A Feedback Attention Network for Improved Biomedical Image Segmentation
Tomar, N. K., Jha, D., Riegler, M. A., Johansen, H. D., Johansen, D., Rittscher, J., Halvorsen, P., & Ali, S. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3159394 · Cited by 252
Multi-compound Transformer for Accurate Biomedical Image Segmentation
Ji, Y., Zhang, R., Wang, H., Li, Z., Wu, L., Zhang, S., & Luo, P. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_31 · Cited by 188
Huang, C., Wu, H.-Y., & Lin, Y.-L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07172 · Cited by 181
Dense Attention-Guided Cascaded Network for Salient Object Detection of Strip Steel Surface Defects
Zhou, X., Fang, H., Liu, Z., Zheng, B., Sun, Y., Zhang, J., & Yan, C. C. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3132082 · Cited by 180
KiU-Net: Towards Accurate Segmentation of Biomedical Images Using Over-Complete Representations
Valanarasu, J. M. J., Sindagi, V. A., Hacihaliloglu, I., & Patel, V. M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59719-1_36 · Cited by 160
Big-Little Net: An Efficient Multi-Scale Feature Representation for Visual and Speech RecognitionPreprint
Chen, C.-F., Fan, Q., Mallinar, N., Sercu, T., & Feris, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.03848 · Cited by 114
Multigrained Attention Network for Infrared and Visible Image Fusion
Li, J., Huo, H., Li, C., Wang, R.-H., Sui, C., & Liu, Z. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3029360 · Cited by 97
Joint Attention Network for Finger Vein Authentication
Huang, J., Tu, M., Yang, W., & Kang, W. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3109978 · Cited by 71
Plane-Wave Image Reconstruction via Generative Adversarial Network and Attention Mechanism
Jiahua, T., Zou, B. J., Li, C., Feng, S., & Peng, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3087819 · Cited by 49
Multiscale Vision TransformersPreprint
Fan, H., Xiong, B., Mangalam, K., Li, Y., Yan, Z., Malik, J., & Feichtenhofer, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.11227 · Cited by 46
Cited by
Transformers in medical imaging: A survey
Shamshad, F., Khan, S., Zamir, S. W., Khan, M. H., Hayat, M., Khan, F. S., & Fu, H. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102802 · Cited by 1,296
Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis
Tang, Y., Yang, D., Li, W., Roth, H. R., Landman, B., Xu, D., Nath, V., & Hatamizadeh, A. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02007 · Cited by 849
VM-UNet: Vision Mamba UNet for Medical Image Segmentation
Ruan, J., Li, J., & Xiang, S. (2025) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3767748 · Cited by 804
nnFormer: Volumetric Medical Image Segmentation via a 3D Transformer
Zhou, H.-Y., Guo, J., Zhang, Y., Han, X., Yu, L., Wang, L., & Yu, Y. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3293771 · Cited by 735
Swin Transformer Embedding UNet for Remote Sensing Image Semantic Segmentation
He, X., Zhou, Y., Zhao, J., Zhang, D., Yao, R., & Xue, Y. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3144165 · Cited by 550
Self-citation
Metadata
- Authors
- Lin, A., Chen, B., Xu, J., Zhang, Z., Lu, G., & Zhang, D.
- Venue
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2022
- Volume
- 71
- Pages
- 1-15
- ISSN
- 0018-9456 (ISSN-L)
- 1557-9662
- OpenAlex
- W3168491317
- Cited by
- 882
- References
- 63
- FWCI
- 64.99
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.