The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
DA-TransUNet: integrating spatial and channel dual attention with transformer U-net for medical image segmentation
Open accessAbstract
Accurate medical image segmentation is critical for disease quantification and treatment evaluation. While traditional U-Net architectures and their transformer-integrated variants excel in automated segmentation tasks. Existing models also struggle with parameter efficiency and computational complexity, often due to the extensive use of Transformers. However, they lack the ability to harness the image’s intrinsic position and channel features. Research employing Dual Attention mechanisms of position and channel have not been specifically optimized for the high-detail demands of medical images. To address these issues, this study proposes a novel deep medical image segmentation framework, called DA-TransUNet, aiming to integrate the Transformer and dual attention block (DA-Block) into the traditional U-shaped architecture. Also, DA-TransUNet tailored for the high-detail requirements of medical images, optimizes the intermittent channels of Dual Attention (DA) and employs DA in each skip-connection to effectively filter out irrelevant information. This integration significantly enhances the model’s capability to extract features, thereby improving the performance of medical image segmentation. DA-TransUNet is validated in medical image segmentation tasks, consistently outperforming state-of-the-art techniques across 5 datasets. In summary, DA-TransUNet has made significant strides in medical image segmentation, offering new insights into existing techniques. It strengthens model performance from the perspective of image features, thereby advancing the development of high-precision automated medical image diagnosis. The codes and parameters of our model will be publicly available at https://github.com/SUN-1024/DA-TransUnet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
UNet++: A Nested U-Net Architecture for Medical Image Segmentation
Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N., & Liang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_1 · Cited by 9,610
Dual Attention Network for Scene Segmentation
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00326 · Cited by 7,351
Swin-Unet: Unet-like pure transformer for medical image segmentation
Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., & Wang, M. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-25066-8_9 · Cited by 5,640
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206 · cited 5×
“Following this, TransUNet innovatively combines Transformer and U-net elements [8].”
BackgroundMethodInfluentialTschandl, P., Rosendahl, C., & Kittler, H. (2018) · Scientific Data · doi:10.1038/sdata.2018.161 · Cited by 3,628
UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation
Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.-W., & Wu, J. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053405 · Cited by 2,774
MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentation
Ibtehaz, N., & Rahman, M. S. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.08.025 · Cited by 2,311
Bernal, J., Sánchez, F. J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., & Vilariño, F. (2015) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2015.02.007 · Cited by 2,191
ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
Diakogiannis, F. I., Waldner, F., Caccetta, P., & Wu, C. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.01.013 · Cited by 2,153
Kvasir-SEG: A Segmented Polyp Dataset
Jha, D., Smedsrud, P. H., Riegler, M. A., Halvorsen, P., de Lange, T., Johansen, D., & Johansen, H. D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-37734-2_37 · Cited by 1,661
TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation
Zhang, Y., Liu, H., & Hu, Q. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_2 · Cited by 1,312
Wang, H., Cao, P., Wang, J., & Zaiane, O. R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20144 · Cited by 1,111
Medical Image Segmentation Review: The Success of U-Net
Azad, R., Aghdam, E. K., Rauland, A., Jia, Y., Avval, A. H., Bozorgpour, A., Karimijafarbigloo, S., Cohen, J. P., Adeli, E., & Merhof, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3435571 · Cited by 1,022
The Importance of Skip Connections in Biomedical Image Segmentation
Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., & Pal, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_19 · Cited by 984
Codella, N., Rotemberg, V., Tschandl, P., Celebi, M. E., Dusza, S., Gutman, D., Helba, B., Kalloo, A., Liopyris, K., Marchetti, M., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.03368 · Cited by 984
DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation
Lin, A., Chen, B., Xu, J., Zhang, Z., Lu, G., & Zhang, D. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3178991 · Cited by 882
Dual Attention Networks for Multimodal Reasoning and Matching
Nam, H., Ha, J.-W., & Kim, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.232 · Cited by 726
Automatic Tuberculosis Screening Using Chest Radiographs
Jaeger, S., Karargyris, A., Candemir, S., Folio, L., Siegelman, J., Callaghan, F., Xue, Z., Palaniappan, K., Singh, R. K., Antani, S., et al. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2284099 · Cited by 678
Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration
Candemir, S., Jaeger, S., Palaniappan, K., Musco, J. P., Singh, R. K., Xue, Z., Karargyris, A., Antani, S., Thoma, G., & McDonald, C. J. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2290491 · Cited by 674
Bi-Directional ConvLSTM U-Net with Densley Connected Convolutions
Azad, R., Asadi-Aghbolaghi, M., Fathy, M., & Escalera, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00052 · Cited by 474
RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans
Jin, Q., Meng, Z., Sun, C., Cui, H., & Su, R. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.605132 · Cited by 468
Dual Attention Matching Network for Context-Aware Feature Sequence Based Person Re-identification
Si, J., Zhang, H., Li, C.-G., Kuen, J., Kong, X., Kot, A. C., & Wang, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00562 · Cited by 466
SA-UNet: Spatial Attention U-Net for Retinal Vessel Segmentation
Guo, C., Szemenyei, M., Yi, Y., Wang, W., Chen, B., & Fan, C. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9413346 · Cited by 431
Mixed Transformer U-Net for Medical Image Segmentation
Wang, H., Xie, S., Lin, L., Iwamoto, Y., Han, X.-H., Chen, Y.-W., & Tong, R. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9746172 · Cited by 383
Attention Res-UNet with Guided Decoder for semantic segmentation of brain tumors
Maji, D., Sigedar, P., & Singh, M. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.103077 · Cited by 255
Shi, Z., Miao, C., Schoepf, U. J., Savage, R. H., Dargis, D. M., Pan, C., Chai, X., Li, X. L., Xia, S., Zhang, X., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-19527-w · Cited by 207
Azad, R., Al-Antary, M. T., Heidari, M., & Merhof, D. (2022) · IEEE Access · doi:10.1109/access.2022.3211501 · Cited by 152
Jha, D., Ali, S., Emanuelsen, K., et al. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67835-7_19 · Cited by 94
AA-TransUNet: Attention Augmented TransUNet For Nowcasting Tasks
Yang, Y., & Mehrkanoon, S. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892376 · Cited by 94
Omics-based deep learning approaches for lung cancer decision-making and therapeutics development
Tran, T.-O., Vo, T. H., & Le, N. Q. K. (2023) · Briefings in Functional Genomics · doi:10.1093/bfgp/elad031 · Cited by 76
TransU-Net++: Rethinking attention gated TransU-Net for deforestation mapping
Jamali, A., Roy, S. K., Li, J., & Ghamisi, P. (2023) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2023.103332 · Cited by 75
Pin, T., Zu, C., Hong, M., Yan, R., Peng, X., Xiao, J., Wu, X., Zhou, J., Zhou, L., & Wang, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.12.085 · Cited by 66
Sahayam, S., Nenavath, R., Jayaraman, U., & Prakash, S. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103939 · Cited by 28
Tran, T.-O., & Le, N. Q. K. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108408 · Cited by 24
MLDA-Unet:Multi Level Dual Attention Unet for Polyp Segmentation
Cai, Y., Li, H., Xin, J., et al. (2022) · ICME International Conference on Complex Medical Engineering (CME) · doi:10.1109/cme55444.2022.10063321 · Cited by 7
Self-citation
Metadata
- Authors
- Sun, G., Pan, Y., Kong, W., Xu, Z., Ma, J., Racharak, T., Nguyen, L.-M., & Xin, J.
- Venue
- Frontiers in Bioengineering and Biotechnology
- Publisher
- Frontiers Media SA
- Published
- 2024-05-16
- Volume
- 12
- Pages
- 1398237-1398237
- ISSN
- 2296-4185 (ISSN-L)
- OpenAlex
- W4396973073
- Cited by
- 339
- References
- 42
- FWCI
- 47.89
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.