Attention U-Net: Learning Where to Look for the Pancreas
Open accessAbstract
We propose a novel attention gate (AG) model for medical imaging that automatically learns to focus on target structures of varying shapes and sizes. Models trained with AGs implicitly learn to suppress irrelevant regions in an input image while highlighting salient features useful for a specific task. This enables us to eliminate the necessity of using explicit external tissue/organ localisation modules of cascaded convolutional neural networks (CNNs). AGs can be easily integrated into standard CNN architectures such as the U-Net model with minimal computational overhead while increasing the model sensitivity and prediction accuracy. The proposed Attention U-Net architecture is evaluated on two large CT abdominal datasets for multi-class image segmentation. Experimental results show that AGs consistently improve the prediction performance of U-Net across different datasets and training sizes while preserving computational efficiency. The code for the proposed architecture is publicly available.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
CNN-based segmentation models nnUNet and ASPP have 19.07M and 47.92M parameters and 412.65G and 44.87G FLOPs, respectively.
“CNN-based segmentation models of nnUNet [21] and ASPP [10] have 19.07M and 47.92M parameters and 412.65G and 44.87G FLOPs, respectively.”
From UNETR: Transformers for 3D Medical Image Segmentation (2022) · cites this paper as [10]
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382 · see citing works
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206 · see citing works
“We conduct main experiments on Synapse multi-organ segmentation dataset by comparing our TransUNet with four previous state-of-the-arts: 1) V-Net [10]; 2) DARR [5]; 3) U-Net [13] and 4) AttnUNet [14].”
MethodInfluentialUNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H. R., & Xu, D. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00181 · Cited by 3,586 · see citing works
Attention mechanisms in computer vision: A survey
Guo, M.-H., Xu, T.-X., Liu, J.-J., Liu, Z.-N., Jiang, P.-T., Mu, T.-J., Zhang, S.-H., Martin, R. R., Cheng, M.-M., & Hu, S.-M. (2022) · Computational Visual Media · doi:10.1007/s41095-022-0271-y · Cited by 2,566 · see citing works
“[19] proposed a simple and yet effective mechanism, the attention gate (AG), to focus on targeted regions while suppressing feature activations in irrelevant regions.”
BackgroundShi, F., Wang, J., Shi, J., Wu, Z., Wang, Q., Tang, Z., He, K., Shi, Y., & Shen, D. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.2987975 · Cited by 1,404 · see citing works
Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation
Tajbakhsh, N., Jeyaseelan, L., Li, Q., Chiang, J. N., Wu, Z., & Ding, X. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101693 · Cited by 1,095 · see citing works
“State-of-the-art architectures now benefit from re-designed skip connections Zhou et al. (2018b), residual convolution blocks Alom et al. (2018), dense convolution blocks Li et al. (2018), attention mechanisms Oktay et al. (2018), hybrid squeeze-excitation modules Roy et al. (2018), to name a few.”
BackgroundA survey on active learning and human-in-the-loop deep learning for medical image analysis
Budd, S., Robinson, E. C., & Kainz, B. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102062 · Cited by 606 · see citing works
Self-citationA Noise-Robust Framework for Automatic Segmentation of COVID-19 Pneumonia Lesions From CT Images
Wang, G., Liu, X., Li, C., Xu, Z., Ruan, J., Zhu, H., Meng, T., Li, K., Huang, N., & Zhang, S. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3000314 · Cited by 469 · see citing works
Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation: The M&Ms Challenge
Campello, V. M., Gkontra, P., Izquierdo, C., Martin-Isla, C., Sojoudi, A., Full, P. M., Maier-Hein, K., Zhang, Y., He, Z., Ma, J., et al. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3090082 · Cited by 481 · see citing works
RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans
Jin, Q., Meng, Z., Sun, C., Cui, H., & Su, R. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.605132 · Cited by 468 · see citing works
Semantic segmentation using Vision Transformers: A survey
Thisanke, H., Deshan, C., Chamith, K., Seneviratne, S., Vidanaarachchi, R., & Herath, D. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106669 · Cited by 288 · see citing works
UNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H., & Xu, D. (2021) · arXiv · doi:10.48550/arxiv.2103.10504 · Cited by 3,580 · see citing works
Focus U-Net: A novel dual attention-gated CNN for polyp segmentation during colonoscopy
Yeung, M., Sala, E., Schönlieb, C.-B., & Rundo, L. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104815 · Cited by 186 · see citing works
Skin disease diagnosis with deep learning: a review
Li, H., Pan, Y., Zhao, J., & Zhang, L. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.096 · Cited by 178 · see citing works
Advancing medical imaging informatics by deep learning-based domain adaptation
Choudhary, A., Tong, L., Zhu, Y., & Wang, M. D. (2020) · Yearbook of Medical Informatics · doi:10.1055/s-0040-1702009 · Cited by 84 · see citing works
Liu, G., Ding, Q., Luo, H., Sha, M., Li, X., & Ju, M. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106194 · Cited by 81 · see citing works
A survey on deep learning in medical ultrasound imaging
Song, K., Feng, J., & Chen, D. (2024) · Frontiers in Physics · doi:10.3389/fphy.2024.1398393 · Cited by 59 · see citing works
Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging
Meng, Q., Housden, J., Matthew, J., Rueckert, D., Schnabel, J. A., Kainz, B., Sinclair, M., Zimmer, V., Hou, B., Rajchl, M., et al. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2913311 · Cited by 52 · see citing works
Self-citationNanocarrier imaging at single-cell resolution across entire mouse bodies with deep learning
Luo, J., Molbay, M., Chen, Y., Horvath, I., Kadletz, K., Kick, B., Zhao, S., Al-Maskari, R., Singh, I., Ali, M., et al. (2025) · Nature Biotechnology · doi:10.1038/s41587-024-02528-1 · Cited by 53 · see citing works
Kang, H., Witanto, J. N., Pratama, K., Lee, D., Choi, K. S., Choi, S. H., Kim, K., Kim, M., Kim, J. W., Kim, Y. H., et al. (2023) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.28332 · Cited by 40 · see citing works
Khosravi, P., Fuchs, T. J., & Ho, D. J. (2025) · Cancer Research · doi:10.1158/0008-5472.can-24-3630 · Cited by 41 · see citing works
An unsupervised domain adaptation brain CT segmentation method across image modalities and diseases
Dong, D., Fu, G., Li, J., Pei, Y., & Chen, Y. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118016 · Cited by 30 · see citing works
Multi-task Federated Learning for Heterogeneous Pancreas Segmentation
Shen, C., Wang, P., Roth, H. R., Yang, D., Xu, D., Oda, M., Wang, W., Fuh, C.-S., Chen, P.-T., Liu, K.-L., et al. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-90874-4_10 · Cited by 36 · see citing works
Self-citationLee, D., Lee, W. H., Seo, H. G., Oh, B.-M., Lee, J. C., & Kim, H. C. (2020) · IEEE Access · doi:10.1109/access.2020.3019532 · Cited by 22 · see citing works
Szentimrey, Z., Ameri, G., Hong, C. X., Cheung, R. Y. K., Ukwatta, E., & Eltahawi, A. (2023) · Medical Physics · doi:10.1002/mp.16389 · Cited by 17 · see citing works
Hussein, R., Shin, D., Zhao, M. Y., Guo, J., Davidzon, G., Steinberg, G., Moseley, M., & Zaharchuk, G. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103072 · Cited by 9 · see citing works
Tian, Z., He, Y., Sun, L., Li, Y., & Du, S. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128184 · Cited by 5 · see citing works
Wali, S., Khan, M. I., Samina, S., & Raza Sialvi, M. A. (2026) · 2026 11th International Conference on Image, Vision and Computing (ICIVC) · doi:10.1109/icivc70586.2026.11686729
- Authors
- Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., Glocker, B., & Rueckert, D.
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1804.03999
- OpenAlex
- W2798122215
- Cited by
- 5,458
- References
- 5
- Citations by year
- 2026: 152 · 2025: 937 · 2024: 1333 · 2023: 1111 · 2022: 769 · 2021: 690 · 2020: 346 · 2019: 114 · 2018: 4 · 2012: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (publishedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Keywords
- attention gate, Attention U-Net, pancreas segmentation, multi-class image segmentation, organ localization, U-Net architecture, medical image segmentation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
