The DOI matches its Crossref record; 163 of the 163 references it cites were found in a registry or an index.
Transformers in medical image analysis
Open accessAbstract
Transformers have dominated the field of natural language processing and have recently made an impact in the area of computer vision. In the field of medical image analysis, transformers have also been successfully used in to full-stack clinical applications, including image synthesis/reconstruction, registration, segmentation, detection, and diagnosis. This paper aimed to promote awareness of the applications of transformers in medical image analysis. Specifically, we first provided an overview of the core concepts of the attention mechanism built into transformers and other basic components. Second, we reviewed various transformer architectures tailored for medical image applications and discuss their limitations. Within this review, we investigated key challenges including the use of transformers in different learning paradigms, improving model efficiency, and coupling with other techniques. We hope this review would provide a comprehensive picture of transformers to readers with an interest in medical image analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Evaluating Deep Neural Network Architectures with Transfer Learning for Pneumonitis Diagnosis
Krishnamurthy, S., Srinivasan, K., Qaisar, S. M., Vincent, P. M. D. R., & Chang, C. (2021) · Computational and Mathematical Methods in Medicine · doi:10.1155/2021/8036304 · Cited by 20
RetractedImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
Swin-Unet: Unet-like pure transformer for medical image segmentation
Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., & Wang, M. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-25066-8_9 · Cited by 5,640
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Self-citationHan (2023) · doi:10.1109/tpami.2022.3152247 · Cited by 4,682
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206 · cited 10×
“Chen et al.[91] proposed TransAttUnet, in which the multi-level guided attention and multi-scale skip connection are jointly designed to effectively enhance traditional U-shaped architecture.”
BackgroundMethodInfluentialUNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H. R., & Xu, D. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00181 · Cited by 3,586 · cited 3×
“[72], [76], [84], [90], [99], [103], [104], polyp segmentation [79], [87], [101], skin lesion segmentation [79], [87], [91], [101], hip segmentation [79], prostate segmentation [79],”
BackgroundMethodUNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H., & Xu, D. (2021) · arXiv · doi:10.48550/arxiv.2103.10504 · Cited by 3,580
Bakas, S., Akbari, H., Sotiras, A., Bilello, M., Rozycki, M., Kirby, J. S., Freymann, J. B., Farahani, K., & Davatzikos, C. (2017) · Scientific Data · doi:10.1038/sdata.2017.117 · Cited by 3,049
Dataset of breast ultrasound images
Al-Dhabyani, W., Gomaa, M., Khaled, H., & Fahmy, A. (2020) · Data in Brief · doi:10.1016/j.dib.2019.104863 · Cited by 2,405
Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images
Hatamizadeh, A., Nath, V., Tang, Y., Yang, D., Roth, H. R., & Xu, D. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-08999-2_22 · Cited by 2,273
Bernal, J., Sánchez, F. J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., & Vilariño, F. (2015) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2015.02.007 · Cited by 2,191
VoxelMorph: A Learning Framework for Deformable Medical Image Registration
Balakrishnan, G., Zhao, A., Sabuncu, M. R., Guttag, J., & Dalca, A. V. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2897538 · Cited by 2,174
MLP-Mixer: An all-MLP Architecture for Vision
Tolstikhin, I., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Steiner, A., Keysers, D., Uszkoreit, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2105.01601 · Cited by 2,087
Can AI help in screening viral and COVID-19 pneumonia?
Chowdhury, M. E. H., Rahman, T., Khandakar, A., Mazhar, R., Kadir, M. A., Mahbub, Z. B., Islam, K. R., Khan, M. S., Iqbal, A., Emadi, N. A., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3010287 · Cited by 1,913
The Parkinson Progression Marker Initiative (PPMI)
Marek, K., Jennings, D., Lasch, S., Siderowf, A., Tanner, C., Simuni, T., Coffey, C., Kieburtz, K., Flagg, E., Chowdhury, S., et al. (2011) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2011.09.005 · Cited by 1,892
Bakas, S., Reyes, M., Jakab, A., Bauer, S., Rempfler, M., Crimi, A., Shinohara, R. T., Berger, C., Ha, S. M., Rozycki, M., et al. (2018) · Apollo - University of Cambridge Repository · doi:10.17863/cam.38755 · Cited by 1,441
Self-citationDeep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases
Janowczyk, A., & Madabhushi, A. (2016) · Journal of Pathology Informatics · doi:10.4103/2153-3539.186902 · Cited by 1,348
TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation
Zhang, Y., Liu, H., & Hu, Q. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_2 · Cited by 1,312
Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer
Silva, J., Histace, A., Romain, O., Dray, X., & Granado, B. (2014) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-013-0926-3 · Cited by 1,309
Medical Transformer: Gated Axial-Attention for Medical Image Segmentation
Valanarasu, J. M. J., Oza, P., Hacihaliloglu, I., & Patel, V. M. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_4 · Cited by 1,248
Automated Polyp Detection in Colonoscopy Videos Using Shape and Context Information
Tajbakhsh, N., Gurudu, S. R., & Liang, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2487997 · Cited by 1,203
A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology
Kumar, N., Verma, R., Sharma, S., Bhargava, S., Vahadane, A., & Sethi, A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2677499 · Cited by 1,126
Automated breast ultrasound lesions detection using convolutional neural networks
Yap, M. H., Pons, G., Martí, J., Ganau, S., Sentís, M., Zwiggelaar, R., Davison, A. K., & Martí, R. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2731873 · Cited by 1,086
Parmar, N., Vaswani, A., Uszkoreit, J., Kaiser, Ł., Shazeer, N., Ku, A., & Tran, D. (2018) · arXiv · doi:10.48550/arxiv.1802.05751 · Cited by 1,085
TransBTS: Multimodal Brain Tumor Segmentation Using Transformer
Wang, W., Chen, C., Ding, M., Yu, H., Zha, S., & Li, J. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_11 · Cited by 1,045
Codella, N., Rotemberg, V., Tschandl, P., Celebi, M. E., Dusza, S., Gutman, D., Helba, B., Kalloo, A., Liopyris, K., Marchetti, M., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.03368 · Cited by 984
Gland segmentation in colon histology images: The glas challenge contest
Sirinukunwattana, K., Pluim, J. P. W., Chen, H., Qi, X., Heng, P.-A., Guo, Y. B., Wang, L. Y., Matuszewski, B. J., Bruni, E., Sanchez, U., et al. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.08.008 · Cited by 979
COVID-19 Image Data Collection: Prospective Predictions are the Future
Cohen, J. P., Morrison, P., Dao, L., Roth, K., Duong, T., & Ghassem, M. (2020) · Machine Learning for Biomedical Imaging · doi:10.59275/j.melba.2020-48g7 · Cited by 927
DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation
Lin, A., Chen, B., Xu, J., Zhang, Z., Lu, G., & Zhang, D. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3178991 · Cited by 882
A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images
Vázquez, D., Bernal, J., Sánchez, F. J., Fernández-Esparrach, G., López, A. M., Romero, A., Drozdzal, M., & Courville, A. (2017) · Journal of Healthcare Engineering · doi:10.1155/2017/4037190 · Cited by 866
Sak, H., Senior, A., & Beaufays, F. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.1128 · Cited by 838
Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl
Caicedo, J. C., Goodman, A., Karhohs, K. W., Cimini, B. A., Ackerman, J., Haghighi, M., Heng, C., Becker, T., Doan, M., McQuin, C., et al. (2019) · Nature Methods · doi:10.1038/s41592-019-0612-7 · Cited by 809
ResMLP: Feedforward networks for image classification with data-efficient training
Touvron, H., Bojanowski, P., Caron, M., Cord, M., El-Nouby, A., Grave, E., Izacard, G., Joulin, A., Synnaeve, G., Verbeek, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2105.03404 · Cited by 807
ResMLP: Feedforward Networks for Image Classification With Data-Efficient Training
Touvron, H., Bojanowski, P., Caron, M., Cord, M., El-Nouby, A., Grave, E., Izacard, G., Joulin, A., Synnaeve, G., Verbeek, J., et al. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3206148 · Cited by 807
TransMorph: Transformer for unsupervised medical image registration
Chen, J., Frey, E. C., He, Y., Segars, W. P., Li, Y., & Du, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102615 · Cited by 804
Neural Speech Synthesis with Transformer Network
Li, N., Liu, S., Liu, Y., Zhao, S., & Liu, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016706 · Cited by 754
Multiple instance learning: A survey of problem characteristics and applications
Carbonneau, M.-A., Cheplygina, V., Granger, E., & Gagnon, G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.009 · Cited by 740
COVID-19 Image Data Collection
Cohen, J., Morrison, P., & Dao, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11597 · Cited by 722
CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation
Xie, Y., Zhang, J., Shen, C., & Xia, Y. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87199-4_16 · Cited by 653
Self-citationSimpson, A. L., Antonelli, M., Bakas, S., Bilello, M., Farahani, K., van Ginneken, B., Kopp‐Schneider, A., Landman, B. A., Litjens, G. J. S., Menze, B. H., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09063 · Cited by 643
ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
Dalmaz, O., Yurt, M., & Cukur, T. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3167808 · Cited by 597
Makropoulos, A., Robinson, E. C., Schuh, A., Wright, R., Fitzgibbon, S., Bozek, J., Counsell, S. J., Steinweg, J., Vecchiato, K., Passerat-Palmbach, J., et al. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.01.054 · Cited by 554
Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation: The M&Ms Challenge
Campello, V. M., Gkontra, P., Izquierdo, C., Martin-Isla, C., Sojoudi, A., Full, P. M., Maier-Hein, K., Zhang, Y., He, Z., Ma, J., et al. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3090082 · Cited by 481
TransMed: Transformers Advance Multi-Modal Medical Image Classification
Dai, Y., Gao, Y., & Liu, F. (2021) · Diagnostics · doi:10.3390/diagnostics11081384 · Cited by 467
Self-citationTransAttUnet: Multi-Level Attention-Guided U-Net With Transformer for Medical Image Segmentation
Chen, B., Liu, Y., Zhang, Z., Lu, G., & Kong, A. W. K. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3309626 · Cited by 459
2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)
(2021) · doi:10.1109/isbi48211.2021 · Cited by 438
Knoll, F., Zbontar, J., Sriram, A., Muckley, M. J., Bruno, M., Defazio, A., Parente, M., Geras, K. J., Katsnelson, J., Chandarana, H., et al. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020190007 · Cited by 409
Mixed Transformer U-Net for Medical Image Segmentation
Wang, H., Xie, S., Lin, L., Iwamoto, Y., Han, X.-H., Chen, Y.-W., & Tong, R. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9746172 · Cited by 383
Graph Neural Networks in Network Neuroscience
Bessadok, A., Mahjoub, M. A., & Rekik, I. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3209686 · Cited by 341
Self-citationSemi-Supervised Medical Image Segmentation via Cross Teaching between CNN and TransformerPreprint
Luo, X., Hu, M., Song, T., Wang, G., & Zhang, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.04894 · Cited by 322
Rahimzadeh, M., Attar, A., & Sakhaei, S. M. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.102588 · Cited by 319
Is it Time to Replace CNNs with Transformers for Medical Images?Preprint
Matsoukas, C., Haslum, J. F., Söderberg, M., & Smith, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.09038 · Cited by 303
VOLO: Vision Outlooker for Visual Recognition
Yuan, L., Hou, Q., Jiang, Z., Feng, J., & Yan, S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3206108 · Cited by 288
ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image RegistrationPreprint
Chen, J., He, Y., Frey, E. C., Li, Y., & Du, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06468 · Cited by 277
MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans
Mendrik, A. M., Vincken, K. L., Kuijf, H. J., Breeuwer, M., Bouvy, W. H., de Bresser, J., Alansary, A., de Bruijne, M., Carass, A., El-Baz, A., et al. (2015) · Computational Intelligence and Neuroscience · doi:10.1155/2015/813696 · Cited by 261
nnFormer: Interleaved Transformer for Volumetric Segmentation
Zhou, H.-Y., Guo, J., Zhang, Y., Yu, L., Wang, L., & Yu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.03201 · Cited by 256
Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal AttentionPreprint
Kim, B.-H., Ye, J. C., & Kim, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13495 · Cited by 249
Graph representation learning: a survey
Chen, F., Wang, Y.-C., Wang, B., & Kuo, C.-C. J. (2020) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2020.13 · Cited by 237
Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers
Korkmaz, Y., Dar, S. U. H., Yurt, M., Ozbey, M., & Cukur, T. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3147426 · Cited by 231
LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentation
Xu, G., Zhang, X., He, X., & Wu, X. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-981-99-8543-2_4 · Cited by 228
AS-MLP: An Axial Shifted MLP Architecture for VisionPreprint
Lian, D., Yu, Z., Sun, X., & Gao, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.08391 · Cited by 225
2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI)
(2023) · doi:10.1109/isbi53787.2023 · Cited by 204
Convolution-Free Medical Image Segmentation Using Transformers
Karimi, D., Vasylechko, S., & Gholipour, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_8 · Cited by 197
Multi-Modal Graph Learning for Disease Prediction
Zheng, S., Zhu, Z., Liu, Z., Guo, Z., Liu, Y., Yang, Y., & Zhao, Y. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3159264 · Cited by 196
Benchmark on Automatic Six-Month-Old Infant Brain Segmentation Algorithms: The iSeg-2017 Challenge
Wang, L., Nie, D., Li, G., Puybareau, E., Dolz, J., Zhang, Q., Wang, F., Xia, J., Wu, Z., Chen, J.-W., et al. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2901712 · Cited by 196
Self-citationProgressively Normalized Self-Attention Network for Video Polyp Segmentation
Ji, G.-P., Chou, Y.-C., Fan, D.-P., Chen, G., Fu, H., Jha, D., & Shao, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_14 · Cited by 187
Task Transformer Network for Joint MRI Reconstruction and Super-Resolution
Feng, C.-M., Yan, Y., Fu, H., Chen, L., & Xu, Y. D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87231-1_30 · Cited by 184
TransPath: Transformer-Based Self-supervised Learning for Histopathological Image Classification
Wang, X., Yang, S., Zhang, J., Wang, M., Zhang, J., Huang, J., Yang, W., & Han, X. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87237-3_18 · Cited by 178
Self-citationX-Net: a dual encoding–decoding method in medical image segmentation
Li, Y., Wang, Z., Li, Y., Zhu, Z., Qi, G., & Liu, Y. (2021) · The Visual Computer · doi:10.1007/s00371-021-02328-7 · Cited by 178
TU-FG-207A-04: Overview of the Low Dose CT Grand Challenge
McCollough, C. (2016) · Medical Physics · doi:10.1118/1.4957556 · Cited by 175
AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentation
Yan, X., Tang, H., Sun, S., Ma, H., Kong, D., & Xie, X. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00333 · Cited by 174
Complex Brain Network Analysis and Its Applications to Brain Disorders: A Survey
Liu, J., Li, M., Pan, Y. F., Lan, W., Zheng, R., Wu, F., & Wang, J. (2017) · Complexity · doi:10.1155/2017/8362741 · Cited by 172
D-former: a U-shaped Dilated Transformer for 3D medical image segmentation
Wu, Y., Liao, K., Chen, J., Wang, J., Chen, D. Z., Gao, H., & Wu, J. (2023) · Neural Computing and Applications · doi:10.1007/s00521-022-07859-1 · Cited by 172
MISSFormer: An Effective Medical Image Segmentation Transformer
Huang, X., Deng, Z., Li, D., & Yuan, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.07162 · Cited by 163
Chen, X., Sun, S., Bai, N., Han, K., Liu, Q., Yao, S., Tang, H., Zhang, C., Lu, Z., Huang, Q., et al. (2021) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2021.04.019 · Cited by 162
COVID-Transformer: Interpretable COVID-19 Detection Using Vision Transformer for Healthcare
Shome, D., Kar, T., Mohanty, S. N., Tiwari, P., Muhammad, K., AlTameem, A., Zhang, Y., & Saudagar, A. K. J. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182111086 · Cited by 154
OperA: Attention-Regularized Transformers for Surgical Phase Recognition
Czempiel, T., Paschali, M., Ostler, D., Kim, S. T., Busam, B., & Navab, N. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87202-1_58 · Cited by 150
Diabetic Retinopathy Grading by Digital Curvelet Transform
Alipour, S. H. M., Rabbani, H., & Akhlaghi, M. (2012) · Computational and Mathematical Methods in Medicine · doi:10.1155/2012/761901 · Cited by 139
CycleMLP: A MLP-like Architecture for Dense PredictionPreprint
Chen, S., Xie, E., Ge, C., Chen, R., Liang, D., & Luo, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.10224 · Cited by 128
PHTrans: Parallelly Aggregating Global and Local Representations for Medical Image Segmentation
Liu, W., Tian, T., Xu, W., Yang, H., Pan, X., Yan, S., & Wang, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16443-9_23 · Cited by 125
Method for diagnosis of acute lymphoblastic leukemia based on vit-cnn ensemble model
Jiang, Z., Dong, Z., Wang, L., & Jiang, W. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/7529893 · Cited by 124
VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers
Kamran, S. A., Hossain, K. F., Tavakkoli, A., Zuckerbrod, S. L., & Baker, S. A. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00362 · Cited by 117
Transclaw U-Net: Claw U-Net With Transformers for Medical Image Segmentation
Yao, C., Hu, M., Li, Q., Zhai, G., & Zhang, X.-P. S. (2022) · International Conference on Information Communication and Signal Processing (ICICSP) · doi:10.1109/icicsp55539.2022.10050624 · Cited by 112
Vision Transformer for femur fracture classification
Tanzi, L., Audisio, A., Cirrincione, G., Aprato, A., & Vezzetti, E. (2022) · Injury · doi:10.1016/j.injury.2022.04.013 · Cited by 111
Nyholm, T., Svensson, S., Andersson, S., Jonsson, J., Sohlin, M., Gustafsson, C., Kjellén, E., Söderström, K., Albertsson, P., Blomqvist, L., et al. (2018) · Medical Physics · doi:10.1002/mp.12748 · Cited by 104
More than Encoder: Introducing Transformer Decoder to Upsample
Li, Y., Cai, W., Gao, Y., Li, C., & Hu, X. (2022) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9995378 · Cited by 91
Self-citationCOVID-19 Prognosis via Self-Supervised Representation Learning and Multi-Image PredictionPreprint
Sriram, A., Muckley, M. J., Sinha, K., Shamout, F. E., Pineau, J., Geras, K. J., Azour, L., Aphinyanaphongs, Y., Yakubova, N., & Moore, W. H. (2021) · PubMed · doi:10.48550/arxiv.2101.04909 · Cited by 89
Zhao, C., Shuai, R., Ma, L., Liu, W., & Wu, M. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12670-0 · Cited by 85
Wang, D., Wu, Z., & Yu, H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87589-3_43 · Cited by 83
Liang, J., Yang, C., Zeng, M., & Wang, X. (2022) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-21-919 · Cited by 82
Hatamizadeh, A., Xu, Z., Yang, D., Li, W., Roth, H. R., & Xu, D. (2022) · arXiv (Cornell University) · doi:10.13140/rg.2.2.17557.19687 · Cited by 81
Multi-view Analysis of Unregistered Medical Images Using Cross-View Transformers
van Tulder, G., Tong, Y., & Marchiori, E. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87199-4_10 · Cited by 78
He, X. J., Wang, S., Shi, S., Chu, X., Tang, J., Liu, X., Yan, C. C., Zhang, J., & Ding, G. (2020) · medRxiv · doi:10.1101/2020.06.08.20125963 · Cited by 76
Self-citationLiu, W., Li, C., Rahaman, M. M., Jiang, T., Sun, H., Wu, X., Hu, W., Chen, H., Sun, C., Yao, Y., et al. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.105026 · Cited by 75
PCAT-UNet: UNet-like network fused convolution and transformer for retinal vessel segmentation
Chen, D., Yang, W., Wang, L., Tan, S., Lin, J., & Bu, W. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262689 · Cited by 71
Song, D., Fu, B., Li, F., Xiong, J., He, J., Zhang, X., & Qiao, Y. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3077484 · Cited by 70
Transformer-Unet: Raw Image Processing with UnetPreprint
Sha, Y., Zhang, Y., Ji, X., & Hu, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08417 · Cited by 67
How Transferable Are Self-supervised Features in Medical Image Classification Tasks?Preprint
Truong, T., Mohammadi, S., & Lenga, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.10048 · Cited by 66
HybridCTrm: Bridging CNN and Transformer for Multimodal Brain Image Segmentation
Sun, J. Q., Fang, N., Liu, Z., Zhao, L., Wen, Y., & Hongxiang, L. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/7467261 · Cited by 59
Pyramid Medical Transformer for Medical Image SegmentationPreprint
Zhang, Z., & Zhang, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.14702 · Cited by 58
Vision Transformer for COVID-19 CXR Diagnosis using Chest X-ray Feature CorpusPreprint
Park, S. J., Kim, G., Oh, Y., Seo, J. B., Lee, S. M., Kim, J. H., Moon, S.-J., Lim, J., & Ye, J. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.07055 · Cited by 57
Multiscale transunet + + : dense hybrid U-Net with transformer for medical image segmentation
Wang, B., Wang, F., Dong, P., & Li, C. (2022) · Signal Image and Video Processing · doi:10.1007/s11760-021-02115-w · Cited by 55
Preclinical Stage Alzheimer's Disease Detection Using Magnetic Resonance Image Scans
Altay, F., Sánchez, G. R., Zhang‐James, Y., Faraone, S. V., Velipasalar, S., & Salekin, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i17.17772 · Cited by 54
Self-Supervised Vision Transformers Learn Visual Concepts in Histopathology
Chen, R. J., & Krishnan, R. G. (2022) · arXiv · doi:10.48550/arxiv.2203.00585 · Cited by 52
RDCTrans U-Net: A Hybrid Variable Architecture for Liver CT Image Segmentation
Li, L., & Ma, H. (2022) · Sensors · doi:10.3390/s22072452 · Cited by 51
COTR: Convolution in Transformer Network for End to End Polyp Detection
Shen, Z., Fu, R., Lin, C., & Zheng, S. (2021) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc54389.2021.9674267 · Cited by 50
BERTHop: An Effective Vision-and-Language Model for Chest X-ray Disease Diagnosis
Monajatipoor, M., Rouhsedaghat, M., Li, L. H., Kuo, C. ‐. J., Chien, A., & Chang, K.-W. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16443-9_69 · Cited by 48
RDFNet: A Fast Caries Detection Method Incorporating Transformer Mechanism
Jiang, H., Zhang, P., Che, C., & Jin, B. (2021) · Computational and Mathematical Methods in Medicine · doi:10.1155/2021/9773917 · Cited by 48
Diabetic Foot Ulcers Grand Challenge
Yap, M. H., Reeves, N. D., Boulton, A. J. M., Rajbhandari, S. M., Armstrong, D. G., Maiya, A. G., Najafi, B., Frank, E., & Wu, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-94907-5 · Cited by 40
PTNet: A High-Resolution Infant MRI Synthesizer Based on TransformerPreprint
Zhang, X., He, X.-Z., Guo, J., Ettehadi, N., Aw, N., Semanek, D., Posner, J., Laine, A., & Wang, Y. (2021) · arXiv.org · doi:10.48550/arxiv.2105.13993 · Cited by 39
Scale-Aware Transformers for Diagnosing Melanocytic Lesions
Wu, W., Mehta, S., Nofallah, S., Knezevich, S. R., May, C. J., Chang, O. H., Elmore, J. G., & Shapiro, L. G. (2021) · IEEE Access · doi:10.1109/access.2021.3132958 · Cited by 39
Shin, H.-C., Ihsani, A., Mandava, S., Sreenivas, S. T., Forster, C. J., Cha, J., & Initiative, A. D. N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.04393 · Cited by 37
LapFormer: surgical tool detection in laparoscopic surgical video using transformer architecture
Kondo, S. (2020) · Computer Methods in Biomechanics and Biomedical Engineering Imaging & Visualization · doi:10.1080/21681163.2020.1835550 · Cited by 36
SpecTr: Spectral Transformer for Hyperspectral Pathology Image SegmentationPreprint
Yun, B., Wang, Y., Chen, J., Wang, H., Shen, W., & Li, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03604 · Cited by 36
Perera, S. R., Adhikari, S., & Yılmaz, A. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506353 · Cited by 36
TF-Unet:An automatic cardiac MRI image segmentation method
Fu, Z., Zhang, J., Luo, R., et al. (2022) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2022244 · Cited by 33
Self-citationJacenków, G., O’Neil, A. Q., & Tsaftaris, S. A. (2022) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi52829.2022.9761567 · Cited by 32
Fundus Disease Image Classification based on Improved Transformer
Yang, H., Chen, J., & Xu, M. (2021) · 2021 International Conference on Neuromorphic Computing (ICNC) · doi:10.1109/icnc52316.2021.9608181 · Cited by 31
Learning to Segment Brain Anatomy From 2D Ultrasound With Less Data
Valanarasu, J. M. J., Yasarla, R., Wang, P., Hacihaliloglu, I., & Patel, V. M. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3001513 · Cited by 31
(2021) · arXiv (Cornell University) · Cited by 31
Medical Transformer: Universal Brain Encoder for 3D MRI AnalysisPreprint
Jun, E., Jeong, S., Heo, D.-W., & Suk, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.13633 · Cited by 30
Self-distillation Augmented Masked Autoencoders for Histopathological Image ClassificationPreprint
Luo, Y., Chen, Z., Zhou, S., & Gao, X. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.16983 · Cited by 30
Chen, J., Chen, J., Zhou, Z., Li, B., Yuille, A., & Lu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.01767 · Cited by 30
Continual Hippocampus Segmentation with Transformers
Ranem, A., González, C., & Mukhopadhyay, A. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00415 · Cited by 30
Covid-19 automatic diagnosis with ct images using the novel transformer architecture
Costa, G. S. S., Paiva, A. C., Braz Júnior, G., & Ferreira, M. M. (2021) · Anais do XXI Simpósio Brasileiro de Computação Aplicada à Saúde (SBCAS 2021) · doi:10.5753/sbcas.2021.16073 · Cited by 24
Watanabe, S., Ueno, T., Kimura, Y., Mishina, M., & Sugimoto, N. (2021) · Annals of Nuclear Medicine · doi:10.1007/s12149-021-01661-0 · Cited by 23
Deep 3D Neural Network for Brain Structures Segmentation Using Self-Attention Modules in MRI Images
Laiton-Bonadiez, C., Torres, G. S., & Branch, J. W. (2022) · Sensors · doi:10.3390/s22072559 · Cited by 22
Cross‐Model Transformer Method for Medical Image Synthesis
Hu, Z., Liu, H., Li, Z., & Yu, Z. (2021) · Complexity · doi:10.1155/2021/5624909 · Cited by 20
Self-citationAlDahoul, N., Karim, H. B. A., Tan, M. J. T., Momo, M. A., & Fermin, J. L. (2021) · F1000Research · doi:10.12688/f1000research.73082.1 · Cited by 19
Chen, H., Li, C., Li, X., Hu, W., Li, Y., Liu, W., Sun, C., Yao, Y., & Grzegorzek, M. (2021) · arXiv (Cornell University) · Cited by 18
Scopeformer: n-CNN-ViT Hybrid Model for Intracranial Hemorrhage ClassificationPreprint
Barhoumi, Y., & Rasool, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.04575 · Cited by 16
CST: A Multitask Learning Framework for Colorectal Cancer Region Mining Based on Transformer
Sui, D., Zhang, K., Liu, W., Chen, J., Ma, X., & Tian, Z. (2021) · BioMed Research International · doi:10.1155/2021/6207964 · Cited by 15
CyTran: Cycle-Consistent Transformers for Non-Contrast to Contrast CT Translation.Preprint
Ristea, N.-C., Ionescu, A.-I., Savencu, O., Georgescu, M.-I., Verga, N. I., Khan, F. S., & Ionescu, R. T. (2021) · arXiv (Cornell University) · Cited by 11
A Multi-Branch Hybrid Transformer Networkfor Corneal Endothelial Cell SegmentationPreprint
Zhang, Y., Higashita, R., Fu, H., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07557 · Cited by 10
Color Space-based HoVer-Net for Nuclei Instance Segmentation and Classification
Azzuni, H., Ridzuan, M., Xu, M. G., & Yaqub, M. K. (2022) · doi:10.1109/isbic56247.2022.9854725 · Cited by 10
Improving Across-Dataset Brain Tissue Segmentation Using Transformer
Rao, V. M., Wan, Z., Ma, D. J., Tian, Y., & Guo, J. (2023) · Proceedings on CD-ROM - International Society for Magnetic Resonance in Medicine. Scientific Meeting and Exhibition/Proceedings of the International Society for Magnetic Resonance in Medicine, Scientific Meeting and Exhibition · doi:10.58530/2022/4817 · Cited by 3
Nguyen, H. H., Saarakkala, S. S., Blaschko, M. B., & Tiulpin, A. (2021) · Lirias · Cited by 2
Cited by
A Review of the Role of Artificial Intelligence in Healthcare
Al Kuwaiti, A., Nazer, K., Al-Reedy, A., Al-Shehri, S., Al-Muhanna, A., Subbarayalu, A. V., Al Muhanna, D., & Al-Muhanna, F. A. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13060951 · Cited by 915
Pinto-Coelho, L. (2023) · Bioengineering · doi:10.3390/bioengineering10121435 · Cited by 676
Takahashi, S., Sakaguchi, Y., Kouno, N., Takasawa, K., Ishizu, K., Akagi, Y., Aoyama, R., Teraya, N., Bolatkan, A., Shinkai, N., et al. (2024) · Journal of Medical Systems · doi:10.1007/s10916-024-02105-8 · Cited by 343
MALUNet: A Multi-Attention and Light-weight UNet for Skin Lesion Segmentation
Ruan, J., Xiang, S., Xie, M., Liu, T., & Fu, Y. (2022) · 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9995040 · Cited by 335
Capurro, N., Pastore, V. P., Touijer, L., Odone, F., Cozzani, E., Gasparini, G., & Parodi, A. (2024) · British Journal of Dermatology · doi:10.1093/bjd/ljae142 · Cited by 22
Metadata
- Authors
- He, K., Gan, C., Li, Z., Rekik, I., Yin, Z., Ji, W., Gao, Y., Wang, Q., Zhang, J., & Shen, D.
- Venue
- Intelligent Medicine
- Publisher
- Elsevier BV
- Published
- 2023-02
- Volume
- 3
- Issue
- 1
- Pages
- 59-78
- ISSN
- 2096-9376 (ISSN-L)
- 2667-1026
- OpenAlex
- W4293163051
- Cited by
- 475
- References
- 163
- FWCI
- 31.16
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.