The DOI matches its Crossref record; 13 of the 14 references it cites were found in a registry or an index.
Vision Transformers for Classification of Breast Ultrasound Images
Abstract
Medical ultrasound (US) imaging has become a prominent modality for breast cancer imaging due to its ease of use, low cost, and safety. In the past decade, convolutional neural networks (CNNs) have emerged as the method of choice in vision applications and have shown excellent potential in the automatic classification of US images. Despite their success, their restricted local receptive field limits their ability to learn global context information. Recently, Vision Transformer (ViT) designs, based on self-attention between image patches, have shown great potential to be an alternative to CNNs. In this study, for the first time, we utilize ViT to classify breast US images using different augmentation strategies. We also adopted a weighted cross-entropy loss function since breast ultrasound datasets are often imbalanced. The results are provided as classification accuracy and Area Under the Curve (AUC) metrics, and the performance is compared with the SOTA CNNs. The results indicate that the ViT models have comparable efficiency with or even better than the CNNs in the classification of US breast images. Clinical relevance- This work shows the potential of Vision Transformers in the automatic classification of masses in breast ultrasound, which helps clinicians diagnose and make treatment decisions more precisely.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most works [30 -34] in medical image classi fi cation jointly adopt the CNN and transformer model but did not develop a transformer-based backbone without convolutions to capture multi-granularity information in medical images.”
From DilatedFormer: dilated granularity transformer network for placental maturity grading in ultrasound (2023) · cites this paper as [31]
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
UNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H. R., & Xu, D. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00181 · Cited by 3,586 · cited 4×
“However, due to their localized receptive fields, these models have a poor performance in learning the longrange information, limiting their capabilities for vision tasks [3].”
InfluentialDataset of breast ultrasound images
Al-Dhabyani, W., Gomaa, M., Khaled, H., & Fahmy, A. (2020) · Data in Brief · doi:10.1016/j.dib.2019.104863 · Cited by 2,405
Automated breast ultrasound lesions detection using convolutional neural networks
Yap, M. H., Pons, G., Martí, J., Ganau, S., Sentís, M., Zwiggelaar, R., Davison, A. K., & Martí, R. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2731873 · Cited by 1,086
TransMed: Transformers Advance Multi-Modal Medical Image Classification
Dai, Y., Gao, Y., & Liu, F. (2021) · Diagnostics · doi:10.3390/diagnostics11081384 · Cited by 511
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers
Steiner, A., Kolesnikov, A., Zhai, X., Wightman, R., Uszkoreit, J., & Beyer, L. (2021) · arXiv · doi:10.48550/arxiv.2106.10270 · Cited by 292
Learning from Imbalanced Data Sets with Weighted Cross-Entropy Function
Aurelio, Y. S., de Almeida, G. M., de Castro, C. L., & Braga, A. P. (2019) · Neural Processing Letters · doi:10.1007/s11063-018-09977-1 · Cited by 285
Training data-efficient image transformers & distillation through attention
Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., & Jégou, H. (2020) · arXiv · doi:10.48550/arxiv.2012.12877 · Cited by 182
MIL-VT: Multiple Instance Learning Enhanced Vision Transformer for Fundus Image Classification
Yu, S., Ma, K., Bi, Q., Bian, C., Ning, M., He, N., Li, Y., Liu, H., & Zheng, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87237-3_5 · Cited by 180
Research works printed but not linked: 1
- dosovitskiy, 2020, An image is worth 16×16 words: Transformers for image recognition at scale, ArXiv Preprint
Cited by
Sorted by citations
Items 201–225 of 225
Deep Learning for Clinical Ultrasound Imaging: From Supervised Approaches to Foundation Models
He, K., Wei, D., & Ranger, B. J. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3636830
Label-Efficient Breast Ultrasound Lesion Detection using a Tiny Transformer Encoder (TEBCS-Net)
Azar, N. A. N. (2025) · International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT) · doi:10.1109/ismsit67332.2025.11268178
Leveraging Transfer Learning and CNNs for Classification of Breast Cancer via Ultrasound Images
Zemam, R. M., Belal, N. A., & Youssif, A. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-6429-0_26
Iacob, B., & Laura, D. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-12478-4_2
Jiang, X., Ding, X., Ma, J., Liu, C., & Li, X. (2026) · Sensors · doi:10.3390/s26030974 · Cited by 1
R, R. V., & Kashyap, K. L. (2025) · International Conference on Computational Intelligence and Communication Networks (CICN) · doi:10.1109/cicn67655.2025.11367878
Манжос, Г. Ю., Томилов, И. В., Gusarova, N., & Valitova, Y. O. (2026) · Scientific and technical journal of information technologies mechanics and optics · doi:10.17586/2226-1494-2026-26-1-77-84
Breast mass pattern classification using vision transformers (VITs) with varied optimizers
Hans, R., & Kaur, N. (2026) · AIP conference proceedings · doi:10.1063/5.0322698
Leveraging Vision Transformer to Classify Cancer Stages from Breast Ultrasound Images
Junayed, M., & Reza, T. T. (2025) · IEEE International Conference on Signal Processing, Information, Communication and Systems (SPICSCON) · doi:10.1109/spicscon69221.2025.11504239
SegViT-Based Segmentation of Common Carotid Artery Ultrasound Images
Liu, Y., Wang, X.-J., Chiu, P.-S., Xu, C.-F., & Huang, K.-W. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-0263-8_13
Segmentation-Guided Multi-Stream Classification of Breast Ultrasound Images Using Deep Learning
Agrawalla, R., Bhati, A., Pushpalatha, M., & Poornima, S. (2026) · International Conference on Intelligent Technologies (CONIT) · doi:10.1109/conit69683.2026.11621537
Çelik, G., & Başaran, E. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.111172
Alsallum, N., Saadeldin, M., & Safdar, A. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00223
Pan-Cancer Histopathology Foundation Models Can Diagnose Oral Lesions Robustly Without Fine-Tuning
Bhattacharya, S., Bandyopadhyay, R., Pal, V., Saha, S. K., & Chakraborti, T. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-7425-4_53
WaveViT-YOLO: A Hybrid Architecture for Dental Caries Detection in Intraoral Photographs
Neji, I., Filali, I., & Ejbali, R. (2026) · Applied Sciences · doi:10.3390/app16168257
Ali, A., Raza, B., Zahra, K., Naqvi, R. A., & Dharejo, F. A. (2026) · Bioengineering · doi:10.3390/bioengineering13090956
Alhaj, Z. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02073-7
Hussaini, H., Bano, S., Elyan, E., & Moreno‐García, C. F. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02249-8
Ozkan-Tepe, A., & Kaya, M. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.111437
Saleem, M. U., Peng, B., Mastoi, M. S., Hassan, M., & Rafique, M. Z. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-31236-5_21
Diptho, R. A., Ghosh, P., Chowdhury, S. H., & Basak, S. (2026) · NDT · doi:10.3390/ndt4030028
Kabir, S. M., Bhuiyan, M. I. H., Shakib, M. N., & Lim, H. S. (2026) · IEEE Access · doi:10.1109/access.2026.3740414
Liu, J., Zhu, B., Yu, M., & Du, S. (2026) · Neurology International · doi:10.3390/neurolint18100191
Sharma, D., & Chauhan, S. (2026) · Academic Radiology · doi:10.1016/j.acra.2026.10.003
Kutlu, H., & Çolak, C. (2026) · Konuralp Tıp Dergisi · doi:10.18521/ktd.1909571
Metadata
- Authors
- Gheflati, B., & Rivaz, H.
- Affiliations
- Concordia University (CA)
- Venue
- 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
- Publisher
- IEEE
- Published
- 2022-07-11
- Volume
- 2022
- Pages
- 480-483
- ISSN
- 2375-7477 (ISSN-L)
- OpenAlex
- W4294975187
- Cited by
- 225
- References
- 14
- Citations by year
- 2026: 28 · 2025: 65 · 2024: 56 · 2023: 59 · 2022: 16
- FWCI
- 27.10
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Medicine › Pathology and Forensic Medicine › Breast Lesions and Carcinomas
- Keywords
- vision transformer, breast ultrasound, breast cancer, mass classification, self-attention, data augmentation, class imbalance, weighted cross-entropy loss, CNN comparison, automated diagnosis
- MeSH terms
- Breast, Breast Neoplasms, Female, Humans, Ultrasonography, Ultrasonography, Mammary, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review