Classification of breast cancer in ultrasound imaging using a generic deep learning analysis software: a pilot study
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Objective: To train a generic deep learning software (DLS) to classify breast cancer on ultrasound images and to compare its performance to human readers with variable breast imaging experience. Methods: In this retrospective study, all breast ultrasound examinations from January 1, 2014 to December 31, 2014 at our institution were reviewed. Patients with post-surgical scars, initially indeterminate, or malignant lesions with histological diagnoses or 2-year follow-up were included. The DLS was trained with 70% of the images, and the remaining 30% were used to validate the performance. Three readers with variable expertise also evaluated the validation set (radiologist, resident, medical student). Diagnostic accuracy was assessed with a receiver operating characteristic analysis. Results: 82 patients with malignant and 550 with benign lesions were included. Time needed for training was 7 min (DLS). Evaluation time for the test data set were 3.7 s (DLS) and 28, 22 and 25 min for human readers (decreasing experience). Receiver operating characteristic analysis revealed non-significant differences (p-values 0.45–0.47) in the area under the curve of 0.84 (DLS), 0.88 (experienced and intermediate readers) and 0.79 (inexperienced reader). Conclusion: DLS may aid diagnosing cancer on breast ultrasound images with an accuracy comparable to radiologists, and learns better and faster than a human reader with no prior experience. Further clinical trials with dedicated algorithms are warranted. Advances in knowledge: DLS can be trained classify cancer on breast ultrasound images high accuracy even with comparably few training cases. The fast evaluation speed makes real-time image analysis feasible.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Sixteen studies62,91,92,94,97–107 compared algorithm performance against healthcare professionals.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [62]
In the citing paper
“Only two studies62,63 used prospectively collected data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [62]
In the citing paper
“Only eight studies in ophthalmology imaging14,21,32,33,43,55,108,109, ten studies in respiratory imaging64,66,70,72,75,79,82,87,89,110 and six studies in breast imaging62,91,97,104,106,111 mentioned adherence to the STARD-2015 guidelines or had a STARD flow diagram in the manuscript.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [62]
Citations
Cites
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Kolb, T. M., Lichy, J., & Newhouse, J. H. (2002) · Radiology · doi:10.1148/radiol.2251011667 · Cited by 1,718
Berg, W. A. (2008) · JAMA · doi:10.1001/jama.299.18.2151 · Cited by 1,526
Freer, T. W., & Ulissey, M. J. (2001) · Radiology · doi:10.1148/radiol.2203001282 · Cited by 751
The Invisible Gorilla Strikes Again: Sustained Inattentional Blindness in Expert Observers
Drew, T., Võ, M. L.-H., & Wolfe, J. M. (2013) · Psychological Science · doi:10.1177/0956797613479386 · Cited by 483
On the Local Behavior of Spaces of Natural Images
Carlsson, G., Ishkhanov, T., de Silva, V., & Zomorodian, A. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0056-x · Cited by 477
SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound
Baumgartner, C. F., Kamnitsas, K., Matthew, J., Fletcher, T. P., Smith, S., Koch, L. M., Kainz, B., & Rueckert, D. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2712367 · Cited by 416
Becker, A. S., Marcon, M., Ghafoor, S., Wurnig, M. C., Frauenfelder, T., & Boss, A. (2017) · Investigative Radiology · doi:10.1097/rli.0000000000000358 · Cited by 352
Self-citationScreening Breast Ultrasound: Past, Present, and Future
Brem, R. F., Lenihan, M. J., Lieberman, J., & Torrente, J. (2015) · American Journal of Roentgenology · doi:10.2214/ajr.13.12072 · Cited by 307
Chen, C.-M., Chou, Y.-H., Han, K.-C., Hung, G.-S., Tiu, C.-M., Chiou, H.-J., & Chiou, S.-Y. (2003) · Radiology · doi:10.1148/radiol.2262011843 · Cited by 257
Shan, J., Alam, S. K., Garra, B. S., Zhang, Y., & Ahmed, T. (2016) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2015.11.016 · Cited by 172
Shi, J., Zhou, S., Liu, X., Zhang, Q., Lu, M., & Wang, T. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.01.074 · Cited by 166
Primary and secondary breast lymphoma: prevalence, clinical signs and radiological features
Surov, A., Holzhausen, H., Wienke, A., et al. (2012) · British Journal of Radiology · doi:10.1259/bjr/78413721 · Cited by 144
Xiao, X., Chen, X., Guan, X., Wu, H., Qin, W., & Luo, B. (2016) · British Journal of Radiology · doi:10.1259/bjr.20160546 · Cited by 131
Performance of computer-aided diagnosis in the interpretation of lesions on breast sonography
Horsch, K., Giger, M. L., Vyborny, C. J., & Venta, L. A. (2004) · Academic Radiology · doi:10.1016/s1076-6332(03)00719-0 · Cited by 96
Ultrasound RF Time Series for Classification of Breast Lesions
Uniyal, N., Eskandari, H., Abolmaesumi, P., Sojoudi, S., Gordon, P., Warren, L., Rohling, R. N., Salcudean, S. E., & Moradi, M. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2365030 · Cited by 83
Quantitative Ultrasound Analysis for Classification of BI-RADS Category 3 Breast Masses
Moon, W. K., Lo, C., Chang, J. M., Huang, C., Chen, J., & Chang, R. (2013) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-013-9593-8 · Cited by 53
Adaptive Gradient Descent Backpropagation for Classification of Breast Tumors in Ultrasound Imaging
Singh, B. K., Verma, K., & Thoke, A. S. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.02.091 · Cited by 48
Automated fault detection using deep belief networks for the quality inspection of electromotors
Sun, J., Wyss, R., Steinecker, A., & Glocker, P. (2014) · tm - Technisches Messen · doi:10.1515/teme-2014-1006 · Cited by 46
Mapping visual features to semantic profiles for retrieval in medical imaging
Hofmanninger, J., & Langs, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298643 · Cited by 38
Continuous Ultrasound B-Scanning of Palpable Breast Masses
Cole-Beuglet, C., & Beique, R. A. (1975) · Radiology · doi:10.1148/117.1.123 · Cited by 31
Classification of Breast Tumors Using Sonographic Texture Analysis
Ardakani, A. A., Gharbali, A., & Mohammadi, A. (2015) · Journal of Ultrasound in Medicine · doi:10.7863/ultra.34.2.225 · Cited by 24
Skaane, P., Olsen, J. B., Sager, E. M., et al. (1999) · Acta Radiologica · doi:10.3109/02841859909177733 · Cited by 18
Tice, J. A., Ollendorf, D. A., Lee, J. M., & Pearson, S. D. (2013) · Cited by 17
Kim, S. M., Han, H. S., Park, J. M., Choi, Y. J., Yoon, H. S., Sohn, J. H., Baek, M. H., Kim, Y. N., Chae, Y. M., June, J. J., et al. (2012) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-012-9457-7 · Cited by 16
Giannotti, E., Vinnicombe, S., Thomson, K., et al. (2016) · British Journal of Radiology · doi:10.1259/bjr.20150865 · Cited by 15
SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand UltrasoundPreprint
Baumgartner, C. F., Kamnitsas, K., Matthew, J., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.05601 · Cited by 3
Research works printed but not linked: 1
- Sickles, 2013, ACR bi-rads atlas, breast imaging reporting and data system, 39
Cited by
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883
Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
Pesapane, F., Codari, M., & Sardanelli, F. (2018) · European Radiology Experimental · doi:10.1186/s41747-018-0061-6 · Cited by 833
Convolutional Neural Networks for Radiologic Images: A Radiologist’s Guide
Soffer, S., Ben-Cohen, A., Shimon, O., Amitai, M. M., Greenspan, H., & Klang, E. (2019) · Radiology · doi:10.1148/radiol.2018180547 · Cited by 577
Artificial intelligence and machine learning for medical imaging: A technology review
Barragán-Montero, A., Javaid, U., Valdés, G., Nguyen, D., Desbordes, P., Macq, B., Willems, S., Vandewinckele, L., Holmström, M., Löfman, F., et al. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.04.016 · Cited by 450
Metadata
- Authors
- Becker, A. S., Mueller, M., Stoffel, E., Marcon, M., Ghafoor, S., & Boss, A.
- Affiliations
- University Hospital Zurich (CH)
- Venue
- The British Journal of Radiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-01-01
- Volume
- 91
- Issue
- 1083
- Pages
- 20170576-20170576
- ISSN
- 0007-1285 (ISSN-L)
- 1748-880X
- PMC
- PMC5965470
- OpenAlex
- W2772603135
- Cited by
- 157
- References
- 27
- Citations by year
- 2026: 8 · 2025: 13 · 2024: 17 · 2023: 23 · 2022: 23 · 2021: 27 · 2020: 22 · 2019: 18 · 2018: 6
- FWCI
- 7.51
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- British Journal of Radiology (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- breast cancer, breast ultrasound, deep learning, computer-aided diagnosis, benign versus malignant differentiation, diagnostic accuracy, real-time image analysis
- MeSH terms
- Machine Learning, Adolescent, Adult, Aged, Aged, 80 and over, Algorithms, Breast Neoplasms, Clinical Competence, Female, Humans, Image Interpretation, Computer-Assisted, Middle Aged, Retrospective Studies, Software, Switzerland, Observer Variation, Ultrasonography, Mammary
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.