Automatic classification of ultrasound breast lesions using a deep convolutional neural network mimicking human decision-making
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Objectives To evaluate a deep convolutional neural network (dCNN) for detection, highlighting, and classification of ultrasound (US) breast lesions mimicking human decision-making according to the Breast Imaging Reporting and Data System (BI-RADS).Methods and materials One thousand nineteen breast ultrasound images from 582 patients (age 56.3 ± 11.5 years) were linked to the corresponding radiological report. Lesions were categorized into the following classes: no tissue, normal breast tissue, BI-RADS 2 (cysts, lymph nodes), BI-RADS 3 (non-cystic mass), and BI-RADS 4-5 (suspicious). To test the accuracy of the dCNN, one internal dataset (101 images) and one external test dataset (43 images) were evaluated by the dCNN and two independent readers. Radiological reports, histopathological results, and follow-up examinations served as reference. The performances of the dCNN and the humans were quantified in terms of classification accuracies and receiver operating characteristic (ROC) curves.Results In the internal test dataset, the classification accuracy of the dCNN differentiating BI-RADS 2 from BI-RADS 3-5 lesions was 87.1% (external 93.0%) compared with that of human readers with 79.2 ± 1.9% (external 95.3 ± 2.3%). For the classification of BI-RADS 2-3 versus BI-RADS 4-5, the dCNN reached a classification accuracy of 93.1% (external 95.3%), whereas the classification accuracy of humans yielded 91.6 ± 5.4% (external 94.1 ± 1.2%). The AUC on the internal dataset was 83.8 (external 96.7) for the dCNN and 84.6 ± 2.3 (external 90.9 ± 2.9) for the humans.Conclusion dCNNs may be used to mimic human decision-making in the evaluation of single US images of breast lesion according to the BI-RADS catalog. The technique reaches high accuracies and may serve for standardization of highly observer-dependent US assessment.Key points • Deep convolutional neural networks could be used to classify US breast lesions. • The implemented dCNN with its sliding window approach reaches high accuracies in the classification of US breast lesions. • Deep convolutional neural networks may serve for standardization in US BI-RADS classification.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“eight91–98 studies validated algorithms on external data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [92]
In the citing paper
“Sixteen studies62,91,92,94,97–107 compared algorithm performance against healthcare professionals.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [92]
Citations
Cites
Solid breast nodules: use of sonography to distinguish between benign and malignant lesions.
Stavros, A. T., Thickman, D., Rapp, C. L., Dennis, M. A., Parker, S. H., & Sisney, G. A. (1995) · Radiology · doi:10.1148/radiology.196.1.7784555 · Cited by 1,780
Berg, W. A. (2008) · JAMA · doi:10.1001/jama.299.18.2151 · Cited by 1,526
The benefits and harms of breast cancer screening: an independent review
(2012) · The Lancet · doi:10.1016/s0140-6736(12)61611-0 · Cited by 1,492
Automated breast ultrasound lesions detection using convolutional neural networks
Yap, M. H., Pons, G., Martí, J., Ganau, S., Sentís, M., Zwiggelaar, R., Davison, A. K., & Martí, R. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2731873 · Cited by 1,086
Cheng, J.-Z., Ni, D., Chou, Y.-H., Qin, J., Tiu, C.-M., Chang, Y.-C., Huang, C.-S., Shen, D., & Chen, C.-M. (2016) · Scientific Reports · doi:10.1038/srep24454 · Cited by 755
Mammographic density and breast cancer risk: current understanding and future prospects
Boyd, N. F., Martin, L. J., Yaffe, M. J., & Minkin, S. (2011) · Breast Cancer Research · doi:10.1186/bcr2942 · Cited by 609
Kelly, K. M., Dean, J., Comulada, W. S., & Lee, S.-J. (2010) · European Radiology · doi:10.1007/s00330-009-1588-y · Cited by 497
A deep learning framework for supporting the classification of breast lesions in ultrasound images
Han, S., Kang, H.-K., Jeong, J.-Y., Park, M.-H., Kim, W., Bang, W.-C., & Seong, Y.-K. (2017) · Physics in Medicine & Biology · doi:10.1088/1361-6560/aa82ec · Cited by 358
Joo, S., Yang, Y. S., Moon, W. K., & Kim, H. C. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.834617 · Cited by 255
Consequences of false-positive screening mammograms
Tosteson, A. N. A., Fryback, D. G., Hammond, C. S., Hanna, L. G., Grove, M. R., Brown, M., Wang, Q., Lindfors, K., & Pisano, E. D. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.981 · Cited by 217
Breast density implications and supplemental screening
Vourtsis, A., & Berg, W. A. (2019) · European Radiology · doi:10.1007/s00330-018-5668-8 · Cited by 217
Observer variability of Breast Imaging Reporting and Data System (BI-RADS) for breast ultrasound
Lee, H.-J., Kim, E.-K., Kim, M. J., Youk, J. H., Lee, J. Y., Kang, D. R., & Oh, K. K. (2008) · European Journal of Radiology · doi:10.1016/j.ejrad.2007.04.008 · Cited by 181
Becker, A. S., Mueller, M., Stoffel, E., Marcon, M., Ghafoor, S., & Boss, A. (2018) · The British Journal of Radiology · doi:10.1259/bjr.20170576 · Cited by 157
Self-citationNewell, D., Nie, K., Chen, J.-H., Hsu, C.-C., Yu, H. J., Nalcioglu, O., & Su, M.-Y. (2010) · European Radiology · doi:10.1007/s00330-009-1616-y · Cited by 150
Yang, M.-C., Moon, W. K., Wang, Y.-C. F., Bae, M. S., Huang, C.-S., Chen, J.-H., & Chang, R.-F. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2279938 · Cited by 97
Park, C. S., Lee, J. H., Yim, H. W., Kang, B. J., Kim, H. S., Jung, J. I., Jung, N. Y., & Kim, S. H. (2007) · Korean Journal of Radiology · doi:10.3348/kjr.2007.8.5.397 · Cited by 88
Advances in oncologic imaging: Update on 5 Common Cancers
Akin, O., Brennan, S. B., Dershaw, D. D., Ginsberg, M. S., Gollub, M. J., Schöder, H., Panicek, D. M., & Hricak, H. (2012) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21156 · Cited by 71
Decline in breast cancer mortality: How much is attributable to screening?
Njor, S. H., Schwartz, W., Blichert-Toft, M., & Lynge, E. (2014) · Journal of Medical Screening · doi:10.1177/0969141314563632 · Cited by 58
Rodtook, A., & Makhanov, S. S. (2013) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2013.09.009 · Cited by 56
Pain in different methods of breast biopsy: Emphasis on vacuum-assisted breast biopsy
Zagouri, F., Sergentanis, T. Ν., Gounaris, A., Koulocheri, D., Nonni, A., Domeyer, P.-R. J., Fotiadis, C., Bramis, J., & Zografos, G. (2007) · The Breast · doi:10.1016/j.breast.2007.07.039 · Cited by 55
Quantitative Ultrasound Analysis for Classification of BI-RADS Category 3 Breast Masses
Moon, W. K., Lo, C., Chang, J. M., Huang, C., Chen, J., & Chang, R. (2013) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-013-9593-8 · Cited by 53
Scar formation after stereotactic vacuum-assisted core biopsy of benign breast lesions
Yazici, B., Sever, A. R., Mills, P., Fish, D. E., Jones, S. E., & Jones, P. (2006) · Clinical Radiology · doi:10.1016/j.crad.2006.03.008 · Cited by 41
Stavros, A. T., de Freitas, A. G., deMello, G. G. N., Barke, L. D., McDonald, D., Kaske, T. I., Wolverton, D., Honick, A., Stanzani, D., Ferreira, A. H. P. G., et al. (2017) · European Radiology · doi:10.1007/s00330-017-4835-7 · Cited by 41
Lång, K., Andersson, I., & Zackrisson, S. (2014) · British Journal of Radiology · doi:10.1259/bjr.20140080 · Cited by 39
Detection of breast lesion regions in ultrasound images using wavelets and order statistics
Mogatadakala, K. V., Donohue, K. D., Piccoli, C. W., & Forsberg, F. (2006) · Medical Physics · doi:10.1118/1.2174134 · Cited by 33
FAMILY HISTORY OF BREAST CANCER, MAMMOGRAPHIC FEATURES OF BREAST TISSUE, AND BREAST CANCER RISK
Brisson, J. (1991) · Epidemiology · doi:10.1097/00001648-199111000-00009 · Cited by 25
Classification of Breast Tumors Using Sonographic Texture Analysis
Ardakani, A. A., Gharbali, A., & Mohammadi, A. (2015) · Journal of Ultrasound in Medicine · doi:10.7863/ultra.34.2.225 · Cited by 24
Tice, J. A., Ollendorf, D. A., Lee, J. M., & Pearson, S. D. (2013) · Cited by 17
Yap, M. H., & Yap, C. H. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2208797 · Cited by 10
(2000) · Medical Entomology and Zoology
Research works printed but not linked: 1
- Kuhl CK (2017) Abbreviated breast MRI for screening women with dense breast: the EA1141 Trial. Br J Radiol. https://doi.org/10.1259/bjr.20170441:20170441 · doi:10.1259/bjr.20170441:20170441
Cited by
Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
External Validation of Deep Learning Algorithms for Radiologic Diagnosis: A Systematic Review
Yu, A. C., Mohajer, B., & Eng, J. (2022) · Radiology: Artificial Intelligence · doi:10.1148/ryai.210064 · Cited by 408
Shen, Y., Shamout, F. E., Oliver, J. R., Witowski, J., Kannan, K., Park, J., Wu, N., Huddleston, C., Wolfson, S., Millet, A., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-26023-2 · Cited by 270
Qian, X., Pei, J., Zheng, H., Xie, X., Yan, L., Zhang, H., Han, C., Gao, X., Zhang, H., Zheng, W., et al. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-021-00711-2 · Cited by 253
Artificial intelligence in ultrasound
Shen, Y.-T., Chen, L., Yue, W.-W., & Xu, H.-X. (2021) · European Journal of Radiology · doi:10.1016/j.ejrad.2021.109717 · Cited by 214
Metadata
- Authors
- Ciritsis, A., Rossi, C., Eberhard, M., Marcon, M., Becker, A. S., & Boss, A.
- Affiliations
- University Hospital Zurich (CH)
- Corresponding author
- Ciritsis, Alexander
- Venue
- European Radiology
- Published
- 2019-03-29
- Volume
- 29
- Issue
- 10
- Pages
- 5458-5468
- ISSN
- 0938-7994 (ISSN-L)
- 1432-1084
- OpenAlex
- W2929215516
- Cited by
- 117
- References
- 31
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 18 · 2023: 26 · 2022: 23 · 2021: 23 · 2020: 12 · 2019: 4
- FWCI
- 7.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- European Radiology (publishedVersion)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Funders
- Universität Zürich
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Pathology and Forensic Medicine › Breast Lesions and Carcinomas
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- breast ultrasound, breast lesion classification, deep convolutional neural networks, computer-aided diagnosis, observer variability, sliding window, breast cancer detection, radiologist performance comparison, external validation, histopathological correlation
- MeSH terms
- Clinical Decision-Making, Adult, Aged, Algorithms, Breast Neoplasms, Female, Humans, Image Interpretation, Computer-Assisted, Middle Aged, Retrospective Studies, ROC Curve, Observer Variation, Ultrasonography, Mammary, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.