Automatic classification of ultrasound breast lesions using a deep convolutional neural network mimicking human decision-making
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Objectives To evaluate a deep convolutional neural network (dCNN) for detection, highlighting, and classification of ultrasound (US) breast lesions mimicking human decision-making according to the Breast Imaging Reporting and Data System (BI-RADS).Methods and materials One thousand nineteen breast ultrasound images from 582 patients (age 56.3 ± 11.5 years) were linked to the corresponding radiological report. Lesions were categorized into the following classes: no tissue, normal breast tissue, BI-RADS 2 (cysts, lymph nodes), BI-RADS 3 (non-cystic mass), and BI-RADS 4-5 (suspicious). To test the accuracy of the dCNN, one internal dataset (101 images) and one external test dataset (43 images) were evaluated by the dCNN and two independent readers. Radiological reports, histopathological results, and follow-up examinations served as reference. The performances of the dCNN and the humans were quantified in terms of classification accuracies and receiver operating characteristic (ROC) curves.Results In the internal test dataset, the classification accuracy of the dCNN differentiating BI-RADS 2 from BI-RADS 3-5 lesions was 87.1% (external 93.0%) compared with that of human readers with 79.2 ± 1.9% (external 95.3 ± 2.3%). For the classification of BI-RADS 2-3 versus BI-RADS 4-5, the dCNN reached a classification accuracy of 93.1% (external 95.3%), whereas the classification accuracy of humans yielded 91.6 ± 5.4% (external 94.1 ± 1.2%). The AUC on the internal dataset was 83.8 (external 96.7) for the dCNN and 84.6 ± 2.3 (external 90.9 ± 2.9) for the humans.Conclusion dCNNs may be used to mimic human decision-making in the evaluation of single US images of breast lesion according to the BI-RADS catalog. The technique reaches high accuracies and may serve for standardization of highly observer-dependent US assessment.Key points • Deep convolutional neural networks could be used to classify US breast lesions. • The implemented dCNN with its sliding window approach reaches high accuracies in the classification of US breast lesions. • Deep convolutional neural networks may serve for standardization in US BI-RADS classification.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“eight91–98 studies validated algorithms on external data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [92]
In the citing paper
“Sixteen studies62,91,92,94,97–107 compared algorithm performance against healthcare professionals.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [92]
Citations
Cites
Solid breast nodules: use of sonography to distinguish between benign and malignant lesions.
Stavros, A. T., Thickman, D., Rapp, C. L., Dennis, M. A., Parker, S. H., & Sisney, G. A. (1995) · Radiology · doi:10.1148/radiology.196.1.7784555 · Cited by 1,780
Berg, W. A. (2008) · JAMA · doi:10.1001/jama.299.18.2151 · Cited by 1,526
The benefits and harms of breast cancer screening: an independent review
(2012) · The Lancet · doi:10.1016/s0140-6736(12)61611-0 · Cited by 1,492
Automated breast ultrasound lesions detection using convolutional neural networks
Yap, M. H., Pons, G., Martí, J., Ganau, S., Sentís, M., Zwiggelaar, R., Davison, A. K., & Martí, R. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2731873 · Cited by 1,086
Cheng, J.-Z., Ni, D., Chou, Y.-H., Qin, J., Tiu, C.-M., Chang, Y.-C., Huang, C.-S., Shen, D., & Chen, C.-M. (2016) · Scientific Reports · doi:10.1038/srep24454 · Cited by 755
Mammographic density and breast cancer risk: current understanding and future prospects
Boyd, N. F., Martin, L. J., Yaffe, M. J., & Minkin, S. (2011) · Breast Cancer Research · doi:10.1186/bcr2942 · Cited by 609
Kelly, K. M., Dean, J., Comulada, W. S., & Lee, S.-J. (2010) · European Radiology · doi:10.1007/s00330-009-1588-y · Cited by 497
A deep learning framework for supporting the classification of breast lesions in ultrasound images
Han, S., Kang, H.-K., Jeong, J.-Y., Park, M.-H., Kim, W., Bang, W.-C., & Seong, Y.-K. (2017) · Physics in Medicine & Biology · doi:10.1088/1361-6560/aa82ec · Cited by 358
Joo, S., Yang, Y. S., Moon, W. K., & Kim, H. C. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.834617 · Cited by 255
Research works printed but not linked: 1
- Kuhl CK (2017) Abbreviated breast MRI for screening women with dense breast: the EA1141 Trial. Br J Radiol. https://doi.org/10.1259/bjr.20170441:20170441 · doi:10.1259/bjr.20170441:20170441
Cited by
Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
External Validation of Deep Learning Algorithms for Radiologic Diagnosis: A Systematic Review
Yu, A. C., Mohajer, B., & Eng, J. (2022) · Radiology: Artificial Intelligence · doi:10.1148/ryai.210064 · Cited by 408
Shen, Y., Shamout, F. E., Oliver, J. R., Witowski, J., Kannan, K., Park, J., Wu, N., Huddleston, C., Wolfson, S., Millet, A., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-26023-2 · Cited by 270
Qian, X., Pei, J., Zheng, H., Xie, X., Yan, L., Zhang, H., Han, C., Gao, X., Zhang, H., Zheng, W., et al. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-021-00711-2 · Cited by 253
Dong, F., She, R., Cui, C., Shi, S., Hu, X., Zeng, J., Wu, H., Xu, J., & Zhang, Y. (2021) · European Radiology · doi:10.1007/s00330-020-07561-7 · Cited by 43
Metadata
- Authors
- Ciritsis, A., Rossi, C., Eberhard, M., Marcon, M., Becker, A. S., & Boss, A.
- Affiliations
- University Hospital Zurich (CH)
- Corresponding author
- Ciritsis, Alexander
- Venue
- European Radiology
- Published
- 2019-03-29
- Volume
- 29
- Issue
- 10
- Pages
- 5458-5468
- ISSN
- 0938-7994 (ISSN-L)
- 1432-1084
- OpenAlex
- W2929215516
- Cited by
- 117
- References
- 31
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 18 · 2023: 26 · 2022: 23 · 2021: 23 · 2020: 12 · 2019: 4
- FWCI
- 7.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- European Radiology (publishedVersion)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Funders
- Universität Zürich
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Pathology and Forensic Medicine › Breast Lesions and Carcinomas
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- breast ultrasound, breast lesion classification, deep convolutional neural networks, computer-aided diagnosis, observer variability, sliding window, breast cancer detection, radiologist performance comparison, external validation, histopathological correlation
- MeSH terms
- Clinical Decision-Making, Adult, Aged, Algorithms, Breast Neoplasms, Female, Humans, Image Interpretation, Computer-Assisted, Middle Aged, Retrospective Studies, ROC Curve, Observer Variation, Ultrasonography, Mammary, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatic classification of ultrasound breast lesions using a deep convolutional neural network mimicking human decision-making. https://app.cochat.ai/papers/10.1007/s00330-019-06118-7
- The paper
- Ciritsis, A., Rossi, C., Eberhard, M., Marcon, M., Becker, A. S., & Boss, A. (2019). Automatic classification of ultrasound breast lesions using a deep convolutional neural network mimicking human decision-making. European Radiology. https://doi.org/10.1007/s00330-019-06118-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.