A Review of Applications of Machine Learning in Mammography and Future Challenges
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Background: The aim of this study is to systematically review the literature to summarize the evidence surrounding the clinical utility of artificial intelligence (AI) in the field of mammography. Databases from PubMed, IEEE Xplore, and Scopus were searched for relevant literature. Studies evaluating AI models in the context of prediction and diagnosis of breast malignancies that also reported conventional performance metrics were deemed suitable for inclusion. From 90 unique citations, 21 studies were considered suitable for our examination. Data was not pooled due to heterogeneity in study evaluation methods. Summary: Three studies showed the applicability of AI in reducing workload. Six studies demonstrated that AI can aid in diagnosis, with up to 69% reduction in false positives and an increase in sensitivity ranging from 84 to 91%. Five studies show how AI models can independently mark and classify suspicious findings on conventional scans, with abilities comparable with radiologists. Seven studies examined AI predictive potential for breast cancer and risk score calculation. Key Messages: Despite limitations in the current evidence base and technical obstacles, this review suggests AI has marked potential for extensive use in mammography. Additional works, including large-scale prospective studies, are warranted to elucidate the clinical utility of AI.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Several systematic reviews have been conducted to summarize the performance of recent AI-assisted tools in specific clinical settings”
From Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review (2022) · cites this paper as [10]
Citations
Cites
International evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287 · cited 3×
“The study concluded that this process can alleviate workload of the second reader up to 88% [21].”
BackgroundMethodInfluentialA breast cancer prediction model incorporating familial and personal risk factors
Tyrer, J., Duffy, S. W., & Cuzick, J. (2004) · Statistics in Medicine · doi:10.1002/sim.1668 · Cited by 1,345
Ensuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341 · cited 1×
“An increasing worry re-volves around creating fair AI practices that promote eq-uity in diagnosis and treatment [49].”
BackgroundA Deep Learning Mammography-based Model for Improved Breast Cancer Risk Prediction
Yala, A., Lehman, C., Schuster, T., Portnoi, T., & Barzilay, R. (2019) · Radiology · doi:10.1148/radiol.2019182716 · Cited by 758
Rodriguez-Ruiz, A., Lång, K., Gubern-Merida, A., Broeders, M., Gennaro, G., Clauser, P., Helbich, T. H., Chevalier, M., Tan, T., Mertelmeier, T., et al. (2019) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djy222 · Cited by 692 · cited 1×
“…AI software (Transpara 1.4.0, Screenpoint Medical BV) to radiologists in the detection of breast cancer in digital mammograms, the performance of the AI system was found to be statistically non-inferior to the average performance of the radiologists at a non-inferiority margin of 0.05 [28].”
MethodInfluentialNelson, H. D., Fu, R., Cantor, A., Pappas, M., Daeges, M., & Humphrey, L. (2016) · Annals of Internal Medicine · doi:10.7326/m15-0969 · Cited by 611
Hubbard, R. A., Kerlikowske, K., Flowers, C. I., Yankaskas, B. C., Zhu, W., & Miglioretti, D. L. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00004 · Cited by 414
Nelson, H. D., Pappas, M., Cantor, A., Griffin, J., Daeges, M., & Humphrey, L. (2016) · Annals of Internal Medicine · doi:10.7326/m15-0970 · Cited by 410
A framework for secure and decentralized sharing of medical imaging data via blockchain consensus
Patel, V. (2019) · Health Informatics Journal · doi:10.1177/1460458218769699 · Cited by 384
Huynh, P. T., Jarolimek, A. M., & Daye, S. (1998) · RadioGraphics · doi:10.1148/radiographics.18.5.9747612 · Cited by 318
Identifying Women With Dense Breasts at High Risk for Interval Cancer: A Cohort Study
Kerlikowske, K., Zhu, W., Tosteson, A. N. A., Sprague, B. L., Tice, J. A., Lehman, C. D., Miglioretti, D. L., & for the Breast Cancer Surveillance Consortium* (2015) · Annals of Internal Medicine · doi:10.7326/m14-1465 · Cited by 286
SD-CNN: A shallow-deep CNN for improved breast cancer diagnosis
Gao, F., Wu, T., Li, J., Zheng, B., Ruan, L., Shang, D., & Patel, B. (2018) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2018.09.004 · Cited by 213
Rodriguez-Ruiz, A., Lång, K., Gubern-Merida, A., Teuwen, J., Broeders, M., Gennaro, G., Clauser, P., Helbich, T. H., Chevalier, M., Mertelmeier, T., et al. (2019) · European Radiology · doi:10.1007/s00330-019-06186-9 · Cited by 210
A Deep Learning Model to Triage Screening Mammograms: A Simulation Study
Yala, A., Schuster, T., Miles, R., Barzilay, R., & Lehman, C. (2019) · Radiology · doi:10.1148/radiol.2019182908 · Cited by 210 · cited 2×
“The radiologists in the study showed a significant improvement in specificity (93.5–94.2%; p = 0.002) and a non-inferior sensitivity (90.6 vs. 90.1%; p < 0.001) at a margin of 0.05 [20].”
BackgroundInfluentialNelson, H. D., O'Meara, E. S., Kerlikowske, K., Balch, S., & Miglioretti, D. (2016) · Annals of Internal Medicine · doi:10.7326/m15-0971 · Cited by 202
Sprague, B. L., Conant, E. F., Onega, T., Garcia, M. P., Beaber, E. F., Herschorn, S. D., Lehman, C. D., Tosteson, A. N. A., Lacson, R., Schnall, M. D., et al. (2016) · Annals of Internal Medicine · doi:10.7326/m15-2934 · Cited by 202
The calculation of breast cancer risk for women with a first degree family history of ovarian cancer
Claus, E. B., Risch, N., & Thompson, W. D. (1993) · Breast Cancer Research and Treatment · doi:10.1007/bf00666424 · Cited by 193
Classification of Mammogram Images Using Multiscale all Convolutional Neural Network (MA-CNN)
Agnes, S. A., Anitha, J., Pandian, S. I. A., & Peter, J. D. (2020) · Journal of Medical Systems · doi:10.1007/s10916-019-1494-z · Cited by 162
Deep Learning to Distinguish Recalled but Benign Mammography Images in Breast Cancer Screening
Aboutalib, S., Mohamed, A. A., Berg, W. A., Zuley, M. L., Sumkin, J. H., & Wu, S. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-1115 · Cited by 149
Geis, J. R., Brady, A. P., Wu, C. C., Spencer, J., Ranschaert, E., Jaremko, J. L., Langer, S. G., Kitts, A. B., Birch, J., Shields, W. F., et al. (2019) · Canadian Association of Radiologists Journal · doi:10.1016/j.carj.2019.08.010 · Cited by 140 · cited 1×
“Geis et al. [48] call attention to the fact that various AI models are relatively straightforward to produce and develop, which emphasizes the importance of streamlining existing perspectives on the subject to focus on radiology specifically.”
BackgroundOng, M.-S., & Mandl, K. D. (2015) · Health Affairs · doi:10.1377/hlthaff.2014.1087 · Cited by 139
Allen, B., Seltzer, S. E., Langlotz, C. P., Dreyer, K. P., Summers, R. M., Petrick, N., Marinac-Dabic, D., Cruz, M., Alkasab, T. K., Hanisch, R. J., et al. (2019) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2019.04.014 · Cited by 128
Deep learning modeling using normal mammograms for predicting breast cancer risk
Arefan, D., Mohamed, A. A., Berg, W. A., Zuley, M. L., Sumkin, J. H., & Wu, S. (2020) · Medical Physics · doi:10.1002/mp.13886 · Cited by 128
Duffy, S. W., Tabár, L. K., Viták, B., Day, N., Smith, R. A., Chen, H. H. T., & Yen, M. F. A. (2003) · European Journal of Cancer · doi:10.1016/s0959-8049(03)00259-4 · Cited by 108
Artificial Intelligence in Breast Imaging: Potentials and Limitations
Mendelson, E. B. (2019) · American Journal of Roentgenology · doi:10.2214/ajr.18.20532 · Cited by 106
Classification of Whole Mammogram and Tomosynthesis Images Using Deep Convolutional Neural Networks
Zhang, X., Zhang, Y., Han, E. Y., Jacobs, N., Han, Q., Wang, X.-Q., & Liu, J. (2018) · IEEE Transactions on Nanobioscience · doi:10.1109/tnb.2018.2845103 · Cited by 102
Watanabe, A. T., Lim, V., Vu, H. X., Chim, R., Weise, E., Liu, J., Bradley, W. G., & Comstock, C. E. (2019) · Journal of Digital Imaging · doi:10.1007/s10278-019-00192-5 · Cited by 95
Mayo, R. C., Kent, D., Sen, L. C., Kapoor, M., Leung, J. W. T., & Watanabe, A. T. (2019) · Journal of Digital Imaging · doi:10.1007/s10278-018-0168-6 · Cited by 87
Convolutional Neural Network Based Breast Cancer Risk Stratification Using a Mammographic Dataset
Ha, R., Chang, P., Karcich, J., Mutasa, S., Pascual Van Sant, E., Liu, M. Z., & Jambawalikar, S. (2019) · Academic Radiology · doi:10.1016/j.acra.2018.06.020 · Cited by 63
Machine Learning Approaches for the Prioritization of Genomic Variants Impacting Pre-mRNA Splicing
Rowlands, C. F., Baralle, D., & Ellingford, J. M. (2019) · Cells · doi:10.3390/cells8121513 · Cited by 61
Becker, A. S., Jendele, L., Skopek, O., Berger, N., Ghafoor, S., Marcon, M., & Konukoğlu, E. (2019) · European Journal of Radiology · doi:10.1016/j.ejrad.2019.108649 · Cited by 39
Mammographic mass segmentation using fuzzy contours
Hmida, M., Hamrouni, K., Solaiman, B., & Boussetta, S. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.07.005 · Cited by 30
Hinton, B., Ma, L., Mahmoudzadeh, A. P., Malkov, S., Fan, B., Greenwood, H. I., Joe, B. N., Lee, V., Kerlikowske, K. M., & Shepherd, J. A. (2019) · Cancer Imaging · doi:10.1186/s40644-019-0227-3 · Cited by 26
Discovery of Breast Cancers Within 1 Year of a Normal Screening Mammogram: How Are They Found?
Carney, P. A., Steiner, E. A., Goodrich, M. E., Dietrich, A. J., Kasales, C. J., Weiss, J. E., & MacKenzie, T. A. (2006) · The Annals of Family Medicine · doi:10.1370/afm.580 · Cited by 16
Linden, O. E., Hayward, J. H., Price, E. R., Kelil, T., Joe, B. N., & Lee, A. Y. (2020) · American Journal of Roentgenology · doi:10.2214/ajr.19.21760 · Cited by 9
Research works printed but not linked: 1
- 10.1002/sim.1668 · DOI · Paper page
Cited by
Adam, R., Dell’Aquila, K., Hodges, L., Maldjian, T., & Duong, T. Q. (2023) · Breast Cancer Research · doi:10.1186/s13058-023-01687-4 · Cited by 156
Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review
Lam, T. Y. T., Cheung, M. F. K., Munro, Y. L., Lim, K. M., Shung, D., & Sung, J. J. Y. (2022) · Journal of Medical Internet Research · doi:10.2196/37188 · Cited by 120
“…in specific clinical settings, such as AI-assisted adenoma detection during colonoscopy [9], AI-assisted mammography in detecting breast cancer [10], AI-assisted intracranial hemorrhage recognition on computed tomography head imaging [11], AI-assisted glycemic control for patients with…”
Jeong, J. J., Vey, B. L., Bhimireddy, A., Kim, T., Santos, T., Correa, R., Dutt, R., Mosunjac, M., Oprea-Ilies, G., Smith, G., et al. (2023) · Radiology Artificial Intelligence · doi:10.1148/ryai.220047 · Cited by 92
Oyelade, O. N., & Ezugwu, A. E.-S. (2022) · Scientific Reports · doi:10.1038/s41598-022-09905-3 · Cited by 88
Advancements in Oncology with Artificial Intelligence—A Review Article
Vobugari, N., Raja, V., Sethi, U., Gandhi, K. D., Raja, K., & Surani, S. (2022) · Cancers · doi:10.3390/cancers14051349 · Cited by 85
Metadata
- Authors
- Batchu, S., Liu, F., Amireh, A., Waller, J., & Umair, M.
- Affiliations
- Cooper Medical School of Rowan University (US)
- Stanford Medicine (US)
- Duke Medical Center (US)
- Drexel University (US)
- Northwestern University (US)
- Venue
- Oncology
- Publisher
- S. Karger AG
- Published
- 2021
- Volume
- 99
- Issue
- 8
- Pages
- 483-490
- ISSN
- 0030-2414 (ISSN-L)
- 1423-0232
- OpenAlex
- W3165265064
- Semantic Scholar
- fe26482e5ba4cedd3239ad785ceb3aa92a89733f
- Cited by
- 41
- References
- 35
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 7 · 2023: 13 · 2022: 6 · 2021: 3
- FWCI
- 0.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Oncology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Digital Radiography and Breast Imaging
- Keywords
- artificial intelligence, mammography, breast cancer diagnosis, breast cancer risk prediction, false positive reduction, radiologist workload, computer-aided detection
- MeSH terms
- Machine Learning, Breast Neoplasms, Female, Humans, Mammography, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.