Detection of Breast Cancer with Mammography: Effect of an Artificial Intelligence Support System
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Purpose To compare breast cancer detection performance of radiologists reading mammographic examinations unaided versus supported by an artificial intelligence (AI) system. Materials and Methods An enriched retrospective, fully crossed, multireader, multicase, HIPAA-compliant study was performed. Screening digital mammographic examinations from 240 women (median age, 62 years; range, 39-89 years) performed between 2013 and 2017 were included. The 240 examinations (100 showing cancers, 40 leading to false-positive recalls, 100 normal) were interpreted by 14 Mammography Quality Standards Act-qualified radiologists, once with and once without AI support. The readers provided a Breast Imaging Reporting and Data System score and probability of malignancy. AI support provided radiologists with interactive decision support (clicking on a breast region yields a local cancer likelihood score), traditional lesion markers for computer-detected abnormalities, and an examination-based cancer likelihood score. The area under the receiver operating characteristic curve (AUC), specificity and sensitivity, and reading time were compared between conditions by using mixed-models analysis dof variance and generalized linear models for multiple repeated measurements. Results On average, the AUC was higher with AI support than with unaided reading (0.89 vs 0.87, respectively; P = .002). Sensitivity increased with AI support (86% [86 of 100] vs 83% [83 of 100]; P = .046), whereas specificity trended toward improvement (79% [111 of 140]) vs 77% [108 of 140]; P = .06). Reading time per case was similar (unaided, 146 seconds; supported by AI, 149 seconds; P = .15). The AUC with the AI system alone was similar to the average AUC of the radiologists (0.89 vs 0.87). Conclusion Radiologists improved their cancer detection at mammography when using an artificial intelligence system for support, without requiring additional reading time. Published under a CC BY 4.0 license. See also the editorial by Bahl in this issue.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Sixteen studies62,91,92,94,97–107 compared algorithm performance against healthcare professionals.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [97]
In the citing paper
“eight91–98 studies validated algorithms on external data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [97]
In the citing paper
“Only eight studies in ophthalmology imaging14,21,32,33,43,55,108,109, ten studies in respiratory imaging64,66,70,72,75,79,82,87,89,110 and six studies in breast imaging62,91,97,104,106,111 mentioned adherence to the STARD-2015 guidelines or had a STARD flow diagram in the manuscript.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [97]
Citations
Cites
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Large scale deep learning for computer aided detection of mammographic lesions
Kooi, T., Litjens, G., van Ginneken, B., Gubern-Mérida, A., Sánchez, C. I., Mann, R., den Heeten, A., & Karssemeijer, N. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.07.007 · Cited by 965 · cited 3×
“Kooi et al (16) and Becker et al (32) found that AI algorithms developed in-house could achieve a performance Figure 4: Mammograms in 62-year-old woman without cancer who was incorrectly recalled (Breast Imaging Reporting and Data System score, 3) by one of 14 radiologists when reading unaided but by five of 14 radio…”
Self-citationAnalysis of cancers missed at screening mammography.
Bird, R. E., Wallace, T. W., & Yankaskas, B. C. (1992) · Radiology · doi:10.1148/radiology.184.3.1509041 · Cited by 820
Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection
Lehman, C. D., Wellman, R. D., Buist, D. S. M., Kerlikowske, K., Tosteson, A. N. A., & Miglioretti, D. L. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.5231 · Cited by 678
DORFMAN, D. D., BERBAUM, K. S., & METZ, C. E. (1992) · Investigative Radiology · doi:10.1097/00004424-199209000-00015 · Cited by 661
Smith, R. A., Cokkinides, V., Brooks, D., Saslow, D., & Brawley, O. W. (2010) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.20063 · Cited by 660
Influence of Computer-Aided Detection on Performance of Screening Mammography
Fenton, J. J., Taplin, S. H., Carney, P. A., Abraham, L., Sickles, E. A., D'Orsi, C., Berns, E. A., Cutter, G., Hendrick, R. E., Barlow, W. E., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa066099 · Cited by 619
Broeders, M., Moss, S., Nyström, L., Njor, S., Jonsson, H., Paap, E., Massat, N., Duffy, S., Lynge, E., & Paci, E. (2012) · Journal of Medical Screening · doi:10.1258/jms.2012.012078 · Cited by 489
Benefit of independent double reading in a population-based mammography screening program.
Thurfjell, E. L., Lernevall, K. A., & Taube, A. A. (1994) · Radiology · doi:10.1148/radiology.191.1.8134580 · Cited by 406
Research works printed but not linked: 1
- Obuchowski NA, 1995, Acad Radiol, 2, S22
Cited by
Items 601–682 of 682
Exosomes: Supramolecular Biomarker Conduit in Cancer
Kaur, M. P., & Sodhi, H. S. (2022) · Studies in computational intelligence · doi:10.1007/978-981-16-9221-5_18
Newlands, R. S. N., Bruhn, H., Díaz, M. R., Lip, G., Anderson, L. A., & Ramsay, C. R. (2024) · Figshare · doi:10.6084/m9.figshare.26715280
Newlands, R. S. N., Bruhn, H., Díaz, M. R., Lip, G., Anderson, L. A., & Ramsay, C. R. (2024) · Figshare · doi:10.6084/m9.figshare.25744290
Newlands, R. S. N., Bruhn, H., Díaz, M. R., Lip, G., Anderson, L. A., & Ramsay, C. R. (2024) · Figshare · doi:10.6084/m9.figshare.26715277
Newlands, R. S. N., Bruhn, H., Díaz, M. R., Lip, G., Anderson, L. A., & Ramsay, C. R. (2024) · Figshare · doi:10.6084/m9.figshare.26715283
Newlands, R. S. N., Bruhn, H., Díaz, M. R., Lip, G., Anderson, L. A., & Ramsay, C. R. (2024) · Figshare · doi:10.6084/m9.figshare.26715286
Newlands, R. S. N., Bruhn, H., Díaz, M. R., Lip, G., Anderson, L. A., & Ramsay, C. R. (2024) · Figshare · doi:10.6084/m9.figshare.25744478
Advances in Breast Cancer Detection Techniques: A Comprehensive Survey
Al-Janabi, M. S., & Al-Sultan, A. Y. (2024) · Journal of University of Babylon for Pure and Applied Sciences · doi:10.29196/4q5rj473
Integrando Saberes: Uma Perspectiva Holística no Câncer de Mama - Edição I
Ferreira, J. L. D. M., Santos, A. C. P., Fachardo, I. R. J., Siqueira, M. E. L. M., FERNANDES, A. V. D. D., DELFINO, M. L. S., Neto, J. D. D. S., & Mundim, F. G. L. (2024) · doi:10.59290/978-65-6029-160-7
ARTIFICIAL INTELLIGENCE TO INTERPRET MAMMOGRAMS- ARE WE THERE YET?
Sethi, D., Sachdev, N., & Singh, Y. (2020) · INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH · doi:10.36106/ijsr/6834881
Lång, K., & Levy, M. S. (2022) · Springer eBooks · doi:10.1007/978-3-030-91170-6_9
Rungsinaporn, K., Issaragrisil, S., Kimhamanon, P., Chaiyungyuen, S., Prasawang, N., Chamveha, I., & Worakriangkrai, S. (2025) · THE BANGKOK MEDICAL JOURNAL · doi:10.31524/bkkmedj.2025.21.007
Ambinder, E. B., Paulbeck, C., Zinzuwadia, S., Mullen, L., Myers, K. S., Oluyemi, E., & Panigrahi, B. (2026) · Radiology Advances · doi:10.1093/radadv/umag042
Analysis of artificial intelligence errors in practical medicine and rehabilitation
Mintser, O. P., Ганинець, П. П., & Sarcanich, O. V. (2026) · Wiadomości Lekarskie · doi:10.36740/wlek/220842
A COMPREHENSIVE SURVEY ON AI-DRIVEN MAMMOGRAPHY-BASED BREAST CANCER DETECTION
Shinde, P., Kamble, S., & Srivaramangai, R. (2026) · doi:10.34218/ijaimed_04_01_003
Artificial Intelligence for Breast Cancer Detection in Mammography: A Review
Kamel, A., Chiba, Z., Moumen, S. E., & Ennaqui, S. (2026) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd69640.2026.11637310
ARTIFICIAL INTELLIGENCE IN RADIOLOGY: CURRENT APPLICATIONS AND FUTURE DIRECTIONS
Waleed, S., Shah, S. Z. A., Tariq, R. A., Jabeen, E., Akhtar, M. K., & Batool, S. (2026) · Veredas do Direito Direito Ambiental e Desenvolvimento Sustentável · doi:10.18623/rvd.v23.8175
da Silveira, J. A. R. O., Ferreira, J. X. D. A. P., Pinheiro, M. M., Barboza, L. G. D. O., Seabra, F. C. D. M., & Barbosa, J. D. S. P. (2026) · Revista Ibero-Americana de Humanidades, Ciências e Educação · doi:10.51891/rease.v12i8.28484
Munsarif, M., & Ampah-Mensah, R. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.111770
Koneoppimisen hyödyntäminen syöpätutkimuksen kuvantamisessa: huomio rintasyövän tutkimukseen
Halenius, H. (2025) · UTUPub (University of Turku)
The social role of AI advisers
Longin, L. (2023) · doi:10.5282/edoc.32546
Ng'ang'a, E., Koech, A. C., Waga, E., Kanini, L., Oregeh, E., Wanyonyi, S., Temmerman, M., Lekadir, K., & Maixenchs, M. (2026) · Research Square · doi:10.21203/rs.3.rs-10801082/v1
Computational problems and use of AI in the medical evaluation of imaging exams
Μάτζαρι, Ρ. Φ. (2023) · University of Thessaly Institutional Repository (University of Thessaly)
A Quantitative Comparison of Synthetic Mammograms with Images from Conventional Mammography
Frost, E. (2019) · Lund University Publications Student Papers (Lund University)
Analysis and Detection of Breast Cancer Using Recursive Feature Elimination
Hemantha, G., Anusha, V. S., & Kumar, G. C. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-78937-3_27
Understanding and Mitigating Search Errors in 3D Volumetric Images
Klein, D. S. (2024) · eScholarship (California Digital Library)
Comparative Analysis For CNN and MLP Models in Breast Cancer Diagnosis
Nurtanio, P. N., Nathaniel, D., Sugiarto, T., Angelina, T., Tjandra, R., Kurniawan, Y. J., & Sampe, M. Z. (2026) · Indonesian Journal of Life Sciences · doi:10.54250/ijls.v8i01.254
Modelo predictivo en la detección de cáncer en mamografías, Lima 2024
Ruiz, L. J. M. (2024) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Improving Screening Mammography Interpretation: Real Impact Within Reach
Gommers, J. J. J. (2026) · doi:10.54195/9789465152790
Pathology AI: Safe Slide, Sample, and Medical Report Analysis in Cancer Care
Alam, R., & Raiyana, J. (2025) · International journal of medical and health research. · doi:10.61424/ijmhr.v3i4.630
Medicina Personalizada: genética, ambiente, estilo de vida e suas influências nas novas abordagens
Editorial, E. (2024) · Editora Inovar eBooks · doi:10.36926/editorainovar-978-65-5388-279-9
Ruffle, J., Mohinta, S., Pombo, G., Biswas, A., Campbell, A. D., Davagnanam, I., Doig, D., Hammam, A., Hyare, H., Jabeen, F., et al. (2026) · UCL Discovery (University College London)
Strategies to improve breast cancer detection by digital screening mammography
Coolen, A. M. P. (2022) · Research Publications (Maastricht University) · doi:10.26481/dis.20220127ac
Weigel, S., Brehl, A.-K., Heindel, W. L., & Kerschke, L. (2023) · TumorDiagnostik & Therapie · doi:10.1055/a-2013-9533
Weigel, S., Brehl, A.-K., Heindel, W. L., & Kerschke, L. (2023) · Senologie - Zeitschrift für Mammadiagnostik und -therapie · doi:10.1055/a-2143-1428
Neural Network Approaches for Early Breast Cancer Detection
Al-Shamasneh, A. R., Alabdulkarim, N., & Ahmad, M. (2024) · European Scientific Journal ESJ · doi:10.19044/esipreprint.3.2024.p296
Álzate-Granados, J. P., Sotomayor-Ricardo, M. J., & Avella-Espinosa, M. K. (2025) · Revista de la Facultad de Medicina · doi:10.15446/revfacmed.v73.114297
Mireles, Y., Díaz, J., Mederos, B., & Madrigal, L. H. R. (2026) · Ciencia Vital · doi:10.20983/cienciavital.2026.03.sal.02
Kettenberger, P. (2025) · MACAU: Open Access Repository of Kiel University
Alström, L. (2025) · Lund University Publications Student Papers (Lund University)
Artificial intelligence: competitor or best friend of breast cancer radiologists?Preprint
Tang, Y. (2023) · doi:10.58445/rars.184
Meme kanseri tedavisinde yapay zeka yaklaşımı
Beldek, T. (2024) · Istanbul Technical University Academic Open Archive (Istanbul Technical University)
Dirbtinis intelektas ir jo reikšmė kepenų ligų diagnostikoje
Zoher, A. N. (2024) · Lithuanian University of Health Sciences
Aboa, L. K., Aparicio, J. C. S., Fei, Z. Y., & Tyrrell, P. N. (2026) · Value in Health Regional Issues · doi:10.1016/j.vhri.2026.102123
Maral, A. M., Erdem, O. A., & Söğüt, E. (2025) · NWSA Academic Journals · doi:10.12739/nwsa.2025.20.4.1a0501
AI BASED HERBAL TREATMENT FOR CANCER CELL
Cuddapah Anitha, K. T. C. G., Gnanatheepa, K. T. C., Hubert, G., Yadav, R., Naik, S. B., & Singh, B. (2022) · Journal of Pharmaceutical Negative Results · doi:10.47750/pnr.2022.13.s07.920
Improvement of the portuguese breast cancer screening through process modelling (BPM)
Marques, I. T. (2020) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Addressing Data Heterogeneity in Image-Based Computer-Aided Detection and Diagnosis Methods
Wimmer, M. (2024) · reposiTUm (TU Wien) · doi:10.34726/hss.2024.125391
Amer, S. A., Hassan, J. G. A. B. A., Ahmed, Z. K. A., Mudawi, A. A. A., Dirar, A., MOHAMEDTOUM, E. S. H., Mohamed, T. M. Y., Ali, A. A. H. M., Basher, S. E. E., Al-Humidi, A. A. M., et al. (2026) · GSC Advanced Research and Reviews · doi:10.30574/gscarr.2026.29.2.0202
Du-Crow, E., Astley, S., & Hulleman, J. (2020) · International Workshop on Breast Imaging (IWBI) · doi:10.1117/12.2556472
Alakhras, M. M., Orabi, E., Zain, N. M., Mustafa, W. A., Alquran, H., Alsalatie, M., & Btayneh, E. (2026) · Frontiers in Systems Biology · doi:10.3389/fsysb.2026.1921782
Interpretive Applications of Artificial Intelligence in Breast Radiology
Talluri, T. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-87760-2.00004-9
Tekoälyn käyttö mammografiakuvien kuvanluennassa
Luukkonen, A. (2024) · Theseus (Ammattikorkeakoulujen)
Artificial intelligence together with mechanical imaging in mammography
Bejnö, A., Hellgren, G. O., Rodríguez‐Ruiz, A., Bakić, P. R., Zackrisson, S., Tingberg, A., & Dustler, M. (2020) · International Workshop on Breast Imaging (IWBI) · doi:10.1117/12.2564107
Self-citationKünstliche Intelligenz zur Unterstützung des Mammographie-Screenings
Kreyenschulte, T. (2023) · Springer eBooks · doi:10.1007/978-3-658-41781-9_30
Farid, M. I. (2024) · Kurdish Studies · doi:10.53555/ks.v12i4.3606
Mudagal, M. P., Prakash, P., Matada, G. S. P., Janadri, S., Sharma, U. R., Haribabu, T. E., Vada, S., Taj, N., Kharvi, J. S., Pal, R., et al. (2025) · International Conference on Frontiers in Physical and Chemical Sciences: Exploring New Horizons (FPCS) · doi:10.4108/eai.13-11-2024.2355688
Epidemiological studies on breast cancer risk factors and screening
Mao, X. (2023) · Open Archive (Karolinska Institutet)
Hipofraccionamiento en cáncer de mama: análisis de resultados y seguridad en nuestro medio
Reglero, V. G. (2025) · Tesis Doctorals en Xarxa (Consorci de Serveis Universitaris de Catalunya)
Machine Learning Approach to Multi-Sport Betting
de Arriba-Pérez, F., García-Méndez, S., & González-Braña, R. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-10721-3_56
Aplicación de la inteligencia artificial en el abordaje diagnóstico del cáncer de mama
Clement, R. C. (2024) · RIUCAM
Lingam, G., & Narang, N. (2026) · IEEE Journal of Electromagnetics RF and Microwaves in Medicine and Biology · doi:10.1109/jerm.2026.3672900
A Hybrid Approach for Diabetic Foot Ulcer Risk Assessment and Survival Probability Estimation
Srikanth, R., Bingari, A., Sree, Y., Vaishnavi, B., & Abhishek, M. (2026) · Lecture notes in networks and systems · doi:10.1007/978-981-95-3498-2_32
Foundation of AI‐Enhanced Nanocarriers
Zarbanooei, P., Aliakbarzadeh, S., Rahdar, A., & Shirzad, M. (2026) · Wiley eBooks · doi:10.1002/9781394384891.ch3
Shaban, D. A. M., Mohammed, A. A. G. B., Chalabi, N. A. E. T., & Nagi, M. A. M. A. (2025) · International Journal of Radiation Research · doi:10.66224/ijrr.23.4.5
An objective assessment of the differences between synthetic and digital mammography using AI
Kristoffersson, E. (2026) · Lund University Publications Student Papers (Lund University)
Moon, Y.-J., Jung, H.-R., & Lim, W.-T. (2020) · International Journal of Psychosocial Rehabilitation · doi:10.61841/mz8x9t78
Gudur, R., Pati, P., Bhatt, C., & Kukreti, S. (2023) · International Journal of Intelligent Systems and Applications in Engineering
M, S. S. R. M. S. S. R., Mishra, N., & Patil, V. N. (2021) · Journal of Advances in Science and Technology
Iot Based Healing Process For Diabetic Foot Ulcer
Keerthana, S. S., Gokulraj, C., Sivaram, N., Vishal, J., & Vishva, K. (2024) · Journal Of Advanced Zoology
Ning, S. G. S., Hao, D., Chandrasegan, G., Lim, Z. L., Chua, W. Y., Ong, H. Y., Seah, E., Ge, S., Lau, S., Wong, Y. M., et al. (2026) · British Journal of Radiology · doi:10.1093/bjr/tqag264
He, Z., Li, Y., Zeng, W., Xu, W., Liu, J., Ma, X., Wei, J., Zeng, H., Xu, Z., Wang, S., et al. (2021) · doi:10.3389/fonc.2021.773389.s001
Anastasio, M. A. (2026) · Journal of medical imaging · doi:10.1117/1.jmi.13.s2.s22407
Juneja, S., Bhati, B. S., Tejani, G. G., & Bassir, D. (2026) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2026.100520
Metadata
- Authors
- Rodríguez-Ruiz, A., Krupinski, E., Mordang, J.-J., Schilling, K., Heywang-Köbrunner, S. H., Sechopoulos, I., & Mann, R. M.
- Affiliations
- Emory University (US)
- ORCID
- Venue
- Radiology
- Published
- 2019-02
- Volume
- 290
- Issue
- 2
- Pages
- 305-314
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2901743512
- Cited by
- 602
- References
- 36
- Citations by year
- 2026: 45 · 2025: 90 · 2024: 89 · 2023: 114 · 2022: 94 · 2021: 79 · 2020: 55 · 2019: 33
- FWCI
- 23.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Radiology (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- Bayer HealthCare
- Radboud Universitair Medisch Centrum
- Siemens Healthineers
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Digital Radiography and Breast Imaging
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- breast cancer detection, mammography, artificial intelligence, computer-aided detection, radiology decision support, computer-aided diagnosis, mammography screening, BI-RADS, malignancy probability, diagnostic accuracy, reading time
- MeSH terms
- Adult, Aged, Aged, 80 and over, Artificial Intelligence, Breast, Breast Neoplasms, Female, Humans, Mammography, Middle Aged, Radiographic Image Enhancement, ROC Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.