The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Detection of Breast Cancer with Mammography: Effect of an Artificial Intelligence Support System
Open accessAbstract
Purpose To compare breast cancer detection performance of radiologists reading mammographic examinations unaided versus supported by an artificial intelligence (AI) system. Materials and Methods An enriched retrospective, fully crossed, multireader, multicase, HIPAA-compliant study was performed. Screening digital mammographic examinations from 240 women (median age, 62 years; range, 39-89 years) performed between 2013 and 2017 were included. The 240 examinations (100 showing cancers, 40 leading to false-positive recalls, 100 normal) were interpreted by 14 Mammography Quality Standards Act-qualified radiologists, once with and once without AI support. The readers provided a Breast Imaging Reporting and Data System score and probability of malignancy. AI support provided radiologists with interactive decision support (clicking on a breast region yields a local cancer likelihood score), traditional lesion markers for computer-detected abnormalities, and an examination-based cancer likelihood score. The area under the receiver operating characteristic curve (AUC), specificity and sensitivity, and reading time were compared between conditions by using mixed-models analysis dof variance and generalized linear models for multiple repeated measurements. Results On average, the AUC was higher with AI support than with unaided reading (0.89 vs 0.87, respectively; P = .002). Sensitivity increased with AI support (86% [86 of 100] vs 83% [83 of 100]; P = .046), whereas specificity trended toward improvement (79% [111 of 140]) vs 77% [108 of 140]; P = .06). Reading time per case was similar (unaided, 146 seconds; supported by AI, 149 seconds; P = .15). The AUC with the AI system alone was similar to the average AUC of the radiologists (0.89 vs 0.87). Conclusion Radiologists improved their cancer detection at mammography when using an artificial intelligence system for support, without requiring additional reading time. Published under a CC BY 4.0 license. See also the editorial by Bahl in this issue.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Sixteen studies62,91,92,94,97–107 compared algorithm performance against healthcare professionals.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [97]
In the citing paper
“eight91–98 studies validated algorithms on external data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [97]
In the citing paper
“Only eight studies in ophthalmology imaging14,21,32,33,43,55,108,109, ten studies in respiratory imaging64,66,70,72,75,79,82,87,89,110 and six studies in breast imaging62,91,97,104,106,111 mentioned adherence to the STARD-2015 guidelines or had a STARD flow diagram in the manuscript.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [97]
Citations
Cites
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Large scale deep learning for computer aided detection of mammographic lesions
Kooi, T., Litjens, G., van Ginneken, B., Gubern-Mérida, A., Sánchez, C. I., Mann, R., den Heeten, A., & Karssemeijer, N. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.07.007 · Cited by 965 · cited 3×
“Kooi et al (16) and Becker et al (32) found that AI algorithms developed in-house could achieve a performance Figure 4: Mammograms in 62-year-old woman without cancer who was incorrectly recalled (Breast Imaging Reporting and Data System score, 3) by one of 14 radiologists when reading unaided but by five of 14 radio…”
Self-citationAnalysis of cancers missed at screening mammography.
Bird, R. E., Wallace, T. W., & Yankaskas, B. C. (1992) · Radiology · doi:10.1148/radiology.184.3.1509041 · Cited by 820
Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection
Lehman, C. D., Wellman, R. D., Buist, D. S. M., Kerlikowske, K., Tosteson, A. N. A., & Miglioretti, D. L. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.5231 · Cited by 678
DORFMAN, D. D., BERBAUM, K. S., & METZ, C. E. (1992) · Investigative Radiology · doi:10.1097/00004424-199209000-00015 · Cited by 661
Smith, R. A., Cokkinides, V., Brooks, D., Saslow, D., & Brawley, O. W. (2010) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.20063 · Cited by 660
Influence of Computer-Aided Detection on Performance of Screening Mammography
Fenton, J. J., Taplin, S. H., Carney, P. A., Abraham, L., Sickles, E. A., D'Orsi, C., Berns, E. A., Cutter, G., Hendrick, R. E., Barlow, W. E., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa066099 · Cited by 619
Broeders, M., Moss, S., Nyström, L., Njor, S., Jonsson, H., Paap, E., Massat, N., Duffy, S., Lynge, E., & Paci, E. (2012) · Journal of Medical Screening · doi:10.1258/jms.2012.012078 · Cited by 489
Benefit of independent double reading in a population-based mammography screening program.
Thurfjell, E. L., Lernevall, K. A., & Taube, A. A. (1994) · Radiology · doi:10.1148/radiology.191.1.8134580 · Cited by 406
Research works printed but not linked: 1
- Obuchowski NA, 1995, Acad Radiol, 2, S22
Cited by
Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
Breast cancer: pathogenesis and treatments
Xiong, X., Zheng, L.-W., Ding, Y., Chen, Y.-F., Cai, Y.-W., Wang, L.-P., Huang, L., Liu, C.-C., Shao, Z.-M., & Yu, K.-D. (2025) · Signal Transduction and Targeted Therapy · doi:10.1038/s41392-024-02108-4 · Cited by 958
Deep Learning to Improve Breast Cancer Detection on Screening Mammography
Shen, L., Margolies, L. R., Rothstein, J. H., Fluder, E., McBride, R., & Sieh, W. (2019) · Scientific Reports · doi:10.1038/s41598-019-48995-4 · Cited by 873
Deep Neural Networks Improve Radiologists’ Performance in Breast Cancer Screening
Wu, N., Phang, J., Park, J., Shen, Y., Huang, Z., Zorin, M., Jastrzebski, S., Fevry, T., Katsnelson, J., Kim, E., et al. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2945514 · Cited by 689
Swanson, K., Wu, E., Zhang, A., Alizadeh, A. A., & Zou, J. (2023) · Cell · doi:10.1016/j.cell.2023.01.035 · Cited by 597
Metadata
- Authors
- Rodríguez-Ruiz, A., Krupinski, E., Mordang, J.-J., Schilling, K., Heywang-Köbrunner, S. H., Sechopoulos, I., & Mann, R. M.
- Affiliations
- Emory University (US)
- ORCID
- Venue
- Radiology
- Published
- 2019-02
- Volume
- 290
- Issue
- 2
- Pages
- 305-314
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2901743512
- Cited by
- 602
- References
- 36
- Citations by year
- 2026: 45 · 2025: 90 · 2024: 89 · 2023: 114 · 2022: 94 · 2021: 79 · 2020: 55 · 2019: 33
- FWCI
- 23.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Radiology (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- Bayer HealthCare
- Radboud Universitair Medisch Centrum
- Siemens Healthineers
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Digital Radiography and Breast Imaging
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- breast cancer detection, mammography, artificial intelligence, computer-aided detection, radiology decision support, computer-aided diagnosis, mammography screening, BI-RADS, malignancy probability, diagnostic accuracy, reading time
- MeSH terms
- Adult, Aged, Aged, 80 and over, Artificial Intelligence, Breast, Breast Neoplasms, Female, Humans, Mammography, Middle Aged, Radiographic Image Enhancement, ROC Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Detection of Breast Cancer with Mammography: Effect of an Artificial Intelligence Support System. https://app.cochat.ai/papers/10.1148/radiol.2018181371
- The paper
- Rodríguez-Ruiz, A., Krupinski, E., Mordang, J.-J., Schilling, K., Heywang-Köbrunner, S. H., Sechopoulos, I., & Mann, R. M. (2019). Detection of Breast Cancer with Mammography: Effect of an Artificial Intelligence Support System. Radiology. https://doi.org/10.1148/radiol.2018181371
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.