CoChat

A Deep Learning Model to Triage Screening Mammograms: A Simulation Study

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Abstract

Background Recent deep learning (DL) approaches have shown promise in improving sensitivity but have not addressed limitations in radiologist specificity or efficiency. Purpose To develop a DL model to triage a portion of mammograms as cancer free, improving performance and workflow efficiency. Materials and Methods In this retrospective study, 223 109 consecutive screening mammograms performed in 66 661 women from January 2009 to December 2016 were collected with cancer outcomes obtained through linkage to a regional tumor registry. This cohort was split by patient into 212 272, 25 999, and 26 540 mammograms from 56 831, 7021, and 7176 patients for training, validation, and testing, respectively. A DL model was developed to triage mammograms as cancer free and evaluated on the test set. A DL-triage workflow was simulated in which radiologists skipped mammograms triaged as cancer free (interpreting them as negative for cancer) and read mammograms not triaged as cancer free by using the original interpreting radiologists’ assessments. Sensitivities, specificities, and percentage of mammograms read were calculated, with and without the DL-triage–simulated workflow. Statistics were computed across 5000 bootstrap samples to assess confidence intervals (CIs). Specificities were compared by using a two-tailed t test (P < .05) and sensitivities were compared by using a one-sided t test with a noninferiority margin of 5% (P < .05). Results The test set included 7176 women (mean age, 57.8 years ± 10.9 [standard deviation]). When reading all mammograms, radiologists obtained a sensitivity and specificity of 90.6% (173 of 191; 95% CI: 86.6%, 94.7%) and 93.5% (24 625 of 26 349; 95% CI: 93.3%, 93.9%). In the DL-simulated workflow, the radiologists obtained a sensitivity and specificity of 90.1% (172 of 191; 95% CI: 86.0%, 94.3%) and 94.2% (24 814 of 26 349; 95% CI: 94.0%, 94.6%) while reading 80.7% (21 420 of 26 540) of the mammograms. The simulated workflow improved specificity (P = .002) and obtained a noninferior sensitivity with a margin of 5% (P < .001). Conclusion This deep learning model has the potential to reduce radiologist workload and significantly improve specificity without harming sensitivity. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Kontos and Conant in this issue.

Overview

Integrity signals

Registry

Crossref · 10.1148/radiol.2019182908

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 22 references

Research works printed but not linked: 3

  1. Shapiro S, 1982, J Natl Cancer Inst, 69, 349
  2. Miller AB, 1981, Clin Invest Med, 4, 227
  3. Yala A, 2019, Radiology, 182716

Cited by

See all 218

Metadata

Authors
Yala, A., Schuster, T., Miles, R., Barzilay, R., & Lehman, C.
Affiliations
Harvard University (US)
Venue
Radiology
Published
2019-10
Volume
293
Issue
1
Pages
38-46
ISSN
  • 0033-8419 (ISSN-L)
  • 1527-1315
OpenAlex
W2964642168
Cited by
210
References
22
Citations by year
2026: 13 · 2025: 33 · 2024: 31 · 2023: 37 · 2022: 31 · 2021: 36 · 2020: 26 · 2019: 3
FWCI
10.95
Type
journal article
Language
en
Open access
closed
Locations
  • Radiology (publishedVersion)
  • PubMed (publishedVersion)
Funders
Breast Cancer Alliance
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Digital Radiography and Breast Imaging
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
Keywords
deep learning, mammography screening, triage, breast cancer screening, sensitivity and specificity, breast cancer detection, simulation study, non-inferiority margin, bootstrap confidence intervals, breast cancer mortality reduction, cost-effectiveness, false positive reduction
MeSH terms
Deep Learning, Adult, Aged, Aged, 80 and over, Breast, Breast Neoplasms, Computer Simulation, Female, Humans, Image Interpretation, Computer-Assisted, Mammography, Middle Aged, Registries, Retrospective Studies, Triage, Cohort Studies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Deep Learning Model to Triage Screening Mammograms: A Simulation Study. https://app.cochat.ai/papers/10.1148/radiol.2019182908
The paper
Yala, A., Schuster, T., Miles, R., Barzilay, R., & Lehman, C. (2019). A Deep Learning Model to Triage Screening Mammograms: A Simulation Study. Radiology. https://doi.org/10.1148/radiol.2019182908

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.