The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
National Performance Benchmarks for Modern Screening Digital Mammography: Update from the Breast Cancer Surveillance Consortium
Open accessAbstract
Purpose To establish performance benchmarks for modern screening digital mammography and assess performance trends over time in U.S. community practice. Materials and Methods This HIPAA-compliant, institutional review board–approved study measured the performance of digital screening mammography interpreted by 359 radiologists across 95 facilities in six Breast Cancer Surveillance Consortium (BCSC) registries. The study included 1 682 504 digital screening mammograms performed between 2007 and 2013 in 792 808 women. Performance measures were calculated according to the American College of Radiology Breast Imaging Reporting and Data System, 5th edition, and were compared with published benchmarks by the BCSC, the National Mammography Database, and performance recommendations by expert opinion. Benchmarks were derived from the distribution of performance metrics across radiologists and were presented as 50th (median), 10th, 25th, 75th, and 90th percentiles, with graphic presentations using smoothed curves. Results Mean screening performance measures were as follows: abnormal interpretation rate (AIR), 11.6 (95% confidence interval [CI]: 11.5, 11.6); cancers detected per 1000 screens, or cancer detection rate (CDR), 5.1 (95% CI: 5.0, 5.2); sensitivity, 86.9% (95% CI: 86.3%, 87.6%); specificity, 88.9% (95% CI: 88.8%, 88.9%); false-negative rate per 1000 screens, 0.8 (95% CI: 0.7, 0.8); positive predictive value (PPV) 1, 4.4% (95% CI: 4.3%, 4.5%); PPV2, 25.6% (95% CI: 25.1%, 26.1%); PPV3, 28.6% (95% CI: 28.0%, 29.3%); cancers stage 0 or 1, 76.9%; minimal cancers, 57.7%; and node-negative invasive cancers, 79.4%. Recommended CDRs were achieved by 92.1% of radiologists in community practice, and 97.1% achieved recommended ranges for sensitivity. Only 59.0% of radiologists achieved recommended AIRs, and only 63.0% achieved recommended levels of specificity. Conclusion The majority of radiologists in the BCSC surpass cancer detection recommendations for screening mammography; however, AIRs continue to be higher than the recommended rate for almost half of radiologists interpreting screening mammograms. © RSNA, 2016 Online supplemental material is available for this article.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic Performance of Digital versus Film Mammography for Breast-Cancer Screening
Pisano, E. D., Gatsonis, C., Hendrick, E., Yaffe, M., Baum, J. K., Acharyya, S., Conant, E. F., Fajardo, L. L., Bassett, L., D'Orsi, C., et al. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa052911 · Cited by 1,940
REDUCTION IN MORTALITY FROM BREAST CANCER AFTER MASS SCREENING WITH MAMMOGRAPHY
Tabár, L., Gad, A., Holmberg, L. H., Ljungquist, U., Fagerberg, C. J. G., Baldetorp, L., Gröntoft, O., Lundström, B., Månson, J. C., Eklund, G., et al. (1985) · The Lancet · doi:10.1016/s0140-6736(85)92204-4 · Cited by 1,781
Oeffinger, K. C., Fontham, E. T. H., Etzioni, R., Herzig, A., Michaelson, J. S., Shih, Y.-C. T., Walter, L. C., Church, T. R., Flowers, C. R., LaMonte, S. J., et al. (2015) · JAMA · doi:10.1001/jama.2015.12783 · Cited by 1,653
The benefits and harms of breast cancer screening: an independent review
(2012) · The Lancet · doi:10.1016/s0140-6736(12)61611-0 · Cited by 1,492
Skaane, P., Bandos, A. I., Gullien, R., Eben, E. B., Ekseth, U., Haakenaasen, U., Izadi, M., Jebsen, I. N., Jahr, G., Krager, M., et al. (2013) · Radiology · doi:10.1148/radiol.12121373 · Cited by 1,012
Breast Cancer Screening Using Tomosynthesis in Combination With Digital Mammography
Friedewald, S. M., Rafferty, E. A., Rose, S. L., Durand, M. A., Plecha, D. M., Greenberg, J. S., Hayes, M. K., Copit, D. S., Carlson, K. L., Cink, T. M., et al. (2014) · JAMA · doi:10.1001/jama.2014.6095 · Cited by 851
Ten- to Fourteen-Year Effect of Screening on Breast Cancer Mortality 2
(1982) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/69.2.349 · Cited by 840
Ciatto, S., Houssami, N., Bernardi, D., Caumo, F., Pellegrini, M., Brunelli, S., Tuttobene, P., Bricolo, P., Fantò, C., Valentini, M., et al. (2013) · The Lancet Oncology · doi:10.1016/s1470-2045(13)70134-7 · Cited by 838
Tice, J. A., Cummings, S. R., Smith-Bindman, R., Ichikawa, L., Barlow, W. E., & Kerlikowske, K. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-5-200803040-00004 · Cited by 537
Self-citationDiagnostic Performance of Digital versus Film Mammography for Breast-Cancer Screening
Pisano, E. D., Gatsonis, C., Hendrick, E., Yaffe, M., Baum, J. K., Acharyya, S., Conant, E. F., Fajardo, L. L., Bassett, L., D???Orsi, C., et al. (2006) · Obstetrical & Gynecological Survey · doi:10.1097/01.ogx.0000201894.94616.71 · Cited by 482
Cited by
International evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287
Liu, M. C., Oxnard, G. R., Klein, E. A., Swanton, C., Seiden, M. V., Liu, M. C., Oxnard, G. R., Klein, E. A., Smith, D., Richards, D., et al. (2020) · Annals of Oncology · doi:10.1016/j.annonc.2020.02.011 · Cited by 1,495
Klein, E. A., Richards, D., Cohn, A., Tummala, M., Lapham, R., Cosgrove, D., Chung, G., Clement, J., Gao, J., Hunkapiller, N., et al. (2021) · Annals of Oncology · doi:10.1016/j.annonc.2021.05.806 · Cited by 995
Deep Learning to Improve Breast Cancer Detection on Screening Mammography
Shen, L., Margolies, L. R., Rothstein, J. H., Fluder, E., McBride, R., & Sieh, W. (2019) · Scientific Reports · doi:10.1038/s41598-019-48995-4 · Cited by 873
Breast cancer early detection: A phased approach to implementation
Ginsburg, O., Yip, C., Brooks, A., Cabanes, A., Caleffi, M., Dunstan Yataco, J. A., Gyawali, B., McCormack, V., McLaughlin de Anderson, M., Mehrotra, R., et al. (2020) · Cancer · doi:10.1002/cncr.32887 · Cited by 744
Establishment of Best Practices for Evidence for Prediction: A Review
Poldrack, R. A., Huckins, G., & Varoquaux, G. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.3671 · Cited by 738
Kim, H.-E., Kim, H. H., Han, B.-K., Kim, K. H., Han, K., Nam, H., Lee, E. H., & Kim, E.-K. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30003-0 · Cited by 525
Lotter, W., Diab, A. R., Haslam, B., Kim, J. G., Grisot, G., Wu, E., Wu, K., Onieva, J. O., Boyer, Y., Boxerman, J. L., et al. (2021) · Nature Medicine · doi:10.1038/s41591-020-01174-9 · Cited by 423
Schaffter, T., Buist, D. S. M., Lee, C. I., Nikulin, Y., Ribli, D., Guan, Y., Lotter, W., Jie, Z., Du, H., Wang, S., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.0265 · Cited by 409
Self-citationBlood-based tests for multicancer early detection (PATHFINDER): a prospective cohort study
Schrag, D., Beer, T. M., McDonnell, C. H., Nadauld, L., Dilaveri, C. A., Reid, R., Marinac, C. R., Chung, K. C., Lopatin, M., Fung, E. T., et al. (2023) · The Lancet · doi:10.1016/s0140-6736(23)01700-2 · Cited by 396
Lebovitz, S., Levina, N., & Lifshitz-Assaf, H. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16564 · Cited by 49
Large-scale pancreatic cancer detection via non-contrast CT and deep learning
Cao, K., Xia, Y., Yao, J., Han, X., Lambert, L., Zhang, T., Tang, W., Jin, G., Jiang, H., Fang, X., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02640-w · Cited by 358
Screening for lung cancer: 2023 guideline update from the American Cancer Society
Wolf, A. M. D., Oeffinger, K. C., Shih, T. Y., Walter, L. C., Church, T. R., Fontham, E. T. H., Elkin, E. B., Etzioni, R. D., Guerra, C. E., Perkins, R. B., et al. (2024) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21811 · Cited by 310
Overview of radiomics in breast cancer diagnosis and prognostication
Tagliafico, A. S., Piana, M., Schenone, D., Lai, R., Massone, A. M., & Houssami, N. (2020) · The Breast · doi:10.1016/j.breast.2019.10.018 · Cited by 309
Dembrower, K., Wåhlin, E., Liu, Y., Salim, M., Smith, K., Lindholm, P., Eklund, M., & Strand, F. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30185-0 · Cited by 290
Salim, M., Wåhlin, E., Dembrower, K., Azavedo, E., Foukakis, T., Liu, Y., Smith, K., Eklund, M., & Strand, F. (2020) · JAMA Oncology · doi:10.1001/jamaoncol.2020.3321 · Cited by 288
Early Detection and Screening for Breast Cancer
Coleman, C. (2017) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2017.02.009 · Cited by 281
A Deep Learning Model to Triage Screening Mammograms: A Simulation Study
Yala, A., Schuster, T., Miles, R., Barzilay, R., & Lehman, C. (2019) · Radiology · doi:10.1148/radiol.2019182908 · Cited by 210
Self-citationGinestra, J. C., Giannini, H. M., Schweickert, W. D., Meadows, L., Lynch, M. J., Pavan, K., Chivers, C. J., Draugelis, M., Donnelly, P. J., Fuchs, B. D., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003803 · Cited by 159
Uses and Limitations of Artificial Intelligence for Oncology
Kolla, L., & Parikh, R. B. (2024) · Cancer · doi:10.1002/cncr.35307 · Cited by 126
Liu, H., Chen, Y., Zhang, Y., Wang, L., Luo, R., Wu, H., Wu, C., Zhang, H., Tan, W., Yin, H., et al. (2021) · European Radiology · doi:10.1007/s00330-020-07659-y · Cited by 88
Atlas, S. J., Tosteson, A. N. A., Wright, A., Orav, E. J., Burdick, T. E., Zhao, W., Hort, S. J., Wint, A. J., Smith, R. E., Chang, F. Y., et al. (2023) · JAMA · doi:10.1001/jama.2023.18755 · Cited by 54
Self-citationThe use and future perspective of Artificial Intelligence—A survey among German surgeons
Pecqueux, M., Riediger, C., Distler, M., Oehme, F., Bork, U., Kolbinger, F. R., Schöffski, O., van Wijngaarden, P., Weitz, J., Schweipert, J., et al. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.982335 · Cited by 41
Hughes, D. R., Espinoza, W., Fein, S., Rula, E. Y., & McGinty, G. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.4893 · Cited by 25
Metadata
- Authors
- Lehman, C. D., Arao, R. F., Sprague, B. L., Lee, J. M., Buist, D. S. M., Kerlikowske, K., Henderson, L. M., Onega, T., Tosteson, A. N. A., Rauscher, G. H., & Miglioretti, D. L.
- Venue
- Radiology
- Published
- 2017-04
- Volume
- 283
- Issue
- 1
- Pages
- 49-58
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2560617851
- Cited by
- 665
- References
- 25
- FWCI
- 30.19
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.