Cited by 30Electronic Health Records SystemsGlobal Cancer Incidence and ScreeningAI in cancer detection

Electronic Triggers to Identify Delays in Follow-Up of Mammography: Harnessing the Power of Big Data in Health Care

Murphy, Daniel R., Meyer, Ashley N.D., Vaghani, Viralkumar, Russo, Elise, Sittig, Dean F., Wei, Li, Wu, Louis, Singh, Hardeep·2018·Journal of the American College of Radiology

Abstract

Purpose We previously developed electronic triggers to automatically flag records for patients experiencing potential delays in diagnostic evaluation for certain cancers. Because of the unique clinical, logistic, and legal aspects of mammography, this study was conducted to evaluate the effectiveness of a trigger to flag delayed follow-up on mammography. Methods An algorithm was developed to detect delays in follow-up of abnormal mammographic results (>60 days for BI-RADS® 0, 4, and 5 and >7 months for BI-RADS 3) using clinical data in the electronic health record. Flagged records were then manually reviewed to determine the trigger's performance characteristics (positive and negative predictive value, sensitivity, and specificity). The frequency of delays and patient communication related to abnormal results, reasons for lack of follow-up, and whether patients were subsequently diagnosed with breast cancer were also assessed. Results Of 365,686 patients seen between January 1, 2010, and May 31, 2015, the trigger identified 2,129 patients with abnormal findings on mammography, of whom it flagged 552 as having delays in follow-up. From these, review of 400 randomly selected records revealed 283 true delays (positive predictive value, 71%; 95% confidence interval, 66%-75%), including 280 records without any documented plan and three patients with plans that were not adhered to. Transcription and reporting inconsistencies were identified in 27% of externally performed mammographic reports. Only 335 records (84%) contained specific documentation that the patient was informed of the abnormal result. Conclusions Care delays appear to continue despite federal laws requiring patient notification of mammographic results within 30 days. Clinical application of mammography-related triggers could help detect these delays.

Integrity signals

Registry

Crossref · 10.1016/j.jacr.2017.10.001

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • A sample size of 30 participants, each reviewing 35 test results, was required to achieve 80% power to detect a statistically significant difference in cognitive workload and performance.

    “On the basis of the anticipated rate of appropriately identified abnormal test results in the literature12,13,14,15,16,17,18,19,20,21 and the anticipated magnitude of the association of the enhanced EHR, we required a sample size of 30 participants, each reviewing 35 test results, to achieve 80% power to detect a statistically significant difference in cognitive workload and performance.”
  • Even in the EHR environment, with alerts and reminders in place, physicians continue to often inappropriately manage abnormal test results.

    “Even in the EHR environment, with alerts and reminders in place, physicians continue to often inappropriately manage abnormal test results.12,13,14,15,16,17,18,19,20,21”

Cites

Flagged first, then by citations

Authors
Murphy, D. R., Meyer, A. N. D., Vaghani, V., Russo, E., Sittig, D. F., Wei, L., Wu, L., & Singh, H.
Affiliations
  • Michael E. DeBakey VA Medical Center (US)
  • Memorial Hermann (US)
Corresponding author
Murphy, Daniel R.
Venue
Journal of the American College of Radiology
Publisher
Elsevier BV
Published
2018-02
Volume
15
Issue
2
Pages
287-295
ISSN
1546-1440 (ISSN-L)
OpenAlex
W2765766150
Cited by
30
References
3
Citations by year
2026: 2 · 2025: 3 · 2024: 2 · 2023: 3 · 2022: 5 · 2021: 3 · 2020: 4 · 2019: 5 · 2018: 3
FWCI
4.52
Type
journal article
Language
en
Open access
closed
Locations
  • Journal of the American College of Radiology (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • U.S. Department of Veterans Affairs
  • Agency for Healthcare Research and Quality (K08HS022901)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Medicine › Oncology › Global Cancer Incidence and Screening
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
Keywords
late follow-up, mammography, BI-RADS 3, breast cancer screening, electronic health records, clinical decision support, patient notification, follow-up adherence
MeSH terms
Big Data, Algorithms, Breast Neoplasms, Continuity of Patient Care, Female, Humans, Mammography, Medical Informatics Applications, Predictive Value of Tests, Sensitivity and Specificity, Reminder Systems, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review