Cited by 32Retinal Imaging and AnalysisOphthalmology and Visual Health ResearchRetinal Diseases and Treatments

Artificial Intelligence Improves Patient Follow-Up in a Diabetic Retinopathy Screening Program

Open access
Dow, Eliot R, Chen, Karen M, Zhao, Cindy, Knapp, Austen, Phadke, Anuradha, Weng, Kirsti, Do, Diana V, Mahajan, Vinit B +3 more·2023·Clinical Ophthalmology

Abstract

Purpose: We examine the rate of and reasons for follow-up in an Artificial Intelligence (AI)-based workflow for diabetic retinopathy (DR) screening relative to two human-based workflows. Patients and Methods: A DR screening program initiated September 2019 between one institution and its affiliated primary care and endocrinology clinics screened 2243 adult patients with type 1 or 2 diabetes without a diagnosis of DR in the previous year in the San Francisco Bay Area. For patients who screened positive for more-than-mild-DR (MTMDR), rates of follow-up were calculated under a store-and-forward human-based DR workflow (“Human Workflow”), an AI-based workflow involving IDx-DR (“AI Workflow”), and a two-step hybrid workflow (“AI–Human Hybrid Workflow”). The AI Workflow provided same-day results, whereas the other workflows took 1– 5 days. Patients were surveyed by phone about follow-up decisions. Results: Under the AI Workflow, 279 patients screened positive for MTMDR. Of these, 69.2% followed up with an ophthalmologist within 90 days. Altogether 70.5% ( N =48) of patients who followed up chose their location based on primary care referral. Under the Human Workflow and AI–Human Hybrid Workflow, 12.0% ( N =14/117) and 11.7% ( N =12/103) of patients with a referrable screening result followed up compared to 35.5% of patients under the AI Workflow ( N =99/279; χ 2 df=2 = 36.70, p < 0.00000001). Conclusion: Ophthalmology follow-up after a positive DR screening result is approximately three-fold higher under the AI Workflow than either the Human Workflow or AI–Human Hybrid Workflow. Improved follow-up behavior may be due to the decreased time to screening result. Keywords: telemedicine, teleophthalmology, fundus photography, deep learning, machine learning, referral

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2147/opth.s422513

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Two studies that replaced routine referrals with targeted, AI-assisted referrals showed greater effect sizes than studies with a manual grading comparator.

    “Firstly, comparator types whereby two studies replaced routine referrals with targeted, AI-assisted referrals13,17 showed greater effect sizes than those studies with a manual grading comparator14–16,18.”

    From Referral uptake after diabetic retinopathy screening with artificial intelligence-assisted care pathways: a systematic review and meta-analysis (2026) · cites this paper as [15]

    The Methods (Program Overview; page unavailable) say the program did not alter established referral-placement processes: patients were referred to ophthalmology when indicated under both AI and human workflows. This contradicts the characterization of this study as replacing routine referrals with targeted, AI-assisted referrals. The Results report greater follow-up under the AI workflow, but do not make the citing authors’ cross-study effect-size comparison. (LLM, conf=0.85)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • Real-world implementation of diabetic retinopathy screening with artificial intelligence-assisted care pathways has accelerated globally since 2020.

    “Real-world implementation of DR screening with AI-assisted care pathways has accelerated globally since 20208,13–22, yet evidence on clinical and health system outcomes such as referral uptake remains limited.”

    From Referral uptake after diabetic retinopathy screening with artificial intelligence-assisted care pathways: a systematic review and meta-analysis (2026) · cites this paper as [15]

    The Methods (Program Overview; page not specified) describe a real-world diabetic retinopathy screening program in the San Francisco Bay Area that adopted an AI workflow after its first 18 months, which began in September 2019. The paper supports an example of implementation after 2020, but does not establish that implementation accelerated globally since 2020. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • Liu et al., Dow et al., and Chotcomwongse et al. demonstrated serious risk of bias due to confounding from co-interventions, sequential implementation with potential for temporal confounding, and fundamentally different comparators.

    “Liu et al.17, Dow et al.15, and Chotcomwongse et al.16 demonstrated serious risk of bias due to confounding from co-interventions (automated reminders16, proactive scheduling calls17), sequential implementation with potential for temporal confounding15,17, and fundamentally different comparators (AI-targeted versus routine referrals)17.”

    From Referral uptake after diabetic retinopathy screening with artificial intelligence-assisted care pathways: a systematic review and meta-analysis (2026) · cites this paper as [15]

    The Methods (Program Overview; page unavailable) describe the human workflow operating for the first 18 months, followed by the AI workflow. The Discussion acknowledges potential bias in the retrospective analysis and confounding from comparison with a historical cohort. These passages support the concern about temporal confounding attributed to Dow et al., but the paper does not characterize its risk of bias as serious; it also describes a hybrid comparison intended to reduce confounding. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • Dow et al.'s retrospective study (n=396) showed 35.5% referral uptake with AI workflow versus 12.0% with manual grading when restricting analysis to university eye institute appointments (+23.5%, p=0.000004).

    “Dow et al.‘s retrospective study (n = 396) showed 35.5% referral uptake with AI workflow versus 12.0% with manual grading when restricting analysis to university eye institute appointments (+23.5%, p = 0.000004)15.”

    From Referral uptake after diabetic retinopathy screening with artificial intelligence-assisted care pathways: a systematic review and meta-analysis (2026) · cites this paper as [15]

    The Results report 35.5% (99/279) follow-up at the university eye institute under the AI Workflow versus 12.0% (14/117) under the Human Workflow; those denominators total 396, and the difference is 23.5 percentage points. The study describes its analyses as retrospective (Discussion). However, the Results give the pairwise comparison as p < 0.000004, not p = 0.000004. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • Workflow redesign alone may drive gains in referral uptake in some contexts, even with existing manual grading infrastructure such as asynchronous telehealth via remote grading centres.

    “suggesting workflow redesign alone may drive gains in referral uptake in some contexts, even with existing manual grading infrastructure such as asynchronous telehealth via remote grading centres.”

    From Referral uptake after diabetic retinopathy screening with artificial intelligence-assisted care pathways: a systematic review and meta-analysis (2026) · cites this paper as [15]

    The Discussion (page not provided) suggests that faster release of results and changes to patient messaging may improve follow-up. But the observed three-fold gain occurred with an AI workflow compared with manual-grading workflows; the study did not test workflow redesign alone while retaining manual grading. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. [18]Pernic A, Kaehr MM, Doerr ED, Koczman JJ, Yung CWR, Phan ADT. Analysis of compliance with recommended follow-up for diabetic retinopathy in a county hospital population. Invest Ophthalmol Vis Sci. 2014; 55(13): 2290.24398091

Cited by

Sorted by citations

Authors
Dow, E. R., Chen, K. M., Zhao, C., Knapp, A., Phadke, A., Weng, K., Do, D. V., Mahajan, V. B., Mruthyunjaya, P., Leng, T., & Myung, D.
Affiliations
  • Duke University (US)
  • Stanford University (US)
  • Stanford Health Care (US)
  • VA Palo Alto Health Care System (US)
Corresponding author
Myung, David
Venue
Clinical Ophthalmology
Published
2023-11
Volume
Volume 17
Pages
3323-3330
ISSN
  • 1177-5467 (ISSN-L)
  • 1177-5483
OpenAlex
W4388153243
Cited by
29
References
18
Citations by year
2026: 10 · 2025: 13 · 2024: 6
FWCI
4.80
Type
journal article
Language
en
Open access
Locations
  • Clinical ophthalmology (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • Dove Medical Press (Taylor and Francis Group) (submittedVersion, cc-by-nc)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Research to Prevent Blindness (EY026877, P30-EY026877)
  • Regeneron Pharmaceuticals
  • Stanford Diabetes Research Center
  • Apellis Pharmaceuticals
  • Astellas Pharma
  • National Institutes of Health (EY 026877)
  • Genentech
  • National Eye Institute (P30EY026877)
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
  • Health Sciences › Medicine › Ophthalmology › Ophthalmology and Visual Health Research
  • Health Sciences › Medicine › Ophthalmology › Retinal Diseases and Treatments
Keywords
diabetic retinopathy screening, artificial intelligence, teleophthalmology, telemedicine, follow-up rates, ophthalmology referral, fundus photography, deep learning, type 1 and type 2 diabetes, primary care referral

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review