Cited by 54Health Systems, Economic Evaluations, Quality of LifeRetinal Imaging and AnalysisRetinal Diseases and Treatments

Artificial Intelligence in Community-Based Diabetic Retinopathy Telemedicine Screening in Urban China: Cost-effectiveness and Cost-Utility Analyses With Real-world Data

Open access
Lin, Senlin, Ma, Yingyan, Xu, Yi, Lu, Lina, He, Jiangnan, Zhu, Jianfeng, Peng, Yajun, Yu, Tao +2 more·2023·JMIR Public Health and Surveillance

Published version of a preprint

Abstract

Background: Community-based telemedicine screening for diabetic retinopathy (DR) has been highly recommended worldwide. However, evidence from low- and middle-income countries (LMICs) on the choice between artificial intelligence (AI)–based and manual grading–based telemedicine screening is inadequate for policy making. Objective: The aim of this study was to test whether the AI model is more worthwhile than manual grading in community-based telemedicine screening for DR in the context of labor costs in urban China. Methods: We conducted cost-effectiveness and cost-utility analyses by using decision-analytic Markov models with 30 one-year cycles from a societal perspective to compare the cost, effectiveness, and utility of 2 scenarios in telemedicine screening for DR: manual grading and an AI model. Sensitivity analyses were performed. Real-world data were obtained mainly from the Shanghai Digital Eye Disease Screening Program. The main outcomes were the incremental cost-effectiveness ratio (ICER) and the incremental cost-utility ratio (ICUR). The ICUR thresholds were set as 1 and 3 times the local gross domestic product per capita. Results: The total expected costs for a 65-year-old resident were US $3182.50 and US $3265.40, while the total expected years without blindness were 9.80 years and 9.83 years, and the utilities were 6.748 quality-adjusted life years (QALYs) and 6.753 QALYs in the AI model and manual grading, respectively. The ICER for the AI-assisted model was US $2553.39 per year without blindness, and the ICUR was US $15,216.96 per QALY, which indicated that AI-assisted model was not cost-effective. The sensitivity analysis suggested that if there is an increase in compliance with referrals after the adoption of AI by 7.5%, an increase in on-site screening costs in manual grading by 50%, or a decrease in on-site screening costs in the AI model by 50%, then the AI model could be the dominant strategy. Conclusions: Our study may provide a reference for policy making in planning community-based telemedicine screening for DR in LMICs. Our findings indicate that unless the referral compliance of patients with suspected DR increases, the adoption of the AI model may not improve the value of telemedicine screening compared to that of manual grading in LMICs. The main reason is that in the context of the low labor costs in LMICs, the direct health care costs saved by replacing manual grading with AI are less, and the screening effectiveness (QALYs and years without blindness) decreases. Our study suggests that the magnitude of the value generated by this technology replacement depends primarily on 2 aspects. The first is the extent of direct health care costs reduced by AI, and the second is the change in health care service utilization caused by AI. Therefore, our research can also provide analytical ideas for other health care sectors in their decision to use AI.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/41624

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Previous studies only focused on theoretical scenarios where sensitivity and specificity can change independently.

    “However, these studies only focused on theoretical scenarios where sensitivity and specificity can change independently, overlooking that in practical screening tools, these two parameters have an inverse correlation.”

    From Economic evaluation for medical artificial intelligence: accuracy vs. cost-effectiveness in a diabetic retinopathy screening case (2024) · cites this paper as [15]

    The Discussion’s Principal Findings (page unavailable) says this study modeled practical screening approaches using real-world data from an ongoing program in urban China. That contradicts the characterization that it focused only on theoretical scenarios. The Methods’ Sensitivity Analysis describes varying sensitivity and specificity, but does not say they can change independently or discuss an inverse correlation between them. (LLM, conf=0.87)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • Most previous health economic studies in China leaned towards adopting AI models with a high specificity (over 97%).

    “Most of these studies leaned towards adopting AI models with a high specificity (over 97%).”

    From Economic evaluation for medical artificial intelligence: accuracy vs. cost-effectiveness in a diabetic retinopathy screening case (2024) · cites this paper as [15]

    Methods > Screening Accuracy (page unavailable) says this Shanghai economic evaluation used an AI model with 97.96% specificity for sight-threatening diabetic retinopathy. The paper does not say that most previous health economic studies in China adopted models with specificity above 97%, so the claim extends a finding about this study to prior studies generally. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • The utility values for each DR status (non-referable DR, referable DR, and treated referable DR) and blindness were derived from previous studies in China.

    “The utility values for each DR status (non-referable DR, referable DR, and treated referable DR) and blindness were derived from previous studies in China that closely matched the situation in the current study14,15,37,39,51,52, and discounted at an annual rate of 3.5% according to the recommendations from the National Institute for Health and Clinical Excellence53.”

    From Economic evaluation for medical artificial intelligence: accuracy vs. cost-effectiveness in a diabetic retinopathy screening case (2024) · cites this paper as [15]

    The Methods section, “Utility and QALYs” (page unavailable), says the utility values were based on published studies from China and other Asian countries and gives values for non-STDR, STDR, and blindness. It does not give a separate utility value for treated referable DR, and it does not say all the underlying studies were from China. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • Previous studies evaluating cost-effectiveness of AI models assigned different values to sensitivity and specificity.

    “To evaluate cost-effectiveness change, previous studies assigned different values to the sensitivity and specificity of AI models14–16.”
  • Previous health economic studies in China have only compared a specific AI-based screening strategy with conventional manual screening.

    “Previous health economic studies in China have only compared a specific AI-based screening strategy with conventional manual screening, to indicate the cost-effectiveness of using AI for screening DR14,15,37–39.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 3

  1. [19]Rothman K Epidemiology: An Introduction, Second Edition 2012 New York Oxford University Press
  2. [28]Zhang W Wei M The Evaluation of the Mortality and Life Expectancy of Chinese Population Population Journal. (in Chinese) 2016 38 3 18 28 10.16405/j.cnki.1004-129X.2016.03.002 · DOI
  3. [31]Guide to the methods of technology appraisal 2013 National Institute for Health and Care Excellence 2022-05-07 https://www.nice.org.uk/process/pmg9/chapter/developing-the-scope 27905712

Cited by

Sorted by citations

Authors
Lin, S., Ma, Y., Xu, Y., Lu, L., He, J., Zhu, J., Peng, Y., Yu, T., Congdon, N., & Zou, H.
Affiliations
  • Shanghai Eye Disease Prevention & Treatment Center (CN)
  • Queen's University Belfast (GB)
Corresponding author
Zou, Haidong
Venue
JMIR Public Health and Surveillance
Published
2023-02-23
Volume
9
Pages
e41624
ISSN
2369-2960 (ISSN-L)
OpenAlex
W4321612624
Cited by
52
References
40
Citations by year
2026: 17 · 2025: 16 · 2024: 14 · 2023: 5
FWCI
10.59
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Public Health and Surveillance (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Shanghai Municipal Health Commission (2022YQ051)
  • Shanghai Hospital Development Center
  • National Key Research and Development Program of China (19DZ2250100, 2021YFC2702100)
Topics
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
  • Health Sciences › Medicine › Ophthalmology › Retinal Diseases and Treatments
Keywords
diabetic retinopathy, telemedicine screening, artificial intelligence, manual grading, cost-effectiveness, cost-utility analysis, community-based screening, low- and middle-income countries, referral compliance, quality-adjusted life years, urban China, labor costs, blindness prevention, Markov model, real-world data, sensitivity analysis, incremental cost-effectiveness
MeSH terms
Aged, Artificial Intelligence, Blindness, China, Cost-Benefit Analysis, Diabetes Mellitus, Diabetic Retinopathy, Humans, Markov Chains, Telemedicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review