CoChat

An Automated Grading System for Detection of Vision-Threatening Referable Diabetic Retinopathy on the Basis of Color Fundus Photographs

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.

Abstract

OBJECTIVE: The goal of this study was to describe the development and validation of an artificial intelligence–based, deep learning algorithm (DLA) for the detection of referable diabetic retinopathy (DR). RESEARCH DESIGN AND METHODS: A DLA using a convolutional neural network was developed for automated detection of vision-threatening referable DR (preproliferative DR or worse, diabetic macular edema, or both). The DLA was tested by using a set of 106,244 nonstereoscopic retinal images. A panel of ophthalmologists graded DR severity in retinal photographs included in the development and internal validation data sets (n = 71,043); a reference standard grading was assigned once three graders achieved consistent grading outcomes. For external validation, we tested our DLA using 35,201 images of 14,520 eyes (904 eyes with any DR; 401 eyes with vision-threatening referable DR) from population-based cohorts of Malays, Caucasian Australians, and Indigenous Australians. RESULTS: Among the 71,043 retinal images in the training and validation data sets, 12,329 showed vision-threatening referable DR. In the internal validation data set, the area under the curve (AUC), sensitivity, and specificity of the DLA for vision-threatening referable DR were 0.989, 97.0%, and 91.4%, respectively. Testing against the independent, multiethnic data set achieved an AUC, sensitivity, and specificity of 0.955, 92.5%, and 98.5%, respectively. Among false-positive cases, 85.6% were due to a misclassification of mild or moderate DR. Undetected intraretinal microvascular abnormalities accounted for 77.3% of all false-negative cases. CONCLUSIONS: This artificial intelligence–based DLA can be used with high accuracy in the detection of vision-threatening referable DR in retinal images. This technology offers potential to increase the efficiency and accessibility of DR screening programs.

Overview

Integrity signals

Registry

Crossref · 10.2337/dc18-0147

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Cited by

See all 267

Metadata

Authors
Li, Z., Keel, S., Liu, C., He, Y., Meng, W., Scheetz, J., Lee, P. Y., Shaw, J., Ting, D., Wong, T. Y., Taylor, H., Chang, R., & He, M.
Affiliations
  • Sun Yat-sen University (CN)
  • The University of Melbourne (AU)
  • Guangzhou Healgoo Interactive Medical Technology Co. Ltd., Guangzhou, China
  • Baker Heart and Diabetes Institute (AU)
  • National University of Singapore (SG)
  • Stanford University (US)
Corresponding author
He, Mingguang
Venue
Diabetes Care
Published
2018-10-01
Volume
41
Issue
12
Pages
2509-2516
ISSN
  • 0149-5992 (ISSN-L)
  • 1935-5548
OpenAlex
W2893365278
Cited by
255
References
39
Citations by year
2026: 23 · 2025: 31 · 2024: 37 · 2023: 43 · 2022: 29 · 2021: 38 · 2020: 31 · 2019: 19 · 2018: 4
FWCI
15.89
Type
journal article
Language
en
Open access
closed
Locations
  • Diabetes Care (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • National Natural Science Foundation of China (81420108008)
  • Science and Technology Planning Project (2013B20400003)
  • Bupa Health Foundation
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
  • Health Sciences › Medicine › Ophthalmology › Retinal Diseases and Treatments
  • Health Sciences › Medicine › Ophthalmology › Ophthalmology and Visual Health Research
Keywords
referable diabetic retinopathy, automated grading, color fundus images, deep learning, convolutional neural networks, diabetic macular edema, preproliferative diabetic retinopathy, retinal image analysis, diabetic retinopathy screening, intraretinal microvascular abnormalities
MeSH terms
Adult, Aged, Aged, 80 and over, Algorithms, Artificial Intelligence, Australia, Automation, Diabetic Retinopathy, Diagnosis, Computer-Assisted, Diagnostic Techniques, Ophthalmological, Female, Humans, Male, Mass Screening, Middle Aged, Photography, Sensitivity and Specificity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.