CoChat

The DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.

Evaluation of a Deep Learning System For Identifying Glaucomatous Optic Neuropathy Based on Color Fundus Photographs

Open access
Al-Aswad, Lama A., Kapoor, Rahul, Chu, Chia Kai, Walters, Stephen, Gong, Dan, Garg, Aakriti, Gopal, Kalashree, Patel, Vipul, Sameer, Trikha, Rogers, Thomas W., Nicolas, Jaccard, De Moraes, Gustavo C., Moazami, Golnaz · 2019 · Journal of Glaucoma

Abstract

Precis: Pegasus outperformed 5 of the 6 ophthalmologists in terms of diagnostic performance, and there was no statistically significant difference between the deep learning system and the “best case” consensus between the ophthalmologists. The agreement between Pegasus and gold standard was 0.715, whereas the highest ophthalmologist agreement with the gold standard was 0.613. Furthermore, the high sensitivity of Pegasus makes it a valuable tool for screening patients with glaucomatous optic neuropathy. Purpose: The purpose of this study was to evaluate the performance of a deep learning system for the identification of glaucomatous optic neuropathy. Materials and Methods: Six ophthalmologists and the deep learning system, Pegasus, graded 110 color fundus photographs in this retrospective single-center study. Patient images were randomly sampled from the Singapore Malay Eye Study. Ophthalmologists and Pegasus were compared with each other and to the original clinical diagnosis given by the Singapore Malay Eye Study, which was defined as the gold standard. Pegasus’ performance was compared with the “best case” consensus scenario, which was the combination of ophthalmologists whose consensus opinion most closely matched the gold standard. The performance of the ophthalmologists and Pegasus, at the binary classification of nonglaucoma versus glaucoma from fundus photographs, was assessed in terms of sensitivity, specificity and the area under the receiver operating characteristic curve (AUROC), and the intraobserver and interobserver agreements were determined. Results: Pegasus achieved an AUROC of 92.6% compared with ophthalmologist AUROCs that ranged from 69.6% to 84.9% and the “best case” consensus scenario AUROC of 89.1%. Pegasus had a sensitivity of 83.7% and a specificity of 88.2%, whereas the ophthalmologists’ sensitivity ranged from 61.3% to 81.6% and specificity ranged from 80.0% to 94.1%. The agreement between Pegasus and gold standard was 0.715, whereas the highest ophthalmologist agreement with the gold standard was 0.613. Intraobserver agreement ranged from 0.62 to 0.97 for ophthalmologists and was perfect (1.00) for Pegasus. The deep learning system took ∼10% of the time of the ophthalmologists in determining classification. Conclusions: Pegasus outperformed 5 of the 6 ophthalmologists in terms of diagnostic performance, and there was no statistically significant difference between the deep learning system and the “best case” consensus between the ophthalmologists. The high sensitivity of Pegasus makes it a valuable tool for screening patients with glaucomatous optic neuropathy. Future work will extend this study to a larger sample of patients.

Overview

Integrity signals

Registry

Crossref · 10.1097/ijg.0000000000001319

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 17 references

Cited by

See all 59

Metadata

Authors
Al-Aswad, L. A., Kapoor, R., Chu, C. K., Walters, S., Gong, D., Garg, A., Gopal, K., Patel, V., Sameer, T., Rogers, T. W., Nicolas, J., De Moraes, G. C., & Moazami, G.
Affiliations
  • Columbia University Medical Center, Harkness Eye Institute, New York, NY
  • Columbia University Irving Medical Center (US)
  • Visulytix Ltd
Corresponding author
  • Kapoor, Rahul
  • Chu, Chia Kai
  • Walters, Stephen
  • Gong, Dan
  • Gopal, Kalashree
  • Patel, Vipul
  • Moazami, Golnaz
Venue
Journal of Glaucoma
Published
2019-06-21
Volume
28
Issue
12
Pages
1029-1034
ISSN
1057-0829 (ISSN-L)
OpenAlex
W2955420986
Cited by
59
References
17
Citations by year
2026: 8 · 2025: 10 · 2024: 7 · 2023: 14 · 2022: 6 · 2021: 10 · 2020: 3 · 2019: 1
FWCI
3.31
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Glaucoma (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
National Eye Institute (R21EY029605)
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
  • Health Sciences › Medicine › Ophthalmology › Glaucoma and retinal disorders
  • Health Sciences › Medicine › Ophthalmology › Ophthalmology and Visual Health Research
Keywords
glaucomatous optic neuropathy, glaucoma diagnosis, color fundus images, deep learning, Pegasus, ophthalmologist comparison, interobserver agreement, intraobserver agreement, glaucoma screening, Singapore Malay Eye Study, diagnostic accuracy, automated diagnosis, intraocular pressure, optic disc margin, cup-to-disc ratio
MeSH terms
Ophthalmologists, Deep Learning, Adult, Aged, Diagnosis, Computer-Assisted, Diagnostic Techniques, Ophthalmological, Female, Glaucoma, Open-Angle, Humans, Intraocular Pressure, Male, Middle Aged, Optic Disk, Optic Nerve Diseases, Photography, Retrospective Studies, ROC Curve, Sensitivity and Specificity, Observer Variation, Area Under Curve

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evaluation of a Deep Learning System For Identifying Glaucomatous Optic Neuropathy Based on Color Fundus Photographs. https://app.cochat.ai/papers/10.1097/ijg.0000000000001319
The paper
Al-Aswad, L. A., Kapoor, R., Chu, C. K., Walters, S., Gong, D., Garg, A., Gopal, K., Patel, V., Sameer, T., Rogers, T. W., Nicolas, J., De Moraes, G. C., & Moazami, G. (2019). Evaluation of a Deep Learning System For Identifying Glaucomatous Optic Neuropathy Based on Color Fundus Photographs. Journal of Glaucoma. https://doi.org/10.1097/ijg.0000000000001319

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.