Development and validation of a deep‐learning algorithm for the detection of neovascular age‐related macular degeneration from colour fundus photographs
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Importance: Detection of early onset neovascular age‐related macular degeneration (AMD) is critical to protecting vision. Background: To describe the development and validation of a deep‐learning algorithm (DLA) for the detection of neovascular age‐related macular degeneration. Design: Development and validation of a DLA using retrospective datasets. Participants: We developed and trained the DLA using 56 113 retinal images and an additional 86 162 images from an independent dataset to externally validate the DLA. All images were non‐stereoscopic and retrospectively collected. Methods: The internal validation dataset was derived from real‐world clinical settings in China. Gold standard grading was assigned when consensus was reached by three individual ophthalmologists. The DLA classified 31 247 images as gradable and 24 866 as ungradable (poor quality or poor field definition). These ungradable images were used to create a classification model for image quality. Efficiency and diagnostic accuracy were tested using 86 162 images derived from the Melbourne Collaborative Cohort Study. Neovascular AMD and/or ungradable outcome in one or both eyes was considered referable. Main Outcome Measures: Area under the receiver operating characteristic curve (AUC), sensitivity and specificity. Results: In the internal validation dataset, the AUC, sensitivity and specificity of the DLA for neovascular AMD was 0.995, 96.7%, 96.4%, respectively. Testing against the independent external dataset achieved an AUC, sensitivity and specificity of 0.967, 100% and 93.4%, respectively. More than 60% of false positive cases displayed other macular pathologies. Amongst the false negative cases (internal validation dataset only), over half (57.2%) proved to be undetected detachment of the neurosensory retina or RPE layer. Conclusions and Relevance: This DLA shows robust performance for the detection of neovascular AMD amongst retinal images from a multi‐ethnic sample and under different imaging protocols. Further research is warranted to investigate where this technology could be best utilized within screening and research settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ting, D. S. W., Cheung, C. Y.-L., Lim, G., Tan, G. S. W., Quang, N. D., Gan, A., Hamzah, H., Garcia-Franco, R., San Yeo, I. Y., Lee, S. Y., et al. (2017) · JAMA · doi:10.1001/jama.2017.18152 · Cited by 2,402
Self-citationCan we open the black box of AI?
Castelvecchi, D. (2016) · Nature · doi:10.1038/538020a · Cited by 1,773 · cited 1×
“differences including camera setup illumination and inclusion criteria.(21) In comparison, our DLA was trained using images from multiple clinical settings using various retinal cameras and imaging protocols, and was able to achieve excellent diagnostic accuracy.”
MethodLi, Z., He, Y., Keel, S., Meng, W., Chang, R. T., & He, M. (2018) · Ophthalmology · doi:10.1016/j.ophtha.2018.01.023 · Cited by 830 · cited 1×
“It is important to note that we have also developed DLAs to detect referable diabetic retinopathy (DR) and glaucomatous optic neuropathy (GON), 10,24-26 which can be deployed concurrently with the DLA described in the present report.”
BackgroundSelf-citationLi, Z., Keel, S., Liu, C., He, Y., Meng, W., Scheetz, J., Lee, P. Y., Shaw, J., Ting, D., Wong, T. Y., et al. (2018) · Diabetes Care · doi:10.2337/dc18-0147 · Cited by 255
Self-citationKeel, S., Lee, P. Y., Scheetz, J., Li, Z., Kotowicz, M. A., MacIsaac, R. J., & He, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-22612-2 · Cited by 220
Self-citation
Cited by
Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
Digital technology, tele-medicine and artificial intelligence in ophthalmology: A global perspective
Li, J.-P. O., Liu, H., Ting, D. S. J., Jeon, S., Chan, R. V. P., Kim, J. E., Sim, D. A., Thomas, P. B. M., Lin, H., Chen, Y., et al. (2021) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2020.100900 · Cited by 626
“Keel et al., (2019) analyzed 56,113 retinal images to develop a DL system for neovascular AMD detection and validated this system using an additional 86,162 images.”
MethodScheetz, J., Koca, D., McGuinness, M., Holloway, E., Tan, Z., Zhu, Z., O’Day, R., Sandhu, S., MacIsaac, R. J., Gilfillan, C., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-94178-5 · Cited by 88
Self-citation
Metadata
- Authors
- Keel, S., Li, Z., Scheetz, J., Robman, L., Phung, J., Makeyeva, G., Aung, K., Liu, C., Yan, X., Meng, W., Guymer, R., Chang, R., & He, M.
- Venue
- Clinical & Experimental Ophthalmology
- Publisher
- Wiley
- Published
- 2019-07-25
- Volume
- 47
- Issue
- 8
- Pages
- 1009-1018
- ISSN
- 1442-6404 (ISSN-L)
- 1442-9071
- OpenAlex
- W2950848962
- Cited by
- 85
- References
- 5
- FWCI
- 6.15
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development and validation of a deep‐learning algorithm for the detection of neovascular age‐related macular degeneration from colour fundus photographs. https://app.cochat.ai/papers/10.1111/ceo.13575
- The paper
- Keel, S., Li, Z., Scheetz, J., Robman, L., Phung, J., Makeyeva, G., Aung, K., Liu, C., Yan, X., Meng, W., Guymer, R., Chang, R., & He, M. (2019). Development and validation of a deep‐learning algorithm for the detection of neovascular age‐related macular degeneration from colour fundus photographs. Clinical & Experimental Ophthalmology. https://doi.org/10.1111/ceo.13575
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.