Artificial Intelligence and Diabetic Retinopathy: AI Framework, Prospective Studies, Head-to-head Validation, and Cost-effectiveness
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Current guidelines recommend that individuals with diabetes receive yearly eye exams for detection of referable diabetic retinopathy (DR), one of the leading causes of new-onset blindness. For addressing the immense screening burden, artificial intelligence (AI) algorithms have been developed to autonomously screen for DR from fundus photography without human input. Over the last 10 years, many AI algorithms have achieved good sensitivity and specificity (>85%) for detection of referable DR compared with human graders; however, many questions still remain. In this narrative review on AI in DR screening, we discuss key concepts in AI algorithm development as a background for understanding the algorithms. We present the AI algorithms that have been prospectively validated against human graders and demonstrate the variability of reference standards and cohort demographics. We review the limited head-to-head validation studies where investigators attempt to directly compare the available algorithms. Next, we discuss the literature regarding cost-effectiveness, equity and bias, and medicolegal considerations, all of which play a role in the implementation of these AI algorithms in clinical practice. Lastly, we highlight ongoing efforts to bridge gaps in AI model data sets to pursue equitable development and delivery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Global Prevalence of Diabetic Retinopathy and Projection of Burden through 2045
Teo, Z. L., Tham, Y.-C., Yu, M., Chee, M. L., Rim, T. H., Cheung, N., Bikbov, M. M., Wang, Y. X., Tang, Y., Lu, Y., et al. (2021) · Ophthalmology · doi:10.1016/j.ophtha.2021.04.027 · Cited by 2,420
Ting, D. S. W., Cheung, C. Y.-L., Lim, G., Tan, G. S. W., Quang, N. D., Gan, A., Hamzah, H., Garcia-Franco, R., San Yeo, I. Y., Lee, S. Y., et al. (2017) · JAMA · doi:10.1001/jama.2017.18152 · Cited by 2,402
Implementing Machine Learning in Health Care — Addressing Ethical Challenges
Char, D. S., Shah, N. H., & Magnus, D. (2018) · New England Journal of Medicine · doi:10.1056/nejmp1714229 · Cited by 1,857
Abràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638
Ensuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341
Bias in data‐driven artificial intelligence systems—An introductory survey
Ntoutsi, E., Fafalios, P., Gadiraju, U., Iosifidis, V., Nejdl, W., Vidal, M., Ruggieri, S., Turini, F., Papadopoulos, S., Krasanakis, E., et al. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1356 · Cited by 1,043
Veale, M., & Zuiderveen Borgesius, F. (2021) · Computer Law Review International · doi:10.9785/cri-2021-220402 · Cited by 805
Screening for diabetic retinopathy: new perspectives and challenges
Vujosevic, S., Aldington, S. J., Silva, P., Hernández, C., Scanlon, P., Peto, T., & Simó, R. (2020) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(19)30411-5 · Cited by 671
Artificial intelligence for diabetic retinopathy screening: a review
Grzybowski, A., Brona, P., Lim, G., Ruamviboonsuk, P., Tan, G. S. W., Abramoff, M., & Ting, D. S. W. (2020) · Eye · doi:10.1038/s41433-019-0566-0 · Cited by 376
Digital medicine and the curse of dimensionality
Berisha, V., Krantsevich, C., Hahn, P. R., Hahn, S., Dasarathy, G., Turaga, P., & Liss, J. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00521-5 · Cited by 344
Gulshan, V., Rajan, R. P., Widner, K., Wu, D., Wubbels, P., Rhodes, T., Whitehouse, K., Coram, M., Corrado, G., Ramasamy, K., et al. (2019) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2019.2004 · Cited by 303
Xie, Y., Nguyen, Q. D., Hamzah, H., Lim, G., Bellemo, V., Gunasekeran, D. V., Yip, M. Y. T., Qi Lee, X., Hsu, W., Li Lee, M., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30060-1 · Cited by 288
Automated Diabetic Retinopathy Image Assessment Software
Tufail, A., Rudisill, C., Egan, C., Kapetanakis, V. V., Salas-Vega, S., Owen, C. G., Lee, A., Louw, V., Anderson, J., Liew, G., et al. (2017) · Ophthalmology · doi:10.1016/j.ophtha.2016.11.014 · Cited by 283
Self-citationČartolovni, A., Tomičić, A., & Lazić Mosler, E. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104738 · Cited by 267
Ipp, E., Liljenquist, D., Bode, B., Shah, V. N., Silverstein, S., Regillo, C. D., Lim, J. I., Sadda, S., Domalpally, A., Gray, G., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.34254 · Cited by 256
Li, Z., Keel, S., Liu, C., He, Y., Meng, W., Scheetz, J., Lee, P. Y., Shaw, J., Ting, D., Wong, T. Y., et al. (2018) · Diabetes Care · doi:10.2337/dc18-0147 · Cited by 255
Ruamviboonsuk, P., Tiwari, R., Sayres, R., Nganthavee, V., Hemarat, K., Kongprayoon, A., Raman, R., Levinstein, B., Liu, Y., Schaekermann, M., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00017-6 · Cited by 250
Ruamviboonsuk, P., Krause, J., Chotcomwongse, P., Sayres, R., Raman, R., Widner, K., Campana, B. J. L., Phene, S., Hemarat, K., Tadarati, M., et al. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0099-8 · Cited by 233
Lee, A. Y., Yanagihara, R. T., Lee, C. S., Blazes, M., Jung, H. C., Chee, Y. E., Gencarella, M. D., Gee, H., Maa, A. Y., Cockerham, G. C., et al. (2021) · Diabetes Care · doi:10.2337/dc20-1877 · Cited by 194
Self-citationGomez Rossi, J., Rojas-Perilla, N., Krois, J., & Schwendicke, F. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.0269 · Cited by 141
A reimbursement framework for artificial intelligence in healthcare
Abràmoff, M. D., Roehrenbeck, C., Trujillo, S., Goldstein, J., Graves, A. S., Repka, M. X., & Silva III, E. “. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00621-w · Cited by 117
Liu, H., Li, R., Zhang, Y., Zhang, K., Yusufu, M., Liu, Y., Mou, D., Chen, X., Tian, J., Li, H., et al. (2023) · The Lancet Global Health · doi:10.1016/s2214-109x(22)00554-x · Cited by 111
Lim, G., Bellemo, V., Xie, Y., Lee, X. Q., Yip, M. Y. T., & Ting, D. S. W. (2020) · Eye and Vision · doi:10.1186/s40662-020-00182-7 · Cited by 96
Foundational Considerations for Artificial Intelligence Using Ophthalmic Images
Abràmoff, M. D., Cunningham, B., Patel, B., Eydelman, M. B., Leng, T., Sakamoto, T., Blodi, B., Grenon, S. M., Wolf, R. M., Manrai, A. K., et al. (2022) · Ophthalmology · doi:10.1016/j.ophtha.2021.08.023 · Cited by 96
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.138 · Cited by 89
Cost-effectiveness of artificial intelligence screening for diabetic retinopathy in rural China
Huang, X.-M., Yang, B.-F., Zheng, W.-L., Liu, Q., Xiao, F., Ouyang, P.-W., Li, M.-J., Li, X.-Y., Meng, J., Zhang, T.-T., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-07655-6 · Cited by 89
Scheetz, J., Koca, D., McGuinness, M., Holloway, E., Tan, Z., Zhu, Z., O’Day, R., Sandhu, S., MacIsaac, R. J., Gilfillan, C., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-94178-5 · Cited by 88
Wolf, R. M., Channa, R., Abramoff, M. D., & Lehmann, H. P. (2020) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2020.3190 · Cited by 87
Lin, S., Ma, Y., Xu, Y., Lu, L., He, J., Zhu, J., Peng, Y., Yu, T., Congdon, N., & Zou, H. (2023) · JMIR Public Health and Surveillance · doi:10.2196/41624 · Cited by 52
Economic challenges of artificial intelligence adoption for diabetic retinopathy
Chen, E. M., Chen, D., Chilakamarri, P., Lopez, R., & Parikh, R. (2021) · Ophthalmology · doi:10.1016/j.ophtha.2020.07.043 · Cited by 21
Cited by
Artificial intelligence for early detection of diabetes mellitus complications via retinal imaging
Sobhi, N., Sadeghi-Bazargani, Y., Mirzaei, M., Abdollahi, M., Jafarizadeh, A., Pedrammehr, S., Alizadehsani, R., Tan, R.-S., Islam, S. M. S., & Acharya, U. R. (2025) · Journal of Diabetes & Metabolic Disorders · doi:10.1007/s40200-025-01596-7 · Cited by 39
Cangelosi, G., Conti, A., Caggianelli, G., Panella, M., Petrelli, F., Mancin, S., Ratti, M., & Masini, A. (2025) · Medicina · doi:10.3390/medicina61081403 · Cited by 31
Ran, A. R., Ding, J. L., Tang, Z., Lam, C., Nguyen, T. X., Zhou, J., Zhang, S., Fang, D., Yang, D., Ng, V., et al. (2026) · Diabetes Care · doi:10.2337/dc25-1493 · Cited by 7
Metadata
- Authors
- Rajesh, A. E., Davidson, O. Q., Lee, C. S., & Lee, A. Y.
- Venue
- Diabetes Care
- Publisher
- American Diabetes Association
- Published
- 2023-09-20
- Volume
- 46
- Issue
- 10
- Pages
- 1728-1739
- ISSN
- 0149-5992 (ISSN-L)
- 1935-5548
- OpenAlex
- W4386884172
- Cited by
- 150
- References
- 31
- FWCI
- 22.14
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.