An Automated Grading System for Detection of Vision-Threatening Referable Diabetic Retinopathy on the Basis of Color Fundus Photographs
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: The goal of this study was to describe the development and validation of an artificial intelligence–based, deep learning algorithm (DLA) for the detection of referable diabetic retinopathy (DR). RESEARCH DESIGN AND METHODS: A DLA using a convolutional neural network was developed for automated detection of vision-threatening referable DR (preproliferative DR or worse, diabetic macular edema, or both). The DLA was tested by using a set of 106,244 nonstereoscopic retinal images. A panel of ophthalmologists graded DR severity in retinal photographs included in the development and internal validation data sets (n = 71,043); a reference standard grading was assigned once three graders achieved consistent grading outcomes. For external validation, we tested our DLA using 35,201 images of 14,520 eyes (904 eyes with any DR; 401 eyes with vision-threatening referable DR) from population-based cohorts of Malays, Caucasian Australians, and Indigenous Australians. RESULTS: Among the 71,043 retinal images in the training and validation data sets, 12,329 showed vision-threatening referable DR. In the internal validation data set, the area under the curve (AUC), sensitivity, and specificity of the DLA for vision-threatening referable DR were 0.989, 97.0%, and 91.4%, respectively. Testing against the independent, multiethnic data set achieved an AUC, sensitivity, and specificity of 0.955, 92.5%, and 98.5%, respectively. Among false-positive cases, 85.6% were due to a misclassification of mild or moderate DR. Undetected intraretinal microvascular abnormalities accounted for 77.3% of all false-negative cases. CONCLUSIONS: This artificial intelligence–based DLA can be used with high accuracy in the detection of vision-threatening referable DR in retinal images. This technology offers potential to increase the efficiency and accessibility of DR screening programs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The classification based on fundus images for referable DR followed the guidelines of the National Health Service (NHS) diabetic eye screening (Supplementary Table 5)40.”
From Economic evaluation for medical artificial intelligence: accuracy vs. cost-effectiveness in a diabetic retinopathy screening case (2024) · cites this paper as [40]
In the citing paper
“We employed a validated AI model for automatic DR screening using fundus images from the Lifeline Express Program and evaluated the AI’s performance against manual grading results40.”
From Economic evaluation for medical artificial intelligence: accuracy vs. cost-effectiveness in a diabetic retinopathy screening case (2024) · cites this paper as [40]
In the citing paper
“It should be noted that the specificity of the AI model in this real-world dataset was lower than the reported performance in its previous validation as well as other reported AI models40.”
From Economic evaluation for medical artificial intelligence: accuracy vs. cost-effectiveness in a diabetic retinopathy screening case (2024) · cites this paper as [40]
In the citing paper
“Li et al. [43] developed a deep CNN-based DR screening system that achieved performance comparable to or exceeding that of professional ophthalmologists across real-world datasets from multiple countries.”
From Artificial intelligence-powered prediction of diabetic complications: from clinical data to molecular omics (2026) · cites this paper as [43]
In the citing paper
“Only eight studies in ophthalmology imaging14,21,32,33,43,55,108,109, ten studies in respiratory imaging64,66,70,72,75,79,82,87,89,110 and six studies in breast imaging62,91,97,104,106,111 mentioned adherence to the STARD-2015 guidelines or had a STARD flow diagram in the manuscript.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [33]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · cited 1×
“These deep learning techniques have been applied in highly image-driven medical specialties, including dermatology and radiology, with promising results: the techniques have identified diseases as accurately as or more accurately than board-certified specialists (15,16).”
BackgroundInternational Diabetes Federation 2017
Carracher, A. M., Marathe, P. H., & Close, K. L. (2018) · Journal of Diabetes · doi:10.1111/1753-0407.12644 · Cited by 13,418
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
(2007) · Developments in Ophthalmology · doi:10.1159/isbn.978-3-318-01439-6 · Cited by 5,583
Global prevalence and major risk factors of diabetic retinopathy
Yau, J. W. Y., Rogers, S. L., Kawasaki, R., Lamoureux, E. L., Kowalski, J. W., Bek, T., Chen, S.-J., Dekker, J. M., Fletcher, A., Grauslund, J., et al. (2012) · Diabetes Care · doi:10.2337/dc11-1909 · Cited by 4,985 · cited 2×
“6%, corresponding to nearly 100 million people worldwide (1).”
BackgroundSelf-citationZhou, B., Lu, Y., Hajifathalian, K., Bentham, J., Di Cesare, M., Danaei, G., Bixby, H., Cowan, M., Ali, M., Taddei, C., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)00618-8 · Cited by 4,311
Wilkinson, C. P., Ferris, F. L., Klein, R. E., Lee, P. P., Agardh, C. D., Davis, M., Dills, D., Kampik, A., Pararajasegaram, R., & Verdaguer, J. T. (2003) · Ophthalmology · doi:10.1016/s0161-6420(03)00475-5 · Cited by 3,743
Self-citationCheung, N., Mitchell, P., & Wong, T. Y. (2010) · The Lancet · doi:10.1016/s0140-6736(09)62124-3 · Cited by 3,288
Self-citation
Cited by
Artificial Intelligence and Deep Learning in Ophthalmology
Wang, Z., Keane, P. A., Chiang, M., Cheung, C. Y., Wong, T. Y., & Ting, D. S. W. (2022) · Artificial Intelligence in Medicine · doi:10.1007/978-3-030-64573-1_200 · Cited by 1,524
Self-citationArtificial intelligence and deep learning in ophthalmology
Ting, D. S. W., Pasquale, L. R., Peng, L., Campbell, J. P., Lee, A. Y., Raman, R., Tan, G. S. W., Schmetterer, L., Keane, P. A., & Wong, T. Y. (2019) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2018-313173 · Cited by 1,554
Self-citationDiagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
Self-citationDigital technology, tele-medicine and artificial intelligence in ophthalmology: A global perspective
Li, J.-P. O., Liu, H., Ting, D. S. J., Jeon, S., Chan, R. V. P., Kim, J. E., Sim, D. A., Thomas, P. B. M., Lin, H., Chen, Y., et al. (2021) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2020.100900 · Cited by 626
Self-citationA deep learning system for detecting diabetic retinopathy across the disease spectrum
Dai, L., Wu, L., Li, H., Cai, C., Wu, Q., Kong, H., Liu, R., Wang, X., Hou, X., Liu, Y., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-23458-5 · Cited by 620
“Current deep learning systems for DR screening have been predominantly focused on the identi fi cation of patients with referable DR (moderate NPDR or worse) or vision-threatening DR, which means the patients should be referred to ophthalmologists for treatment or closer follow-up 21,22,24 .”
BackgroundInfluentialDeep learning in ophthalmology: The technical and clinical considerations
Ting, D. S. W., Peng, L., Varadarajan, A. V., Keane, P. A., Burlina, P. M., Chiang, M. F., Schmetterer, L., Pasquale, L. R., Bressler, N. M., Webster, D. R., et al. (2019) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2019.04.003 · Cited by 534
Self-citationApplications of deep learning in fundus images: A review
Li, T., Bo, W., Hu, C., Kang, H., Liu, H., Wang, K., & Fu, H. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101971 · Cited by 396
Bellemo, V., Lim, Z. W., Lim, G., Nguyen, Q. D., Xie, Y., Yip, M. Y. T., Hamzah, H., Ho, J., Lee, X. Q., Hsu, W., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30004-4 · Cited by 419
Self-citationArtificial intelligence for diabetic retinopathy screening: a review
Grzybowski, A., Brona, P., Lim, G., Ruamviboonsuk, P., Tan, G. S. W., Abramoff, M., & Ting, D. S. W. (2020) · Eye · doi:10.1038/s41433-019-0566-0 · Cited by 376
Self-citationArtificial Intelligence in Cardiology: Present and Future
Lopez-Jimenez, F., Attia, Z., Arruda-Olson, A. M., Carter, R., Chareonthaitawee, P., Jouni, H., Kapa, S., Lerman, A., Luong, C., Medina-Inojosa, J. R., et al. (2020) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2020.01.038 · Cited by 280
Scheetz, J., Rothschild, P., McGuinness, M., Hadoux, X., Soyer, H. P., Janda, M., Condon, J. J. J., Oakden-Rayner, L., Palmer, L. J., Keel, S., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-84698-5 · Cited by 273
Self-citationPromising Artificial Intelligence-Machine Learning-Deep Learning Algorithms in Ophthalmology
(2019) · Asia-Pacific Journal of Ophthalmology · doi:10.22608/apo.2018479 · Cited by 182
“Recent studies regarding DR revealed that AI, ML, and DL demonstrated high accuracy, sensitivity, and specificity for the detection of DR. 14,21,23–25 The results of some studies on DR based on AI, ML, and DL modalities are given in detail below.”
BackgroundThe Integration of Artificial Intelligence into Clinical Practice
Karalis, V. D. (2024) · Applied Biosciences · doi:10.3390/applbiosci3010002 · Cited by 255
“Automated application systems have the potential to enhance doctors’ comprehension of diabetic retinopathy predictions and enhance the practicality of intelligent diagnostic models in real-world clinical settings [133].”
BackgroundDeepDRiD: Diabetic Retinopathy—Grading and Image Quality Estimation Challenge
Liu, R., Wang, X., Wu, Q., Dai, L., Fang, X., Yan, T., Son, J., Tang, S., Li, J., Gao, Z., et al. (2022) · Patterns · doi:10.1016/j.patter.2022.100512 · Cited by 211
Explainable AI for Retinoblastoma Diagnosis: Interpreting Deep Learning Models with LIME and SHAP
Aldughayfiq, B., Ashfaq, F., Jhanjhi, N. Z., & Humayun, M. (2023) · Diagnostics · doi:10.3390/diagnostics13111932 · Cited by 211
“However, their decision-making process is often considered a “black box” that lacks transparency and interpretability, which can hinder their clinical adoption and trust [16–18].”
BackgroundArtificial intelligence in ophthalmology: The path to the real-world clinic
Li, Z., Wang, L., Wu, X., Jiang, J., Qiang, W., Xie, H., Zhou, H., Wu, S., Shao, Y., & Chen, W. (2023) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101095 · Cited by 188
“Li et al.(29) 2018 retrospective TFI 48,116 Inception-v3 detection of referable GON AUC = 0.”
InfluentialSelf-citationIslam, M. M., Yang, H.-C., Poly, T. N., Jian, W.-S., & (Jack) Li, Y.-C. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105320 · Cited by 187
Qureshi, I., Ma, J., & Abbas, Q. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10238-4 · Cited by 186
Ellahham, S., Ellahham, N., & Simsekler, M. C. E. (2020) · American Journal of Medical Quality · doi:10.1177/1062860619878515 · Cited by 177
“Li et al 36 applied a deep learning algorithm to detect referable diabetic retinopathy in a data set of 71 043 retinal images.”
Rajesh, A. E., Davidson, O. Q., Lee, C. S., & Lee, A. (2023) · Diabetes Care · doi:10.2337/dci23-0032 · Cited by 191
Artificial Intelligence for Screening of Multiple Retinal and Optic Nerve Diseases
Dong, L., He, W., Zhang, R., Ge, Z., Wang, Y. X., Zhou, J., Xu, J., Shao, L., Wang, Q., Yan, Y., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.9960 · Cited by 157
A universal artificial intelligence platform for collaborative management of cataracts
Wu, X., Huang, Y., Liu, Z., Lai, W., Long, E., Zhang, K., Jiang, J., Lin, D., Chen, K., Yu, T., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)32358-x · Cited by 159
Self-citationEnsemble deep learning and EfficientNet for accurate diagnosis of diabetic retinopathy
Arora, L., Singh, S. K., Kumar, S., Gupta, H., Alhalabi, W., Arya, V., Bansal, S., Chui, K. T., & Gupta, B. B. (2024) · Scientific Reports · doi:10.1038/s41598-024-81132-4 · Cited by 157
Artificial intelligence for diabetic retinopathy screening, prediction and management
Gunasekeran, D. V., Ting, D. S. W., Tan, G. S. W., & Wong, T. Y. (2020) · Current Opinion in Ophthalmology · doi:10.1097/icu.0000000000000693 · Cited by 133
“2018 [37] Inception V3 71043 Images 3 Datasets: 35201 images 95.”
Self-citationArtificial intelligence and digital health in global eye health: opportunities and challenges
Tan, T. F., Thirunavukarasu, A. J., Jin, L., Lim, J., Poh, S. S. J., Teo, Z. L., Ang, M., Chan, R. V. P., Ong, J., Turner, A. W., et al. (2023) · The Lancet Global Health · doi:10.1016/s2214-109x(23)00323-6 · Cited by 142
Self-citationZhang, L., Yuan, M., An, Z., Zhao, X., Wu, H., Li, H., Wang, Y., Sun, B., Li, H., Ding, S., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0233166 · Cited by 149
“Though this Inception-v3 model was not developed for medical image recognition, it has been successfully used for classifying medical images base on transfer learning methods [12, 24], which include classification of retinal fundus images [8, 14, 25].”
MethodAutomatic Diabetic Retinopathy Grading System Based on Detecting Multiple Retinal Lesions
AbdelMaksoud, E., El–Sappagh, S., Barakat, S., Abuhmed, T., & Elmogy, M. M. (2021) · IEEE Access · doi:10.1109/access.2021.3052870 · Cited by 128
“The occurrence of one/two or all of these features in the retina determines the DR stages [5].”
BackgroundÖzbay, E. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10231-3 · Cited by 137
“Thus, blindness can be prevented with early screening and regular drug therapy, which is appropriate for DR patients (Li et al. 2018).”
BackgroundWang, J., Bai, Y., & Xia, B. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3012547 · Cited by 123
“[16] developed a convolutional neural network for detecting vision-threatening referable DR.”
BackgroundTransfer Learning-Based Model for Diabetic Retinopathy Diagnosis Using Retinal Images
Jabbar, M. K., Yan, J., Xu, H., Rehman, Z. U., & Jabbar, A. (2022) · Brain Sciences · doi:10.3390/brainsci12050535 · Cited by 124
González-Gonzalo, C., Sánchez-Gutiérrez, V., Hernández-Martínez, P., Contreras, I., Lechanteur, Y. T. E., Domanian, A., van Ginneken, B., & Sánchez, C. I. (2019) · Acta Ophthalmologica · doi:10.1111/aos.14306 · Cited by 118
Zhang, Y., Shi, J., Peng, Y. H., Zhao, Z., Zheng, Q., Wang, Z., Liu, K., Jiao, S., Qiu, K., Zhou, Z., et al. (2020) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2020-001596 · Cited by 124
Artificial Intelligence and Ophthalmology
Keskinbora, K. H., & Güven, F. (2020) · Turkish Journal of Ophthalmology · doi:10.4274/tjo.galenos.2020.78989 · Cited by 115
Wu, J.-H., Liu, T. Y. A., Hsu, W.-T., Ho, J. H.-C., & Lee, C.-C. (2021) · Journal of Medical Internet Research · doi:10.2196/23863 · Cited by 108
“After further exclusion, only 32 studies were retrieved after the second stage of literature selection [13,15,17-46].”
BackgroundArtificial intelligence for diabetes care: current and future prospects
Sheng, B., Pushpanathan, K., Guan, Z., Lim, Q. H., Lim, Z. W., Yew, S. M. E., Goh, J. H. L., Bee, Y. M., Sabanayagam, C., Sevdalis, N., et al. (2024) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(24)00154-2 · Cited by 106
Self-citationAbdelMaksoud, E., Barakat, S., & Elmogy, M. M. (2022) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-022-02564-6 · Cited by 112
“The appearance of at least one of these lesions in the retina represents one of the DR grade [4].”
BackgroundPan, X., Jin, K., Cao, J., Liu, Z., Wu, J., You, K., Lu, Y., Xu, Y., Su, Z., Jiang, J.-K., et al. (2020) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-019-04575-w · Cited by 94
“According to an abrupt rise in diabetes, the increasing burden of DR can be forecasted [2].”
BackgroundGrzybowski, A. E., Singhanetr, P., Nanegrungsunk, O., & Ruamviboonsuk, P. (2023) · Ophthalmology and Therapy · doi:10.1007/s40123-023-00691-3 · Cited by 98
“The sensitivity and specificity were found to be 92.5% and 98.5%, respectively [35].”
BackgroundInfluentialScheetz, J., Koca, D., McGuinness, M., Holloway, E., Tan, Z., Zhu, Z., O’Day, R., Sandhu, S., MacIsaac, R. J., Gilfillan, C., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-94178-5 · Cited by 88
“Previous studies investigating the diagnostic performance of AI systems for the detection of referable DR using retrospective datasets have also demonstrated high levels of accuracy 10,11,13,30 .”
BackgroundMethodResultSelf-citationArmstrong, G. W., & Lorch, A. (2019) · International Ophthalmology Clinics · doi:10.1097/iio.0000000000000298 · Cited by 94
Qian, B., Chen, H., Wang, X., Guan, Z., Li, T., Jin, Y., Wu, Y.-L., Wen, Y., Che, H., Kwon, G., et al. (2024) · Patterns · doi:10.1016/j.patter.2024.100929 · Cited by 102
Self-citationKeel, S., Li, Z., Scheetz, J., Robman, L. D., Phung, J., Makeyeva, G. A., Aung, K.-Z., Liu, C., Yan, X., Meng, W., et al. (2019) · Clinical and Experimental Ophthalmology · doi:10.1111/ceo.13575 · Cited by 92
Self-citationArtificial Intelligence in Diabetic Eye Disease Screening
(2019) · Asia-Pacific Journal of Ophthalmology · doi:10.22608/apo.201976 · Cited by 82
Self-citationMathenge, W., Whitestone, N., Nkurikiye, J., Patnaik, J. L., Piyasena, P., Uwaliraye, P., Lanouette, G., Kahook, M. Y., Cherwek, D. H., Congdon, N., et al. (2022) · Ophthalmology Science · doi:10.1016/j.xops.2022.100168 · Cited by 80
“Using validated AI algorithms instead of scarce trained specialists could potentially increase the efficiency and accessibility of screening programs.(10) Systematic reviews of deep learning-based algorithms in DR screening have highlighted such advantages as reduction in demands for manpower, cost of screening, and i…”
MethodDeployment of Artificial Intelligence in Real-World Practice: Opportunity and Challenge
He, M., Li, Z., Liu, C., Shi, D., & Tan, Z. (2020) · Asia-Pacific Journal of Ophthalmology · doi:10.1097/apo.0000000000000301 · Cited by 75
“Google Inception V3 is the most commonly used of these, followed by VGG-net, AlexNet, ResNet, and so on.(9,10,13,27,44,45) The adoption of a neural network model often depends on its availability when the study is conducted.”
Self-citationShi, D., Lin, Z., Wang, W., Tan, Z., Shang, X., Zhang, X., Meng, W., Ge, Z., & He, M. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2022.823436 · Cited by 78
“Two hundred and twenty images with significant variations were initially included, of which 20 came from the UK Biobank (14), 120 from the LabelMe platform (15).”
BackgroundSelf-citationWang, Y., Liu, C., Hu, W., Luo, L., Shi, D., Zhang, J., Yin, Q., Zhang, L., Han, X., & He, M. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01032-9 · Cited by 76
Self-citationOuda, O. M., AbdelMaksoud, E., El-Aziz, A. A. A., & Elmogy, M. M. (2022) · Electronics · doi:10.3390/electronics11131966 · Cited by 85
“It has received extensive research interest in developing new medical image processing algorithms to support disease detection and diagnosis [15–21].”
BackgroundTang, F., Luenam, P., Ran, A. R., Quadeer, A. A., Raman, R., Sen, P., Khan, R., Anantharaman, G., Haridas, S., Iglicki, M., et al. (2021) · Ophthalmology Retina · doi:10.1016/j.oret.2021.01.013 · Cited by 77
JOSEPH, S., SELVARAJ, J., MANI, I., KUMARAGURUPARI, T., SHANG, X., MUDGIL, P., RAVILLA, T., & HE, M. (2024) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2024.02.012 · Cited by 69
Self-citationShah, P. N., Mishra, D., Shanmugam, M. P., Doshi, B., Jayaraj, H., & Ramanjulu, R. (2020) · Indian Journal of Ophthalmology · doi:10.4103/ijo.ijo_966_19 · Cited by 76
Shi, D., Zhang, W., He, S., Chen, Y., Song, F., Liu, S., Wang, R., Zheng, Y., & He, M. (2023) · Ophthalmology Science · doi:10.1016/j.xops.2023.100401 · Cited by 59
“As most DR screening programs are based on conventional CF, 35 e 37 the CF-to-FFA framework as a new technology serves as a simple add-on to improve DR screening accuracy with no additional cost.”
Self-citationPieczyński, J., Kuklo, P., & Grzybowski, A. E. (2021) · Ophthalmology and Therapy · doi:10.1007/s40123-021-00353-2 · Cited by 66
Li, B., Chen, H., Zhang, B., Yuan, M., Jin, X., Lei, B., Xu, J., Gu, W., Wong, D., He, X., et al. (2021) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2020-316290 · Cited by 68
Artificial intelligence for diabetic retinopathy
Li, S., Zhao, R., & Zou, H. (2021) · Chinese Medical Journal · doi:10.1097/cm9.0000000000001816 · Cited by 65
“[59] Most current AI-based diagnostic systems for DR are based on FP. FP can only detect DME based on the recognition of hard exudates in the posterior pole, which is limited by the based on FP may probably miss cases although they cover DME.”
BackgroundBanerjee, T., Singh, D. P., & Kour, P. (2025) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-025-10376-8 · Cited by 68
Application of Artificial Intelligence in Ophthalmology: An Updated Comprehensive Review
Hashemian, H., Pető, T., Ambrósio, R., Lengyel, I., Kafieh, R., Noori, A. M., & Khorrami‐Nejad, M. (2024) · Journal of Ophthalmic and Vision Research · doi:10.18502/jovr.v19i3.15893 · Cited by 62
“[79, 80, 83] This would lead to early detection and treatment, ultimately preserving vision and preventing blindness for millions of patients with diabetes worldwide.”
BackgroundMethodInfluentialQuantifying the impact of physical activity on future glucose trends using machine learning
Tyler, N. S., MOSQUERA-LOPEZ, C. M., Young, G. M., Youssef, J. E., Castle, J. R., & Jacobs, P. G. (2022) · iScience · doi:10.1016/j.isci.2022.103888 · Cited by 55
Management of diabetes complications in youth
Graves, L. E., & Donaghue, K. C. (2019) · Therapeutic Advances in Endocrinology and Metabolism · doi:10.1177/2042018819863226 · Cited by 60
Updates in deep learning research in ophthalmology
Ng, W. Y., Zhang, S., Wang, Z., Ong, C., Gunasekeran, D. V., Lim, G. Y. S., Zheng, F., Tan, S. C. Y., Tan, G. S. W., Rim, T. H., et al. (2021) · Clinical Science · doi:10.1042/cs20210207 · Cited by 54
Self-citationAutomated detection of severe diabetic retinopathy using deep learning method
Zhang, X., Li, F., Li, D., Wei, Q., Han, X., Zhang, B., Chen, H., Zhang, Y., Mo, B., Hu, B., et al. (2021) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-021-05402-x · Cited by 55
Ye, X., Wang, J., Chen, Y., Lv, Z., He, S., Mao, J., Xu, J., & Shen, L. (2021) · Translational Vision Science & Technology · doi:10.1167/tvst.10.13.10 · Cited by 53
Gao, Z., Jin, K., Yan, Y., Liu, X., Shi, Y., Ge, Y., Pan, X., Lu, Y., Wu, J., Wang, Y., et al. (2022) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-021-05503-7 · Cited by 53
Shi, C., Lee, J., Wang, G., Dou, X., Yuan, F., & Zee, B. C.-Y. (2022) · Scientific Reports · doi:10.1038/s41598-022-13919-2 · Cited by 56
“Another study suggested adding the visual acuity assessment into retinal analysis in DR screening, and those with reduced vision should be given a referral 34 .”
BackgroundHu, W., Joseph, S., Li, R., Woods, E., Sun, J., Shen, M., Jan, C. L., Zhu, Z., He, M., & Zhang, L. (2024) · eClinicalMedicine · doi:10.1016/j.eclinm.2023.102387 · Cited by 47
Self-citationA comprehensive review of artificial intelligence models for screening major retinal diseases
Hassan, B., Raja, H., Hassan, T., Akram, M. U., Raja, H., Abd-Alrazaq, A. A., Yousefi, S., & Werghi, N. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10736-z · Cited by 49
Yip, M. Y. T., Lim, G., Lim, Z. W., Nguyen, Q. D., Chong, C. C. Y., Yu, M., Bellemo, V., Xie, Y., Lee, X. Q., Hamzah, H., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0247-1 · Cited by 55
Self-citationDeep learning‐based detection and stage grading for optimising diagnosis of diabetic retinopathy
Wang, Y., Yu, M., Hu, B., Jin, X., Li, Y., Zhang, X., Zhang, Y., Gong, D., Wu, C., Zhang, B., et al. (2021) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.3445 · Cited by 47
“The upper branch adopted the convolutional layers of the well‐recognised Inception‐v3 model,(18,26) which was originally designed for referable/nonreferable DR classification.(15,18,27) In the lower branch, we used a fully convolutional network (FCN‐32s) to give pixelwise lesion segmentation predictions.”
MethodDevelopment and research status of intelligent ophthalmology in China
Gong, D., Li, X., Wan, C., Zhou, Y., Wang, S., Wang, J., Xu, Y., Zhang, S.-C., & Yang, W. (2024) · International Journal of Ophthalmology · doi:10.18240/ijo.2024.12.20 · Cited by 43
Qian, X., Jingying, H., Xian, S., Zhao, Y., Wu, L., Baorui, C., Guo, W., Yefeng, Z., Zhang, Q., Chunyan, C., et al. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.1025271 · Cited by 46
“Intra-retinal microvascular abnormalities were identified as the main source of misclassification (24), which was optimized in the training datasets (both laboratory and real-world clinic workflow).”
Feasibility of Diagnosing Both Severity and Features of Diabetic Retinopathy in Fundus Photography
Wang, J., Bai, Y., & Xia, B. (2019) · IEEE Access · doi:10.1109/access.2019.2930941 · Cited by 44
“[15] designed a CNN method for detecting vision-threatening referable DR.”
MethodLiu, B., Zhang, B., Hu, Y., Cao, D., Yang, D., Wu, Q., Hu, Y., Yang, J., Peng, Q., Huang, M., et al. (2021) · Annals of Translational Medicine · doi:10.21037/atm-20-1431 · Cited by 46
Update on Screening for Sight-Threatening Diabetic Retinopathy
Scanlon, P. H. (2019) · Ophthalmic Research · doi:10.1159/000499539 · Cited by 43
Artificial intelligence for early detection of diabetes mellitus complications via retinal imaging
Sobhi, N., Sadeghi-Bazargani, Y., Mirzaei, M., Abdollahi, M., Jafarizadeh, A., Pedrammehr, S., Alizadehsani, R., Tan, R.-S., Islam, S. M. S., & Acharya, U. R. (2025) · Journal of Diabetes & Metabolic Disorders · doi:10.1007/s40200-025-01596-7 · Cited by 39
“To address this, researchers have developed DL neural networks for lesion-based classification [ 62, 66, 67].”
Liu, R., Li, Q., Xu, F., Wang, S., He, J., Cao, Y., Shi, F., Chen, X., & Chen, J. (2022) · BioMedical Engineering OnLine · doi:10.1186/s12938-022-01018-2 · Cited by 43
Wang, X., Dai, L., Li, S., Kong, H., Sheng, B., & Wu, Q. E. (2020) · Current Eye Research · doi:10.1080/02713683.2020.1764975 · Cited by 42
Lu, Z., Miao, J., Dong, J., Zhu, S., Wang, X., & Feng, J. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.104365 · Cited by 38
Vidal‐Alaball, J., Fibla, D. R., Zapata, M. Á., Marin-Gomez, F. X., & Solans, Ó. (2018) · JMIR Research Protocols · doi:10.2196/12539 · Cited by 45
“This project will follow a methodology similar to that used by Li et al [17] and will consist of 2 concomitant studies: In the first study, we will develop an AI algorithm to detect the signs of DR in patients with diabetes.”
BackgroundMethodThe biomedical applications of artificial intelligence: an overview of decades of research
Naskar, S., Sharma, S., Kuotsu, K., Halder, S., Pal, G., Saha, S., Mondal, S., Biswas, U. K., Jana, M., & Bhattacharjee, S. (2025) · Journal of drug targeting · doi:10.1080/1061186x.2024.2448711 · Cited by 47
“…system identifying referable Dr [210] inception-v3 identifying referable Dr [211] inception-v3 identification of vision-threatening conditions Dr [212] adapted Vggnet identification of referable and potentially blinding Dr [213] inception-v3 identifying referable Dr [214] resnet50 finding Poag…”
The era of artificial intelligence–based individualized telemedicine is coming
Jheng, Y.-C., Kao, C.-L., Yarmishyn, A. A., Chou, Y.-B., Hsu, C., Lin, T.-C., Hu, H.-K., Ho, T.-Y., Chen, P.-Y., Kao, Z.-K., et al. (2020) · Journal of the Chinese Medical Association · doi:10.1097/jcma.0000000000000374 · Cited by 38
Convolutional neural network for detecting rib fractures on chest radiographs: a feasibility study
Wu, J., Liu, N., Li, X., Fan, Q., Li, Z., Shang, J., Wang, F., Chen, B., Shen, Y., Cao, P., et al. (2023) · BMC Medical Imaging · doi:10.1186/s12880-023-00975-x · Cited by 41
“As in the research by Li et al. [43], several steps were performed for stand-ardisation, including rescaling, downsizing, and transformation.”
Self-citationFundus Image-Based Eye Disease Detection Using EfficientNetB3 Architecture
Alsohemi, R., & Dardouri, S. (2025) · Journal of Imaging · doi:10.3390/jimaging11080279 · Cited by 37
“EfficientNetB3 outperformed conventional CNNs and showed notable gains in accuracy, sensitivity, and F1-score metrics when used for multi-disease retinal categorization in [7].”
AbdelMaksoud, E., Barakat, S., & Elmogy, M. M. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104039 · Cited by 35
Deep learning-based fundus image analysis for cardiovascular disease: a review
Chikumba, S., Hu, Y., & Luo, J. (2023) · Therapeutic Advances in Chronic Disease · doi:10.1177/20406223231209895 · Cited by 38
Urina‐Triana, M., Piñeres-Melo, M. A., Mantilla-Morrón, M., Butt, S. A., Galeano-Muñoz, L., Naz, S., & Ariza-Colpas, P. (2024) · IEEE Access · doi:10.1109/access.2024.3378277 · Cited by 36
Li, N., Ma, M., Lai, M., Gu, L., Kang, M., Wang, Z., Jiao, S., Dang, K., Deng, J., Ding, X., et al. (2021) · Journal of Diabetes · doi:10.1111/1753-0407.13241 · Cited by 38
“9,10 11-16 However, a majority of DLA systems have been validated using online curated or publicly available datasets (EyePACS, Messidor-2, e-ophtha), 11,12,15 which contained high-quality photographs from individuals.”
MethodUsing artificial intelligence to improve medical services in China
Li, R., Yang, Y., Wu, S., Huang, K., Chen, W., Liu, Y., & Lin, H. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2019.11.108 · Cited by 36
Zhelev, Z., Peters, J., Rogers, M., Allen, M. J., Kijauskaite, G., Seedat, F., Wilkinson, E. C., & Hyde, C. (2023) · Journal of Medical Screening · doi:10.1177/09691413221144382 · Cited by 38
Kiburg, K., Turner, A. W., & He, M. (2022) · Clinical and Experimental Ophthalmology · doi:10.1111/ceo.14147 · Cited by 35
“This limits the generalisability of artificial intelligence algorithms with area under the curve lower in Aboriginal and Torres Strait Islanders compared to Chinese, Malay and Caucasian populations.(34) However, these advances in technology provide a promising future for increased access to screening and assessment of…”
BackgroundSelf-citationProgress of artificial intelligence in diabetic retinopathy screening
Wang, Y., Yang, J., Yang, J., Zhao, X., Chen, Y., & Yu, W. (2020) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.3414 · Cited by 33
Artificial Intelligence in Ophthalmology: Accuracy, Challenges, and Clinical Application
Tan, Z., Scheetz, J., & He, M. (2019) · Asia-Pacific Journal of Ophthalmology · doi:10.22608/apo.2019122 · Cited by 36
Self-citationArtificial Intelligence in Ophthalmology: Evolutions in Asia
Ruamviboonsuk, P., Cheung, C. Y.-L., Zhang, X., Raman, R., Park, S. J., & Ting, D. S. W. (2020) · Asia-Pacific Journal of Ophthalmology · doi:10.1097/01.apo.0000656980.41190.bf · Cited by 37
Self-citationYao, L., Zhong, Y., Wu, J., Zhang, G., Chen, L., Guan, P., Huang, D., & Liu, L. (2019) · Diabetes Metabolic Syndrome and Obesity · doi:10.2147/dmso.s219842 · Cited by 34
“…such as Deep learning system (DLS) under the broad term of arti fi cial intelligence (AI), to detect referable DR and related eye diseases 14,15 by evaluating retinal images, these programs for screening DR are still challenged by issues related to implementation (Fundus Camera),…”
BackgroundGomes, R. F. T., Schuch, L. F., Martins, M. D., Honório, E. F., de Figueiredo, R. M., Schmith, J., Machado, G. N., & Carrard, V. C. (2023) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-023-00775-3 · Cited by 31
“Some technologies, which undergo updates to meet new demands, were Inception V1 [11, 23, 59], ResNetV2 initiation [34], Incep-tionV3 [6, 34, 54, 56, 58, 61, 68, 69, 73], and Inception-v44 [5, 62, 68].”
BackgroundMethodInfluentialSeguí, F. L., Aguilar, R. A.-E., de Maeztu, G., García‐Altés, A., Cuyàs, F. G., Walsh, S. M., Castro, M. S., & Vidal‐Alaball, J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17031093 · Cited by 28
Computer aided diagnosis of diabetic macular edema in retinal fundus and OCT images: A review
Chakrapani, P. K., Kumar, P., Geetha, M. K., & Bhandary, S. V. (2023) · Journal of Applied Biomedicine · doi:10.1016/j.bbe.2022.12.005 · Cited by 30
Fine-grained attention & knowledge-based collaborative network for diabetic retinopathy grading
Tian, M., Wang, H., Sun, Y., Wu, S., Tang, Q., & Zhang, M. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e17217 · Cited by 28
Wagner, G., Raymond, L., & Paré, G. (2023) · JMIR Medical Education · doi:10.2196/45631 · Cited by 27
Rodríguez, A., Arruabarrena, C., Allendes, G., Olivera, M., Zarranz‐Ventura, J., & Teus, M. A. (2024) · Scientific Reports · doi:10.1038/s41598-024-68489-2 · Cited by 29
Tahir, H. N., Ullah, N., Tahir, M., Domnic, I. S., Prabhakar, R., Meerasa, S. S., AbdElneam, A. I., Tahir, S., & Ali, Y. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1519768 · Cited by 32
Metadata
- Authors
- Li, Z., Keel, S., Liu, C., He, Y., Meng, W., Scheetz, J., Lee, P. Y., Shaw, J., Ting, D., Wong, T. Y., Taylor, H., Chang, R., & He, M.
- Affiliations
- Sun Yat-sen University (CN)
- The University of Melbourne (AU)
- Guangzhou Healgoo Interactive Medical Technology Co. Ltd., Guangzhou, China
- Baker Heart and Diabetes Institute (AU)
- National University of Singapore (SG)
- Stanford University (US)
- Corresponding author
- He, Mingguang
- ORCID
- Venue
- Diabetes Care
- Publisher
- American Diabetes Association
- Published
- 2018-10-01
- Volume
- 41
- Issue
- 12
- Pages
- 2509-2516
- ISSN
- 0149-5992 (ISSN-L)
- 1935-5548
- OpenAlex
- W2893365278
- Cited by
- 255
- References
- 39
- Citations by year
- 2026: 23 · 2025: 31 · 2024: 37 · 2023: 43 · 2022: 29 · 2021: 38 · 2020: 31 · 2019: 19 · 2018: 4
- FWCI
- 15.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Diabetes Care (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (81420108008)
- Science and Technology Planning Project (2013B20400003)
- Bupa Health Foundation
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
- Health Sciences › Medicine › Ophthalmology › Retinal Diseases and Treatments
- Health Sciences › Medicine › Ophthalmology › Ophthalmology and Visual Health Research
- Keywords
- referable diabetic retinopathy, automated grading, color fundus images, deep learning, convolutional neural networks, diabetic macular edema, preproliferative diabetic retinopathy, retinal image analysis, diabetic retinopathy screening, intraretinal microvascular abnormalities
- MeSH terms
- Adult, Aged, Aged, 80 and over, Algorithms, Artificial Intelligence, Australia, Automation, Diabetic Retinopathy, Diagnosis, Computer-Assisted, Diagnostic Techniques, Ophthalmological, Female, Humans, Male, Mass Screening, Middle Aged, Photography, Sensitivity and Specificity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.