Deep Learning–Based Algorithms in Screening of Diabetic Retinopathy: A Systematic Review of Diagnostic Performance
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
TOPIC Diagnostic performance of deep learning-based algorithms in screening patients with diabetes for diabetic retinopathy (DR). The algorithms were compared with the current gold standard of classification by human specialists. CLINICAL RELEVANCE Because DR is a common cause of visual impairment, screening is indicated to avoid irreversible vision loss. Automated DR classification using deep learning may be a suitable new screening tool that could improve diagnostic performance and reduce manpower. METHODS For this systematic review, we aimed to identify studies that incorporated the use of deep learning in classifying full-scale DR in retinal fundus images of patients with diabetes. The studies had to provide a DR grading scale, a human grader as a reference standard, and a deep learning performance score. A systematic search on April 5, 2018, through MEDLINE and Embase yielded 304 publications. To identify potentially missed publications, the reference lists of the final included studies were manually screened, yielding no additional publications. The Quality Assessment of Diagnostic Accuracy Studies 2 tool was used for risk of bias and applicability assessment. RESULTS By using objective selection, we included 11 diagnostic accuracy studies that validated the performance of their deep learning method using a new group of patients or retrospective datasets. Eight studies reported sensitivity and specificity of 80.28% to 100.0% and 84.0% to 99.0%, respectively. Two studies report accuracies of 78.7% and 81.0%. One study provides an area under the receiver operating curve of 0.955. In addition to diagnostic performance, one study also reported on patient satisfaction, showing that 78% of patients preferred an automated deep learning model over manual human grading. CONCLUSIONS Advantages of implementing deep learning-based algorithms in DR screening include reduction in manpower, cost of screening, and issues relating to intragrader and intergrader variability. However, limitations that may hinder such an implementation particularly revolve around ethical concerns regarding lack of trust in the diagnostic accuracy of computers. Considering both strengths and limitations, as well as the high performance of deep learning-based algorithms, automated DR classification using deep learning could be feasible in a real-world screening scenario.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
McInnes, M. D. F., Moher, D., Thombs, B. D., McGrath, T. A., Bossuyt, P. M., and the PRISMA-DTA Group, Clifford, T., Cohen, J. F., Deeks, J. J., Gatsonis, C., et al. (2018) · JAMA · doi:10.1001/jama.2017.19163 · Cited by 3,210
Ting, D. S. W., Cheung, C. Y.-L., Lim, G., Tan, G. S. W., Quang, N. D., Gan, A., Hamzah, H., Garcia-Franco, R., San Yeo, I. Y., Lee, S. Y., et al. (2017) · JAMA · doi:10.1001/jama.2017.18152 · Cited by 2,402
Efficient object localization using Convolutional Networks
Tompson, J., Goroshin, R., Jain, A., LeCun, Y., & Bregler, C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298664 · Cited by 1,365
Abràmoff, M. D., Lou, Y., Erginay, A., Clarida, W., Amelon, R., Folk, J. C., & Niemeijer, M. (2016) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.16-19964 · Cited by 1,101
Distributed deep learning networks among institutions for medical imaging
Chang, K., Balachandar, N., Lam, C., Yi, D., Brown, J., Beers, A., Rosen, B., Rubin, D. L., & Kalpathy-Cramer, J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy017 · Cited by 340
Automated Diabetic Retinopathy Image Assessment Software
Tufail, A., Rudisill, C., Egan, C., Kapetanakis, V. V., Salas-Vega, S., Owen, C. G., Lee, A., Louw, V., Anderson, J., Liew, G., et al. (2017) · Ophthalmology · doi:10.1016/j.ophtha.2016.11.014 · Cited by 283
Keel, S., Lee, P. Y., Scheetz, J., Li, Z., Kotowicz, M. A., MacIsaac, R. J., & He, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-22612-2 · Cited by 220
Cited by
Convolutional neural networks for dental image diagnostics: A scoping review
Schwendicke, F., Golla, T., Dreher, M., & Krois, J. (2019) · Journal of Dentistry · doi:10.1016/j.jdent.2019.103226 · Cited by 513
Economics of artificial intelligence in healthcare: Diagnosis vs. treatment
Khanna, N. N., Maindarkar, M. A., Viswanathan, V., Fernandes, J. F. E., Paul, S., Bhagawati, M., Ahluwalia, P., Ruzsa, Z., Sharma, A., Kolluri, R., et al. (2022) · Healthcare · doi:10.3390/healthcare10122493 · Cited by 347
Freeman, K., Geppert, J., Stinton, C., Todkill, D., Johnson, S., Clarke, A., & Taylor-Phillips, S. (2021) · BMJ · doi:10.1136/bmj.n1872 · Cited by 338
Deep learning for diabetic retinopathy detection and classification based on fundus images: A review
Tsiknakis, N., Theodoropoulos, D., Manikis, G., Ktistakis, E., Boutsora, O., Berto, A., Scarpa, F., Scarpa, A., Fotiadis, D. I., & Marias, K. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104599 · Cited by 328
Jayakumar, S., Sounderajah, V., Normahani, P., Harling, L., Markar, S. R., Ashrafian, H., & Darzi, A. (2022) · npj Digital Medicine · doi:10.1038/s41746-021-00544-y · Cited by 110
Wu, J.-H., Liu, T. Y. A., Hsu, W.-T., Ho, J. H.-C., & Lee, C.-C. (2021) · Journal of Medical Internet Research · doi:10.2196/23863 · Cited by 108
Liu, J., Gibson, E., Ramchal, S., Shankar, V., Piggott, K., Sychev, Y., Li, A. S., Rao, P. K., Margolis, T. P., Fondahn, E., et al. (2021) · Ophthalmology Retina · doi:10.1016/j.oret.2020.06.016 · Cited by 88
Mathenge, W., Whitestone, N., Nkurikiye, J., Patnaik, J. L., Piyasena, P., Uwaliraye, P., Lanouette, G., Kahook, M. Y., Cherwek, D. H., Congdon, N., et al. (2022) · Ophthalmology Science · doi:10.1016/j.xops.2022.100168 · Cited by 80
“Systematic reviews of deep learning-based algorithms in DR screening have highlighted such advantages as reduction in demands for manpower, cost of screening, and intragrader and intergrader variability.(11) However, evidence from real-life screening programs is limited, and no evidence exists on community acceptance…”
BackgroundFeasibility and acceptance of artificial intelligence-based diabetic retinopathy screening in Rwanda
Whitestone, N., Nkurikiye, J., Patnaik, J. L., Jaccard, N., Lanouette, G., Cherwek, D. H., Congdon, N., & Mathenge, W. (2024) · British Journal of Ophthalmology · doi:10.1136/bjo-2022-322683 · Cited by 31
“11 Using AI for DR screening allows non-clinicians to be trained on retinal imaging, with AI interpreting the images on-site, providing patients instant feedback.”
Tsai, M.-J., Hsieh, Y.-T., Tsai, C.-H., Chen, M., Hsieh, A.-T., Tsai, C.-W., & Chen, M.-L. (2022) · Journal of Diabetes Research · doi:10.1155/2022/5779276 · Cited by 18
“We believe that deep learning algorithms using datasets with mostly high-quality images for model training may not be truly representative of real-world conditions and could possibly result in the overestimation of screening performance [17].”
BackgroundRahmati, M., Smith, L., Piyasena, M. P., Bowen, M., Boyer, L., Fond, G., Kazemi, A., Yon, D. K., Lee, H., Sehmbi, T., et al. (2025) · Eye · doi:10.1038/s41433-025-03849-4 · Cited by 11
Metadata
- Authors
- Nielsen, K. B., Lautrup, M. L., Andersen, J. K. H., Savarimuthu, T. R., & Grauslund, J.
- Venue
- Ophthalmology Retina
- Publisher
- Elsevier BV
- Published
- 2019-04
- Volume
- 3
- Issue
- 4
- Pages
- 294-304
- ISSN
- 2468-6530 (ISSN-L)
- OpenAlex
- W2899170201
- Cited by
- 118
- References
- 10
- FWCI
- 1.74
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.