Automatic interpretation and clinical evaluation for fundus fluorescein angiography images of diabetic retinopathy patients by deep learning
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Background/aims: Fundus fluorescein angiography (FFA) is an important technique to evaluate diabetic retinopathy (DR) and other retinal diseases. The interpretation of FFA images is complex and time-consuming, and the ability of diagnosis is uneven among different ophthalmologists. The aim of the study is to develop a clinically usable multilevel classification deep learning model for FFA images, including prediagnosis assessment and lesion classification. Methods: A total of 15 599 FFA images of 1558 eyes from 845 patients diagnosed with DR were collected and annotated. Three convolutional neural network (CNN) models were trained to generate the label of image quality, location, laterality of eye, phase and five lesions. Performance of the models was evaluated by accuracy, F-1 score, the area under the curve and human-machine comparison. The images with false positive and false negative results were analysed in detail. Results: Compared with LeNet-5 and VGG16, ResNet18 got the best result, achieving an accuracy of 80.79%–93.34% for prediagnosis assessment and an accuracy of 63.67%–88.88% for lesion detection. The human-machine comparison showed that the CNN had similar accuracy with junior ophthalmologists. The false positive and false negative analysis indicated a direction of improvement. Conclusion: This is the first study to do automated standardised labelling on FFA images. Our model is able to be applied in clinical practice, and will make great contributions to the development of intelligent diagnosis of FFA images.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“FFA provides more dynamic and abundant fundus vascular information, yet is accompanied by a more complex and time-consuming interpretation, which requires significant ophthalmological expertise2.”
From Generative artificial intelligence for fundus fluorescein angiography interpretation and human expert evaluation (2025) · cites this paper as [2]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Optical coherence tomography angiography
Spaide, R. F., Fujimoto, J. G., Waheed, N. K., Sadda, S. R., & Staurenghi, G. (2018) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2017.11.003 · Cited by 1,779
HD-CNN: Hierarchical Deep Convolutional Neural Networks for Large Scale Visual Recognition
Yan, Z., Zhang, H., Piramuthu, R., Jagadeesh, V., DeCoste, D., Di, W., & Yu, Y. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.314 · Cited by 936
Deep Learning in Medical Image Analysis
Chan, H.-P., Samala, R. K., Hadjiiski, L. M., & Zhou, C. (2020) · Advances in Experimental Medicine and Biology · doi:10.1007/978-3-030-33128-3_1 · Cited by 747
Digital technology, tele-medicine and artificial intelligence in ophthalmology: A global perspective
Li, J.-P. O., Liu, H., Ting, D. S. J., Jeon, S., Chan, R. V. P., Kim, J. E., Sim, D. A., Thomas, P. B. M., Lin, H., Chen, Y., et al. (2021) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2020.100900 · Cited by 626
Sayres, R., Taly, A., Rahimy, E., Blumer, K., Coz, D., Hammel, N., Krause, J., Narayanaswamy, A., Rastegar, Z., Wu, D., et al. (2019) · Ophthalmology · doi:10.1016/j.ophtha.2018.11.016 · Cited by 418
Cen, L.-P., Ji, J., Lin, J.-W., Ju, S.-T., Lin, H.-J., Li, T.-P., Wang, Y., Yang, J.-F., Liu, Y.-F., Tan, S., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-25138-w · Cited by 346
Deep vessel segmentation by learning graphical connectivity
Shin, S. Y., Lee, S., Yun, I. D., & Lee, K. M. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101556 · Cited by 250
Data Augmentation Classifier for Imbalanced Fault Classification
Jiang, X., & Ge, Z. (2020) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2020.2998467 · Cited by 175
Self-citationImaging and Biomarkers in Diabetic Macular Edema and Diabetic Retinopathy
Kwan, C. C., & Fawzi, A. A. (2019) · Current Diabetes Reports · doi:10.1007/s11892-019-1226-2 · Cited by 141 · cited 1×
“…30 years, FFA has been widely used for the diagnosis of retinal diseases due to its ability to provide information on vascular flow and vessel permeability over time, 3 allowing the visualisation of lesions such as microaneu-rysms (MA), choroidal neovascularisation and non-perfusion areas (NPA).”
MethodArtificial intelligence for diabetic retinopathy screening, prediction and management
Gunasekeran, D. V., Ting, D. S. W., Tan, G. S. W., & Wong, T. Y. (2020) · Current Opinion in Ophthalmology · doi:10.1097/icu.0000000000000693 · Cited by 133 · cited 1×
“8 Even though the newly developed OCT angiography technology has advantages of ease, speed and safety, it is pretty expensive and not widely accessible.”
BackgroundXu, B. Y., Chiang, M., Chaudhary, S., Kulkarni, S., Pardeshi, A. A., & Varma, R. (2019) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2019.08.004 · Cited by 122
Deep Learning for Lesion Detection, Progression, and Prediction of Musculoskeletal Disease
Kijowski, R., Liu, F., Caliva, F., & Pedoia, V. (2020) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.27001 · Cited by 106
Pan, X., Jin, K., Cao, J., Liu, Z., Wu, J., You, K., Lu, Y., Xu, Y., Su, Z., Jiang, J.-K., et al. (2020) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-019-04575-w · Cited by 94 · cited 1×
“21 The CNNs can simultaneously detect DR lesions of FFA images including NPA, vascular leakage, MA and laser scar.”
BackgroundSelf-citationContemporary retinal imaging techniques in diabetic retinopathy: a review
Cole, E. D., Novais, E. A., Louzada, R. N., & Waheed, N. K. (2016) · Clinical & Experimental Ophthalmology · doi:10.1111/ceo.12711 · Cited by 91 · cited 1×
“6 7 The properties of FFA allow it to detect lesions of diseases earlier.”
BackgroundFully Automatic Segmentation of Fluorescein Leakage in Subjects With Diabetic Macular Edema
Rabbani, H., Allingham, M. J., Mettu, P., Cousins, S. W., & Farsiu, S. (2015) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.14-15457 · Cited by 81
Diabetic Retinopathy Screening Using Smartphone-Based Fundus Imaging in India
Wintergerst, M. W. M., Mishra, D. K. C., Hartmann, L., Shah, P. N., Konana, V. K., Sagar, P., Berger, M., Murali, K., Holz, F. G., Shanmugam, M. P., et al. (2020) · Ophthalmology · doi:10.1016/j.ophtha.2020.05.025 · Cited by 65
A Novel Deep Learning Pipeline for Retinal Vessel Detection In Fluorescein Angiography
Ding, L., Bawany, M. H., Kuriyan, A. E., Ramchandran, R. S., Wykoff, C. C., & Sharma, G. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2991530 · Cited by 63 · cited 1×
“Also, FFA provides a larger field of imaging beyond the macula, 4 revealing lesions around the peripheral retina.”
BackgroundFluorescein Angiography: Basic Principles and Interpretation
Johnson, R. N., McDonald, H. R., Ai, E., Jumper, J. M., & Fu, A. D. (2006) · Elsevier eBooks · doi:10.1016/b978-0-323-02598-0.50057-4 · Cited by 62
Jin, K., Pan, X., You, K., Wu, J., Liu, Z., Cao, J., Lou, L., Xu, Y., Su, Z., Yao, K., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-71622-6 · Cited by 59
Self-citationPerformance of a deep learning-based identification system for esophageal cancer from CT images
Takeuchi, M., Seto, T., Hashimoto, M., Ichihara, N., Morimoto, Y., Kawakubo, H., Suzuki, T., Jinzaki, M., Kitagawa, Y., Miyata, H., et al. (2021) · Esophagus · doi:10.1007/s10388-021-00826-0 · Cited by 56
Dow, E. R., Keenan, T. D. L., Lad, E. M., Lee, A., Lee, C. S., Loewenstein, A., Eydelman, M. B., Chew, E. Y., Keane, P. A., & Lim, J. I. (2022) · Ophthalmology · doi:10.1016/j.ophtha.2022.01.002 · Cited by 54
Chaikitmongkol, V., Khunsongkiet, P., Patikulsila, D., Ratanasukon, M., Watanachai, N., Jumroendararasame, C., Mayerle, C. B., Han, I. C., Chen, C. J., Winaikosol, P., et al. (2018) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2018.05.005 · Cited by 37
Chen, M., Jin, K., You, K., Xu, Y., Wang, Y., Yip, C., Wu, J., & Ye, J. (2021) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-021-05151-x · Cited by 32 · cited 1×
“20 In our previous study, we presented multilabel classification of retinal lesions in diabetic retinopathy (DR) based on convolutional neural network (CNN) models.”
BackgroundSelf-citationSun, G., Liu, X., & Yu, X. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106422 · Cited by 23
Zhu, H., Qianhao, F. A. N. G., He, H., Hu, J., Jiang, D., & Xu, K. M. (2019) · Computational and Mathematical Methods in Medicine · doi:10.1155/2019/7289273 · Cited by 22
Deep-Learning–Based Pre-Diagnosis Assessment Module for Retinal Photographs: A Multicenter Study
Yuen, V. L., Ran, A. R., Shi, J., Sham, K., Yang, D., Chan, V. T. T., Chan, R. N. C., Yam, J. C. S., Tham, C. C. Y., McKay, G. J., et al. (2021) · Translational Vision Science & Technology · doi:10.1167/tvst.10.11.16 · Cited by 20
The barriers to global eye care equity and the role of digital innovations
Zheng, S., Choo, J., Chen, J., Joshi, S., & Sun, Z. (2021) · Advances in Ophthalmology Practice and Research · doi:10.1016/j.aopr.2021.100021 · Cited by 11
Cited by
Medical image analysis using deep learning algorithms
Li, M., Jiang, Y., Zhang, Y., & Zhu, H. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1273253 · Cited by 505
“Using deep learning algorithms to automatically extract data from medical photos and incorporate it into EHRs is a further possible use (109).”
MethodAminizadeh, S., Heidari, A., Toumaj, S., Darbandi, M., Navimipour, N. J., Rezaei, M., Talebi, S., Azad, P., & Unal, M. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107745 · Cited by 193
Amiri, Z., Heidari, A., Navimipour, N. J., Esmaeilpour, M., & Yazdani, Y. (2024) · Neural Computing and Applications · doi:10.1007/s00521-023-09366-3 · Cited by 177
“They have also developed secure data aggregation mechanisms allowing medical data aggregation from multiple sources while preserving data privacy and confidentiality [150].”
A deep learning based model for diabetic retinopathy grading
Akhtar, S., Aftab, S., Ali, O., Ahmad, M., Khan, M. A., Abbas, S., & Ghazal, T. M. (2025) · Scientific Reports · doi:10.1038/s41598-025-87171-9 · Cited by 199
Rasheed, Z., Ma, Y.-K., Ullah, I., Ghadi, Y. Y., Khan, M. Z., Khan, M. A., Abdusalomov, A. B., Alqahtani, F. H., & Shehata, A. M. (2023) · Brain Sciences · doi:10.3390/brainsci13091320 · Cited by 166
Metadata
- Authors
- Gao, Z., Pan, X., Shao, J., Jiang, X., Su, Z., Jin, K., & Ye, J.
- Affiliations
- Second Affiliated Hospital of Zhejiang University (CN)
- Zhejiang University (CN)
- Corresponding author
- Ye, Juan
- Venue
- British Journal of Ophthalmology
- Publisher
- BMJ
- Published
- 2022-09-28
- Volume
- 107
- Issue
- 12
- Pages
- 1852-1858
- ISSN
- 0007-1161 (ISSN-L)
- 1468-2079
- OpenAlex
- W4297476735
- Cited by
- 93
- References
- 30
- Citations by year
- 2026: 11 · 2025: 14 · 2024: 21 · 2023: 47
- FWCI
- 11.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- British Journal of Ophthalmology (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Natural Science Foundation of China (U20A20386)
- National key research and development program of China (2019YFC0118400)
- Clinical Medical Research Center for Eye Diseases of Zhejiang Province (2021E50007)
- Key research and development program of Zhejiang Province (2019C03020)
- Medical and Health Science and Technology Program of Zhejiang Province (2021RC064)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
- Health Sciences › Medicine › Ophthalmology › Retinal Diseases and Treatments
- Health Sciences › Medicine › Ophthalmology › Ophthalmology and Visual Health Research
- Keywords
- fundus fluorescein angiography, diabetic retinopathy, automated image interpretation, lesion classification, retinal lesion detection, image quality assessment, phase detection, ResNet-18, convolutional neural networks, automated diagnosis, human-machine comparison
- MeSH terms
- Deep Learning, Diabetes Mellitus, Diabetic Retinopathy, Fluorescein Angiography, Fundus Oculi, Humans, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.