Prediction of systemic biomarkers from retinal photographs: development and validation of deep-learning algorithms
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Background The application of deep learning to retinal photographs has yielded promising results in predicting age, sex, blood pressure, and haematological parameters. However, the broader applicability of retinal photograph-based deep learning for predicting other systemic biomarkers and the generalisability of this approach to various populations remains unexplored. Methods With use of 236 257 retinal photographs from seven diverse Asian and European cohorts (two health screening centres in South Korea, the Beijing Eye Study, three cohorts in the Singapore Epidemiology of Eye Diseases study, and the UK Biobank), we evaluated the capacities of 47 deep-learning algorithms to predict 47 systemic biomarkers as outcome variables, including demographic factors (age and sex); body composition measurements; blood pressure; haematological parameters; lipid profiles; biochemical measures; biomarkers related to liver function, thyroid function, kidney function, and inflammation; and diabetes. The standard neural network architecture of VGG16 was adopted for model development. Findings In addition to previously reported systemic biomarkers, we showed quantification of body composition indices (muscle mass, height, and bodyweight) and creatinine from retinal photographs. Body muscle mass could be predicted with an R 2 of 0·52 (95% CI 0·51–0·53) in the internal test set, and of 0·33 (0·30–0·35) in one external test set with muscle mass measurement available. The R 2 value for the prediction of height was 0·42 (0·40–0·43), of bodyweight was 0·36 (0·34–0·37), and of creatinine was 0·38 (0·37–0·40) in the internal test set. However, the performances were poorer in external test sets (with the lowest performance in the European cohort), with R 2 values ranging between 0·08 and 0·28 for height, 0·04 and 0·19 for bodyweight, and 0·01 and 0·26 for creatinine. Of the 47 systemic biomarkers, 37 could not be predicted well from retinal photographs via deep learning ( R 2 ≤0·14 across all external test sets). Interpretation Our work provides new insights into the potential use of retinal photographs to predict systemic biomarkers, including body composition indices and serum creatinine, using deep learning in populations with a similar ethnic background. Further evaluations are warranted to validate these findings and evaluate the clinical utility of these algorithms. Funding Agency for Science, Technology, and Research and National Medical Research Council, Singapore; Korea Institute for Advancement of Technology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136
Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning
Poplin, R., Varadarajan, A. V., Blumer, K., Liu, Y., McConnell, M. V., Corrado, G. S., Peng, L., & Webster, D. R. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0195-0 · Cited by 1,865
Artificial intelligence and deep learning in ophthalmology
Ting, D. S. W., Pasquale, L. R., Peng, L., Campbell, J. P., Lee, A. Y., Raman, R., Tan, G. S. W., Schmetterer, L., Keane, P. A., & Wong, T. Y. (2019) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2018-313173 · Cited by 1,554
Self-citationDent, E., Morley, J. E., Cruz-Jentoft, A. J., Arai, H., Kritchevsky, S. B., Guralnik, J., Bauer, J. M., Pahor, M., Clark, B. C., Cesari, M., et al. (2018) · The Journal of nutrition, health and aging · doi:10.1007/s12603-018-1139-9 · Cited by 1,130
Sabanayagam, C., Xu, D., Ting, D. S. W., Nusinovici, S., Banu, R., Hamzah, H., Lim, C., Tham, Y.-C., Cheung, C. Y., Tai, E. S., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30063-7 · Cited by 279
Self-citationDetection of anaemia from retinal fundus images via deep learning
Mitani, A., Huang, A., Venugopalan, S., Corrado, G. S., Peng, L., Webster, D. R., Hammel, N., Liu, Y., & Varadarajan, A. V. (2019) · Nature Biomedical Engineering · doi:10.1038/s41551-019-0487-z · Cited by 230
Cited by
Artificial intelligence and deep learning in ophthalmology
Ting, D. S. W., Pasquale, L. R., Peng, L., Campbell, J. P., Lee, A. Y., Raman, R., Tan, G. S. W., Schmetterer, L., Keane, P. A., & Wong, T. Y. (2019) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2018-313173 · Cited by 1,554
Self-citationArtificial Intelligence and Deep Learning in Ophthalmology
Wang, Z., Keane, P. A., Chiang, M., Cheung, C. Y., Wong, T. Y., & Ting, D. S. W. (2022) · Artificial Intelligence in Medicine · doi:10.1007/978-3-030-64573-1_200 · Cited by 1,524
Self-citationAI recognition of patient race in medical imaging: a modelling study
Gichoya, J. W., Banerjee, I., Bhimireddy, A. R., Burns, J. L., Celi, L. A., Chen, L.-C., Correa, R., Dullerud, N., Ghassemi, M., Huang, S.-C., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00063-2 · Cited by 611
“13–15 These findings, which show that demographic factors that are strongly associated with disease outcomes (eg, age, sex, and racial identity), are also strongly associated with features of medical images and might induce bias in model results, mirroring what is known from over a century of…”
Zhang, K., Liu, X., Xu, J., Yuan, J., Cai, W., Chen, T., Wang, K., Gao, Y., Nie, S., Xu, X., et al. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-021-00745-6 · Cited by 324
Cheung, C. Y., Ran, A. R., Wang, S., Chan, V. T. T., Sham, K., Hilal, S., Venketasubramanian, N., Cheng, C.-Y., Sabanayagam, C., Tham, Y. C., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00169-8 · Cited by 264
Self-citation
Metadata
- Authors
- Rim, T. H., Lee, G., Kim, Y., Tham, Y.-C., Lee, C. J., Baik, S. J., Kim, Y. A., Yu, M., Deshmukh, M., Lee, B. K., Park, S., Kim, H. C., Sabayanagam, C., Ting, D. S. W., Wang, Y. X., Jonas, J. B., Kim, S. S., Wong, T. Y., & Cheng, C.-Y.
- Venue
- The Lancet Digital Health
- Publisher
- Elsevier BV
- Published
- 2020-10
- Volume
- 2
- Issue
- 10
- Pages
- e526-e536
- ISSN
- 2589-7500 (ISSN-L)
- OpenAlex
- W3088248772
- Cited by
- 185
- References
- 7
- FWCI
- 8.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Prediction of systemic biomarkers from retinal photographs: development and validation of deep-learning algorithms. https://app.cochat.ai/papers/10.1016/s2589-7500(20)30216-8
- The paper
- Rim, T. H., Lee, G., Kim, Y., Tham, Y.-C., Lee, C. J., Baik, S. J., Kim, Y. A., Yu, M., Deshmukh, M., Lee, B. K., Park, S., Kim, H. C., Sabayanagam, C., Ting, D. S. W., Wang, Y. X., Jonas, J. B., Kim, S. S., Wong, T. Y., & Cheng, C.-Y. (2020). Prediction of systemic biomarkers from retinal photographs: development and validation of deep-learning algorithms. The Lancet Digital Health. https://doi.org/10.1016/s2589-7500(20)30216-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.