CoChat

Validation of a deep-learning-based retinal biomarker (Reti-CVD) in the prediction of cardiovascular disease: data from UK Biobank

Tseng, Rachel Marjorie Wei Wen, Rim, Tyler Hyungtaek, Shantsila, Eduard, Yi, Joseph K., Park, Sungha, Kim, Sung Soo, Lee, Chan Joo, Thakur, Sahil, Nusinovici, Simon, Peng, Qingsheng, Kim, Hyeonmin, Lee, Geunyoung, Yu, Marco, Tham, Yih-Chung, Bakhai, Ameet, Leeson, Paul, Lip, Gregory Y.H., Wong, Tien Yin, Cheng, Ching-Yu · 2023 · BMC Medicine
Cited by 69

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Abstract

Background: Currently in the United Kingdom, cardiovascular disease (CVD) risk assessment is based on the QRISK3 score, in which 10% 10-year CVD risk indicates clinical intervention. However, this benchmark has limited efficacy in clinical practice and the need for a more simple, non-invasive risk stratification tool is necessary. Retinal photography is becoming increasingly acceptable as a non-invasive imaging tool for CVD. Previously, we developed a novel CVD risk stratification system based on retinal photographs predicting future CVD risk. This study aims to further validate our biomarker, Reti-CVD, (1) to detect risk group of ≥ 10% in 10-year CVD risk and (2) enhance risk assessment in individuals with QRISK3 of 7.5–10% (termed as borderline-QRISK3 group) using the UK Biobank. Methods: Reti-CVD scores were calculated and stratified into three risk groups based on optimized cut-off values from the UK Biobank. We used Cox proportional-hazards models to evaluate the ability of Reti-CVD to predict CVD events in the general population. C-statistics was used to assess the prognostic value of adding Reti-CVD to QRISK3 in borderline-QRISK3 group and three vulnerable subgroups. Results: Among 48,260 participants with no history of CVD, 6.3% had CVD events during the 11-year follow-up. Reti-CVD was associated with an increased risk of CVD (adjusted hazard ratio [HR] 1.41; 95% confidence interval [CI], 1.30–1.52) with a 13.1% (95% CI, 11.7–14.6%) 10-year CVD risk in Reti-CVD-high-risk group. The 10-year CVD risk of the borderline-QRISK3 group was greater than 10% in Reti-CVD-high-risk group (11.5% in non-statin cohort [n = 45,473], 11.5% in stage 1 hypertension cohort [n = 11,966], and 14.2% in middle-aged cohort [n = 38,941]). C statistics increased by 0.014 (0.010–0.017) in non-statin cohort, 0.013 (0.007–0.019) in stage 1 hypertension cohort, and 0.023 (0.018–0.029) in middle-aged cohort for CVD event prediction after adding Reti-CVD to QRISK3. Conclusions: Reti-CVD has the potential to identify individuals with ≥ 10% 10-year CVD risk who are likely to benefit from earlier preventative CVD interventions. For borderline-QRISK3 individuals with 10-year CVD risk between 7.5 and 10%, Reti-CVD could be used as a risk enhancer tool to help improve discernment accuracy, especially in adult groups that may be pre-disposed to CVD.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12916-022-02684-8

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 2 references

Research works printed but not linked: 26

  1. Deshmukh M, Liu YC, Rim TH, Venkatraman A, Davidson M, Yu M, et al. Automatic segmentation of corneal deposits from corneal stromal dystrophy images via deep learning. Comput Biol Med. 2021;137:104675. · DOI
  2. Ng WY, Zhang S, Wang Z, Ong CJT, Gunasekeran DV, Lim GYS, et al. Updates in deep learning research in ophthalmology. Clin Sci (Lond). 2021;135(20):2357–76. · DOI
  3. Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, May M, Brindle P. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. BMJ. 2007;335(7611):136. · DOI · Paper page
  4. Jones NR, McCormack T, Constanti M, McManus RJ. Diagnosis and management of hypertension in adults: NICE guideline update 2019. Br J Gen Pract. 2020;70(691):90–1. · DOI · Paper page
  5. Pate A, Emsley R, van Staa T. Impact of lowering the risk threshold for statin treatment on statin prescribing: a descriptive study in English primary care. Br J Gen Pract. 2020;70(700):e765–e71. · DOI
  6. Betzler BK, Yang HHS, Thakur S, Yu M, Quek TC, Soh ZD, et al. Gender prediction for a multiethnic population via deep learning across different retinal fundus photograph fields: retrospective cross-sectional study. JMIR Med Inform. 2021;9(8):e25165. · DOI
  7. Tseng RMWW, Rim TH, Cheung CY, Wong TY. Artificial intelligence using the eye as a biomarker of systemic risk. Artificial Intelligence in Ophthalmology: Springer; 2021. p. 243–55.
  8. Rim TH, Lee G, Kim Y, Tham YC, Lee CJ, Baik SJ, et al. Prediction of systemic biomarkers from retinal photographs: development and validation of deep-learning algorithms. Lancet Digit Health. 2020;2(10):e526–e36. · DOI · Paper page
  9. Sudlow C, Gallacher J, Allen N, Beral V, Burton P, Danesh J, et al. UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med. 2015;12(3):e1001779. · DOI · Paper page
  10. Palmer LJ. UK Biobank: bank on it. Lancet. 2007;369(9578):1980–2. · DOI · Paper page
  11. UK Biobank: Protocol for a large-scale prospective epidemiological resource. 2007.
  12. Man REK, Gan AHW, Fenwick EK, Gan ATL, Gupta P, Sabanayagam C, et al. Prevalence, determinants and association of unawareness of diabetes, hypertension and hypercholesterolemia with poor disease control in a multi-ethnic Asian population without cardiovascular disease. Popul Health Metrics. 2019;17(1):17. · DOI
  13. Welsh C, Welsh P, Celis-Morales CA, Mark PB, Mackay D, Ghouri N, et al. Glycated hemoglobin, prediabetes, and the links to cardiovascular disease: data from UK Biobank. Diabetes Care. 2020;43(2):440–5. · DOI · Paper page
  14. Li Y, Sperrin M, van Staa T. R package “QRISK3”: an unofficial research purposed implementation of ClinRisk’s QRISK3 algorithm into R. F1000Research. 2020;8:2139. · DOI
  15. Pencina MJ, D'Agostino RB Sr, D'Agostino RB Jr, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27(2):157–72 discussion 207-12. · DOI · Paper page
  16. Vardas PE, Asselbergs FW, van Smeden M, Friedman P. The year in cardiovascular medicine 2021: digital health and innovation. Eur Heart J. 2022;43(4):271–9. · DOI
  17. Zhang L, Yuan M, An Z, Zhao X, Wu H, Li H, et al. Prediction of hypertension, hyperglycemia and dyslipidemia from retinal fundus photographs via deep learning: A cross-sectional study of chronic diseases in central China. PLoS One. 2020;15(5):e0233166. · DOI
  18. Gerrits N, Elen B, Craenendonck TV, Triantafyllidou D, Petropoulos IN, Malik RA, et al. Age and sex affect deep learning prediction of cardiometabolic risk factors from retinal images. Sci Rep. 2020;10(1):9432. · DOI
  19. Wang JJ, Liew G, Wong TY, Smith W, Klein R, Leeder SR, et al. Retinal vascular calibre and the risk of coronary heart disease-related death. Heart. 2006;92(11):1583–7. · DOI · Paper page
  20. Mueller S, Wintergerst MWM, Falahat P, Holz FG, Schaefer C, Schahab N, et al. Multiple instance learning detects peripheral arterial disease from high-resolution color fundus photography. Sci Rep. 2022;12(1):1389. · DOI
  21. Barriada RG, Simó-Servat O, Planas A, Hernández C, Simó R, Masip D. Deep Learning of Retinal Imaging: A Useful Tool for Coronary Artery Calcium Score Prediction in Diabetic Patients. Appl Sci. 2022;12:1401. https://doi.org/10.3390/app12031401. · DOI
  22. Son J, Shin JY, Chun EJ, Jung K-H, Park KH, Park SJ. Predicting high coronary artery calcium score from retinal fundus images with deep learning algorithms. Transl Vis Sci Technol. 2020;9(2):28. · DOI
  23. Chang J, Ko A, Park SM, Choi S, Kim K, Kim SM, et al. Association of cardiovascular mortality and deep learning-funduscopic atherosclerosis score derived from retinal fundus images. Am J Ophthalmol. 2020;217:121–30. · DOI
  24. Arnould L, Guenancia C, Bourredjem A, Binquet C, Gabrielle PH, Eid P, et al. Prediction of cardiovascular parameters with supervised machine learning from singapore “I” vessel assessment and OCT-angiography: a pilot study. Transl Vision Sci Technol. 2021;10(13):20. · DOI
  25. Martin A, Saunders CL, Harte E, Griffin SJ, MacLure C, Mant J, et al. Delivery and impact of the NHS health check in the first 8 years: a systematic review. Br J Gen Pract. 2018;68(672):e449–e59. · DOI
  26. Kivimäki M, Batty GD, Singh-Manoux A, Britton A, Brunner EJ, Shipley MJ. Validity of cardiovascular disease event ascertainment using linkage to UK hospital records. Epidemiology. 2017;28(5):735–9. · DOI · Paper page

Metadata

Authors
Tseng, R. M. W. W., Rim, T. H., Shantsila, E., Yi, J. K., Park, S., Kim, S. S., Lee, C. J., Thakur, S., Nusinovici, S., Peng, Q., Kim, H., Lee, G., Yu, M., Tham, Y.-C., Bakhai, A., Leeson, P., Lip, G. Y. H., Wong, T. Y., & Cheng, C.-Y.
Venue
BMC Medicine
Published
2023-01-24
Volume
21
Issue
1
ISSN
1741-7015
Cited by
69
References
2
Language
en
Licence
Funders
Agency for Science, Technology and Research (Grant No. H20c6a0031)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Validation of a deep-learning-based retinal biomarker (Reti-CVD) in the prediction of cardiovascular disease: data from UK Biobank. https://app.cochat.ai/papers/10.1186/s12916-022-02684-8
The paper
Tseng, R. M. W. W., Rim, T. H., Shantsila, E., Yi, J. K., Park, S., Kim, S. S., Lee, C. J., Thakur, S., Nusinovici, S., Peng, Q., Kim, H., Lee, G., Yu, M., Tham, Y.-C., Bakhai, A., Leeson, P., Lip, G. Y. H., Wong, T. Y., & Cheng, C.-Y. (2023). Validation of a deep-learning-based retinal biomarker (Reti-CVD) in the prediction of cardiovascular disease: data from UK Biobank. BMC Medicine. https://doi.org/10.1186/s12916-022-02684-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.