Cited by 234Cardiac Imaging and DiagnosticsRetinal Imaging and AnalysisHealth Promotion and Cardiovascular Prevention

Deep-learning-based cardiovascular risk stratification using coronary artery calcium scores predicted from retinal photographs

Open access
Rim, Tyler Hyungtaek, Lee, Chan Joo, Tham, Yih-Chung, Cheung, Ning, Yu, Marco, Lee, Geunyoung, Kim, Youngnam, Ting, Daniel S W, Chong, Crystal Chun Yuen, Choi, Yoon Seong, Yoo, Tae Keun, Ryu, Ik Hee, Baik, Su Jung, Kim, Young Ah, Kim, Sung Kyu, Lee, Sang-Hak, Lee, Byoung Kwon, Kang, Seok-Min, Wong, Edmund Yick Mun, Kim, Hyeon Chang, Kim, Sung Soo, Park, Sungha, Cheng, Ching-Yu, Wong, Tien Yin·2021·The Lancet Digital Health

Abstract

BACKGROUND: Coronary artery calcium (CAC) score is a clinically validated marker of cardiovascular disease risk. We developed and validated a novel cardiovascular risk stratification system based on deep-learning-predicted CAC from retinal photographs. METHODS: We used 216 152 retinal photographs from five datasets from South Korea, Singapore, and the UK to train and validate the algorithms. First, using one dataset from a South Korean health-screening centre, we trained a deep-learning algorithm to predict the probability of the presence of CAC (ie, deep-learning retinal CAC score, RetiCAC). We stratified RetiCAC scores into tertiles and used Cox proportional hazards models to evaluate the ability of RetiCAC to predict cardiovascular events based on external test sets from South Korea, Singapore, and the UK Biobank. We evaluated the incremental values of RetiCAC when added to the Pooled Cohort Equation (PCE) for participants in the UK Biobank. FINDINGS: RetiCAC outperformed all single clinical parameter models in predicting the presence of CAC (area under the receiver operating characteristic curve of 0·742, 95% CI 0·732-0·753). Among the 527 participants in the South Korean clinical cohort, 33 (6·3%) had cardiovascular events during the 5-year follow-up. When compared with the current CAC risk stratification (0, >0-100, and >100), the three-strata RetiCAC showed comparable prognostic performance with a concordance index of 0·71. In the Singapore population-based cohort (n=8551), 310 (3·6%) participants had fatal cardiovascular events over 10 years, and the three-strata RetiCAC was significantly associated with increased risk of fatal cardiovascular events (hazard ratio [HR] trend 1·33, 95% CI 1·04-1·71). In the UK Biobank (n=47 679), 337 (0·7%) participants had fatal cardiovascular events over 10 years. When added to the PCE, the three-strata RetiCAC improved cardiovascular risk stratification in the intermediate-risk group (HR trend 1·28, 95% CI 1·07-1·54) and borderline-risk group (1·62, 1·04-2·54), and the continuous net reclassification index was 0·261 (95% CI 0·124-0·364). INTERPRETATION: A deep learning and retinal photograph-derived CAC score is comparable to CT scan-measured CAC in predicting cardiovascular events, and improves on current risk stratification approaches for cardiovascular disease events. These data suggest retinal photograph-based deep learning has the potential to be used as an alternative measure of CAC, especially in low-resource settings. FUNDING: Yonsei University College of Medicine; Ministry of Health and Welfare, Korea Institute for Advancement of Technology, South Korea; Agency for Science, Technology, and Research; and National Medical Research Council, Singapore.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/s2589-7500(21)00043-1

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 32 · Cited by 234

Research works printed but not linked: 1

  1. 20 Welsh C, Celis-Morales CA, Brown R, et al. Comparison of conventional lipoprotein tests and apolipoproteins in the prediction of cardiovascular disease. Circulation 2019; 140: 542-52.

Authors
Rim, T. H., Lee, C. J., Tham, Y.-C., Cheung, N., Yu, M., Lee, G., Kim, Y., Ting, D. S. W., Chong, C. C. Y., Choi, Y. S., Yoo, T. K., Ryu, I. H., Baik, S. J., Kim, Y. A., Kim, S. K., Lee, S.-H., Lee, B. K., Kang, S.-M., Wong, E. Y. M., Kim, H. C., Kim, S. S., Park, S., Cheng, C.-Y., & Wong, T. Y.
Affiliations
  • Yonsei University (KR)
  • National University of Singapore (SG)
  • Singapore National Eye Center (SG)
Corresponding author
  • Park, Sungha
  • Cheng, Ching-Yu
Venue
The Lancet Digital Health
Publisher
Elsevier BV
Published
2021-05
Volume
3
Issue
5
Pages
e306-e316
ISSN
2589-7500 (ISSN-L)
OpenAlex
W3152552104
Cited by
234
References
32
Citations by year
2026: 55 · 2025: 50 · 2024: 46 · 2023: 46 · 2022: 32 · 2021: 5
FWCI
17.17
Type
journal article
Language
en
Open access
Locations
  • The Lancet Digital Health (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • YUHSpace (Yonsei University Medical Library) (submittedVersion, cc-by-nc-nd)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by)
Funders
  • Korea Health Industry Development Institute
  • National Medical Research Council
  • Korea Ministry of Trade Industry and Energy
  • Yonsei University College of Medicine
  • Agency for Science Technology and Research
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Cardiac Imaging and Diagnostics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health Promotion and Cardiovascular Prevention
Keywords
coronary artery calcium, fundus images, cardiovascular risk stratification, deep learning, cardiovascular event prediction, Pooled Cohort Equations, risk reclassification, retinal imaging biomarkers, UK Biobank, fatal cardiovascular events, intermediate risk group, net reclassification improvement, external validation, health screening
MeSH terms
Deep Learning, Adult, Aged, Algorithms, Cardiovascular Diseases, Coronary Artery Disease, Female, United Kingdom, Humans, Male, Middle Aged, Predictive Value of Tests, Retina, ROC Curve, Singapore, Proportional Hazards Models, Risk Assessment, Area Under Curve, Kaplan-Meier Estimate, Republic of Korea, Vascular Calcification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review