Deep-learning-based cardiovascular risk stratification using coronary artery calcium scores predicted from retinal photographs
Open accessAbstract
BACKGROUND: Coronary artery calcium (CAC) score is a clinically validated marker of cardiovascular disease risk. We developed and validated a novel cardiovascular risk stratification system based on deep-learning-predicted CAC from retinal photographs. METHODS: We used 216 152 retinal photographs from five datasets from South Korea, Singapore, and the UK to train and validate the algorithms. First, using one dataset from a South Korean health-screening centre, we trained a deep-learning algorithm to predict the probability of the presence of CAC (ie, deep-learning retinal CAC score, RetiCAC). We stratified RetiCAC scores into tertiles and used Cox proportional hazards models to evaluate the ability of RetiCAC to predict cardiovascular events based on external test sets from South Korea, Singapore, and the UK Biobank. We evaluated the incremental values of RetiCAC when added to the Pooled Cohort Equation (PCE) for participants in the UK Biobank. FINDINGS: RetiCAC outperformed all single clinical parameter models in predicting the presence of CAC (area under the receiver operating characteristic curve of 0·742, 95% CI 0·732-0·753). Among the 527 participants in the South Korean clinical cohort, 33 (6·3%) had cardiovascular events during the 5-year follow-up. When compared with the current CAC risk stratification (0, >0-100, and >100), the three-strata RetiCAC showed comparable prognostic performance with a concordance index of 0·71. In the Singapore population-based cohort (n=8551), 310 (3·6%) participants had fatal cardiovascular events over 10 years, and the three-strata RetiCAC was significantly associated with increased risk of fatal cardiovascular events (hazard ratio [HR] trend 1·33, 95% CI 1·04-1·71). In the UK Biobank (n=47 679), 337 (0·7%) participants had fatal cardiovascular events over 10 years. When added to the PCE, the three-strata RetiCAC improved cardiovascular risk stratification in the intermediate-risk group (HR trend 1·28, 95% CI 1·07-1·54) and borderline-risk group (1·62, 1·04-2·54), and the continuous net reclassification index was 0·261 (95% CI 0·124-0·364). INTERPRETATION: A deep learning and retinal photograph-derived CAC score is comparable to CT scan-measured CAC in predicting cardiovascular events, and improves on current risk stratification approaches for cardiovascular disease events. These data suggest retinal photograph-based deep learning has the potential to be used as an alternative measure of CAC, especially in low-resource settings. FUNDING: Yonsei University College of Medicine; Ministry of Health and Welfare, Korea Institute for Advancement of Technology, South Korea; Agency for Science, Technology, and Research; and National Medical Research Council, Singapore.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A study using 216,152 retinal photographs from datasets in South Korea, Singapore, and the United Kingdom trained and validated deep learning algorithms, and retinal photograph-derived coronary artery calcium scores were comparable to those measured by CT scans.
“For example, a study utilized 216,152 retinal photographs from datasets in South Korea, Singapore, and the United Kingdom to train and validate deep learning algorithms [6]. The retinal photograph-derived coronary artery calcium scores were found to be comparable to those measured by CT scans [6].”
From Integrating machine learning and artificial intelligence in life-course epidemiology: pathways to innovative public health solutions (2024) · cites this paper as [6]
ML models integrating clinical, genetic, and lifestyle factors have been developed to predict an individual's risk of developing cardiovascular disease.
“Researchers have developed ML models that integrate clinical, genetic, and lifestyle factors to predict an individual’s risk of developing cardiovascular disease [4–7].”
From Integrating machine learning and artificial intelligence in life-course epidemiology: pathways to innovative public health solutions (2024) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 32 · Cited by 234
Research works printed but not linked: 1
- 20 Welsh C, Celis-Morales CA, Brown R, et al. Comparison of conventional lipoprotein tests and apolipoproteins in the prediction of cardiovascular disease. Circulation 2019; 140: 542-52.
- Authors
- Rim, T. H., Lee, C. J., Tham, Y.-C., Cheung, N., Yu, M., Lee, G., Kim, Y., Ting, D. S. W., Chong, C. C. Y., Choi, Y. S., Yoo, T. K., Ryu, I. H., Baik, S. J., Kim, Y. A., Kim, S. K., Lee, S.-H., Lee, B. K., Kang, S.-M., Wong, E. Y. M., Kim, H. C., Kim, S. S., Park, S., Cheng, C.-Y., & Wong, T. Y.
- Affiliations
- Yonsei University (KR)
- National University of Singapore (SG)
- Singapore National Eye Center (SG)
- Corresponding author
- Park, Sungha
- Cheng, Ching-Yu
- ORCID
- Venue
- The Lancet Digital Health
- Publisher
- Elsevier BV
- Published
- 2021-05
- Volume
- 3
- Issue
- 5
- Pages
- e306-e316
- ISSN
- 2589-7500 (ISSN-L)
- OpenAlex
- W3152552104
- Cited by
- 234
- References
- 32
- Citations by year
- 2026: 55 · 2025: 50 · 2024: 46 · 2023: 46 · 2022: 32 · 2021: 5
- FWCI
- 17.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- The Lancet Digital Health (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- YUHSpace (Yonsei University Medical Library) (submittedVersion, cc-by-nc-nd)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Funders
- Korea Health Industry Development Institute
- National Medical Research Council
- Korea Ministry of Trade Industry and Energy
- Yonsei University College of Medicine
- Agency for Science Technology and Research
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Cardiac Imaging and Diagnostics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health Promotion and Cardiovascular Prevention
- Keywords
- coronary artery calcium, fundus images, cardiovascular risk stratification, deep learning, cardiovascular event prediction, Pooled Cohort Equations, risk reclassification, retinal imaging biomarkers, UK Biobank, fatal cardiovascular events, intermediate risk group, net reclassification improvement, external validation, health screening
- MeSH terms
- Deep Learning, Adult, Aged, Algorithms, Cardiovascular Diseases, Coronary Artery Disease, Female, United Kingdom, Humans, Male, Middle Aged, Predictive Value of Tests, Retina, ROC Curve, Singapore, Proportional Hazards Models, Risk Assessment, Area Under Curve, Kaplan-Meier Estimate, Republic of Korea, Vascular Calcification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review