Cardiovascular/stroke risk predictive calculators: a comparison between statistical and machine learning models
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Background: Statistically derived cardiovascular risk calculators (CVRC) that use conventional risk factors, generally underestimate or overestimate the risk of cardiovascular disease (CVD) or stroke events primarily due to lack of integration of plaque burden. This study investigates the role of machine learning (ML)-based CVD/stroke risk calculators (CVRCML) and compares against statistically derived CVRC (CVRCStat) based on (I) conventional factors or (II) combined conventional with plaque burden (integrated factors). Methods: The proposed study is divided into 3 parts: (I) statistical calculator: initially, the 10-year CVD/stroke risk was computed using 13 types of CVRCStat (without and with plaque burden) and binary risk stratification of the patients was performed using the predefined thresholds and risk classes; (II) ML calculator: using the same risk factors (without and with plaque burden), as adopted in 13 different CVRCStat, the patients were again risk-stratified using CVRCML based on support vector machine (SVM) and finally; (III) both types of calculators were evaluated using AUC based on ROC analysis, which was computed using combination of predicted class and endpoint equivalent to CVD/stroke events. Results: An Institutional Review Board approved 202 patients (156 males and 46 females) of Japanese ethnicity were recruited for this study with a mean age of 69±11 years. The AUC for 13 different types of CVRCStat calculators were: AECRS2.0 (AUC 0.83, P<0.001), QRISK3 (AUC 0.72, P<0.001), WHO (AUC 0.70, P<0.001), ASCVD (AUC 0.67, P<0.001), FRScardio (AUC 0.67, P<0.01), FRSstroke (AUC 0.64, P<0.001), MSRC (AUC 0.63, P=0.03), UKPDS56 (AUC 0.63, P<0.001), NIPPON (AUC 0.63, P<0.001), PROCAM (AUC 0.59, P<0.001), RRS (AUC 0.57, P<0.001), UKPDS60 (AUC 0.53, P<0.001), and SCORE (AUC 0.45, P<0.001), while the AUC for the CVRCML with integrated risk factors (AUC 0.88, P<0.001), a 42% increase in performance. The overall risk-stratification accuracy for the CVRCML with integrated risk factors was 92.52% which was higher compared all the other CVRCStat. Conclusions: ML-based CVD/stroke risk calculator provided a higher predictive ability of 10-year CVD/stroke compared to the 13 different types of statistically derived risk calculators including integrated model AECRS 2.0.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
KDIGO 2024 clinical practice guideline for the evaluation and management of chronic kidney disease
Stevens, P. E., Ahmed, S. B., Carrero, J. J., Foster, B., Francis, A., Hall, R. K., Herrington, W. G., Hill, G., Inker, L. A., Kazancıoğlu, R., et al. (2024) · Kidney International · doi:10.1016/j.kint.2023.10.018 · Cited by 8,530
General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study
D’Agostino, R. B., Vasan, R. S., Pencina, M. J., Wolf, P. A., Cobain, M., Massaro, J. M., & Kannel, W. B. (2008) · Circulation · doi:10.1161/circulationaha.107.699579 · Cited by 7,491
Whelton, P. K., Carey, R. M., Aronow, W. S., Casey, D. E., Collins, K. J., Dennison Himmelfarb, C., DePalma, S. M., Gidding, S., Jamerson, K. A., Jones, D. W., et al. (2018) · Hypertension · doi:10.1161/hyp.0000000000000065 · Cited by 7,391
Heart disease and stroke statistics-2018 update: a report from the american heart association
Benjamin, E. J., Virani, S. S., Callaway, C. W., Chamberlain, A. M., Chang, A. R., Cheng, S., Chiuve, S. E., Cushman, M., Delling, F. N., Deo, R., et al. (2018) · Circulation · doi:10.1161/cir.0000000000000558 · Cited by 7,146
Whelton, P. K., Carey, R. M., Aronow, W. S., Casey, D. E., Collins, K. J., Dennison Himmelfarb, C., DePalma, S. M., Gidding, S., Jamerson, K. A., Jones, D. W., et al. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2017.11.006 · Cited by 6,616
Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., Das, S. R., de Ferranti, S., Després, J.-P., Fullerton, H. J., et al. (2016) · Circulation · doi:10.1161/cir.0000000000000350 · Cited by 6,596
2016 European Guidelines on cardiovascular disease prevention in clinical practice
Piepoli, M. F., Hoes, A. W., Agewall, S., Albus, C., Brotons, C., Catapano, A. L., Cooney, M.-T., Corrà, U., Cosyns, B., Deaton, C., et al. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw106 · Cited by 6,457
Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project
Conroy, R. (2003) · European Heart Journal · doi:10.1016/s0195-668x(03)00114-3 · Cited by 5,290
2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk
Goff, D. C., Lloyd-Jones, D. M., Bennett, G., Coady, S., D’Agostino, R. B., Gibbons, R., Greenland, P., Lackland, D. T., Levy, D., O’Donnell, C. J., et al. (2014) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.11.005 · Cited by 4,945
Whelton, P. K., Carey, R. M., Aronow, W. S., Casey, D. E., Collins, K. J., Dennison Himmelfarb, C., DePalma, S. M., Gidding, S., Jamerson, K. A., Jones, D. W., et al. (2018) · Hypertension · doi:10.1161/hyp.0000000000000066 · Cited by 4,347
Progress and challenges in translating the biology of atherosclerosis
Libby, P., Ridker, P. M., & Hansson, G. K. (2011) · Nature · doi:10.1038/nature10146 · Cited by 4,010
O'Donnell, M. J., Xavier, D., Liu, L., Zhang, H., Chin, S. L., Rao-Melacini, P., Rangarajan, S., Islam, S., Pais, P., McQueen, M. J., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60834-3 · Cited by 3,448
O'Donnell, M. J., Chin, S. L., Rangarajan, S., Xavier, D., Liu, L., Zhang, H., Rao-Melacini, P., Zhang, X., Pais, P., Agapay, S., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30506-2 · Cited by 2,296
Ridker, P. M., Buring, J. E., Rifai, N., & Cook, N. R. (2007) · JAMA · doi:10.1001/jama.297.6.611 · Cited by 1,814
Assmann, G., Cullen, P., & Schulte, H. (2002) · Circulation · doi:10.1161/hc0302.102575 · Cited by 1,541
Can machine-learning improve cardiovascular risk prediction using routine clinical data?
Weng, S. F., Reps, J., Kai, J., Garibaldi, J. M., & Qureshi, N. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174944 · Cited by 1,346
KDOQI clinical practice guideline for diabetes and CKD: 2012 update
(2012) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2012.07.005 · Cited by 1,320
Anderson, T. J., Grégoire, J., Pearson, G. J., Barry, A. R., Couture, P., Dawes, M., Francis, G. A., Genest, J., Grover, S., Gupta, M., et al. (2016) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2016.07.510 · Cited by 1,173
Whelton, P. K., Carey, R. M., Aronow, W. S., Casey, D. E., Collins, K. J., Dennison Himmelfarb, C., DePalma, S. M., Gidding, S., Jamerson, K. A., Jones, D. W., et al. (2018) · Circulation · doi:10.1161/cir.0000000000000596 · Cited by 1,127
The UKPDS risk engine: a model for the risk of coronary heart disease in Type II diabetes (UKPDS 56)
STEVENS, R. J., KOTHARI, V., ADLER, A. I., & STRATTON, I. M. (2001) · Clinical Science · doi:10.1042/cs20000335 · Cited by 1,084
Cardiovascular Event Prediction by Machine Learning: The Multi-Ethnic Study of Atherosclerosis
Ambale-Venkatesh, B., Yang, X., Wu, C. O., Liu, K., Hundley, W. G., McClelland, R., Gomes, A. S., Folsom, A. R., Shea, S., Guallar, E., et al. (2017) · Circulation Research · doi:10.1161/circresaha.117.311312 · Cited by 639
Standards of Medical Care in Diabetes—2019 Abridged for Primary Care Providers
American Diabetes Association (2019) · Clinical Diabetes · doi:10.2337/cd18-0105 · Cited by 539
Accurate Diabetes Risk Stratification Using Machine Learning: Role of Missing Value and Outliers
Maniruzzaman, M., Rahman, M. J., Al-MehediHasan, M., Suri, H. S., Abedin, M. M., El-Baz, A., & Suri, J. S. (2018) · Journal of Medical Systems · doi:10.1007/s10916-018-0940-7 · Cited by 275
Self-citationMachine Learning Outperforms ACC/AHA CVD Risk Calculator in MESA
Kakadiaris, I. A., Vrigkas, M., Yen, A. A., Kuznetsova, T., Budoff, M., & Naghavi, M. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.118.009476 · Cited by 227
NIPPON DATA80 Research Group (2006) · Circulation Journal · doi:10.1253/circj.70.1249 · Cited by 218
Han, D., Kolli, K. K., Gransar, H., Lee, J. H., Choi, S.-Y., Chun, E. J., Han, H.-W., Park, S. H., Sung, J., Jung, H. O., et al. (2020) · Journal of Cardiovascular Computed Tomography · doi:10.1016/j.jcct.2019.09.005 · Cited by 41
Cited by
Economics of artificial intelligence in healthcare: Diagnosis vs. treatment
Khanna, N. N., Maindarkar, M. A., Viswanathan, V., Fernandes, J. F. E., Paul, S., Bhagawati, M., Ahluwalia, P., Ruzsa, Z., Sharma, A., Kolluri, R., et al. (2022) · Healthcare · doi:10.3390/healthcare10122493 · Cited by 347
“Conventional CVD risk assessment calculators such as the Framingham Risk Score (FRS), Pooled Cohort Risk Equation (PCRE), and QRISK3 can ac‐ commodate a substantially greater number of possible variables than ML‐based methods [94].”
BackgroundMethodInfluentialSelf-citationCai, Y., Cai, Y.-Q., Tang, L.-Y., Wang, Y.-H., Gong, M., Jing, T.-C., Li, H.-J., Li-Ling, J., Hu, W., Yin, Z., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03273-7 · Cited by 122
Metadata
- Authors
- Jamthikar, A., Gupta, D., Saba, L., Khanna, N. N., Araki, T., Viskovic, K., Mavrogeni, S., Laird, J. R., Pareek, G., Miner, M., Sfikakis, P. P., Protogerou, A., Viswanathan, V., Sharma, A., Nicolaides, A., Kitas, G. D., & Suri, J. S.
- Venue
- Cardiovascular Diagnosis and Therapy
- Publisher
- AME Publishing Company
- Published
- 2020-08
- Volume
- 10
- Issue
- 4
- Pages
- 919-938
- ISSN
- 2223-3652 (ISSN-L)
- 2223-3660
- OpenAlex
- W3010094798
- Cited by
- 83
- References
- 26
- FWCI
- 11.27
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.