Cited by 9Artificial Intelligence in HealthcareMachine Learning in HealthcareDiabetes, Cardiovascular Risks, and Lipoproteins

Prediction of cardiovascular complication in patients with newly diagnosed type 2 diabetes using an XGBoost/GRU-ODE-bayes-based machine-learning algorithm

Open access
Lee, Joonyub, Choi, Yera, Ko, Taehoon, Lee, Kanghyuck, Shin, Juyoung, Kim, Hun-Sung·2024·Endocrinology and Metabolism

Abstract

Background: Cardiovascular disease is life-threatening yet preventable for patients with type 2 diabetes mellitus (T2DM). Because each patient with T2DM has a different risk of developing cardiovascular complications, the accurate stratification of cardiovascular risk is critical. In this study, we proposed cardiovascular risk engines based on machine-learning algorithms for newly diagnosed T2DM patients in Korea.Methods: To develop the machine-learning-based cardiovascular disease engines, we retrospectively analyzed 26,166 newly diagnosed T2DM patients who visited Seoul St. Mary’s Hospital between July 2009 and April 2019. To accurately measure diabetes-related cardiovascular events, we designed a buffer (1 year), an observation (1 year), and an outcome period (5 years). The entire dataset was split into training and testing sets in an 8:2 ratio, and this procedure was repeated 100 times. The area under the receiver operating characteristic curve (AUROC) was calculated by 10-fold cross-validation on the training dataset.Results: The machine-learning-based risk engines (AUROC XGBoost=0.781±0.014 and AUROC gated recurrent unit [GRU]-ordinary differential equation [ODE]-Bayes=0.812±0.016) outperformed the conventional regression-based model (AUROC=0.723± 0.036).Conclusion: GRU-ODE-Bayes-based cardiovascular risk engine is highly accurate, easily applicable, and can provide valuable information for the individualized treatment of Korean patients with newly diagnosed T2DM.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3803/enm.2023.1739

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 29 · Cited by 9

Research works printed but not linked: 25

  1. [1]Stratton IM Adler AI Neil HA Matthews DR Manley SE Cull CA Association of glycaemia with macrovascular and microvascular complications of type 2 diabetes (UKPDS 35): prospective observational study BMJ 2000 321 405 12 10938048 PMC27454
  2. [2]Emerging Risk Factors Collaboration Sarwar N Gao P Seshasai SR Gobin R Kaptoge S Diabetes mellitus, fasting blood glucose concentration, and risk of vascular disease: a collaborative meta-analysis of 102 prospective studies Lancet 2010 375 2215 22 20609967 PMC2904878
  3. [3]Gregg EW Sattar N Ali MK The changing face of diabetes complications Lancet Diabetes Endocrinol 2016 4 537 47 27156051
  4. [5]UK Prospective Diabetes Study Group Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes: UKPDS 38 BMJ 1998 317 703 13 9732337 PMC28659
  5. [7]Colhoun HM Betteridge DJ Durrington PN Hitman GA Neil HA Livingstone SJ Primary prevention of cardiovascular disease with atorvastatin in type 2 diabetes in the Collaborative Atorvastatin Diabetes Study (CARDS): multicentre randomised placebo-controlled trial Lancet 2004 364 685 96 15325833
  6. [8]Ahlqvist E Storm P Karajamaki A Martinell M Dorkhan M Carlsson A Novel subgroups of adult-onset diabetes and their association with outcomes: a data-driven cluster analysis of six variables Lancet Diabetes Endocrinol 2018 6 361 9 29503172
  7. [9]Goff DC Jr Lloyd-Jones DM Bennett G Coady S D’Agostino RB Sr Gibbons R 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association task force on practice guidelines J Am Coll Cardiol 2014 63 25 Pt B 2935 59 24239921 PMC4700825
  8. [10]Stevens RJ Kothari V Adler AI Stratton IM; United Kingdom Prospective Diabetes Study (UKPDS) Group The UKPDS risk engine: a model for the risk of coronary heart disease in type II diabetes (UKPDS 56) Clin Sci (Lond) 2001 101 671 9 11724655
  9. [11]Wilson PW D’Agostino RB Levy D Belanger AM Silbershatz H Kannel WB Prediction of coronary heart disease using risk factor categories Circulation 1998 97 1837 47 9603539
  10. [12]Guzder RN Gatling W Mullee MA Mehta RL Byrne CD Prognostic value of the Framingham cardiovascular risk equation and the UKPDS risk engine for coronary heart disease in newly diagnosed type 2 diabetes: results from a United Kingdom study Diabet Med 2005 22 554 62 15842509
  11. [13]van der Heijden AA Ortegon MM Niessen LW Nijpels G Dekker JM Prediction of coronary heart disease risk in a general, pre-diabetic, and diabetic population during 10 years of follow-up: accuracy of the Framingham, SCORE, and UKPDS risk functions: the Hoorn Study Diabetes Care 2009 32 2094 8 19875606 PMC2768197
  12. [14]Yang F Ye J Pomerantz K Stewart M Potential modification of the UKPDS risk engine and evaluation of macrovascular event rates in controlled clinical trials Diabetes Metab Syndr Obes 2013 6 247 56 23885178 PMC3716447
  13. [15]Kengne AP Patel A Colagiuri S Heller S Hamet P Marre M The Framingham and UK Prospective Diabetes Study (UKPDS) risk equations do not reliably estimate the probability of cardiovascular events in a large ethnically diverse sample of patients with diabetes: the Action in Diabetes and Vascular Disease: Preterax and Diamicron-MR Controlled Evaluation (ADVANCE) Study Diabetologia 2010 53 821 31 20157695
  14. [16]McEwan P Williams JE Griffiths JD Bagust A Peters JR Hopkinson P Evaluating the performance of the Framingham risk equations in a population with diabetes Diabet Med 2004 21 318 23 15049932
  15. [17]DeFilippis AP Young R Carrubba CJ McEvoy JW Budoff MJ Blumenthal RS An analysis of calibration and discrimination among multiple cardiovascular risk scores in a modern multiethnic cohort Ann Intern Med 2015 162 266 75 25686167 PMC4414494
  16. [18]Beam AL Kohane IS Big data and machine learning in health care JAMA 2018 319 1317 8 29532063
  17. [19]Chen T, Guestrin C. XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2016 Aug 13-17; San Francisco, CA. New York: Association for Computing Machinery; 2016. p. 785-94
  18. [21]De Brouwer E, Simm J, Arany A, Moreau Y. GRU-ODEBayes: continuous modeling of sporadically-observed time series. In: Wallach H, Larochelle H, Beygelzimer A, d’AlcheBuc F, Fox E, Garnett R. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019); 2019 Dec 8-14; Vancouver. San Diego: Neural Information Processing Systems Foundation, Inc. (NeurIPS); 2020. p. 7347-58
  19. [22]Alaa AM Bolton T Di Angelantonio E Rudd JH van der Schaar M Cardiovascular disease risk prediction using automated machine learning: a prospective study of 423,604 UK Biobank participants PLoS One 2019 14 e0213653 31091238 PMC6519796
  20. [23]Longato E Fadini GP Sparacino G Avogaro A Tramontan L Di Camillo B A deep learning approach to predict diabetes’ cardiovascular complications from administrative claims IEEE J Biomed Health Inform 2021 25 3608 17 33710962
  21. [25]DeLong ER DeLong DM Clarke-Pearson DL Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach Biometrics 1988 44 837 45 3203132
  22. [26]Shin SY Kim HS Data pseudonymization in a range that does not affect data quality: correlation with the degree of participation of clinicians J Korean Med Sci 2021 36 e299 34783216 PMC8593412
  23. [27]Kim HS Kim DJ Yoon KH Medical big data is not yet available: why we need realism rather than exaggeration Endocrinol Metab (Seoul) 2019 34 349 54 31884734 PMC6935779
  24. [28]Kyoung DS Kim HS Understanding and utilizing claim data from the Korean National Health Insurance Service (NHIS) and Health Insurance Review & Assessment (HIRA) database for research J Lipid Atheroscler 2022 11 103 10 35656154 PMC9133780
  25. [29]Lee S Kim HS Prospect of artificial intelligence based on electronic medical record J Lipid Atheroscler 2021 10 282 90 34621699 PMC8473961

Authors
Lee, J., Choi, Y., Ko, T., Lee, K., Shin, J., & Kim, H.-S.
Affiliations
  • The Catholic University of Korea Seoul St. Mary's Hospital (KR)
  • NAVER Cloud (South Korea) (KR)
  • Catholic University of Korea (KR)
Corresponding author
Kim, Hun-Sung
Venue
Endocrinology and Metabolism
Published
2024-02-29
Volume
39
Issue
1
Pages
176-185
ISSN
  • 2093-596X (ISSN-L)
  • 2093-5978
OpenAlex
W4388848131
Cited by
9
References
29
Citations by year
2026: 3 · 2025: 4 · 2024: 2
FWCI
2.02
Type
journal article
Language
en
Open access
Locations
  • Endocrinology and Metabolism (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes, Cardiovascular Risks, and Lipoproteins
Keywords
type 2 diabetes, cardiovascular complications, cardiovascular risk prediction, newly diagnosed diabetes, XGBoost, gated recurrent unit, ordinary differential equations, Bayesian neural networks, risk stratification, Korean patients
MeSH terms
Machine Learning, Algorithms, Bayes Theorem, Cardiovascular Diseases, Diabetes Mellitus, Type 2, Humans, Retrospective Studies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review