Cited by 9Artificial Intelligence in HealthcareMachine Learning in HealthcareDiabetes, Cardiovascular Risks, and Lipoproteins

Machine learning for the prediction of atherosclerotic cardiovascular disease during 3‐year follow up in Chinese type 2 diabetes mellitus patients

Open access
Ding, Jinru, Luo, Yingying, Shi, Huwei, Chen, Ruiyao, Luo, Shuqing, Yang, Xu, Xiao, Zhongzhou, Liang, Bilin +3 more·2023·Journal of Diabetes Investigation

Abstract

Aims/Introduction: Clinical guidelines for the management of individuals with type 2 diabetes mellitus endorse the systematic assessment of atherosclerotic cardiovascular disease risk for early interventions. In this study, we aimed to develop machine learning models to predict 3‐year atherosclerotic cardiovascular disease risk in Chinese type 2 diabetes mellitus patients. Materials and Methods: Clinical records of 4,722 individuals with type 2 diabetes mellitus admitted to 94 hospitals were used. The features included demographic information, disease histories, laboratory tests and physical examinations. Logistic regression, support vector machine, gradient boosting decision tree, random forest and adaptive boosting were applied for model construction. The performance of these models was evaluated using the area under the receiver operating characteristic curve. Additionally, we applied SHapley Additive exPlanation values to explain the prediction model. Results: All five models achieved good performance in both internal and external test sets (area under the receiver operating characteristic curve >0.8). Random forest showed the highest discrimination ability, with sensitivity and specificity being 0.838 and 0.814, respectively. The SHapley Additive exPlanation analyses showed that previous history of diabetic peripheral vascular disease, older populations and longer diabetes duration were the three most influential predictors. Conclusions: The prediction models offer opportunities to personalize treatment and maximize the benefits of these medical interventions.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/jdi.14069

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 38

  1. [1]Magliano D, Boyko EJ. IDF Diabetes Atlas. Brussels, Belgium: International Diabetes Federation, 2021. 35914061
  2. [2]Ke C, Narayan KV, Chan JC, et al. Pathophysiology, phenotypes and management of type 2 diabetes mellitus in Indian and Chinese populations. Nat Rev Endocrinol 2022; 18: 413– 432. 35508700 PMC9067000
  3. [3]Draznin B, Aroda VR, Bakris G, et al. 10. Cardiovascular disease and risk management: Standards of medical Care in Diabetes‐2022. Diabetes Care 2022; 45(Supplement_1): S144– S174. 34964815
  4. [4]Arnett DK, Blumenthal RS, Albert MA, et al. 2019 ACC/AHA guideline on the primary prevention of cardiovascular disease: Executive summary: A report of the American College of Cardiology/American Heart Association task force on clinical practice guidelines. Circulation 2019; 140: e563– e595. 30879339 PMC8351755
  5. [5]Petruzzo M, Reia A, Maniscalco GT, et al. The Framingham cardiovascular risk score and 5‐year progression of multiple sclerosis. Eur J Neurol 2021; 28: 893– 900. 33091222
  6. [6]D'Agostino RB, Grundy S, Sullivan LM, et al. Validation of the Framingham coronary heart disease prediction scores: Results of a multiple ethnic groups investigation. JAMA 2001; 286: 180– 187. 11448281
  7. [7]Chen J, Budoff MJ, Reilly MP, et al. Coronary artery calcification and risk of cardiovascular disease and death among patients with chronic kidney disease. JAMA Cardiol 2017; 2: 635– 643. 28329057 PMC5798875
  8. [8]McClelland RL, Jorgensen NW, Budoff M, et al. 10‐year coronary heart disease risk prediction using coronary artery calcium and traditional risk factors: Derivation in the MESA (multi‐ethnic study of atherosclerosis) with validation in the HNR (Heinz Nixdorf recall) study and the DHS (Dallas heart study). J Am Coll Cardiol 2015; 66: 1643– 1653. 26449133 PMC4603537
  9. [9]Yang X, Li J, Hu D, et al. Predicting the 10‐year risks of atherosclerotic cardiovascular disease in Chinese population: The China‐PAR project (prediction for ASCVD risk in China). Circulation 2016; 134: 1430– 1440. 27682885
  10. [10]Pylypchuk R, Wells S, Kerr A, et al. Cardiovascular disease risk prediction equations in 400 000 primary care patients in New Zealand: A derivation and validation study. Lancet 2018; 391: 1897– 1907. 29735391
  11. [11]DeFilippis AP, Young R, Carrubba CJ, et al. An analysis of calibration and discrimination among multiple cardiovascular risk scores in a modern multiethnic cohort. Ann Intern Med 2015; 162: 266– 275. 25686167 PMC4414494
  12. [12]Dalton JE, Perzynski AT, Zidar DA, et al. Accuracy of cardiovascular risk prediction varies by neighborhood socioeconomic position: a retrospective cohort study. Ann Intern Med 2017; 167: 456– 464. 28847012 PMC6435027
  13. [13]Piri J, Mohapatra P. An analytical study of modified multi‐objective Harris hawk optimizer towards medical data feature selection. Comput Biol Med 2021; 135: 104558. 34182329
  14. [14]Zreik M, Van Hamersvelt RW, Wolterink JM, et al. A recurrent CNN for automatic detection and classification of coronary artery plaque and stenosis in coronary CT angiography. IEEE Trans Med Imaging 2018; 38: 1588– 1598. 30507498
  15. [15]Shi Z, Miao C, Schoepf UJ, et al. A clinically applicable deep‐learning model for detecting intracranial aneurysm in computed tomography angiography images. Nat Commun 2020; 11: 6090. 33257700 PMC7705757
  16. [16]Flores AM, Demsas F, Leeper NJ, et al. Leveraging machine learning and artificial intelligence to improve peripheral artery disease detection, treatment, and outcomes. Circ Res 2021; 128: 1833– 1850. 34110911 PMC8285054
  17. [17]Li Q, Campan A, Ren A, et al. Automating and improving cardiovascular disease prediction using machine learning and EMR data features from a regional healthcare system. Int J Med Inform 2022; 163: 104786. 35512622
  18. [18]Nabrdalik K, Kwiendacz H, Drożdż K, et al. Machine learning predicts cardiovascular events in patients with diabetes: The Silesia diabetes‐heart project. Curr Probl Cardiol 2023; 48: 101694. 36921649
  19. [19]Ji L, Hu D, Pan C, et al. Primacy of the 3B approach to control risk factors for cardiovascular disease in type 2 diabetes patients. Am J Med 2013; 126: 925.e11– 925.e22. 23810406
  20. [20]Zhang H, Jiang L, Webb GI. Rigorous non‐disjoint discretization for naive Bayes. Pattern Recognit 2023; 140: 109554.
  21. [21]Jia W, Weng J, Zhu D, et al. Standards of medical care for type 2 diabetes in China 2019. Diabetes Metab Res Rev 2019; 35: e3158. 30908791
  22. [22]Hosmer DW Jr, Lemeshow S, Sturdivant RX. Applied Logistic Regression. Hoboken, NJ: John Wiley & Sons, 2013.
  23. [24]Friedman JH. Greedy function approximation: A gradient boosting machine. Ann Stat 2001; 29: 1189– 1232.
  24. [25]Breiman L. Random forests. Mach Learn 2001; 45: 5– 32.
  25. [26]Freund Y, Schapire RE. A decision‐theoretic generalization of on‐line learning and an application to boosting. J Comput Syst Sci 1997; 55: 119– 139.
  26. [27]Yang L, Wu H, Jin X, et al. Study of cardiovascular disease prediction model based on random forest in eastern China. Sci Rep 2020; 10: 5245. 32251324 PMC7090086
  27. [28]Jung KJ, Jang Y, Oh DJ, et al. The ACC/AHA 2013 pooled cohort equations compared to a Korean risk prediction model for atherosclerotic cardiovascular disease. Atherosclerosis 2015; 242: 367– 375. 26255683
  28. [29]Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults. Executive summary of the third report of the National Cholesterol Education Program (NCEP) expert panel on detection, evaluation, and treatment of high blood cholesterol in adults (adult treatment panel III). JAMA 2001; 285: 2486– 2497. 11368702
  29. [30]Peach G, Griffin M, Jones K, et al. Diagnosis and management of peripheral arterial disease. BMJ 2012; 345: 345. 22893640
  30. [31]Criqui MH, Matsushita K, Aboyans V, et al. Lower extremity peripheral artery disease: contemporary epidemiology, management gaps, and future directions: a scientific statement from the American Heart Association. Circulation 2021; 144: e171– e191. 34315230 PMC9847212
  31. [32]Campia U, Gerhard‐Herman M, Piazza G, et al. Peripheral artery disease: past, present, and future. Am J Med 2019; 132: 1133– 1141. 31150643
  32. [33]Nordestgaard BG, Varbo A. Triglycerides and cardiovascular disease. Lancet 2014; 384: 626– 635. 25131982
  33. [35]Liu J, Hong Y, D'Agostino RB Sr, et al. Predictive value for the Chinese population of the Framingham CHD risk assessment tool compared with the Chinese multi‐provincial cohort study. JAMA 2004; 291: 2591– 2599. 15173150
  34. [36]Li X, Wu C, Lu J, et al. Cardiovascular risk factors in China: A nationwide population‐based cohort study. Lancet Public Health 2020; 5: e672– e681. 33271080
  35. [37]Kranenburg G, van der Graaf Y, van der Leeuw J, et al. The relation between HbA1c and cardiovascular events in patients with type 2 diabetes with and without vascular disease. Diabetes Care 2015; 38: 1930– 1936. 26307606
  36. [38]Inoue K, Nianogo R, Telesca D, et al. Low HbA1c levels and all‐cause or cardiovascular mortality among people without diabetes: the US National Health and nutrition examination survey 1999–2015. Int J Epidemiol 2021; 50: 1373– 1383. 33378417 PMC8562330
  37. [39]Ngiam KY, Khor W. Big data and machine learning algorithms for health‐care delivery. Lancet Oncol 2019; 20: e262– e273. 31044724
  38. [40]Berkelmans GF, Gudbjörnsdottir S, Visseren FL, et al. Prediction of individual life‐years gained without cardiovascular events from lipid, blood pressure, glucose, and aspirin treatment based on data of more than 500 000 patients with type 2 diabetes mellitus. Eur Heart J 2019; 40: 2899– 2906. 30629157 PMC7963127

Cited by

Sorted by citations

Authors
Ding, J., Luo, Y., Shi, H., Chen, R., Luo, S., Yang, X., Xiao, Z., Liang, B., Yan, Q., Xu, J., & Ji, L.
Affiliations
  • Shanghai Artificial Intelligence Laboratory (CN)
  • Peking University People's Hospital (CN)
  • Sensetime (China) (CN)
Corresponding author
  • Xu, Jie
  • Ji, Linong
Venue
Journal of Diabetes Investigation
Publisher
Wiley
Published
2023-08-22
Volume
14
Issue
11
Pages
1289-1302
ISSN
  • 2040-1116 (ISSN-L)
  • 2040-1124
OpenAlex
W4386046932
Cited by
9
References
1
Citations by year
2026: 3 · 2025: 4 · 2024: 2
FWCI
2.02
Type
journal article
Language
en
Open access
Locations
  • Journal of Diabetes Investigation (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes, Cardiovascular Risks, and Lipoproteins
Keywords
atherosclerotic cardiovascular disease, type 2 diabetes, cardiovascular risk prediction, machine learning, random forest, SHAP, diabetic peripheral vascular disease, diabetes duration, Chinese patients
MeSH terms
Machine Learning, East Asian People, Cardiovascular Diseases, Diabetes Mellitus, Type 2, Follow-Up Studies, Humans, Atherosclerosis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review