Reverse Engineering and Evaluation of Prediction Models for Progression to Type 2 Diabetes: An Application of Machine Learning Using Electronic Health Records
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Background: Application of novel machine learning approaches to electronic health record (EHR) data could provide valuable insights into disease processes. We utilized this approach to build predictive models for progression to prediabetes and type 2 diabetes (T2D). Methods: Using a novel analytical platform (Reverse Engineering and Forward Simulation [REFS]), we built prediction model ensembles for progression to prediabetes or T2D from an aggregated EHR data sample. REFS relies on a Bayesian scoring algorithm to explore a wide model space, and outputs a distribution of risk estimates from an ensemble of prediction models. We retrospectively followed 24 331 adults for transitions to prediabetes or T2D, 2007-2012. Accuracy of prediction models was assessed using an area under the curve (AUC) statistic, and validated in an independent data set. Results: Our primary ensemble of models accurately predicted progression to T2D (AUC = 0.76), and was validated out of sample (AUC = 0.78). Models of progression to T2D consisted primarily of established risk factors (blood glucose, blood pressure, triglycerides, hypertension, lipid disorders, socioeconomic factors), whereas models of progression to prediabetes included novel factors (high-density lipoprotein, alanine aminotransferase, C-reactive protein, body temperature; AUC = 0.70). Conclusions: We constructed accurate prediction models from EHR data using a hypothesis-free machine learning approach. Identification of established risk factors for T2D serves as proof of concept for this analytical approach, while novel factors selected by REFS represent emerging areas of T2D research. This methodology has potentially valuable downstream applications to personalized medicine and clinical research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Information theory and statistical mechanics
Jaynes, E. T. (1957) · Physical Review · doi:10.1103/physrev.106.620 · Cited by 12,931
Diagnosis and classification of diabetes mellitus
American Diabetes Association (2014) · Diabetes Care · doi:10.2337/dc14-s081 · Cited by 5,974
Prediabetes: a high-risk state for diabetes development
Tabák, A. G., Herder, C., Rathmann, W., Brunner, E. J., & Kivimäki, M. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60283-9 · Cited by 2,958
Nonalcoholic Fatty Liver Disease
Marchesini, G., Brizi, M., Bianchi, G., Tomassetti, S., Bugianesi, E., Lenzi, M., McCullough, A. J., Natale, S., Forlani, G., & Melchionda, N. (2001) · Diabetes · doi:10.2337/diabetes.50.8.1844 · Cited by 2,581
Changes in diabetes-related complications in the United States, 1990-2010
Gregg, E. W., Li, Y., Wang, J., Rios Burrows, N., Ali, M. K., Rolka, D., Williams, D. E., & Geiss, L. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1310799 · Cited by 1,749 · cited 15×
“The rate of progression from normoglycemia to T2D was 4.72 events per 100 person-years; normoglycemia to prediabetes, 18.72 events per 100 person-years; prediabetes to T2D, 8.6 events per 100 person-years.”
BackgroundMethodInfluentialModel Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476894 · Cited by 1,205 · cited 2×
“Other/unknown 5433 (22) 610 (11) Region Midwest 22 362 (92) 3230 (14) South 1858 (8) 523 (28) West/Northeast 111 (<1) 12 (11) Insurance status Commercial 11 317 (47) 1452 (13) Medicare 6822 (28) 779 (11) Inconsistent 5866 (24) 1491 (25) Uninsured/other 326 (1) 43 (13) Average income (US$/year) <40 000 6021 (25) 1371 (…”
Bayesian Graphical Models for Discrete Data
Madigan, D., York, J., & Allard, D. (1995) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403615 · Cited by 1,090
Vozarova, B., Stefan, N., Lindsay, R. S., Saremi, A., Pratley, R. E., Bogardus, C., & Tataranni, P. A. (2002) · Diabetes · doi:10.2337/diabetes.51.6.1889 · Cited by 717
Collins, G. S., Mallett, S., Omar, O., & Yu, L.-M. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-103 · Cited by 484
Abbasi, A., Peelen, L. M., Corpeleijn, E., van der Schouw, Y. T., Stolk, R. P., Spijkerman, A. M. W., van der A, D. L., Moons, K. G. M., Navis, G., Bakker, S. J. L., et al. (2012) · BMJ · doi:10.1136/bmj.e5900 · Cited by 321
Cited by
Machine learning and data mining methods in diabetes research
Kavakiotis, I., Tsave, O., Salifoglou, A., Maglaveras, N., Vlahavas, I., & Chouvarda, I. (2017) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2016.12.005 · Cited by 1,445
Machine learning in medicine: a practical introduction
Sidey-Gibbons, J. A. M., & Sidey-Gibbons, C. J. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0681-4 · Cited by 1,271
Artificial intelligence for diabetes management and decision support: Literature review
Contreras, I., & Vehi, J. (2018) · Journal of Medical Internet Research · doi:10.2196/10775 · Cited by 560
“[107] 2016 NB T2D 24331 5 years Group risks of T2D progression Disease progression”
BackgroundZhang, B., Shi, H., & Wang, H. (2023) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s410301 · Cited by 347
Predicting the onset of type 2 diabetes using wide and deep learning with electronic health records
Nguyen, B. P., Pham, H. N., Tran, H., Nghiem, N., Nguyen, Q. H., Do, T. T. T., Tran, C. T., & Simpson, C. R. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.105055 · Cited by 158
Metadata
- Authors
- Anderson, J. P., Parikh, J. R., Shenfeld, D. K., Ivanov, V., Marks, C., Church, B. W., Laramie, J. M., Mardekian, J., Piper, B. A., Willke, R. J., & Rublee, D. A.
- Venue
- Journal of Diabetes Science and Technology
- Publisher
- SAGE Publications
- Published
- 2015-12-20
- Volume
- 10
- Issue
- 1
- Pages
- 6-18
- ISSN
- 1932-2968 (ISSN-L)
- OpenAlex
- W2236731268
- Cited by
- 110
- References
- 11
- FWCI
- 3.44
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reverse Engineering and Evaluation of Prediction Models for Progression to Type 2 Diabetes: An Application of Machine Learning Using Electronic Health Records. https://app.cochat.ai/papers/10.1177/1932296815620200
- The paper
- Anderson, J. P., Parikh, J. R., Shenfeld, D. K., Ivanov, V., Marks, C., Church, B. W., Laramie, J. M., Mardekian, J., Piper, B. A., Willke, R. J., & Rublee, D. A. (2016). Reverse Engineering and Evaluation of Prediction Models for Progression to Type 2 Diabetes: An Application of Machine Learning Using Electronic Health Records. Journal of Diabetes Science and Technology. https://doi.org/10.1177/1932296815620200
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.