The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Population-Level Prediction of Type 2 Diabetes From Claims Data and Analysis of Risk Factors
Open accessAbstract
We present a new approach to population health, in which data-driven predictive models are learned for outcomes such as type 2 diabetes. Our approach enables risk assessment from readily available electronic claims data on large populations, without additional screening cost. Proposed model uncovers early and late-stage risk factors. Using administrative claims, pharmacy records, healthcare utilization, and laboratory results of 4.1 million individuals between 2005 and 2009, an initial set of 42,000 variables were derived that together describe the full health status and history of every individual. Machine learning was then used to methodically enhance predictive variable set and fit models predicting onset of type 2 diabetes in 2009-2011, 2010-2012, and 2011-2013. We compared the enhanced model with a parsimonious model consisting of known diabetes risk factors in a real-world environment, where missing values are common and prevalent. Furthermore, we analyzed novel and known risk factors emerging from the model at different age groups at different stages before the onset. Parsimonious model using 21 classic diabetes risk factors resulted in area under ROC curve (AUC) of 0.75 for diabetes prediction within a 2-year window following the baseline. The enhanced model increased the AUC to 0.80, with about 900 variables selected as predictive (p < 0.0001 for differences between AUCs). Similar improvements were observed for models predicting diabetes onset 1-3 years and 2-4 years after baseline. The enhanced model improved positive predictive value by at least 50% and identified novel surrogate risk factors for type 2 diabetes, such as chronic liver disease (odds ratio [OR] 3.71), high alanine aminotransferase (OR 2.26), esophageal reflux (OR 1.85), and history of acute bronchitis (OR 1.45). Liver risk factors emerge later in the process of diabetes development compared with obesity-related factors such as hypertension and high hemoglobin A1c. In conclusion, population-level risk prediction for type 2 diabetes using readily available administrative data is feasible and has better prediction performance than classical diabetes risk prediction algorithms on very large populations with missing data. The new model enables intervention allocation at national scale quickly and accurately and recovers potentially novel risk factors at different stages before the disease onset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin
(2002) · New England Journal of Medicine · doi:10.1056/nejmoa012512 · Cited by 19,011 · cited 7×
“We demonstrated that compared with using a parsimonious set of variables, using big data and machine learning improves PPVs by 67% and AUC by 6.6%.”
InfluentialThe Diabetes Prevention Program (DPP)
The Diabetes Prevention Program (DPP) Research Group (2002) · Diabetes Care · doi:10.2337/diacare.25.12.2165 · Cited by 1,938
Ramachandran, A., Snehalatha, C., Mary, S., Mukesh, B., Bhaskar, A. D., Vijay, V., & Indian Diabetes Prevention Programme (IDPP) (2006) · Diabetologia · doi:10.1007/s00125-005-0097-z · Cited by 1,881
The Finnish Diabetes Prevention Study (DPS)
Lindström, J., Louheranta, A., Mannelin, M., Rastas, M., Salminen, V., Eriksson, J., Uusitupa, M., Tuomilehto, J., & for the Finnish Diabetes Prevention Study Group (2003) · Diabetes Care · doi:10.2337/diacare.26.12.3230 · Cited by 1,848
Mining electronic health records: towards better research applications and clinical care
Jensen, P. B., Jensen, L. J., & Brunak, S. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3208 · Cited by 1,680
Li, G., Zhang, P., Wang, J., Gregg, E. W., Yang, W., Gong, Q., Li, H., Li, H., Jiang, Y., An, Y., et al. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60766-7 · Cited by 1,600
Obstructive Sleep Apnea Is Independently Associated with Insulin Resistance
Ip, M. S. M., Lam, B., Ng, M. M. T., Lam, W. K., Tsang, K. W. T., & Lam, K. S. L. (2002) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.165.5.2103001 · Cited by 1,300 · cited 1×
“60 We also found other makers of cardiovascular disease, such as coronary atherosclerosis (Supplementary Table S2), hypertension (Tables 3 and 4), and kidney disease (Table 4 and Supplementary Tables S1–S3), to be predictive of diabetes onset.”
Cited by
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
IDF Diabetes Atlas: Global estimates of diabetes prevalence for 2017 and projections for 2045
Cho, N. H., Shaw, J. E., Karuranga, S., Huang, Y., da Rocha Fernandes, J. D., Ohlrogge, A. W., & Malanda, B. (2018) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2018.02.023 · Cited by 7,283
IDF Diabetes Atlas: Global estimates for the prevalence of diabetes for 2015 and 2040
Ogurtsova, K., da Rocha Fernandes, J. D., Huang, Y., Linnenkamp, U., Guariguata, L., Cho, N. H., Cavan, D., Shaw, J. E., & Makaroff, L. E. (2017) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2017.03.024 · Cited by 6,966
Machine learning and data mining methods in diabetes research
Kavakiotis, I., Tsave, O., Salifoglou, A., Maglaveras, N., Vlahavas, I., & Chouvarda, I. (2017) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2016.12.005 · Cited by 1,445
Predicting Diabetes Mellitus With Machine Learning Techniques
Zou, Q., Qu, K., Luo, Y., Yin, D., Ju, Y., & Tang, H. (2018) · Frontiers in Genetics · doi:10.3389/fgene.2018.00515 · Cited by 920
Rudin, C., & Radin, J. (2019) · Harvard Data Science Review · doi:10.1162/99608f92.5a8a3a3d · Cited by 432
“…domains and across many other high-stakes machine learning applications where life-altering decisions are being made (e.g., Caruana et al., 2015; Razavian et al., 2015; Rudin & Ustun, 2018, who all show models with interpretability constraints that perform just as well as unconstrained models).”
BackgroundLearning a Health Knowledge Graph from Electronic Medical Records
Rotmensch, M., Halpern, Y., Tlimat, A., Horng, S., & Sontag, D. (2017) · Scientific Reports · doi:10.1038/s41598-017-05778-z · Cited by 423
Self-citationDiagnosis of Diabetes Mellitus Using Gradient Boosting Machine (LightGBM)
Rufo, D. D., Debelee, T. G., Ibenthal, A., & Negera, W. G. (2021) · Diagnostics · doi:10.3390/diagnostics11091714 · Cited by 317
Diabetes Fact Sheet in Korea, 2016: An Appraisal of Current Status
Won, J. C., Lee, J. H., Kim, J. H., Kang, E. S., Won, K. C., Kim, D. J., & Lee, M.-K. (2018) · Diabetes & Metabolism Journal · doi:10.4093/dmj.2018.0017 · Cited by 299
A Systematic Review on Healthcare Analytics: Application and Theoretical Perspective of Data Mining
Islam, M. S., Hasan, M. M., Wang, X., Germack, H. D., & Noor-E-Alam, M. (2018) · Healthcare · doi:10.3390/healthcare6020054 · Cited by 267
Online Decision Making with High-Dimensional Covariates
Bastani, H., & Bayati, M. (2020) · Operations Research · doi:10.1287/opre.2019.1902 · Cited by 263
Predicting Type 2 Diabetes Using Logistic Regression and Machine Learning Approaches
Joshi, R. D., & Dhakal, C. K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18147346 · Cited by 260
Big Data and Machine Learning Based Secure Healthcare Framework
Kaur, P., Sharma, M., & Mittal, M. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.05.020 · Cited by 218
Predicting the early risk of chronic kidney disease in patients with diabetes using real-world data
Ravizza, S., Huschto, T., Adamov, A., Böhm, L., Büsser, A., Flöther, F. F., Hinzmann, R., König, H., McAhren, S. M., Robertson, D. H., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0239-8 · Cited by 167
Predicting the onset of type 2 diabetes using wide and deep learning with electronic health records
Nguyen, B. P., Pham, H. N., Tran, H., Nghiem, N., Nguyen, Q. H., Do, T. T. T., Tran, C. T., & Simpson, C. R. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.105055 · Cited by 158
A scoping review of artificial intelligence-based methods for diabetes risk prediction
Mohsen, F., Al-Absi, H. R. H., Yousri, N. A., El Hajj, N., & Shah, Z. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00933-5 · Cited by 125
Ravaut, M., Sadeghi, H., Leung, K. K., Volkovs, M., Kornas, K., Harish, V., Watson, T., Lewis, G. F., Weisman, A., Poutanen, T., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00394-8 · Cited by 121
Health Big Data Analytics: A Technology Survey
Harerimana, G., Jang, B., Kim, J. W., & Park, H. K. (2018) · IEEE Access · doi:10.1109/access.2018.2878254 · Cited by 119
Thesmar, D., Sraer, D., Pinheiro, L., Dadson, N., Veliche, R., & Greenberg, P. (2019) · PharmacoEconomics · doi:10.1007/s40273-019-00777-6 · Cited by 91
Zhang, L., Shang, X., Sreedharan, S., Yan, X., Liu, J., Keel, S., Wu, J., Peng, W., & He, M. (2020) · JMIR Medical Informatics · doi:10.2196/16850 · Cited by 40
Systems and precision medicine approaches to diabetes heterogeneity: a Big Data perspective
Capobianco, E. (2017) · Clinical and Translational Medicine · doi:10.1186/s40169-017-0155-4 · Cited by 39
Identification of risk factors for patients with diabetes: diabetic polyneuropathy case study
Metsker, O., Magoev, K., Yakovlev, A., Yanishevskiy, S., Kopanitsa, G., Kovalchuk, S., & Krzhizhanovskaya, V. V. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01215-w · Cited by 35
Metadata
- Authors
- Razavian, N., Blecker, S., Schmidt, A. M., Smith-McLallen, A., Nigam, S., & Sontag, D.
- Venue
- Big Data
- Publisher
- SAGE Publications
- Published
- 2015-12
- Volume
- 3
- Issue
- 4
- Pages
- 277-287
- ISSN
- 2167-6461 (ISSN-L)
- 2167-647X
- OpenAlex
- W2239135493
- Cited by
- 212
- References
- 17
- FWCI
- 11.26
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.