The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Development and Validation of a Tool to Identify Patients With Type 2 Diabetes at High Risk of Hypoglycemia-Related Emergency Department or Hospital Use
Open accessAbstract
Importance: Hypoglycemia-related emergency department (ED) or hospital use among patients with type 2 diabetes (T2D) is clinically significant and possibly preventable. Objective: To develop and validate a tool to categorize risk of hypoglycemic-related utilization in patients with T2D. Design, Setting, and Participants: Using recursive partitioning with a split-sample design, we created a classification tree based on potential predictors of hypoglycemia-related ED or hospital use. The resulting model was transcribed into a tool for practical application and tested in 1 internal and 2 fully independent, external samples. Development and internal testing was conducted in a split sample of 206 435 patients with T2D from Kaiser Permanente Northern California (KPNC), an integrated health care system. The tool was externally tested in 1 335 966 Veterans Health Administration and 14 972 Group Health Cooperative patients with T2D. Exposures: Based on a literature review, we identified 156 candidate predictor variables (prebaseline exposures) using data collected from electronic medical records. Main Outcomes and Measures: Hypoglycemia-related ED or hospital use during 12 months of follow-up. Results: The derivation sample (n = 165 148) had a mean (SD) age of 63.9 (13.0) years and included 78 576 (47.6%) women. The crude annual rate of at least 1 hypoglycemia-related ED or hospital encounter in the KPNC derivation sample was 0.49%. The resulting hypoglycemia risk stratification tool required 6 patient-specific inputs: number of prior episodes of hypoglycemia-related utilization, insulin use, sulfonylurea use, prior year ED use, chronic kidney disease stage, and age. We categorized the predicted 12-month risk of any hypoglycemia-related utilization as high (>5%), intermediate (1%-5%), or low (<1%). In the internal validation sample, 2.0%, 10.7%, and 87.3% were categorized as high, intermediate, and low risk, respectively, with observed 12-month hypoglycemia-related utilization rates of 6.7%, 1.4%, and 0.2%, respectively. There was good discrimination in the internal validation KPNC sample (C statistic = 0.83) and both external validation samples (Veterans Health Administration: C statistic = 0.81; Group Health Cooperative: C statistic = 0.79). Conclusions and Relevance: This hypoglycemia risk stratification tool categorizes the 12-month risk of hypoglycemia-related utilization in patients with T2D using only 6 inputs. This tool could facilitate targeted population management interventions, potentially reducing hypoglycemia risk and improving patient safety and quality of life.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Older adults can also be stratified for future risk for hypoglycemia with validated risk calculators (e.g., Kaiser Hypoglycemia Model) (34) and with consideration of hypoglycemia risk factors (Table 6.5).”
From 13. Older Adults: Standards of Care in Diabetes—2024 (2024) · cites this paper as [34]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Older adults can also be stratified for future risk for hypoglycemia with validated risk calculators (e.g., Kaiser Hypoglycemia Model for adults with type 2 diabetes) (40) and with consideration of hypoglycemia risk factors (Table 6.5).”
From 13. Older Adults: Standards of Care in Diabetes—2026 (2026) · cites this paper as [40]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Validated tools have been developed to estimate hypoglycemia risk using predominantly electronic health record data (101-103).”
From 6. Glycemic Goals, Hypoglycemia, and Hyperglycemic Crises: Standards of Care in Diabetes-2026. (2026) · cites this paper as [101]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,030
Levey, A. S., Bosch, J. P., Lewis, J. B., Greene, T., Rogers, N., Roth, D., & for the Modification of Diet in Renal Disease Study Group* (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-6-199903160-00002 · Cited by 15,079
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281
Moons, K. G. M., de Groot, J. A. H., Bouwmeester, W., Vergouwe, Y., Mallett, S., Altman, D. G., Reitsma, J. B., & Collins, G. S. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001744 · Cited by 2,018
Changes in diabetes-related complications in the United States, 1990-2010
Gregg, E. W., Li, Y., Wang, J., Rios Burrows, N., Ali, M. K., Rolka, D., Williams, D. E., & Geiss, L. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1310799 · Cited by 1,749
Emergency hospitalizations for adverse drug events in older Americans.
Budnitz, D., Lovegrove, M., Shehab, N., & Richards, C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1103053 · Cited by 1,748
Fonarow, G. C. (2005) · JAMA · doi:10.1001/jama.293.5.572 · Cited by 1,617
Severe hypoglycemia and risks of vascular events and death
Zoungas, S., Patel, A., Chalmers, J., de Galan, B. E., Li, Q., Billot, L., Woodward, M., Ninomiya, T., Neal, B., MacMahon, S., et al. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa1003795 · Cited by 1,471
Prognosis and prognostic research: validating a prognostic model
Altman, D. G., Vergouwe, Y., Royston, P., & Moons, K. G. M. (2009) · BMJ · doi:10.1136/bmj.b605 · Cited by 1,436
Cited by
Sorted by citations
Heart Disease and Stroke Statistics—2021 Update: A Report From the American Heart Association
Virani, S. S., Alonso, A., Aparicio, H. J., Benjamin, E. J., Bittencourt, M. S., Callaway, C. W., Carson, A. P., Chamberlain, A. M., Cheng, S., Delling, F. N., et al. (2021) · Circulation · doi:10.1161/cir.0000000000000950 · Cited by 5,784
6. Glycemic Goals and Hypoglycemia: Standards of Care in Diabetes—2024
ElSayed, N. A., Aleppo, G., Bannuru, R. R., Bruemmer, D., Collins, B. S., Ekhlaspour, L., Hilliard, M. E., Johnson, E. L., Khunti, K., Lingvay, I., et al. (2023) · Diabetes Care · doi:10.2337/dc24-s006 · Cited by 574
6. Glycemic Goals and Hypoglycemia: Standards of Care in Diabetes—2025
American Diabetes Association Professional Practice Committee, ElSayed, N. A., McCoy, R. G., Aleppo, G., Balapattabi, K., Beverly, E. A., Briggs Early, K., Bruemmer, D., Echouffo-Tcheugui, J. B., Ekhlaspour, L., et al. (2025) · Diabetes Care · doi:10.2337/dc25-s006 · Cited by 440
11. Microvascular Complications and Foot Care: Standards of Medical Care in Diabetes—2019
American Diabetes Association (2018) · Diabetes Care · doi:10.2337/dc19-s011 · Cited by 416
11. Microvascular Complications and Foot Care: Standards of Medical Care in Diabetes—2021
American Diabetes Association (2021) · Diabetes Care · doi:10.2337/dc21-s011 · Cited by 395
Metadata
- Authors
- Karter, A. J., Warton, E. M., Lipska, K. J., Ralston, J. D., Moffet, H. H., Jackson, G. G., Huang, E. S., & Miller, D. R.
- Affiliations
- University of California, San Francisco (US)
- Kaiser Permanente (US)
- Yale University (US)
- Kaiser Permanente Washington Health Research Institute (US)
- University of Chicago (US)
- Veterans Health Administration (US)
- Corresponding author
- Karter, Andrew J.
- ORCID
- Venue
- JAMA Internal Medicine
- Publisher
- American Medical Association (AMA)
- Published
- 2017-10-01
- Volume
- 177
- Issue
- 10
- Pages
- 1461
- ISSN
- 2168-6106 (ISSN-L)
- PMC
- PMC5624849
- OpenAlex
- W2749343537
- Semantic Scholar
- 865993e54ca35e1a709ba058bb73942c855a57a4
- Cited by
- 150
- References
- 62
- Citations by year
- 2026: 7 · 2025: 18 · 2024: 21 · 2023: 18 · 2022: 16 · 2021: 17 · 2020: 19 · 2019: 17 · 2018: 14 · 2017: 3
- FWCI
- 11.47
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- JAMA Internal Medicine (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (UL1TR001863)
- National Institute on Aging (K23AG048359)
- National Institute of Diabetes and Digestive and Kidney Diseases (K24DK105340, R01DK103721, R01DK081796, P30DK092949, P30DK092924)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes Management and Research
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes Treatment and Management
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Keywords
- type 2 diabetes, hypoglycemia, hospital utilization, risk stratification tools, classification trees, insulin use, chronic kidney disease, risk prediction model, external validation, Kaiser Permanente, Veterans Health Administration, Group Health Cooperative, electronic health records, hypoglycemia prevention
- MeSH terms
- Diabetes Mellitus, Type 2, Emergency Service, Hospital, Female, Follow-Up Studies, Humans, Hypoglycemia, Hypoglycemic Agents, Male, Prospective Studies, Quality of Life, Risk Factors, United States, Incidence, Risk Assessment, Delivery of Health Care, Integrated, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
