Ability of Current Machine Learning Algorithms to Predict and Detect Hypoglycemia in Patients With Diabetes Mellitus: Meta-analysis
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Background: Machine learning (ML) algorithms have been widely introduced to diabetes research including those for the identification of hypoglycemia. Objective: The objective of this meta-analysis is to assess the current ability of ML algorithms to detect hypoglycemia (ie, alert to hypoglycemia coinciding with its symptoms) or predict hypoglycemia (ie, alert to hypoglycemia before its symptoms have occurred). Methods: Electronic literature searches (from January 1, 1950, to September 14, 2020) were conducted using the Dialog platform that covers 96 databases of peer-reviewed literature. Included studies had to train the ML algorithm in order to build a model to detect or predict hypoglycemia and test its performance. The set of 2 × 2 data (ie, number of true positives, false positives, true negatives, and false negatives) was pooled with a hierarchical summary receiver operating characteristic model. Results: A total of 33 studies (14 studies for detecting hypoglycemia and 19 studies for predicting hypoglycemia) were eligible. For detection of hypoglycemia, pooled estimates (95% CI) of sensitivity, specificity, positive likelihood ratio (PLR), and negative likelihood ratio (NLR) were 0.79 (0.75-0.83), 0.80 (0.64-0.91), 8.05 (4.79-13.51), and 0.18 (0.12-0.27), respectively. For prediction of hypoglycemia, pooled estimates (95% CI) were 0.80 (0.72-0.86) for sensitivity, 0.92 (0.87-0.96) for specificity, 10.42 (5.82-18.65) for PLR, and 0.22 (0.15-0.31) for NLR. Conclusions: Current ML algorithms have insufficient ability to detect ongoing hypoglycemia and considerate ability to predict impeding hypoglycemia in patients with diabetes mellitus using hypoglycemic drugs with regard to diagnostic tests in accordance with the Users’ Guide to Medical Literature (PLR should be ≥5 and NLR should be ≤0.2 for moderate reliability). However, it should be emphasized that the clinical applicability of these ML algorithms should be evaluated according to patients’ risk profiles such as for hypoglycemia and its associated complications (eg, arrhythmia, neuroglycopenia) as well as the average ability of the ML algorithms. Continued research is required to develop more accurate ML algorithms than those that currently exist and to enhance the feasibility of applying ML in clinical settings. Trial Registration: PROSPERO International Prospective Register of Systematic Reviews CRD42020163682; http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42020163682
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910 · cited 1×
“Publication bias was statistically assessed as proposed by Deeks et al [13], wherein the logarithm of the diagnostic odds ratio is regressed against its corresponding inverse of the square root of the effective sample size.”
MethodZoungas, S., Arima, H., Gerstein, H. C., Holman, R. R., Woodward, M., Reaven, P., Hayward, R. A., Craven, T., Coleman, R. L., & Chalmers, J. (2017) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(17)30104-3 · Cited by 529
Continuous glucose monitoring: a review of recent studies demonstrating improved glycemic outcomes
Rodbard, D. (2017) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2017.0035 · Cited by 458
metandi: Meta-analysis of diagnostic accuracy using hierarchical logistic regression
Harbord, R. M., & Whiting, P. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900203 · Cited by 453
Hypoglycemia in Type 2 Diabetes
Zammitt, N. N., & Frier, B. M. (2005) · Diabetes Care · doi:10.2337/diacare.28.12.2948 · Cited by 435
Chow, E., Bernjak, A., Williams, S., Fawdry, R. A., Hibbert, S., Freeman, J., Sheridan, P. J., & Heller, S. R. (2014) · Diabetes · doi:10.2337/db13-0468 · Cited by 403 · cited 1×
“For example, for patients with both DM and high cardiovascular risk, in particular, those who are vulnerable to cardiac arrhythmias, using ECGs for detecting hypoglycemia is useful considering that a hypoglycemia-induced arrhythmia could contribute to increased cardiovascular mortality [57].”
BackgroundMultivariate Random-effects Meta-regression: Updates to Mvmeta
White, I. R. (2011) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1101100206 · Cited by 400
Prevalence of impaired awareness of hypoglycaemia in adults with Type 1 diabetes
Geddes, J., Schopman, J. E., Zammitt, N. N., & Frier, B. M. (2008) · Diabetic Medicine · doi:10.1111/j.1464-5491.2008.02413.x · Cited by 387
Rebrin, K., Sheppard, N. F., & Steil, G. M. (2010) · Journal of Diabetes Science and Technology · doi:10.1177/193229681000400507 · Cited by 152
Cited by
Artificial intelligence in diabetes management: Advancements, opportunities, and challenges
Guan, Z., Li, H., Liu, R., Cai, C., Liu, Y., Li, J., Wang, X., Huang, S., Wu, L., Liu, D., et al. (2023) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101213 · Cited by 412
“72 In particular, the clinical applicability of these AI algorithms should be evaluated according to patients’ risk profiles, such as for hypoglycemia and its associated complications (e.g., arrhythmia and neuroglycopenia), as well as the average ability of the AI algorithms.”
BackgroundArtificial intelligence for diabetes care: current and future prospects
Sheng, B., Pushpanathan, K., Guan, Z., Lim, Q. H., Lim, Z. W., Yew, S. M. E., Goh, J. H. L., Bee, Y. M., Sabanayagam, C., Sevdalis, N., et al. (2024) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(24)00154-2 · Cited by 106
Continuous glucose monitoring for children with hypoglycaemia: Evidence in 2023
Worth, C., Hoskyns, L., Salomon-Estebanez, M., Nutter, P. W., Harper, S., Derks, T. G. J., Beardsall, K., & Banerjee, I. (2023) · Frontiers in Endocrinology · doi:10.3389/fendo.2023.1116864 · Cited by 29
Metadata
- Authors
- Kodama, S., Fujihara, K., Shiozaki, H., Horikawa, C., Yamada, M. H., Sato, T., Yaguchi, Y., Yamamoto, M., Kitazawa, M., Iwanaga, M., Matsubayashi, Y., & Sone, H.
- Venue
- JMIR Diabetes
- Publisher
- JMIR Publications Inc.
- Published
- 2021-01-29
- Volume
- 6
- Issue
- 1
- Pages
- e22458
- ISSN
- 2371-4379 (ISSN-L)
- OpenAlex
- W3123700022
- Cited by
- 49
- References
- 15
- FWCI
- 5.92
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.