Methods and Evaluation Criteria for Apps and Digital Interventions for Diabetes Self-Management: Systematic Review
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Background: There is growing evidence that apps and digital interventions have a positive impact on diabetes self-management. Standard self-management for patients with diabetes could therefore be supplemented by apps and digital interventions to increase patients’ skills. Several initiatives, models, and frameworks suggest how health apps and digital interventions could be evaluated, but there are few standards for this. And although there are many methods for evaluating apps and digital interventions, a more specific approach might be needed for assessing digital diabetes self-management interventions. Objective: This review aims to identify which methods and criteria are used to evaluate apps and digital interventions for diabetes self-management, and to describe how patients were involved in these evaluations. Methods: We searched CINAHL, EMBASE, MEDLINE, and Web of Science for articles published from 2015 that referred to the evaluation of apps and digital interventions for diabetes self-management and involved patients in the evaluation. We then conducted a narrative qualitative synthesis of the findings, structured around the included studies’ quality, methods of evaluation, and evaluation criteria. Results: Of 1681 articles identified, 31 fulfilled the inclusion criteria. A total of 7 articles were considered of high confidence in the evidence. Apps were the most commonly used platform for diabetes self-management (18/31, 58%), and type 2 diabetes (T2D) was the targeted health condition most studies focused on (12/31, 38%). Questionnaires, interviews, and user-group meetings were the most common methods of evaluation. Furthermore, the most evaluated criteria for apps and digital diabetes self-management interventions were cognitive impact, clinical impact, and usability. Feasibility and security and privacy were not evaluated by studies considered of high confidence in the evidence. Conclusions: There were few studies with high confidence in the evidence that involved patients in the evaluation of apps and digital interventions for diabetes self-management. Additional evaluation criteria, such as sustainability and interoperability, should be focused on more in future studies to provide a better understanding of the effects and potential of apps and digital interventions for diabetes self-management.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The impact of mHealth interventions: systematic review of systematic reviews
Marcolino, M. S., Oliveira, J. A. Q., D'Agostino, M., Ribeiro, A. L., Alkmim, M. B. M., & Novillo-Ortiz, D. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8873 · Cited by 1,163 · cited 1×
“There is growing evidence that apps and digital interventions such as websites (web), social media, and other online services have a positive impact on diabetes self-management [4-12], suggesting that standard self-management could be supplemented by digital interventions to aid and improve patients’ skills [4-12].”
BackgroundSelf-Management: A Comprehensive Approach to Management of Chronic Conditions
Grady, P. A., & Gough, L. L. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.302041 · Cited by 923
Agarwal, S., LeFevre, A. E., Lee, J., L’Engle, K., Mehl, G., Sinha, C., & Labrique, A. (2016) · BMJ · doi:10.1136/bmj.i1174 · Cited by 639 · cited 2×
“In 2016, the mobile health (mHealth) evidence reporting and assessment checklist was developed by the World Health Organization to help with reporting evidence of the effectiveness of mHealth interventions [64].”
BackgroundGreenwood, D. A., Gee, P. M., Fatkin, K. J., & Peeples, M. (2017) · Journal of Diabetes Science and Technology · doi:10.1177/1932296817713506 · Cited by 526 · cited 1×
“There is growing evidence that apps and digital interventions such as websites (web), social media, and other online services have a positive impact on diabetes self-management [4-12], suggesting that standard self-management could be supplemented by digital interventions to aid and improve patients’ skills [4-12].”
BackgroundHou, C., Carter, B., Hewitt, J., Francisa, T., & Mayor, S. (2016) · Diabetes Care · doi:10.2337/dc16-0346 · Cited by 411 · cited 1×
“There is growing evidence that apps and digital interventions such as websites (web), social media, and other online services have a positive impact on diabetes self-management [4-12], suggesting that standard self-management could be supplemented by digital interventions to aid and improve patients’ skills [4-12].”
BackgroundShan, R., Sarkar, S., & Martin, S. S. (2019) · Diabetologia · doi:10.1007/s00125-019-4864-7 · Cited by 339 · cited 1×
“There is growing evidence that apps and digital interventions such as websites (web), social media, and other online services have a positive impact on diabetes self-management [4-12], suggesting that standard self-management could be supplemented by digital interventions to aid and improve patients’ skills [4-12].”
BackgroundHolmen, H., Torbjørnsen, A., Wahl, A. K., Jenum, A. K., Småstuen, M. C., Årsand, E., & Ribu, L. (2014) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3882 · Cited by 294 · cited 1×
“Several studies, including many in this review, have shown that involving HCPs in digital interventions is associated with improved self-management of diabetes and the success of these interventions [31,48,49,52,70-72].”
BackgroundSelf-citationCotter, A. P., Durant, N., Agne, A. A., & Cherrington, A. L. (2014) · Journal of Diabetes and its Complications · doi:10.1016/j.jdiacomp.2013.07.003 · Cited by 239 · cited 1×
“There is growing evidence that apps and digital interventions such as websites (web), social media, and other online services have a positive impact on diabetes self-management [4-12], suggesting that standard self-management could be supplemented by digital interventions to aid and improve patients’ skills [4-12].”
BackgroundGeorgsson, M., & Staggers, N. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv099 · Cited by 200 · cited 2×
“[29-34, 36-39 36-39, 41,46-49,52,”
Beyond pilotitis: taking digital health interventions to the national level in China and Uganda
Huang, F., Blaschke, S., & Lucas, H. (2017) · Globalization and Health · doi:10.1186/s12992-017-0275-z · Cited by 182
Cited by
van der Kamp, M., Reimering Hartgerink, P., Driessen, J., Thio, B., Hermens, H., & Tabak, M. (2021) · JMIR Formative Research · doi:10.2196/24634 · Cited by 19
Hakami, A. M., Almutairi, B., Alanazi, A. S., & Alzahrani, M. A. (2024) · Cureus · doi:10.7759/cureus.51791 · Cited by 20
“Additionally, substantial data support the effectiveness of apps in enhancing lifestyle modification for T2DM patients [9].”
BackgroundFu, H. N. C., Wyman, J. F., Peden-McAlpine, C. J., Draucker, C. B., Schleyer, T., & Adam, T. J. (2023) · JMIR Diabetes · doi:10.2196/38592 · Cited by 15
“To date, only a few rigorous evaluation studies of app designs have involved patients [16], and most have evaluated the quality of all available apps in the market without involving end users such as patients and clinicians [17,18].”
BackgroundAbdulhussein, F. S., Pinkney, S., Görges, M., van Rooij, T., & Amed, S. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/46432 · Cited by 10
“User engagement in evaluating diabetes digital apps is low, and most apps have involved patients only after the apps have been created [6].”
Metadata
- Authors
- Larbi, D., Randine, P., Årsand, E., Antypas, K., Bradway, M., & Gabarron, E.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-07-06
- Volume
- 22
- Issue
- 7
- Pages
- e18480
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W3038986362
- Cited by
- 52
- References
- 22
- FWCI
- 2.49
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methods and Evaluation Criteria for Apps and Digital Interventions for Diabetes Self-Management: Systematic Review. https://app.cochat.ai/papers/10.2196/18480
- The paper
- Larbi, D., Randine, P., Årsand, E., Antypas, K., Bradway, M., & Gabarron, E. (2020). Methods and Evaluation Criteria for Apps and Digital Interventions for Diabetes Self-Management: Systematic Review. Journal of Medical Internet Research. https://doi.org/10.2196/18480
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.