iCHECK-DH: Guidelines and Checklist for the Reporting on Digital Health Implementations
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Background: Implementation of digital health technologies has grown rapidly, but many remain limited to pilot studies due to challenges, such as a lack of evidence or barriers to implementation. Overcoming these challenges requires learning from previous implementations and systematically documenting implementation processes to better understand the real-world impact of a technology and identify effective strategies for future implementation. Objective: A group of global experts, facilitated by the Geneva Digital Health Hub, developed the Guidelines and Checklist for the Reporting on Digital Health Implementations (iCHECK-DH, pronounced “I checked”) to improve the completeness of reporting on digital health implementations. Methods: A guideline development group was convened to define key considerations and criteria for reporting on digital health implementations. To ensure the practicality and effectiveness of the checklist, it was pilot-tested by applying it to several real-world digital health implementations, and adjustments were made based on the feedback received. The guiding principle for the development of iCHECK-DH was to identify the minimum set of information needed to comprehensively define a digital health implementation, to support the identification of key factors for success and failure, and to enable others to replicate it in different settings. Results: The result was a 20-item checklist with detailed explanations and examples in this paper. The authors anticipate that widespread adoption will standardize the quality of reporting and, indirectly, improve implementation standards and best practices. Conclusions: Guidelines for reporting on digital health implementations are important to ensure the accuracy, completeness, and consistency of reported information. This allows for meaningful comparison and evaluation of results, transparency, and accountability and informs stakeholder decision-making. i-CHECK-DH facilitates standardization of the way information is collected and reported, improving systematic documentation and knowledge transfer that can lead to the development of more effective digital health interventions and better health outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
Standards for Reporting Qualitative Research: A Synthesis of Recommendations
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000388 · Cited by 12,211
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Agarwal, S., LeFevre, A. E., Lee, J., L’Engle, K., Mehl, G., Sinha, C., & Labrique, A. (2016) · BMJ · doi:10.1136/bmj.i1174 · Cited by 639
Self-citationRathbone, A. L., & Prescott, J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7740 · Cited by 497 · cited 1×
“…when used as an intervention within standard care as a control, had a moderate to large between-group effect on medication adherence 1 month posttest (d=0.77), 2 month posttest (d=0.88), and continued to stay just as effective, if not become even more so, at the 3-month follow-up (d=1.02)” [38].”
InfluentialBest practices in scaling digital health in low and middle income countries
Labrique, A. B., Wadhwani, C., Williams, K. A., Lamptey, P., Hesp, C., Luk, R., & Aerts, A. (2018) · Globalization and Health · doi:10.1186/s12992-018-0424-z · Cited by 449
Lennon, M. R., Bouamrane, M.-M., Devlin, A. M., O'Connor, S., O'Donnell, C., Chetty, U., Agbakoba, R., Bikker, A., Grieve, E., Finch, T., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6900 · Cited by 264
Marwaha, J. S., Landman, A. B., Brat, G. A., Dunn, T., & Gordon, W. J. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00557-1 · Cited by 241 · cited 1×
“One dimension of long-term ownership that should be considered is whether the tool has a “technical owner” who can provide technical support and own the functionality of the tool in the long term before it is adopted [34].”
Hauser-Ulrich, S., Künzli, H., Meier-Peterhans, D., & Kowatsch, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/15806 · Cited by 210 · cited 2×
“Data protection requirements were fulfilled according to the KEK-ZH” [27].”
Long, L.-A., Pariyo, G., & Kallander, K. (2018) · Global Health: Science and Practice · doi:10.9745/ghsp-d-18-00167 · Cited by 148 · cited 1×
“…may not progress beyond the pilot stage: The pilot does not provide sufficient evidence of effectiveness or value to justify a wider rollout [1], or there are challenges or barriers to implementation that are not addressed or resolved during the pilot phase, such as resistance from health…”
Cited by
Zangger, G., Bricca, A., Liaghat, B., Juhl, C. B., Mortensen, S. R., Andersen, R. M., Damsted, C., Hamborg, T. G., Ried-Larsen, M., Tang, L. H., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/46439 · Cited by 116
Consolidated Reporting Guidelines for Prognostic and Diagnostic Machine Learning Models (CREMLS)
El Emam, K., Leung, T. I., Malin, B., Klement, W., & Eysenbach, G. (2024) · Journal of Medical Internet Research · doi:10.2196/52508 · Cited by 16
Karakachoff, M., Goronflot, T., Coudol, S., Toublant, D., Bazoge, A., Constant Dit Beaufils, P., Varey, E., Leux, C., Mauduit, N., Wargny, M., et al. (2024) · JMIR Medical Informatics · doi:10.2196/50194 · Cited by 15
El Emam, K., Leung, T. I., Malin, B., Klement, W., & Eysenbach, G. (2024) · doi:10.2196/preprints.52508
Metadata
- Authors
- Perrin Franck, C., Babington-Ashaye, A., Dietrich, D., Bediang, G., Veltsos, P., Gupta, P. P., Juech, C., Kadam, R., Collin, M., Setian, L., Serrano Pons, J., Kwankam, S. Y., Garrette, B., Barbe, S., Bagayoko, C. O., Mehl, G., Lovis, C., & Geissbuhler, A.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-05-10
- Volume
- 25
- Pages
- e46694
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W4366696852
- Cited by
- 111
- References
- 13
- FWCI
- 36.28
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.