A design and evaluation framework for digital health interventions
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Digital health interventions (DHIs) have the potential to help the growing number of chronic disease patients better manage their everyday lives. However, guidelines for the systematic development of DHIs are still scarce. The current work has, therefore, the objective to propose a framework for the design and evaluation of DHIs (DEDHI). The DEDHI framework is meant to support both researchers and practitioners alike from early conceptual DHI models to large-scale implementations of DHIs in the healthcare market.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474 · cited 4×
“of DHIs from MOST [19, 20, 21] for the Phases 1, 2 and 3 and from related work on intervention design and life cycle models [15, 16, 22] for Phase 4 as outlined in Section 2.”
MethodInfluentialMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 1×
“For example, first evaluation criteria have been proposed during the last decade [8, 9, 18, 27, 60, 80, 83].”
BackgroundNahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171 · cited 1×
“, just-in-time adaptive interventions [61, 62] and corresponding assessment methods such as micro-randomized trials [48] that heavily rely on the use of technology and, finally, (c) because it also focuses on behavioral health interventions at the individual-level which is relevant for chronic health problems [46, 53].”
BackgroundFord, I., & Norrie, J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510059 · Cited by 1,405 · cited 1×
“study nurses that are experienced with clinical trials [32].”
BackgroundIntervention Mapping: A Process for Developing Theory and Evidence-Based Health Education Programs
Bartholomew, L. K., Parcel, G. S., & Kok, G. (1998) · Health Education & Behavior · doi:10.1177/109019819802500502 · Cited by 1,102 · cited 1×
“Intervention Mapping [6, 7] (1998) Health education interventions with a focus on theory as justificatory knowledge Increasing condom use among men with HIV [57]”
BackgroundCollins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Development and validation of the user version of the Mobile application rating scale (uMARS)
Stoyanov, S. R., Hides, L., Kavanagh, D. J., & Wilson, H. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5849 · Cited by 872 · cited 1×
“[45, 79, 81] 41, 12.4%”
InfluentialEvaluating Digital Health Interventions
Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., Rivera, D. E., West, R., & Wyatt, J. C. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.008 · Cited by 847
Cited by
Perceptions and opinions of patients about mental health chatbots: scoping review
Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/17828 · Cited by 301
“The first attempts toward evaluation frameworks for digital health interventions [82] and health chatbots [83,84] have been recently published.”
Whitehead, L., Talevski, J., Fatehi, F., & Beauchamp, A. (2023) · Journal of Medical Internet Research · doi:10.2196/42719 · Cited by 261
Hauser-Ulrich, S., Künzli, H., Meier-Peterhans, D., & Kowatsch, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/15806 · Cited by 210
“A recent study [93] showed that conversational agent-based interventions target neurological disorders [94-96], addictions [97,98], mental-physical wellness [99,100], nutritional metabolic disorders [101-103], and sexually transmitted disease [104].”
BackgroundSelf-citationTechnical metrics used to evaluate health care chatbots: scoping review
Abd-Alrazaq, A., Safi, Z., Alajlani, M., Warren, J., Househ, M., & Denecke, K. (2020) · Journal of Medical Internet Research · doi:10.2196/18301 · Cited by 150
Jahnel, T., Pan, C.-C., Pedros Barnils, N., Muellmann, S., Freye, M., Dassow, H.-H., Lange, O., Reinschluessel, A. V., Rogowski, W., & Gerhardus, A. (2024) · Journal of Medical Internet Research · doi:10.2196/54269 · Cited by 15
Metadata
- Authors
- Kowatsch, T., Otto, L., Harperink, S., Cotti, A., & Schlieter, H.
- Venue
- it - Information Technology
- Publisher
- Walter de Gruyter GmbH
- Published
- 2019-10-01
- Volume
- 61
- Issue
- 5-6
- Pages
- 253-263
- ISSN
- 1611-2776 (ISSN-L)
- 2196-7032
- OpenAlex
- W2990180535
- Cited by
- 116
- References
- 35
- FWCI
- 15.05
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A design and evaluation framework for digital health interventions. https://app.cochat.ai/papers/10.1515/itit-2019-0019
- The paper
- Kowatsch, T., Otto, L., Harperink, S., Cotti, A., & Schlieter, H. (2019). A design and evaluation framework for digital health interventions. it - Information Technology. https://doi.org/10.1515/itit-2019-0019
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.