Digital Mental Health Interventions for Depression: Scoping Review of User Engagement
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index; 15 of the 36 sources its claims cite were checked for support.
Abstract
Background: While many digital mental health interventions (DMHIs) have been found to be efficacious, patient engagement with DMHIs has increasingly emerged as a concern for implementation in real-world clinical settings. To address engagement, we must first understand what standard engagement levels are in the context of randomized controlled trials (RCTs) and how these compare with other treatments. Objective: This scoping review aims to examine the state of reporting on intervention engagement in RCTs of mobile app–based interventions intended to treat symptoms of depression. We sought to identify what engagement metrics are and are not routinely reported as well as what the metrics that are reported reflect about standard engagement levels. Methods: We conducted a systematic search of 7 databases to identify studies meeting our eligibility criteria, namely, RCTs that evaluated use of a mobile app–based intervention in adults, for which depressive symptoms were a primary outcome of interest. We then extracted 2 kinds of information from each article: intervention details and indices of DMHI engagement. A 5-element framework of minimum necessary DMHI engagement reporting was derived by our team and guided our data extraction. This framework included (1) recommended app use as communicated to participants at enrollment and, when reported, app adherence criteria; (2) rate of intervention uptake among those assigned to the intervention; (3) level of app use metrics reported, specifically number of uses and time spent using the app; (4) duration of app use metrics (ie, weekly use patterns); and (5) number of intervention completers. Results: Database searching yielded 2083 unique records. Of these, 22 studies were eligible for inclusion. Only 64% (14/22) of studies included in this review specified rate of intervention uptake. Level of use metrics was only reported in 59% (13/22) of the studies reviewed. Approximately one-quarter of the studies (5/22, 23%) reported duration of use metrics. Only half (11/22, 50%) of the studies reported the number of participants who completed the app-based components of the intervention as intended or other metrics related to completion. Findings in those studies reporting metrics related to intervention completion indicated that between 14.4% and 93.0% of participants randomized to a DMHI condition completed the intervention as intended or according to a specified adherence criteria. Conclusions: Findings suggest that engagement was underreported and widely varied. It was not uncommon to see completion rates at or below 50% (11/22) of those participants randomized to a treatment condition or to simply see completion rates not reported at all. This variability in reporting suggests a failure to establish sufficient reporting standards and limits the conclusions that can be drawn about level of engagement with DMHIs. Based on these findings, the 5-element framework applied in this review may be useful as a minimum necessary standard for DMHI engagement reporting.
Overview
CoChat Summary
TL;DR
This scoping review examined reporting on user engagement in 22 RCTs of mobile app–based interventions for depression and found that engagement metrics were inconsistently reported and often low. It proposes a 5-element minimum reporting framework for digital mental health intervention (DMHI) engagement.
Key findings
- Database searching yielded 2083 unique records; 22 studies were eligible. Only 64% (14/22) specified rate of intervention uptake, and among those reporting it, uptake ranged from 42% to 100%.
- Level-of-use metrics were reported in 59% (13/22) of studies, duration-of-use metrics in 23% (5/22), and completion metrics in 50% (11/22). Completion ranged from 14.4% to 93.0%; among the 11 studies reporting completion, 6 reported ≤50% completion.
- Engagement was underreported and widely varied; the authors conclude that current reporting makes it nearly impossible to quantify standard engagement and propose a 5-element framework: intervention instructions/adherence criteria, rate of uptake, level of use, duration of use, and number of completers.
Methods
- Systematic search of 7 databases via OvidSP for RCTs of mobile app–based interventions in adults with clinical depression and depressive symptoms as a primary outcome; search conducted May 7, 2020, for articles published through May 1, 2020. Screening identified 2083 unique records and 22 eligible studies.
- Data extraction used a 5-element framework of minimum necessary DMHI engagement reporting: (1) recommended app use/adherence criteria, (2) rate of uptake, (3) level of app use (number of uses and time spent), (4) duration of use (weekly use patterns and final-week use), and (5) number of intervention completers. Intervention details and whether backend or self-report data quantified app usage were also extracted.
Limitations
- Stated: findings are limited to depression interventions in psychiatric samples using mobile app–based interventions; the original goal of quantifying typical engagement shifted because of variability and absence of metrics; only academic sources were reviewed, excluding private-industry reports; and the review covers literature only through May 2020.
- Evident from the text: the review cannot itself quantify standard engagement because of underreporting, and the authors note it is unclear how far the findings generalize to mobile app interventions in other areas of mental health.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
10 Valid · 0 Not valid · 14 Not checked · 52 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In the last 10 years, several large implementation studies of DMHIs have shown that the majority of patients offered these interventions do not engage at the recommended frequency or complete the full course of treatment [4-6].”
§ Digital Mental Health Interventions for Depression: Scoping Review of User Engagement > Introduction
What the sources say
- Supportedcites [4] Gilbody S Brabyn S Lovell K Kessler D Devlin T Smith L Araya R Barkham M Bower P Cooper C Knowles S Littlewood E Richards DA Tallon D White D Worthy G REEACT collaborative Telephone-supported computerised cognitive-behavioural therapy: REEACT-2 large-scale pragmatic randomised controlled trial Br J Psychiatry 2017 05 210 5 362 367 10.1192/bjp.bp.116.192435 28254959 S0007125000281439 28254959 source
The Results describe REEACT-2 as a large pragmatic trial, and Adherence and adverse events reports that only 10.4% of minimally supported and 19.4% of telephone-facilitated participants completed all five sessions. Fewer than half in either group completed even two sessions. The paper therefore supports the cited sentence as one example of low engagement and completion; it does not alone establish the findings of the other studies cited alongside it. (LLM, conf=0.90)
- Not checked yetcites [5] Cavanagh K Seccombe N Lidbetter N The Implementation of Computerized Cognitive Behavioural Therapies in a Service User-Led, Third Sector Self Help Clinic Behav. Cogn. Psychother 2011 02 22 39 4 427 442 10.1017/s1352465810000858 21338531 source
- Partly supportedcites [6] Hensel JM Shaw J Ivers NM Desveaux L Vigod SN Cohen A Onabajo N Agarwal P Mukerji G Yang R Nguyen M Bouck Z Wong I Jeffs L Jamieson T Bhatia RS A Web-Based Mental Health Platform for Individuals Seeking Specialized Mental Health Care Services: Multicenter Pragmatic Randomized Controlled Trial J Med Internet Res 2019 06 04 21 6 e10838 10.2196/10838 31165710 v21i6e10838 31165710 PMC6684216 sourceExperimental — accuracy not yet measured
The Results (Uptake, Use, and Satisfaction With the Intervention) show low use in this large trial: among 542 participants offered immediate access, the median was two logins over the study period. The Discussion (Comparison With Other Studies) also reports that fewer than 20% completed all modules in another large pragmatic trial. But this paper does not establish a recommended frequency or full course for its own multicomponent intervention; it says an adequate dose is difficult to define. (LLM, conf=0.84)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Finally, several recent reviews have explored variables related to user engagement with DMHIs [8,9,18].”
§ Digital Mental Health Interventions for Depression: Scoping Review of User Engagement > Introduction
What the sources say
- Supportedcites [8] Borghouts J Eikey E Mark G De Leon C Schueller SM Schneider M Stadnick N Zheng K Mukamel D Sorkin DH Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review J Med Internet Res 2021 03 24 23 3 e24387 10.2196/24387 33759801 v23i3e24387 33759801 PMC8074985 source
The Introduction (Background) identifies this paper as a systematic review of barriers and facilitators influencing engagement with DMHIs. The Discussion (Principal Findings) reports that it synthesized factors affecting that engagement, so it is an example of the reviews described in the citing sentence. (LLM, conf=0.93)
- Supportedcites [9] Arnold C Farhall J Villagonzalo K Sharma K Thomas N Engagement with online psychosocial interventions for psychosis: A review and synthesis of relevant factors Internet Interv 2021 09 25 100411 10.1016/j.invent.2021.100411 34401370 S2214-7829(21)00051-8 34401370 PMC8350605 source
The Discussion identifies this paper as a review of 18 variables potentially relevant to engagement with digital interventions among people with psychosis. It therefore supports its use as one example of the reviews cited, with that population-specific scope. (LLM, conf=0.93)
- Supportedcites [18] Amagai S Pila S Kaat AJ Nowinski CJ Gershon RC Challenges in Participant Engagement and Retention Using Mobile Health Apps: Literature Review J Med Internet Res 2022 04 26 24 4 e35120 10.2196/35120 35471414 v24i4e35120 35471414 PMC9092233 source
The Methods (Data Extraction and Analysis; page not given) describe a literature review that examined factors affecting retention and themes related to engagement. The paper covers mobile health apps broadly, including mental health apps; as one of several citations, it supports identifying a recent review relevant to engagement with digital mental health interventions. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly, concerns related to sustained engagement with web-based psychiatric interventions have been reported in routine-care implementation studies [4-6,17].”
§ Digital Mental Health Interventions for Depression: Scoping Review of User Engagement > Discussion > Principal Findings
What the sources say
- Supportedcites [4] Gilbody S Brabyn S Lovell K Kessler D Devlin T Smith L Araya R Barkham M Bower P Cooper C Knowles S Littlewood E Richards DA Tallon D White D Worthy G REEACT collaborative Telephone-supported computerised cognitive-behavioural therapy: REEACT-2 large-scale pragmatic randomised controlled trial Br J Psychiatry 2017 05 210 5 362 367 10.1192/bjp.bp.116.192435 28254959 S0007125000281439 28254959 source
The Adherence and adverse events section (p. 365) reports that few participants completed all five sessions of computerised CBT, even with telephone facilitation. The Strengths and limitations section describes the trial as pragmatic and recruited from primary care, supporting the claim’s routine-care context. (LLM, conf=0.88)
- Not checked yetcites [5] Cavanagh K Seccombe N Lidbetter N The Implementation of Computerized Cognitive Behavioural Therapies in a Service User-Led, Third Sector Self Help Clinic Behav. Cogn. Psychother 2011 02 22 39 4 427 442 10.1017/s1352465810000858 21338531 source
- Supportedcites [6] Hensel JM Shaw J Ivers NM Desveaux L Vigod SN Cohen A Onabajo N Agarwal P Mukerji G Yang R Nguyen M Bouck Z Wong I Jeffs L Jamieson T Bhatia RS A Web-Based Mental Health Platform for Individuals Seeking Specialized Mental Health Care Services: Multicenter Pragmatic Randomized Controlled Trial J Med Internet Res 2019 06 04 21 6 e10838 10.2196/10838 31165710 v21i6e10838 31165710 PMC6684216 source
The Conclusions state that many participants did not engage with the web-based application on an ongoing basis. The Discussion describes the trial as part of a large provincial implementation program using a real-world approach to evaluation. Page numbers were not provided in our copy. (LLM, conf=0.93)
- Partly supportedcites [17] Melville KM Casey LM Kavanagh DJ Dropout from Internet-based treatment for psychological disorders Br J Clin Psychol 2010 11 49 Pt 4 455 71 10.1348/014466509X472138 19799804 bjcp840 19799804 sourceExperimental — accuracy not yet measured
The Overview reports that participants in internet-based psychological treatment often fail to complete sessions or drop out, supporting the concern about sustained engagement. The Extent of Dropout section reviews treatment studies, but does not establish that the reported concerns came from routine-care implementation studies. Page numbers are unavailable in our copy. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“but this was only the case in 1 of the reviewed studies [36].”
§ Digital Mental Health Interventions for Depression: Scoping Review of User Engagement > Discussion > Principal Findings
What the sources say
- Supportedcites [36] O'Toole MS Arendt MB Pedersen CM Testing an App-Assisted Treatment for Suicide Prevention in a Randomized Controlled Trial: Effects on Suicide Risk and Depression Behav Ther 2019 03 50 2 421 429 10.1016/j.beth.2018.07.007 30824256 S0005-7894(18)30099-6 30824256 source
The citing sentence offers this paper as the single reviewed study that reported an alternative engagement metric (number of clicks). Our copy does exactly that: the Methods (p. 8) state 'Total app activity was calculated as the sum of all clicks regardless of the type of click,' the Results (p. 13) report the mean number of total clicks (297.9, SD = 180.3) among the 50 active users, and the moderation analyses (pp. 10, 15) use total number of clicks as a usage predictor. The 'only 1 of the reviewed studies' count is the citing authors' own review statistic, not a claim attributed to this source, so nothing here is unsupported. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It could lead to underestimating the intervention effect especially if a dose-response relationship exists [11].”
§ Digital Mental Health Interventions for Depression: Scoping Review of User Engagement > Introduction
What the sources say
- Partly supportedcites [11] Donkin L Christensen H Naismith SL Neal B Hickie IB Glozier N A systematic review of the impact of adherence on the effectiveness of e-therapies J Med Internet Res 2011 08 05 13 3 e52 10.2196/jmir.1772 21821503 v13i3e52 21821503 PMC3222162 sourceExperimental — accuracy not yet measured
The Introduction (p. 1) supplies the dose–response half of the claim: in pharmaceutical trials 'a dose–response curve is often plotted ... and adherence is considered highly influential within this. In e-therapy, adherence may be just as important a consideration', and the Discussion (p. 9) links module completion/program exposure to outcome while noting null adherence-outcome findings 'might be explained by lack of power'. However, no passage of our copy states that low engagement leads to UNDERESTIMATING the intervention effect; the only 'underestimate' language in the paper (Discussion > Implications for Future Work, p. 9) concerns objective measures underestimating a user's USAGE/dose, not the effect size, and the dose–response framing is drawn from medication trials with a recommendation that e-therapy studies randomise participants to different doses. That inferential step is the citing authors' own. (LLM, conf=0.65)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
38 more claims · 1 with their cited sources checked
Create a free account to see all 76 claims and to verify the 21 references still open.
- Probably not a substantial claim. 22
- It may state two separate claims as one. 18
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“As noted, engagement with mHealth interventions can be highly variable29,30.”
From Selecting and describing control conditions in mobile health randomized controlled trials: a proposed typology (2023) · cites this paper as [30]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“depression has been shown to negatively impact intervention engagement [31]”
From Feasibility and Preliminary Efficacy of Digital Interventions for Depressive Symptoms in Working Adults: Multiarm Randomized Controlled Trial (2023) · cites this paper as [31]
Experimental — accuracy not yet measured
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“The creation of this report was guided by the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Extension for Scoping Reviews (Multimedia Appendix 1) [20].”
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 1×
“Furthermore, as discussed by Eysenbach [12], if a participant did not significantly engage with an intervention, it is difficult to conclude that the intervention produced a positive outcome even if such outcomes were observed.”
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 1×
“While face-to-face, evidence-based psychotherapy remains the first-line treatment option for mild to moderate depression [1], emerging literature on DMHIs suggests that these too could be an effective stand-alone or supplemental treatment option [2,3].”
Self-citationBorghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · cited 2×
“Finally, several recent reviews have explored variables related to user engagement with DMHIs [8,9,18].”
A Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876 · cited 1×
“It could lead to underestimating the intervention effect especially if a dose-response relationship exists [11].”
Linardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2019) · World Psychiatry · doi:10.1002/wps.20673 · Cited by 860 · cited 1×
“While face-to-face, evidence-based psychotherapy remains the first-line treatment option for mild to moderate depression [1], emerging literature on DMHIs suggests that these too could be an effective stand-alone or supplemental treatment option [2,3].”
Dropout from Internet‐based treatment for psychological disorders
Melville, K. M., Casey, L. M., & Kavanagh, D. J. (2010) · British Journal of Clinical Psychology · doi:10.1348/014466509x472138 · Cited by 597 · cited 1×
“Similarly, concerns related to sustained engagement with web-based psychiatric interventions have been reported in routine-care implementation studies [4-6 , 17].”
Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546 · cited 1×
“For example, study dropout or study attrition has been evaluated as a proxy for treatment dropout, with findings suggesting significant dropout [16-18].”
Self-citation
Cited by
Lipschitz, J. M., Pike, C. K., Hogan, T. P., Murphy, S. A., & Burdick, K. E. (2023) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-023-00297-3 · Cited by 225
Self-citationEngagement and retention in digital mental health interventions: a narrative review
Boucher, E. M., & Raiker, J. S. (2024) · BMC Digital Health · doi:10.1186/s44247-024-00105-9 · Cited by 181
“Although many DMHIs are criticized for low engagement and retention rates, engagement rates tend to be underreported in published research [6] and are rarely reported publicly for available DMHIs (though there are services that provide estimates of app engagement for a fee).”
BackgroundEaton, C. K., Vallejo, N., McDonald, X., Wu, J., Rodríguez, R., Muthusamy, N., Mathioudakis, N. N., & Riekert, K. A. (2024) · Journal of Medical Internet Research · doi:10.2196/50508 · Cited by 140
“…dosage of medication on a strict schedule and trials of in-person behavior change interventions (traditional therapy) in which participants are given therapy regimens and expectations for participation (eg, attend 12 therapy sessions and complete assigned homework each week of treatment) [11].”
Goldberg, S. B., Sun, S., Carlbring, P., & Torous, J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00923-7 · Cited by 75
Self-citationEngagement and attrition in digital mental health: current challenges and potential solutions
Smith, K., Ward, T., Lambe, S., Ostinelli, E. G., Blease, C., Gant, T., Gold, S. M., Holmes, E. A., Paccoud, I., Vinnikova, A., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01778-w · Cited by 98
“For example, in a scoping review focussing on DMHIs for depression, only 59% (13/22) of studies reported usage statistics 10 .”
Self-citationBear, H. A., Ayala‐Nunes, L., Ramos, G., Manchanda, T., Fernandes, B., Chabursky, S., Walper, S., Watkins, E. R., & Fazel, M. S. (2024) · Journal of Medical Internet Research · doi:10.2196/48964 · Cited by 78
“This is consistent with the literature that suggests that the majority of those offered these app-based interventions do not engage at the recommended frequency or complete the full course of treatment [58,59].”
(2024) · doi:10.2196/49660 · Cited by 45
“Although uptake and adherence to digital therapy in the research setting have shown improvement [13], engagement is still low, particularly in routine mental health care [14-17].”
BackgroundUnderstanding Disengagement in Just-in-Time Mobile Health Interventions
Park, J., & Lee, U. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3596240 · Cited by 48
“According to a recent survey [55], low completion rates of less than 50% are relatively common in digital mental health interventions.”
BackgroundA meta-analysis of persuasive design, engagement, and efficacy in 92 RCTs of mental health apps
Valentine, L., Hinton, J. D. X., Bajaj, K., Boyd, L., O’Sullivan, S., Sorenson, R. P., Bell, I., Vega, M. S., Liu, P., Peters, W., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01567-5 · Cited by 56
Digital mental health care: five lessons from Act 1 and a preview of Acts 2–5
Insel, T. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00760-8 · Cited by 35
Artificial intelligence in mental healthcare: an overview and future perspectives
Jin, K. W., Li, Q., Xie, Y., & Xiao, G. (2023) · British Journal of Radiology · doi:10.1259/bjr.20230213 · Cited by 62
The impact of mindfulness apps on psychological processes of change: a systematic review
Macrynikola, N., Mir, Z., Gopal, T., Rodriguez, E., Li, S., Cox, M., Yeh, G. Y., & Torous, J. B. (2024) · npj Mental Health Research · doi:10.1038/s44184-023-00048-5 · Cited by 42
“The lack of consensus on engagement metrics is a recognized challenge in the mHealth space 79,80 , as is the dif fi culty sustaining engagement over time 81 .”
Self-citationEltahawy, L., Essig, T., Myszkowski, N., & Trub, L. R. (2023) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2023.100035 · Cited by 42
Wang, Y., Li, X., Zhang, Q., Yeung, D. Y.-L., & Wu, Y. (2025) · JMIR mhealth and uhealth · doi:10.2196/63806 · Cited by 77
Predictors of adherence to a publicly available self-guided digital mental health intervention
Woolley, M. G., Klimczak, K. S., Davis, C. H., & Levin, M. E. (2024) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2024.2341807 · Cited by 27
“…such as cognitive behavioral therapy and acceptance and commitment therapy (ACT), have shown that program completion rates often fall below 50%, and the majority of trial participants typically do not reach full completion of these programs (Klimczak et al., 2023; Lipschitz et al., 2022).”
Zainal, N. H., Wang, V. Y., Garthwaite, B., & Curtiss, J. E. (2025) · Health Psychology Review · doi:10.1080/17437199.2025.2547610 · Cited by 37
“Trials of empirically-supported DMHIs, including acceptance and commitment therapy (ACT) and cognitive–behavioural therapy (CBT), show engagement rates often fall below 50%, with most users not completing all modules (Klimczak et al., 2023; Lipschitz et al., 2022).”
Chau, L. W., Lam, R. W. M., Minas, H., Hayashi, K., Nguyen, V. C., & O’Neil, J. (2025) · JMIR Mental Health · doi:10.2196/68296 · Cited by 39
“Conversely, poor usability is a primary reason for low user engagement, limiting clinical utility and resulting in the failed adoption of DMHIs [32,33].”
Taylor, R. W., Male, R., Economides, M., Bolton, H., & Cavanagh, K. (2023) · JMIR Formative Research · doi:10.2196/41590 · Cited by 15
“As depression has been shown to negatively impact intervention engagement [31], we deemed it necessary to establish acceptability and report on app engagement in this novel study population.”
Nogueira-Leite, D., Marques‐Cruz, M., & Cruz-Correia, R. J. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02488-1 · Cited by 20
“Previous work has shown that despite interest in mental health apps among students, the use of these apps can be limited [57–59].”
BackgroundFitzpatrick, S., Crenshaw, A. O., Donkin, V., Collins, A., Xiang, A., Earle, E., Goenka, K., Varma, S., Bushe, J., McFadden, T., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/58198 · Cited by 20
“It is important to note that retention is measured differently across studies (eg, completing all vs half of the intervention modules) [44].”
Nordberg, S. S., Jaso, B. A., Sah, P., Schuler, K. L., Eyllon, M., Pennine, M., Hoyler, G. H., Barnes, J. B., Murillo, L., O’Dea, H., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/54528 · Cited by 19
Zainal, N. H., Tan, H. H., Hong, R. Y. S., & Newman, M. G. (2024) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2024.102858 · Cited by 17
Armaou, M. (2024) · Social Sciences · doi:10.3390/socsci13020114 · Cited by 13
“Such findings have driven calls to develop clear criteria in reporting on intervention engagement (Lipschitz et al. 2022, 2023).”
Valentine, L., Arnold, C., Nicholas, J., Castagnini, E., Malouf, J., Álvarez‐Jiménez, M., & Bell, I. (2024) · Journal of Medical Internet Research · doi:10.2196/63732 · Cited by 9
“This theme aligns with broader findings in the digital mental health literature that demonstrates maintaining engagement, particularly in real-world contexts, remains a considerable challenge, with many interventions experiencing low rates of sustained use [42-45].”
Espel-Huynh, H. M., Wang, L., Lattie, E. G., Wickham, R. E., Varra, A., Chen, C. E., Lungu, A., & Lee, J. L. (2024) · Journal of Medical Internet Research · doi:10.2196/60502 · Cited by 9
“Demonstrating correspondence between engagement and clinical outcomes is imperative when evaluating blended care therapy models and digital mental health intervention components, especially given that digital engagement is typically lower than intended or desired for these interventions [44,45].”
Reilly, E. D., Kelly, M. M., Grigorian, H. L., Waring, M. E., Quigley, K. S., Hogan, T. P., Heapy, A. A., Drebing, C. E., Volonte, M., Kathawalla, U., et al. (2024) · JMIR Formative Research · doi:10.2196/56437 · Cited by 14
Self-citationLukka, L., Karhulahti, V., Bergman, V.-R., & Palva, J. M. (2024) · Internet Interventions · doi:10.1016/j.invent.2023.100706 · Cited by 15
“However, new interventions often suffer from low behavioral engagement (Fleming et al., 2018; Lipschitz et al., 2022; Ng et al., 2019; Torous et al., 2020): 40 % of people drop out before completing 25 % of treatment modules (Karyotaki et al., 2015).”
BackgroundUser journey method: a case study for improving digital intervention use measurement
Lukka, L., Vesterinen, M., Salonen, A., Bergman, V.-R., Torkki, P. M., Palva, S., & Palva, J. M. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12641-9 · Cited by 9
“When the users are found, their indicated interest does not necessarily lead to sufficient use [5], and dropping out is common [6–8], which diminishes the intervention effectiveness [9, 10].”
InfluentialWho engages in well-being interventions? An analysis of a global digital intervention study
Park, Y., Guevarra, D. A., Simon-Thomas, E. R., & Epel, E. S. (2024) · The Journal of Positive Psychology · doi:10.1080/17439760.2024.2417098 · Cited by 7
“…this body of work is quite challenging, partly due to the varying ways in which engagement has been operationalized across different studies (Bijkerk et al., 2023; Lipschitz et al., 2022), as well as the differing content of the interventions themselves, which also affects engagement levels.”
Dahne, J., Wahlquist, A. E., Carpenter, M. J., Graboyes, E. M., Lejuez, C. W., Kustanowitz, J., Natale, N., Levins, O., Player, M. S., & Díaz, V. A. (2025) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2025.0494 · Cited by 10
Universal digital mental health interventions for children and youth: a scoping review
Pierdomenico, K. D., Bucsea, O., Leguia, A., Hashemi, H., Lovegrove, A., Cribbie, R. A., & Riddell, R. P. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1665975 · Cited by 12
Baee, S., Eberle, J. W., Baglione, A. N., Spears, T., Lewis, E., Wang, H., Funk, D., Teachman, B. A., & Barnes, L. E. (2024) · JMIR Mental Health · doi:10.2196/51567 · Cited by 9
Zhang, Z., Sun, S., Moradbakhti, L., Hall, A., Mougenot, C., Chen, J., & Calvo, R. A. (2025) · JMIR Mental Health · doi:10.2196/67190 · Cited by 8
Sustained engagement with a digital youth mental health platform: A mixed-methods study
Valentine, L., Nicholas, J., Sorenson, R. P., Chen, N. A., McEnery, C., Louis, S., Cross, S. P. M., Mangelsdorf, S. N., O’Sullivan, S., Wren, T. W., et al. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100899 · Cited by 7
“Despite the promise of DMHIs, one of the most persistent implementation challenges is low engagement (Fleming et al., 2018; de Beurs et al., 2017; Lipschitz et al., 2022; Torous et al., 2025).”
Kanamori, S., Imamura, K., Inagawa, Y., Yamauchi, T., Ikeda, H., Okuyama, T., Muto, G., Kato, R., Iida, M., Asaoka, H., et al. (2025) · Journal of Occupational Health · doi:10.1093/joccuh/uiaf035 · Cited by 6
Human-Centered Design and Digital Transformation of Mental Health Services
Fleming, W. J., Coutts, A. P., Pochard, D., Trivedi, D. P., & Sanderson, K. A. (2025) · JMIR Human Factors · doi:10.2196/66040 · Cited by 13
“Therefore, continued use of the apps is low, with high attrition [68,70,71].”
Witte, N. A. J. D., Best, P., Torous, J. B., Mulvenna, M. D., Assche, E. V., Mathiasen, K., Kleiboer, A. M., Carlbring, P., & Daele, T. V. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100927 · Cited by 8
Self-citationHaderlein, T. P., Guzman-Clark, J., Dardashti, N., McMahon, N., Duran, E. L., Haun, J. N., Robinson, S. A., Blok, A. C., Cutrona, S. L., Lindsay, J. A., et al. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-023-08488-7 · Cited by 8
Self-citationDavis, C. A., Miller, M. L., & McLean, C. P. (2024) · JMIR mhealth and uhealth · doi:10.2196/49393 · Cited by 5
“Even among apps for more common mental health concerns, robust reporting on usage metrics remains scant [27].”
BackgroundEustis, E. H., Nauphal, M., Jaso, B. A., Spencer-Laitt, D., Woodard, L. S., Farchione, T. J., & Barlow, D. H. (2024) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2024.07.003 · Cited by 7
Bear, H. A., Money, C., Watkins, E. R., & Fazel, M. S. (2025) · BJPsych Open · doi:10.1192/bjo.2025.48 · Cited by 4
“8,10,13,16,17 Research suggests that the majority of those offered these app-based interventions do not engage at the recommended frequency or complete the full course of treatment.”
Wu, Z., Luo, F., Wang, S., hu, X., & Chen, M. (2025) · JMIR Cancer · doi:10.2196/64754 · Cited by 8
“Conversely, the observed timeline for depression interventions aligns with prior findings that app engagement, typically highest at initial download but declining over time, yields minimal effects on depressive symptoms [55].”
Investigating the Role of Situational Disruptors in Engagement with Digital Mental Health Tools
Bhattacharjee, A., Williams, J. J., Beltzer, M., Meyerhoff, J., Kumar, H., Song, H., Mohr, D. C., Mariakakis, A. T., & Kornfield, R. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757487 · Cited by 10
“The program spanned eight weeks, which aligns with typical durations for clinical DMH interventions and is comparable to the expected engagement period required for people to benefit from in-person therapy [127, 140].”
Smith, A., Mangelsdorf, S. N., Baker, S. T. E., Jafari, J., Álvarez‐Jiménez, M., Hitchcock, C., & Cross, S. P. M. (2025) · Journal of Medical Internet Research · doi:10.2196/73793 · Cited by 4
“Consistent with prior research in digital mental health [57], we defined engagement as at least 1 day of activity on the platform, which included completing the demographic and mental health questionnaires, as well as the character strengths questionnaire.”
InfluentialFunk, J., Kopf‐Beck, J., Takano, K., Watkins, E. R., & Ehring, T. W. (2025) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2024.102014 · Cited by 7
“Importantly, usage rates of self-help apps designed to reduce mental health problems vary considerably (Lipschitz et al., 2022), whereby individuals with more frequent app use experience greater benefits (Crookston et al., 2017).”
Zarski, A., Sextl-Plötz, T., Schmidt-Hantke, J., Hess, N. S., & Buntrock, C. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1626428 · Cited by 5
Kim, G. S., Baek, S., Kim, L., & Kwon, S. (2025) · Journal of Medical Internet Research · doi:10.2196/78810 · Cited by 5
“Upon reviewing measurement tools for user engagement [9,13], the engagement index and time were found to be comprehensive elements capable of measuring app feature utilization.”
Peiper, N. C., Pettitt, A., Shah, B., Atwood, O., Sivonen, E., & Pfeffer, J. (2025) · JMIR Formative Research · doi:10.2196/71828 · Cited by 5
“DMHIs have been shown to address a number of structural barriers to care, including access, cost, and stigma [14,15].”
Help Is Just a Message Away: Online Counselling Chat Services Bridging Gaps in Youth Mental Health?
Dewaele, A., Denayer, E., Cabello, M., Higuera-Lozano, I., Pitkänen, T., Felvinczi, K., Kaló, Z., Soininvaara, S., & Goossens, L. (2025) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe15120257 · Cited by 9
“Lipschitz et al. (2022) propose harmonized reporting of engagement metrics, while Lagan et al. (2021) advocate for integrated frameworks that balance usability with clinical impact.”
Baker, J. A., Kendal, S., Bojke, C., Louch, G., Halligan, D., Shafiq, S., Sturley, C., Walker, L. E., Brown, M., Berzins, K. M., et al. (2024) · Health and Social Care Delivery Research · doi:10.3310/udbq8402 · Cited by 4
Gould, C. E., Carlson, C., Wetherell, J. L., Goldstein, M. K., Anker, L. A., & Beaudreau, S. A. (2024) · JMIR Aging · doi:10.2196/56959 · Cited by 5
Bernstein, E. E., Daniel, K. E., Miyares, P. E., Hoeppner, S. S., Bentley, K. H., Snorrason, Í., Fisher, L. B., Greenberg, J. L., Weingarden, H. M., Harrison, O., et al. (2025) · JMIR Mental Health · doi:10.2196/63497 · Cited by 4
“For example, a recent scoping review of digital mental health interventions for depression reported attrition rates across 11 studies ranging from 7% to 85.6% and only 50% or fewer participants completed their given digital intervention as intended [16].”
InfluentialZainal, N. H., & Newman, M. G. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.120963 · Cited by 2
Ainslie, M., Corvini, M., & Chadbourne, J. (2023) · JMIR Formative Research · doi:10.2196/48232 · Cited by 3
“While these findings echo recommendations previously noted by Lipschitz et al [6], this work emphasizes the need for continual reassessment of the most supportive care delivery modality to recognize that the therapeutic needs of the patient change rapidly due to many nonclinical and clinical…”
BackgroundMethodInfluentialPettitt, A., Nelson, B. W., Forman‐Hoffman, V. L., Goldin, P. R., & Peiper, N. C. (2024) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12517 · Cited by 4
Campos, F. A. A. C., Feitosa, F. B., Moll, M. F., Reis, I. D. O., García, J. C. S., & Ventura, C. A. A. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22020310 · Cited by 6
“…that mental health apps have accessibility, which is expressed through the inclusion of diversities and human particularities, being a factor that influences engagement [41,43,49], which represents the user’s involvement in using a mental health app and performing their tasks/actions [58].”
Hauck, J., Gegner, C., Giglberger, M., & Hilbert, S. (2025) · Digital Health · doi:10.1177/20552076251351805 · Cited by 3
“88 – 91 Furthermore, the inherent simplicity and memorability of the application ’ s exercises may have allowed participants to internalize them after minimal time, facilitating independent practice without digital assistance.”
HR PRACTICES ADDRESSING MENTAL HEALTH CHALLENGES AMONG GEN Z
Sugiharti, S., Kiswoyo, K., Abdullah, A., Sumiati, T., & Dwi, H. W. (2024) · International Conference of Business and Social Sciences · doi:10.24034/icobuss.v4i1.634 · Cited by 3
“Organizations may easily adopt digital mental health services to suit the mental health needs of Gen Z workers who are used to using technology for self-care and support (Lattie et al., 2019; Lipschitz et al., 2022; Himle et al., 2022).”
Graboyes, E. M., Levins, O., DeMass, R., Baskar, N., Natale, N., Sterba, K. R., Obeid, J. S., Sharma, S., Hill, E. G., & Dahne, J. (2025) · Psycho-Oncology · doi:10.1002/pon.70309 · Cited by 2
Varsi, C., Børøsund, E., Ehlers, S. L., Clark, M. M., Andrykowski, M. A., & Nes, L. S. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1703540 · Cited by 1
Wahyuni, S., & Triyanto, E. (2026) · Al-Rafidain Journal of Medical Sciences · doi:10.54133/ajms.v10i1.2678 · Cited by 2
Gugel, J., Rauschenberg, C., Paetzold, I., Schick, A., Wierzba, E., Hirjak, D., Boehnke, J. R., Boecking, B., & Reininghaus, U. (2026) · Journal of Medical Internet Research · doi:10.2196/77150 · Cited by 3
“Given that engagement in digital interventions and real-world uptake shows high variability [88-90], it is crucial to further examine how to develop appealing tasks individuals are prepared to use in their daily life.”
Peiper, N. C., Pettitt, A., Shah, B., Atwood, O., & Pfeffer, J. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/8adpu · Cited by 2
Gugel, J., Paetzold, I., Rauschenberg, C., Schick, A., Hirjak, D., Boehnke, J. R., Boecking, B., & Reininghaus, U. (2025) · doi:10.2196/preprints.77150 · Cited by 1
Nogueira-Leite, D., Marques‐Cruz, M., & Cruz-Correia, R. J. (2023) · doi:10.2196/preprints.46384
Lukka, L., Karhulahti, V., Bergman, V.-R., & Palva, J. M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4578807
Reflections on Integrating a Therapist-guided CBT Website Into Routine Clinical Practice
Lapidos, A., & Parikh, S. V. (2024) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000808 · Cited by 1
Khalil, A., Azhar, Z. I., Shuib, N., Baker, P., & Chen, X. W. (2024) · medRxiv · doi:10.1101/2024.12.20.24319466
Smith, A., Mangelsdorf, S. N., Baker, S. T. E., Jafari, J., Álvarez‐Jiménez, M., Hitchcock, C., & Cross, S. P. M. (2025) · doi:10.2196/preprints.73793
Universal Digital Mental Health Interventions for Children and YouthPreprint
Pierdomenico, K. D., Bucsea, O., Leguia, A., Hashemi, H., Lovegrove, A., Cribbie, R. A., & Riddell, R. P. (2025) · Research Square · doi:10.21203/rs.3.rs-6473660/v1
Jung, G., Lim, H., Han, K., Kim, H., & Lee, U. (2025) · JMIR Human Factors · doi:10.2196/64967 · Cited by 3
“A recent study [17] suggested similar metrics for measuring engagement, categorizing them into individual-level metrics, such as launch counts, use durations, and long-term use patterns, and population-level metrics, including the ratio of users who open the app at least once and the number of…”
Ko, E., Rose, K. M., Gordon, K. C., Kim, S., Gao, Y., Wang, P., Wijayasingha, L. N., Wang, H., Stankovic, J. A., & Wright, K. (2025) · Journal of Advanced Nursing · doi:10.1111/jan.70007
“Intervention adherence can refer to how participants follow the intervention as intended (Lipschitz et al. 2022).”
Development of the Psychosocial Rehabilitation Web Application (Psychosocial Rehab App)
Campos, F. A. A. C., García, J. C. S., da Silva, G. L. G., Araujo, J. A. L., Ulloa, I. F., Caritá, E. C., Feitosa, F. B., Moll, M. F., Rodríguez, T. D. M., & Ventura, C. A. A. (2025) · Nursing Reports · doi:10.3390/nursrep15070228
Severe, J., Lapidos, A., Taubman, D. S., Sochowicz, A., Wolk, S., López, D., Biehl, A., & Parikh, S. V. (2025) · Journal of Participatory Medicine · doi:10.2196/55349
“Such a decline in frequency of use is expected and has been observed in numerous digital mental health studies [10,11,14,15,19,23-26], including those involving moodgym [[[[[[[[[[14,15]]]]]]]]]] and Moodkit [25].”
Reilly, E. D., Grigorian, H. L., Heapy, A. A., Etingen, B., Kelly, M. M., Wolkowicz, N. R., Girouard, C. M., Hogan, T. P., Bernice, K., & Bickmore, T. (2025) · JMIR Research Protocols · doi:10.2196/70601
“However, although online programs are increasing in popularity and are often as efficacious as in-person treatment, sustained engagement and retention of consumers in online treatment continue to lag [23,26].”
Self-citationKhalil, A., Azhar, Z. I., Shuib, N., Baker, P., & Chen, X. W. (2025) · PLoS ONE · doi:10.1371/journal.pone.0316960
“Evidence supports the role of digital interventions in improving access, adherence, and outcomes for managing mild to moderate depression [13].”
Setiyowati, A. J., Bariyyah, K., Pratiwi, A. S., So, H., & Hidayatullah, H. T. (2025) · doi:10.1109/icet67257.2025.11290890
“Developed correctly, digital interventions can be used to reach victims who would otherwise be disinclined or unable to seek help directly in ways which are psychologically and culturally relevant [14].”
Nogueira-Leite, D., Marques-Cruz, M., & Cruz-Correia, R. J. (2024) · Figshare · doi:10.6084/m9.figshare.26708624
Nogueira-Leite, D., Marques-Cruz, M., & Cruz-Correia, R. J. (2024) · Figshare · doi:10.6084/m9.figshare.26708633
Nogueira-Leite, D., Marques-Cruz, M., & Cruz-Correia, R. J. (2024) · Figshare · doi:10.6084/m9.figshare.26708627
Nogueira-Leite, D., Marques-Cruz, M., & Cruz-Correia, R. J. (2024) · Figshare · doi:10.6084/m9.figshare.26708630
Nogueira-Leite, D., Marques-Cruz, M., & Cruz-Correia, R. J. (2024) · Figshare · doi:10.6084/m9.figshare.26708621
Nogueira-Leite, D., Marques-Cruz, M., & Cruz-Correia, R. J. (2024) · Figshare · doi:10.6084/m9.figshare.26708636
Last, B. S., & Khazanov, G. K. (2026) · Nature Mental Health · doi:10.1038/s44220-025-00565-6 · Cited by 2
“Drop-out rates for self-guided BH technologies in research studies are around 50% and up to 85% 24–26 .”
ATEŞ, E. G. Ç., Daşcı, E., Önal, A. A., & Güç, E. (2026) · Erzincan Üniversitesi Eğitim Fakültesi Dergisi · doi:10.17556/erziefd.1804448
Maminimini, M., Gabrielli, S., & Piffer, S. A. (2026) · doi:10.2196/preprints.90855
Pinto, A., Conceição, G., Viana, J., Santos, P. J., & Freitas, A. (2025) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom60686.2025.11342516
Martens, J., Forkmann, T., & Höller, I. (2026) · JMIR Research Protocols · doi:10.2196/72138
“In terms of usability, it is assumed that adherence might be insufficient [48] and information on adherence and user engagement with the interventions might be lacking [49].”
Lakey, G., Kusosa, R., Dawe‐Lane, E., Edwards, J., Cella, M., & Simblett, S. K. (2026) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2026.2623949
Flores-Tremblay, T., & Belleville, G. (2026) · doi:10.2196/preprints.95073
Feasibility of social media health education plus exercise in older adults with possible sarcopenia
Shi, Y., Stanmore, E., McGarrigle, L., Wang, X. H., Gu, C., Ye, Y., & Todd, C. J. (2026) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2026.105467 · Cited by 2
Roos, C. R., Witkiewitz, K. A., Bowen, S. W., Kiluk, B. D., Bricker, J. B., Mun, C. J., Baillet, E., John, M., & Kober, H. (2026) · Mindfulness · doi:10.1007/s12671-026-02836-4
Levinson, C. A., Brosof, L. C., Stancil, J., Fitterman-Harris, H. F., Tilquist, M., McCarthy, A., Cohen, Z. D., & Craske, M. G. (2026) · Behavior Therapy · doi:10.1016/j.beth.2026.05.001
Yang, H., Liu, J., Chen, S., Mao, Y., Lai, K.-H., Wu, X., Jiang, R., & Cheng, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-9664215/v1
Yap, L. K., Ennis, E., Mulvenna, M. D., & Carracedo, J. M. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2696826 · Cited by 1
Mattera, D. (2026) · Latin-American Journal of Computing · doi:10.33333/lajc.vol13n2.05
“…mental health applications enable, unprecedented forms of longitudinal monitoring of emotional states through systematic records, psychological assessment scales, affect regulation exercises, and crisis intervention tools (Berrouiguet et al., 2016; Lipschitz et al., 2022; Lehtimäki et al., 2021).”
Jordan, E. J., Woolley, M. G., Gowan, T. M., West, J. R., Hoy, M. S., Twohig, M. P., & Johns, S. A. (2026) · doi:10.2196/preprints.106490
Delivery Model Matters for Digital Interventions in Pain Self-Management: Mixed Methods Study
Nes, L. S., Børøsund, E., Nordang, E. F., Asbjørnsen, R. A., Eide, H., Varsi, C., Waxenberg, L. B., Weiss, K. E., Morrison, E. J. P., Støle, H. S., et al. (2026) · Journal of Medical Internet Research · doi:10.2196/89780 · Cited by 1
“The well-known ≤ 50% adherence challenges associated with digital health interventions are concerning [67,68], and studies point to the necessity of some form of guidance to enhance intervention adherence and hence impact [33-35].”
Maciejewski, J., Lesnierowska, M., Carlbring, P., & Smoktunowicz, E. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.101006
Smoktunowicz, E., Akis, S., Stepien, M., Maciejewski, J., Lesnierowska, M., Gutral, J., & Roczniewska, M. A. (2026) · doi:10.2196/preprints.112074
Metadata
- Authors
- Lipschitz, J. M., Van Boxtel, R., Torous, J., Firth, J., Lebovitz, J. G., Burdick, K. E., & Hogan, T. P.
- Affiliations
- Brigham and Women's Hospital (US)
- Beth Israel Deaconess Medical Center (US)
- Greater Manchester Mental Health NHS Foundation Trust (GB)
- Edith Nourse Rogers Memorial Veterans Hospital (US)
- Corresponding author
- Lipschitz, Jessica M
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-10-14
- Volume
- 24
- Issue
- 10
- Pages
- e39204
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC9617183
- OpenAlex
- W4292396150
- Cited by
- 105
- References
- 43
- Citations by year
- 2026: 25 · 2025: 37 · 2024: 32 · 2023: 11
- FWCI
- 3.56
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Alliance for Research on Schizophrenia and Depression
- National Institute of Mental Health (K23MH120324)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- digital mental health interventions, depression, user engagement, engagement metrics, reporting quality, intervention uptake, intervention completion, adherence, engagement framework, digital therapeutics
- MeSH terms
- Adult, Depression, Humans, Mental Health, Patient Participation, Randomized Controlled Trials as Topic, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
