Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 250 of the 250 references it cites were found in a registry or an index; 285 of the 439 sources its claims cite were checked for support.
Abstract
Background: Digital mental health interventions (DMHIs), which deliver mental health support via technologies such as mobile apps, can increase access to mental health support, and many studies have demonstrated their effectiveness in improving symptoms. However, user engagement varies, with regard to a user's uptake and sustained interactions with these interventions. Objective: This systematic review aims to identify common barriers and facilitators that influence user engagement with DMHIs. Methods: A systematic search was conducted in the SCOPUS, PubMed, PsycINFO, Web of Science, and Cochrane Library databases. Empirical studies that report qualitative and/or quantitative data were included. Results: A total of 208 articles met the inclusion criteria. The included articles used a variety of methodologies, including interviews, surveys, focus groups, workshops, field studies, and analysis of user reviews. Factors extracted for coding were related to the end user, the program or content offered by the intervention, and the technology and implementation environment. Common barriers included severe mental health issues that hampered engagement, technical issues, and a lack of personalization. Common facilitators were social connectedness facilitated by the intervention, increased insight into health, and a feeling of being in control of one's own health. Conclusions: Although previous research suggests that DMHIs can be useful in supporting mental health, contextual factors are important determinants of whether users actually engage with these interventions. The factors identified in this review can provide guidance when evaluating DMHIs to help explain and understand user engagement and can inform the design and development of new digital interventions. © 2021 Journal of Medical Internet Research. All rights reserved.
Overview
CoChat Summary
## TL;DR
This systematic review synthesized 208 empirical articles to identify common barriers and facilitators of engagement with digital mental health interventions (DMHIs). Engagement was shaped by user characteristics, program/content fit, and technology/implementation context, with technical problems, severe symptoms, and poor personalization commonly hindering use.
## Key findings
- The review included 208 articles; study sizes ranged from 6 to more than 2 million participants, and exposure ranged from a short demonstration to up to 1 year of use.
- The authors identified 16 broader constructs influencing engagement, grouped into user-related, program-related, and technology- and environment-related factors.
- Common barriers included severe mental health issues that hampered engagement, technical issues (the primary barrier noted in 25 studies), usability issues, and lack of personalization.
- Common facilitators included social connectedness (e.g., connection to peers or therapists, reported in 18 studies), increased insight into health, and feeling in control of one’s own health.
## Methods
- Systematic review of empirical English-language peer-reviewed studies published from January 1, 2010 to December 2019 on digitally delivered mental health interventions for people aged ≥16 years.
- Searches were conducted in SCOPUS, PubMed, PsycINFO, Web of Science, and the Cochrane Library; 6146 papers were identified, 77 duplicates removed, 480 full texts reviewed, and 208 included.
- The team used inductive thematic analysis to code barriers/facilitators from abstracts, results/findings, and discussion sections, and used a quality reporting tool with 4 criteria.
## Limitations
- The paper states that the included studies were heterogeneous, so the authors could not conduct a meta-analysis.
- The paper notes inconsistency across studies in how engagement was measured (e.g., log-ins, time engaged, total time used, self-report), which makes comparison difficult.
- The review was limited to peer-reviewed empirical articles and to studies before the COVID-19 pandemic; the authors say some interventions may have been missed, and pandemic-related factors were not captured.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
104 Valid · 7 Not valid · 34 Not checked · 122 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Overall, 11 studies did not report the recruitment and/or selection process of study participants [30-40].”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Results > Quality Assessment
What the sources say
- Not matchedcites [30] Pagliari, C, 2012, Stud Health Technol Inform
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites [31] source
- Not checked — no full text of the sourcecites [32] source
- Could not verifycites [33] sourceExperimental — accuracy not yet measured
The paper’s ‘What Is Needed to Benefit From Blended Mental Health Treatment?’ section describes recruitment of therapists for its own consultations, but does not assess recruitment or selection reporting across 11 studies. Searches for the claimed count and for recruitment and selection reporting found no passage addressing it; page numbers were not available in our copy. (LLM, conf=0.75)
- Disputedcites [34] sourceExperimental — accuracy not yet measured
The Methods > Participants section reports where participants were recruited and specifies eligibility and exclusion criteria. Thus, this paper does report recruitment and selection information, contrary to the claim as applied to this cited study. The aggregate count of 11 studies cannot be assessed from this paper alone. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
- Disputedcites [35] sourceExperimental — accuracy not yet measured
The Methods > Recruitment section explicitly describes how participants were approached and selected: through personal and professional networks, followed by snowball and maximum variance sampling. Thus, this paper does not fit the citing sentence’s description of studies that failed to report recruitment and/or selection. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
- Disputedcites [36] sourceExperimental — accuracy not yet measured
The Methods section (page unavailable) reports that workshop trainees were invited to consultation groups and that those wishing to attend were assigned to groups. The Results > Participants section (page unavailable) states that 28 of 50 trainees elected to attend and explains why two were excluded from the analysis. This paper therefore reports how participants entered and were selected for the study, contrary to its inclusion among studies said not to report that process. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [37] source
- Disputedcites [38] sourceExperimental — accuracy not yet measured
The Methods > Procedure section explicitly reports how this study recruited participants: through websites, mental-health forums, social media, and word of mouth. Methods > Participants also reports how many people viewed and completed the survey. This source therefore contradicts its inclusion among studies said not to report recruitment and/or participant selection; it cannot establish the total for the other studies. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [39] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“However, evaluation studies have shown that more severe symptoms hamper actual engagement with digital interventions [51,56,83-101].”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Results > User-Related Constructs
What the sources say
- Not checked — no full text of the sourcecites [51] source
- Partly supportedcites [56] sourceExperimental — accuracy not yet measured
In Qualitative Results (page not supplied), one patient said cancer-related fatigue prevented her from completing an app exercise, supporting a limited example of symptoms hampering engagement. But Results > Maintenance reports greater continuous use among patients with higher depressive symptoms, so this study does not support the broad claim that more severe symptoms generally hamper engagement. (LLM, conf=0.85)
- Could not verifycites [83] sourceExperimental — accuracy not yet measured
The Device performance (p. 5) and Device stability (p. 7) passages concern perovskite solar cells, not people using digital interventions. Searches for symptom severity and engagement found no passage addressing whether more severe symptoms hamper use of those interventions. (LLM, conf=0.79)
- Not checked — no full text of the sourcecites [84] source
- Partly supportedcites [85] sourceExperimental — accuracy not yet measured
The Results (Engagement Conditions; no page given) report that symptom severity mattered to participants’ willingness to use the eating-disorder program: some doubted it was suitable for serious eating-disorder issues. But the study reports perceptions during usability testing, not evidence that more severe symptoms reduced actual engagement across digital interventions. The Discussion (Principal Findings; no page given) also notes that greater impairment may increase motivation in some groups. (LLM, conf=0.87)
- Disputedcites [86] sourceExperimental — accuracy not yet measured
The Feasibility section reports that completion was not significantly correlated with baseline anxiety or depression. It also notes that men with no distress were overrepresented among those who completed less than 20%; the Discussion suggests that men seeking psychological support may be more likely to complete the program. These passages do not show that more severe symptoms hamper engagement and point in the opposite direction. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Partly supportedcites [87] sourceExperimental — accuracy not yet measured
The Results (Adherence and Feasibility; page unavailable) report that higher positive-symptom scores correlated with lower diary completion, while higher negative-symptom scores correlated with lower diary completion and wearable adherence. This supports an association between symptom severity and engagement in this small schizophrenia study, but the claim’s broader wording implies a causal effect across digital interventions that the study does not establish. (LLM, conf=0.88)
- Partly supportedcites [88] sourceExperimental — accuracy not yet measured
In Results > Barriers and Facilitators (page not provided), some respondents said that people under severe psychological distress might be unwilling or unable to try the app. This supports distress as a possible barrier, but not the claim that evaluation studies showed reduced actual engagement. The Limitations section says respondents had not used a functioning app over an extended period, so their feedback could not establish that effect. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [89] source
- Partly supportedcites [90] sourceExperimental — accuracy not yet measured
The Introduction (Background; no page provided) says psychological symptoms may make mindfulness practice harder and may lead participants to disengage. But the Results (Participant Characteristics and Engagement) found no significant relationship between psychosocial characteristics and lesson completion, and the Discussion (Principal Findings) specifically found no significant association between baseline stress and engagement. This study therefore supports a possible barrier, not the claim that more severe symptoms were shown to hamper actual engagement. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Users’ engagement was facilitated by whether the intervention was endorsed by other users [43] or peers [211,241], their friends and family [97], or their current health care provider [152,161,242].”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Results > Technology- and Environment-Related Constructs
What the sources say
- Could not verifycites [43] sourceExperimental — accuracy not yet measured
Citation [242] is attached to the claim about endorsement by a user's current health care provider. The Discussion says clinician and consumer ratings may help users judge whether an intervention is appropriate and engaging, but it does not say that provider endorsement facilitates users' engagement. Searches for provider recommendations and clinician endorsement found no passage addressing that link. (LLM, conf=0.73)
- Partly supportedcites [211] sourceExperimental — accuracy not yet measured
The Results (Enabler 2: Positive Experience of the Consultation Sessions; page unavailable) describe health workers using YouTube clips as a different way to engage clients. That supports a role for providers in introducing digital resources, but the paper does not show that provider endorsement facilitated users’ engagement with a DMHI. The other endorsement sources in the citing sentence have separate citations and are not attributed to this paper. (LLM, conf=0.74)
- Disputedcites [241] sourceExperimental — accuracy not yet measured
Citation [43] is attached to endorsement by other users, not to the later claims about peers, family, or health care providers. In the Results section (page unavailable), attitudes among participants shown user testimonials did not differ significantly from the other conditions. The Discussion likewise reports no significant difference from the control group and says the effect of testimonials on uptake remains unclear. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Partly supportedcites [97] sourceExperimental — accuracy not yet measured
The Results (Posttreatment Attrition; page unavailable) report higher odds of completing posttreatment assessments among participants who heard about Anxiety Online from friends or family. This supports an association with that referral source, but the paper does not establish that friends or family endorsed the intervention or that endorsement facilitated engagement. The other sources of endorsement in the citing sentence have separate citations and are not assessed here. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although some DMHIs have been shown to be as effective as traditional mental health services (eg, psychotherapy and pharmacotherapy) in improving mental health conditions such as depression [7]”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Introduction > Background
What the sources say
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
The Results of Traditional Meta-analysis (page unavailable) report that self-guided iCBT improved depressive symptoms more than control conditions. They do not establish that it is as effective as psychotherapy or pharmacotherapy; the paper’s concluding discussion (page unavailable) notes smaller effects than face-to-face interventions. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, these analyses did not report on factors related to this variability in engagement.”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Introduction > Understanding User Engagement With DMHIs
What the sources say
- Not checked — no full text of the sourcecites [9] source
- Supportedcites [10] source
Section 3.3.4 (Satisfaction and adherence; page unavailable) reports the median and spread of adherence across trials, but does not report factors associated with that variation. Section 2.2 (Information sources; page unavailable) describes extracting adherence as course completion; the reported analysis is descriptive rather than an analysis of engagement-related factors. (LLM, conf=0.84)
- Supportedcites [11] source
The Discussion’s Summary of Evidence reports large differences in engagement but says that diverse measures make direct comparisons difficult. It calls for future reporting of intervention and implementation characteristics to help explain which approaches engage and retain users, consistent with the claim that the review did not analyze factors behind the variability. No page number is provided in our copy. (LLM, conf=0.83)
- Not checked — no full text of the sourcecites [16] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
157 more claims · 82 with their cited sources checked
Create a free account to see all 267 claims and every source verdict.
- It may state two separate claims as one. 57
- Probably not a substantial claim. 63
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Despite decades of research evidence, the uptake of DMHIs into practice is limited due to high dropout rates and poor user engagement of clients, especially in self-guided formats [2021].”
From Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 2): Participatory Design Study including Mental Health Professionals (2025) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ensure tools are convenient and useful in the context of day-to-day life, it is necessary to involve end-users across the design and development process (Mohr et al., 2017; Blandford et al., 2018; Borghouts et al., 2021; Poole, 2013).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Borghouts et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“if a product is not developed in line with the target user’s needs (eg, values, goals, and abilities) or is not engaging and intuitive to use, the likelihood of such a product being integrated, accepted, and adopted by people is low [14,20]”
From Optimization of a Transdiagnostic Mobile Emotion Regulation Intervention for University Students: Protocol for a Microrandomized Trial (2023) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A systematic review of barriers to facilitators of engagement with mobile health (mHealth) interventions reported that a user’s ability to integrate the intervention into their lives impacted engagement [53].”
From A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study (2022) · cites this paper as [53]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similar onboarding procedures have been shown to improve treatment adherence in app-based mindfulness meditation studies [49,51].”
From App-Based Mindfulness Meditation for People of Color Who Experience Race-Related Stress: Protocol for a Randomized Controlled Trial (2022) · cites this paper as [51]
Experimental — accuracy not yet measured
20 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035 · cited 6×
“Some of the themes identified in this review overlap with previous models conceptualizing engagement with digital health interventions, as well as general technology acceptance and health behavior, such as the Efficiency Model of Support [251], Technology Acceptance Model [253], and Health Belief Model [249].”
BackgroundMethodInfluentialRayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092 · cited 1×
“The search results were uploaded to Rayyan [20], a web-based software program for facilitating systematic reviews.”
MethodThe Health Belief Model: a decade later.
Janz, N. K., & Becker, M. H. (1984) · Health Education Quarterly · doi:10.1177/109019818401100101 · Cited by 8,437 · cited 2×
“…themes identified in this review overlap with previous models conceptualizing engagement with digital health interventions, as well as general technology acceptance and health behavior, such as the Efficiency Model of Support [251], Technology Acceptance Model [253], and Health Belief Model [249].”
BackgroundTechnology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159 · cited 1×
“…themes identified in this review overlap with previous models conceptualizing engagement with digital health interventions, as well as general technology acceptance and health behavior, such as the Efficiency Model of Support [251], Technology Acceptance Model [253], and Health Belief Model [249].”
BackgroundGuest, G., MacQueen, K., & Namey, E. (2012) · doi:10.4135/9781483384436 · Cited by 7,924 · cited 1×
“This process is common in qualitative research [26].”
BackgroundGulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292 · cited 3×
“In line with previous work [2], this again indicates that privacy can be important for people who experience stigma for or reluctance to help-seeking.”
BackgroundIBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429 · cited 2×
“The usability and acceptability of the technology were assessed using qualitative methods and standard measures, such as the survey based on the Unified Theory of Acceptance and Use of Technology [27], the Mobile Application Rating Scale [28], and the System Usability and After-Scenario Questionnaire [29].”
BackgroundMethodMental health literacy: empowering the community to take action for better mental health
Jorm, A. F. (2012) · American Psychologist · doi:10.1037/a0025957 · Cited by 1,783 · cited 1×
“Mental health literacy refers to knowledge about mental health symptoms and appropriate treatment options [238].”
BackgroundMohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 3×
“Although human support enhances engagement more than automated means such as email reminders [250], several studies included in our review found that such automated reminders not only facilitated engagement but were also experienced positively by users.”
BackgroundInfluentialThe association between social relationships and depression: A systematic review
Santini, Z. I., Koyanagi, A., Tyrovolas, S., Mason, C., & Haro, J. M. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.12.049 · Cited by 949 · cited 1×
“Social connectedness may be especially important for mental health interventions, as it can improve mood [254] and help combat depression [255].”
Background
Research works printed but not linked: 12
- Pagliari, C, 2012, Stud Health Technol Inform, 181, 329
- 10.2196/jmir.4972 · DOI · Paper page
- 10.2196/12869 · DOI · Paper page
- Huerta-Ramos, E, 2017, Actas Esp Psiquiatr, 45, 277
- 10.3109/09638237.2016.1139064 · DOI · Paper page
- 10.1007/s00737-018-0829-y · DOI · Paper page
- 10.2196/resprot.5450 · DOI · Paper page
- 10.2196/mental.5837 · DOI · Paper page
- 10.2196/jmir.6269 · DOI · Paper page
- 10.2196/mental.6202 · DOI · Paper page
- 10.1080/15228835.2016.1233842 · DOI · Paper page
- 10.2196/10035 · DOI · Paper page
Cited by
An overview of and recommendations for more accessible digital mental health services
Lattie, E. G., Stiles-Shields, C., & Graham, A. K. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00003-1 · Cited by 446
Artificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440
“culties with using the program or remembering to engage with it [40].”
BackgroundJakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446
“Many of these strategies and factors, such as well-designed reminders, self-monitoring features, and embedded health professional support, have been applied across various health domains [11,20,21].”
BackgroundLam, R. W., Kennedy, S. H., Adams, C., Bahji, A., Beaulieu, S., Bhat, V., Blier, P., Blumberger, D. M., Brietzke, E., Chakrabarty, T., et al. (2024) · The Canadian Journal of Psychiatry · doi:10.1177/07067437241245384 · Cited by 369
Torous, J., Linardon, J., Goldberg, S. B., Sun, S., Bell, I., Nicholas, J., Hassan, L., Hua, Y., Milton, A., & Firth, J. (2025) · World Psychiatry · doi:10.1002/wps.21299 · Cited by 323
Lipschitz, J. M., Pike, C. K., Hogan, T. P., Murphy, S. A., & Burdick, K. E. (2023) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-023-00297-3 · Cited by 225
Berardi, C., Antonini, M., Jordan, Z., Wechtler, H., Paolucci, F., & Hinwood, M. (2024) · BMC Health Services Research · doi:10.1186/s12913-023-10536-1 · Cited by 190
“…has been inconsistent, and this could be attributed to a complex interaction between patient, professional, organisational, and policy barriers [15, 17–19 Given the limited scope of previous reviews, it is critical to advance evidence synthesis in this area by identifying barriers and…”
BackgroundEngagement and retention in digital mental health interventions: a narrative review
Boucher, E. M., & Raiker, J. S. (2024) · BMC Digital Health · doi:10.1186/s44247-024-00105-9 · Cited by 181
“Relatedly, lower levels of health literacy, digital literacy, and mental health literacy have all been linked to poorer adherence to DMHIs [29, 36].”
BackgroundResultInfluentialPotential and Pitfalls of Mobile Mental Health Apps in Traditional Treatment: An Umbrella Review
Koh, J., Tng, G. Y. Q., & Hartanto, A. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12091376 · Cited by 155
“First, eight reviews found that mental health app users were commonly concerned with their confidential information being shared with third parties or used for unauthorized purposes such as marketing [9,14,18,29,39,45,46,50].”
BackgroundProviding Human Support for the Use of Digital Mental Health Interventions: Systematic Meta-review
Werntz, A., Amado, S., Jasman, M., Ervin, A., & Rhodes, J. E. (2023) · Journal of Medical Internet Research · doi:10.2196/42864 · Cited by 158
“See Multimedia Appendix 1 [3,34,47,54] for a list of studies that initially appeared to meet the inclusion criteria but were later excluded.”
Digital interventions in mental health: An overview and future perspectives
Löchner, J., Carlbring, P., Schuller, B. W., Torous, J. B., & Sander, L. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100824 · Cited by 204
“In contrast, the following facilitating factors were discussed (Borghouts et al., 2021; Graham et al., 2020): Advances in technology and quality of care, guidance from a healthcare professional, improvement in therapeutic relationship/relationship, social support through online forums or groups,…”
Ramos, G., Ponting, C., Labao, J. P., & Sobowale, K. (2021) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.103990 · Cited by 160
Digital Mental Health Interventions for Depression: Scoping Review of User Engagement
Lipschitz, J. M., Van Boxtel, R., Torous, J., Firth, J., Lebovitz, J. G., Burdick, K. E., & Hogan, T. P. (2022) · Journal of Medical Internet Research · doi:10.2196/39204 · Cited by 105
“Finally, several recent reviews have explored variables related to user engagement with DMHIs [8,9,18].”
AI-Based and Digital Mental Health Apps: Balancing Need and Risk
Hamdoun, S., Monteleone, R., Bookman, T., & Michael, K. (2023) · IEEE Technology and Society Magazine · doi:10.1109/mts.2023.3241309 · Cited by 110
Sharma, A., Rushton, K., Lin, I. W., Nguyen, T., & Althoff, T. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642761 · Cited by 201
Yeo, G., Reich, S. M., Liaw, N. A., & Chia, E. Y. M. (2023) · Journal of Medical Internet Research · doi:10.2196/51268 · Cited by 168
Taylor, H., Cavanagh, K., Field, A. P., & Strauss, C. (2022) · JMIR mHealth and uHealth · doi:10.2196/31744 · Cited by 94
“However, finding ways of encouraging engagement in unguided digital well-being interventions is a well-recognized challenge [80], and greater engagement with Headspace in comparison with an NHS-developed digital well-being offer is important in itself, as, in the real world, it is the ITT benefits that are realized ra…”
BackgroundForbes, A., Keleher, M. R., Venditto, M., & DiBiasi, F. (2023) · Journal of Medical Internet Research · doi:10.2196/43727 · Cited by 116
“Extroversion, fatigue, and more severe depression symptoms were barriers to engagement [187].”
InfluentialKlimczak, K. S., San Miguel, G. G., Mukasa, M. N., Twohig, M. P., & Levin, M. E. (2023) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2023.2178498 · Cited by 88
“However, these ACT adherence rates appear to be generally similar to those found with other online CBTs (Borghouts et al., 2021; Linardon & FullerTyszkiewicz, 2020).”
ResultRiadi, I., Kervin, L. M., Dhillon, S., Teo, K., Churchill, R., Card, K. G., Sixsmith, A. J., Moreno, S., Fortuna, K. L., Torous, J. B., et al. (2022) · The Lancet Healthy Longevity · doi:10.1016/s2666-7568(22)00121-0 · Cited by 95
Gan, D. Z. Q., McGillivray, L., Larsen, M. E., Christensen, H. M., & Torok, M. H. (2022) · Digital Health · doi:10.1177/20552076221098268 · Cited by 91
“52 Thus, it would not be possible to establish the effectiveness of a technology-supported engagement strategy if used in conjunction with a DMHI with poor user acceptability ratings.”
BackgroundWhat Is the Current and Future Status of Digital Mental Health Interventions?
Baños, R. M., Herrero, R., & Vara, M. D. (2022) · The Spanish Journal of Psychology · doi:10.1017/sjp.2022.2 · Cited by 82
“…users being less likely to engage if they do not perceive the program to be useful and personalized; and (c) technology and implementation environment, pointing to technical problems and lack of security (in terms of privacy and anonymity) as other barriers to engagement (Borghouts et al., 2021).”
BackgroundMadrid‐Cagigal, A., Kealy, C., Potts, C., Mulvenna, M. D., Byrne, M., Barry, M. M., & Donohoe, G. (2025) · Early Intervention in Psychiatry · doi:10.1111/eip.70017 · Cited by 78
“A systematic review by Borghouts et al. (2021) suggested that interventions that include some levels of prompting were associated with improved adherence but appeared agnostic about whether this needed to come from another human or was simply an automated reminder.”
Evaluation of the Use of Digital Mental Health Platforms and Interventions: Scoping Review
Balcombe, L., & Leo, D. D. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20010362 · Cited by 106
“A systematic review reported DMHIs have higher sustained engagement than self-guided digital tools [10].”
BackgroundMethodInfluentialUptake and effectiveness of a self-guided mobile app platform for college student mental health
Lattie, E. G., Cohen, K. A., Hersch, E., Williams, K. D. A., Kruzan, K. P., MacIver, C., Hermes, J., Maddi, K. L., Kwasny, M., & Mohr, D. C. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100493 · Cited by 84
Milne-Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1227443 · Cited by 69
“, 2022) identified several systematic reviews that have explored questions around this topic (O’Connor et al., 2016; Szinay et al., 2020; Wei et al., 2020; Borghouts et al., 2021), but none that analyzed how BCTs can best support the various components of engagement.”
Bell, I. H., Thompson, A., Valentine, L., Adams, S., Alvarez-Jimenez, M., & Nicholas, J. (2022) · JMIR Mental Health · doi:10.2196/30716 · Cited by 60
“Poor engagement with DMHIs has been highlighted as a significant problem in the field and has formed the focus of several reviews [17-20].”
BackgroundEngagement and attrition in digital mental health: current challenges and potential solutions
Smith, K., Ward, T., Lambe, S., Ostinelli, E. G., Blease, C., Gant, T., Gold, S. M., Holmes, E. A., Paccoud, I., Vinnikova, A., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01778-w · Cited by 91
Limpanopparat, S., Gibson, E., & Harris, D. A. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100081 · Cited by 100
Eisner, E., Faulkner, S., Allan, S., Ball, H., Basilio, D. D., Nicholas, J., Priyam, A., Wilson, P. M., Zhang, X., & Bucci, S. (2025) · JMIR Mental Health · doi:10.2196/65246 · Cited by 76
“Barriers and facilitators of engagement with DMHIs for common mental health problems (eg, depression or anxiety) were examined relatively recently [11], but the last systematic review of factors affecting DMHI implementation in samples with psychosis or bipolar disorder was 5 years ago [17].”
InfluentialKodish, T., Lau, A. S., Gong-Guy, E., Congdon, E. L., Arnaudova, I., Schmidt, M., Shoemaker, L., & Craske, M. G. (2021) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-021-01163-1 · Cited by 69
“Nonetheless, is it likely that commonly observed barriers to digital therapy engagement were at play in the present study, including factors such as limited perceived usefulness and fit, technical issues, limitations with regard to personalization and customizability, concerns about privacy and confidentiality, and li…”
BackgroundOti, O., & Pitt, I. J. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100468 · Cited by 71
Human Support in App-Based Cognitive Behavioral Therapies for Emotional Disorders: Scoping Review
Bernstein, E. E., Weingarden, H. M., Wolfe, E. C., Hall, M. D., Snorrason, Í., & Wilhelm, S. (2022) · Journal of Medical Internet Research · doi:10.2196/33307 · Cited by 62
“Currently, although coaching ostensibly outperforms automated messages or reminders in enhancing engagement with digital therapies, the latter may still provide clinically meaningful benefits and are appreciated by users [21] and fully automated chatbots and other conversational agents are becoming more sophisticated…”
BackgroundJardine, J., Nadal, C., Robinson, S., Enrique, Á., Hanratty, M., & Doherty, G. J. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3635472 · Cited by 73
Wani, C., McCann, L., Lennon, M., & Radu, C. (2024) · Journal of Medical Internet Research · doi:10.2196/51376 · Cited by 100
Habicht, J., Dina, L.-M., McFadyen, J., Stylianou, M., Harper, R., Hauser, T. U., & Rollwage, M. (2025) · Journal of Medical Internet Research · doi:10.2196/60435 · Cited by 52
“Recognizing the important role of personalization in overcoming the barrier to the uptake of digital solutions [22], our solution uses generative AI to deliver a user-centric experience.”
Acceptability of Digital Mental Health Interventions for Depression and Anxiety: Systematic Review
Lau, C. K. Y., Saad, A., Camara, B., Rahman, D., & Bolea-Alamanac, B. (2024) · Journal of Medical Internet Research · doi:10.2196/52609 · Cited by 51
“Related issues have been found with user engagement (initiation and continuation of use of a digital health intervention) [13] among digital mental health interventions.”
Understanding users’ perspectives on mobile apps for anxiety management
Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. J. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.854263 · Cited by 65
“Other facilitators that influence user engagement are social connectedness facilitated by the intervention, increased insight into health, and a feeling of being in control of one’s own health (38).”
BackgroundSelf-citationTetri, B., & Juujärvi, S. (2022) · Psychology Research and Behavior Management · doi:10.2147/prbm.s340867 · Cited by 73
“5 Both material deprivation and inadequate skills are contributing factors to digital exclusion, 1,6,7 and rapid advances in digital technology increase the barriers to digital engagement even further.”
BackgroundDigital Mental Health Interventions for Young People Aged 16-25 Years: Scoping Review
Potts, C., Kealy, C., McNulty, J. M., Madrid‐Cagigal, A., Wilson, T., Mulvenna, M. D., O’Neill, S. M., Donohoe, G. J., & Barry, M. M. (2025) · Journal of Medical Internet Research · doi:10.2196/72892 · Cited by 74
“Therefore, guided interventions usually have higher engagement rates than unguided interventions [27].”
Digital tools to support mental health: a survey study in psychosis
Eisner, E., Berry, N., & Bucci, S. (2023) · BMC Psychiatry · doi:10.1186/s12888-023-05114-y · Cited by 64
“Research in psychosis samples examining implementation barriers and facilitators is ongoing [13].”
BackgroundGoonesekera, Y., & Donkin, L. (2022) · JMIR Formative Research · doi:10.2196/37877 · Cited by 43
“The themes of technical difficulties and content delivery affecting engagement with Otis reflected the results in the systematic review by Borghouts and colleagues [53].”
BackgroundResultDigital Interventions to Promote Healthy Eating in Children: Umbrella Review
Prowse, R. J. L., & Carsley, S. (2021) · JMIR Pediatrics and Parenting · doi:10.2196/30160 · Cited by 58
Lang, A. J., Hamblen, J. L., Holtzheimer, P. E., Kelly, U. A., Norman, S. B., Riggs, D. S., Schnurr, P. P., & Wiechers, I. R. (2024) · Journal of Traumatic Stress · doi:10.1002/jts.23013 · Cited by 68
Different components of cognitive-behavioral therapy affect specific cognitive mechanisms
Norbury, A., Hauser, T. U., Fleming, S. M., Dolan, R. J., & Huys, Q. J. M. (2024) · Science Advances · doi:10.1126/sciadv.adk3222 · Cited by 87
“However, increasing user engagement is likely to be key for greater uptake of digital therapeutics ( 27 , 61 ).”
Mair, J. L., Hashim, J., Thai, L., Tai, E. S., Ryan, J. C., Kowatsch, T., Müller‐Riemenschneider, F., & Edney, S. M. (2025) · Translational Behavioral Medicine · doi:10.1093/tbm/ibaf010 · Cited by 56
Park, S. Y., Sigmon, C. A. N., & Boeldt, D. L. (2022) · Cureus · doi:10.7759/cureus.29329 · Cited by 43
“Individual engagement with DMHI is often higher when the content can be personalized to the user’s specific needs [22].”
BackgroundGiebel, G. D., Abels, C., Plescher, F., Speckemeier, C., Schrader, N. F., Börchers, K., Wasem, J., Neusser, S., & Blase, N. (2024) · Journal of Medical Internet Research · doi:10.2196/49982 · Cited by 61
Yin, R., Martinengo, L., Smith, H. E., Subramaniam, M., Griva, K., & Car, L. T. (2024) · The Lancet Healthy Longevity · doi:10.1016/j.lanhl.2024.08.007 · Cited by 56
Ludlow, K., Russell, J. K., Ryan, B., Brown, R. L., Joynt, T., Uhlmann, L. R., Smith, G. E., Donovan, C., Hides, L., Spence, S. H., et al. (2023) · DIGITAL HEALTH · doi:10.1177/20552076231216410 · Cited by 42
“While uncertainty about the evidence-base and credibility of DMHIs has been established as a barrier to user engagement in adult populations (>16 year-olds), 30 our research demonstrates that this preference is also evident in younger populations (7 – 17 year-olds).”
BackgroundInfluentialCameron, G., Mulvenna, M. D., Ennis, E., O’Neill, S. M., Bond, R., Cameron, D., & Bunting, A. (2024) · JMIR Mental Health · doi:10.2196/67785 · Cited by 81
“…“internet treatment” OR “computer intervention” OR “computer treatment” OR “cyber intervention” OR “cyber treatment” OR “electronic intervention” OR “electronic treatment” OR ( mobile AND program* ) OR mhealth OR ehealth OR mtherap* OR etherap* OR telehealth OR telemedicine OR “mobile app*” [10].”
Eis, S., Solà-Morales, O., Duarte‐Díaz, A., Vidal‐Alaball, J., Perestelo‐Pérez, L., Robles, N., & Carrión, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19042186 · Cited by 45
Cross, S. P. M., & Álvarez‐Jiménez, M. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1382726 · Cited by 58
Funnell, E. L., Spadaro, B., Martin-Key, N. A., Metcalfe, T., & Bahn, S. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.857304 · Cited by 50
“Additionally, other factors are put forward as being related to low app engagement including concerns about the security of user data (44, 45), the app not adequately meeting the users’ needs, and the app being considered untrustworthy by users (44).”
BackgroundMethodInfluentialKim, M., Yang, J., Ahn, W.-Y., & Choi, H. J. (2021) · Journal of Medical Internet Research · doi:10.2196/27218 · Cited by 41
“For the first time, this study evaluated the multiple dimensions of motivation at two different periods: before (conventional motivation) and during (in-app motivation) the intervention [31,32].”
BackgroundYeo, G., Fortuna, K. L., Lansford, J. E., & Rudolph, K. D. (2025) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796024000854 · Cited by 57
“Studies of facilitators of and barriers to the uptake of digital behavioural health interventions argue that engagement affects intervention effectiveness (Borghouts et al. , 2021).”
Nicolaidou, I. A., Aristeidis, L., & Lambrinos, L. (2022) · Digital Health · doi:10.1177/20552076221109059 · Cited by 46
“The Student Stress Resilience app attempted to overcome these barriers 14 and address this need.”
BackgroundDigital health technologies and major depressive disorder
McIntyre, R. S., Greenleaf, W., Bulaj, G., Taylor, S. T., Mitsi, G., Saliu, D., Czysz, A., Silvesti, G., Garcia, M., & Jain, R. (2023) · CNS Spectrums · doi:10.1017/s1092852923002225 · Cited by 38
“Firstly, symptoms related to depression, low mood, and tiredness may hinder the patient’s engagement with digital technologies.(145) Patients’ mistrust in data sharing due to privacy concerns and confidentiality breachesmay reduce their acceptability of digital health technologies.”
BackgroundKozelka, E. E., Acquilano, S. C., Al‐Abdulmunem, M., Guarino, S., Elwyn, G. J., Drake, R. E., & Carpenter-Song, E. A. (2023) · SSM - Mental Health · doi:10.1016/j.ssmmh.2023.100241 · Cited by 50
Steare, T., Giorgalli, M., Free, K., Harju‐Seppänen, J., Akther, S. F., Eskinazi, M., O’Hanlon, P., Rostill, H., Amani, S., Lloyd‐Evans, B., et al. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03317-9 · Cited by 42
“Although responses were specific to My Journey 3, much of the feedback is likely to be relevant to similar DHIs delivered within EIP services.”
BackgroundResultInfluentialHo, T. Q. A., Le, L. K.-D., Engel, L., Le, N., Melvin, G., Le, H. N. D., & Mihalopoulos, C. (2025) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-024-02386-x · Cited by 38
“User engagement with W-MHIs has been more commonly examined than mental health apps [12, 13].”
InfluentialToward the Science of Engagement With Digital Interventions
Nahum-Shani, I. B., & Yoon, C. (2024) · Current Directions in Psychological Science · doi:10.1177/09637214241254328 · Cited by 45
“…implicit assumption in digital health research that engagement is inherently beneficial (Nahum-Shani, Shaw, et al., 2022; Yardley et al., 2016) and the absence of standards for conceptualizing and accurately measuring different patterns of engagement (Borghouts et al., 2021; Saleem et al., 2021).”
Mental Wellbeing at Work: Perspectives of Software Engineers
Wong, N., Jackson, V., van der Hoek, A., Ahmed, I., Schueller, S. M., & Reddy, M. C. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581528 · Cited by 53
“Additionally, user engagement and adherence continue to be a challenge for mental wellbeing mobile applications [13].”
BackgroundSelf-citationAtem, J., Gümüşkaya, O., & Wilson, R. L. (2024) · International Journal of Mental Health Nursing · doi:10.1111/inm.13283 · Cited by 51
A meta-analysis of persuasive design, engagement, and efficacy in 92 RCTs of mental health apps
Valentine, L., Hinton, J. D. X., Bajaj, K., Boyd, L., O’Sullivan, S., Sorenson, R. P., Bell, I., Vega, M. S., Liu, P., Peters, W., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01567-5 · Cited by 56
Osborne, E. L., Ainsworth, B., Hooper, N., & Atkinson, M. J. (2023) · Journal of Medical Internet Research · doi:10.2196/44220 · Cited by 37
“Although low engagement is a common issue in digital mental health interventions generally [13]—for example, the pooled completion rate from studies of apps for depressive symptoms is 52% [14]—it is particularly important in mindfulness training as regular practice is essential to develop…”
The conceptualisation and measurement of engagement in digital health
Milne‐Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100735 · Cited by 41
“…of engagement with DHIs in quick and easy-to-use measures (Kelders and Kip, 2019a; Perski et al., 2019a) and are currently the only theory-based scales to do so (Bijkerk et al., 2023; Borghouts et al., 2021; Kelders et al., 2020a; Ng et al., 2019; Perski et al., 2019a, 2019b; Short et al., 2018).”
BackgroundAtefi, G., Koh, W. Q., Kohl, G., Seydavi, M., Swift, J. K., Akbari, M., & de Vugt, M. E. (2024) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2024.04.008 · Cited by 41
Bhattacharjee, A., Williams, J. J., Meyerhoff, J., Kumar, H., Mariakakis, A. T., & Kornfield, R. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580774 · Cited by 44
“Digital mental health (DMH) tools enable users to access resources and strategies for managing their psychological wellbeing at their own convenience [9, 86].”
BackgroundLukka, L., & Palva, J. M. (2023) · JMIR Serious Games · doi:10.2196/42173 · Cited by 46
“Users’age, gender, education, personality, and prior experiences with mental health services and the severity of their symptoms influence user engagement [64].”
BackgroundRasouli, S., Ghafurian, M., Nilsen, E. S., & Dautenhahn, K. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.108072 · Cited by 45
Storm, M., Fjellså, H. M. H., Skjærpe, J. N., Myers, A. L., Bartels, S. J., & Fortuna, K. L. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18168667 · Cited by 36
“Community engagement and user participation when developing and adapting digital interventions can ensure relevance and appropriateness [16] and facilitate continuous engagement with health interventions [4].”
BackgroundWhat are you thinking?: Using CBT and Storytelling to Improve Mental Health Among College Students
Hamid, A., Arshad, R., & Shahid, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517603 · Cited by 41
“This fnding is also corroborated by other reviews showing a lack of explicit engagement features in CBT apps [54, 83], despite the conceptualization of a therapeutic alliance in digital interventions indicating that tailoring content, personalization and other interactive features can facilitate user engagement and im…”
ResultKornfield, R., Stamatis, C. A., Bhattacharjee, A., Pang, B., Nguyen, T., Williams, J. J., Kumar, H., Popowski, S., Beltzer, M., Karr, C. J., et al. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100667 · Cited by 33
“To ensure tools are convenient and useful in the context of day-to-day life, it is necessary to involve end-users across the design and development process (Mohr et al., 2017; Blandford et al., 2018; Borghouts et al., 2021; Poole, 2013).”
BackgroundMethodInfluentialBrinsley, J., O'Connor, E. J., Singh, B., McKeon, G., Curtis, R., Ferguson, T., Gosse, G., Willems, I., Marent, P.-J., Szeto, K., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/56975 · Cited by 47
“Digital interventions can also reduce the stigma associated with seeking help [11], while data-driven insights allow for personalized and efficient interventions tailored to individual needs.”
Meyerhoff, J., Kornfield, R., Mohr, D. C., & Reddy, M. C. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555203 · Cited by 46
“Recent work has suggested that social interactions can provide an important avenue to increase engagement with DMH tools [15]; however, many questions remain about the forms of social interaction that are most appealing and helpful, particularly for those who are initiating their”
The impact of mindfulness apps on psychological processes of change: a systematic review
Macrynikola, N., Mir, Z., Gopal, T., Rodriguez, E., Li, S., Cox, M., Yeh, G. Y., & Torous, J. B. (2024) · npj Mental Health Research · doi:10.1038/s44184-023-00048-5 · Cited by 42
“Yet how an intervention is introduced affects engagement and outcomes 94,95 , and calls have been made for mindfulness intervention studies to report on the explicit instruction given to participants regarding mindfulness 82 .”
Fassnacht, D. B., Ali, K., van Agteren, J. E., Iasiello, M. P., Mavrangelos, T., Furber, G., & Kyrios, M. (2022) · JMIR Mental Health · doi:10.2196/37292 · Cited by 33
“Importantly, the aspect of social connectedness has also been highlighted as a facilitator for user engagement in a recent systematic review [89].”
Küchler, A., Schultchen, D., Dretzler, T., Moshagen, M., Ebert, D. D., & Baumeister, H. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20043208 · Cited by 39
“, chatbots [85] or reminders, which is consistent with previous research [23,86].”
ResultSchwarz, A. F., Winkens, L. H. H., de Vet, E., Ossendrijver, D., Bouwsema, K., & Simons, M. (2022) · JMIR mhealth and uhealth · doi:10.2196/40898 · Cited by 39
“When comparing the results with those of research in adults, several features are shared, such as a simple and structured interface, tailored and positive feedback on PA levels [43,44,89,90], progress [90], well-designed reminders (eg, timing and frequency of notifications) [26,43,44,89], rewards [43,44,49,91-93], sel…”
BackgroundResultOpie, J. E., Vuong, A. T., Welsh, E. T., Esler, T. B., Khan, U. R., & Khalil, H. (2024) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-024-00468-5 · Cited by 46
“Although not youth-specific, this is consistent with a prior systematic review wherein guided DMHIs providing automated reminders were associated with enhanced user engagement (Borghouts et al., 2021).”
ResultForman‐Hoffman, V. L., Flom, M., Mariano, T. Y., Chiauzzi, E. J., Williams, A. A. A., Kirvin-Quamme, A., Pajarito, S., Durden, E., & Perski, O. (2023) · Journal of Medical Internet Research · doi:10.2196/47198 · Cited by 44
“Those with greater severity of baseline symptoms, conversely, tend to have lower engagement levels [13,26].”
Palmer, C. E., Marshall, E., Millgate, E., Warren, G., Ewbank, M., Cooper, E., Lawes, S., Bouazzaoui, M., Smith, A., Hutchins-Joss, C., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/69351 · Cited by 46
“However, real-world usage of many digital mental health solutions—most of which are self-led—has been poor [9-11].”
MENTAL HEALTH AND DIGITAL TECHNOLOGY: A PUBLIC HEALTH REVIEW OF CURRENT TRENDS AND RESPONSES
Ogugua, J. O., Okongwu, C. C., Akomolafe, O. O., Anyanwu, E. C., & Daraojimba, O. D. (2024) · International Medical Science Research Journal · doi:10.51594/imsrj.v4i2.754 · Cited by 39
Kaihara, T., Scherrenberg, M., Intan-Goey, V., Falter, M., Kindermans, H., Frederix, I., & Dendale, P. (2022) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztac037 · Cited by 29
“A previous systematic review mentioned the barriers to user engagement with DHIs for mental health.(48) Because patients with heart disease represent a different population than relatively young psychiatric patients, it is important to understand the specific characteristics and personal preferences of the target popu…”
BackgroundThe Use of Sensors to Detect Anxiety for In-the-Moment Intervention: Scoping Review
Dobson, R., Li, L. L., Garner, K., Tane, T., McCool, J. P., & Whittaker, R. (2023) · JMIR Mental Health · doi:10.2196/42611 · Cited by 30
Hoffman, B. D., Oppert, M. L., & Owen, M. S. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100086 · Cited by 55
Encouraging help-seeking and engagement in a mental health app: What young people want
Garrido, S., Oliver, E., Chmiel, A., Doran, B., & Boydell, K. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1045765 · Cited by 34
“However, other work has suggested that engagement tends to be higher in mental health apps that offer peer support (19) or other forms of social connection (20).”
BackgroundUser engagement in mobile apps for people with schizophrenia: A scoping review
de Almeida, R. S., & Marques, A. J. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1023592 · Cited by 35
Blackmore, R., Giles, C., Tremain, H., Kelly, R., Foley, F., Fletcher, K., Nedeljkovic, M., Wadley, G., Seabrook, E., & Thomas, N. (2024) · Journal of Medical Internet Research · doi:10.2196/45640 · Cited by 27
“In line with this, the severity of mental health symptoms has been identified as a common barrier for accessing technology-supported mental health interventions [52].”
The Role of Serious Video Games in the Treatment of Disordered Eating Behaviors: Systematic Review
Tang, W. S. W., Ng, T. J. Y., Wong, J. Z. A., & Ho, C. S. H. (2022) · Journal of Medical Internet Research · doi:10.2196/39527 · Cited by 21
“A review by Borghouts et al [82] showed that concerns over the safety and privacy of disclosed information can act as a barrier to engagement in such digital mental health interventions [82].”
Cogan, N., Craig, A., Milligan, L., McCluskey, R., Burns, T., Ptak, W., Kirk, A., Graf, C., Goodman, J., & De Kock, J. (2024) · European Journal of Psychotraumatology · doi:10.1080/20008066.2024.2395113 · Cited by 29
Chen, C., Huang, N., Hu, B., Zhang, M., Yuan, J., & Guo, J. (2024) · GeroScience · doi:10.1007/s11357-024-01446-z · Cited by 30
“Nevertheless, a social support program may foster old adults’ social connectedness through regular contact with professionals and peers [62].”
Wanniarachchi, V. U., Greenhalgh, C., Choi, A., & Warren, J. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1500220 · Cited by 46
Heffner, J. L., Watson, N. L., Serfozo, E., Kelly, M. M., Reilly, E. D., Kim, D., Baker, K. K., Scout, N., & Karekla, M. (2021) · JMIR Formative Research · doi:10.2196/30241 · Cited by 29
“Social connectedness has been demonstrated to increase engagement in other digital programs [25] and was associated with better engagement and abstinence outcomes in an online tobacco treatment program [26,27].”
BackgroundDigital Interventions to Enhance Readiness for Psychological Therapy: Scoping Review
Jardine, J., Bowman, R., & Doherty, G. J. (2022) · Journal of Medical Internet Research · doi:10.2196/37851 · Cited by 39
“The rationale for examining only recent evidence (past 15 years) is that digital technology is advancing rapidly; older studies may be out of date in terms of client attitudes and acceptance of technology [46].”
Fowler, J. A., Buckley, L., Muir, M., Viskovich, S., Paradisis, C., Zanganeh, P., & Dean, J. A. (2023) · Journal of Clinical Psychology · doi:10.1002/jclp.23571 · Cited by 31
Ball, H., Eisner, E., Nicholas, J., Wilson, P. M., & Bucci, S. (2025) · BMC Public Health · doi:10.1186/s12889-025-22189-2 · Cited by 28
“Indeed, the severity of mental health symptomatology, and the interplay between service users’ mental health symptoms and DHIs, have been found to impact on DHI engagement [25, 26].”
Kodish, T., Schueller, S. M., & Lau, A. S. (2023) · Journal of Behavioral and Cognitive Therapy · doi:10.1016/j.jbct.2022.12.002 · Cited by 32
Self-citationRabin, B. A., Cain, K. L., Watson, P., Oswald, W., Laurent, L. C., Meadows, A. R., Seifert, M., Munoz, F. A., Salgin, L., Aldous, J. L., et al. (2023) · Implementation Science · doi:10.1186/s13012-023-01283-2 · Cited by 32
“Important considerations for the implementation of mHealth in real-world settings include technology literacy, personalization of interventions, and perceptions of health risk and status [43].”
BackgroundSelf-citation
Metadata
- Authors
- Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H.
- Affiliations
- University of California, Irvine (US)
- University of California San Diego (US)
- Corresponding author
- Borghouts, Judith
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-03-24
- Volume
- 23
- Issue
- 3
- Pages
- e24387
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8074985
- OpenAlex
- W3128534511
- Semantic Scholar
- 893b0a390c82140e66abca65226ea876a93696cf
- Cited by
- 1,069
- References
- 250
- Citations by year
- 2026: 240 · 2025: 307 · 2024: 225 · 2023: 168 · 2022: 96 · 2021: 33
- FWCI
- 20.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- digital mental health interventions, user engagement, barriers to engagement, mental health apps, severe mental illness, technical challenges, personalization, social connectedness, user control, intervention design
- MeSH terms
- Mental Disorders, Humans, Mental Health, Technology, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.