Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 250 of the 250 references it cites were found in a registry or an index; 285 of the 439 sources its claims cite were checked for support.
Abstract
Background: Digital mental health interventions (DMHIs), which deliver mental health support via technologies such as mobile apps, can increase access to mental health support, and many studies have demonstrated their effectiveness in improving symptoms. However, user engagement varies, with regard to a user's uptake and sustained interactions with these interventions. Objective: This systematic review aims to identify common barriers and facilitators that influence user engagement with DMHIs. Methods: A systematic search was conducted in the SCOPUS, PubMed, PsycINFO, Web of Science, and Cochrane Library databases. Empirical studies that report qualitative and/or quantitative data were included. Results: A total of 208 articles met the inclusion criteria. The included articles used a variety of methodologies, including interviews, surveys, focus groups, workshops, field studies, and analysis of user reviews. Factors extracted for coding were related to the end user, the program or content offered by the intervention, and the technology and implementation environment. Common barriers included severe mental health issues that hampered engagement, technical issues, and a lack of personalization. Common facilitators were social connectedness facilitated by the intervention, increased insight into health, and a feeling of being in control of one's own health. Conclusions: Although previous research suggests that DMHIs can be useful in supporting mental health, contextual factors are important determinants of whether users actually engage with these interventions. The factors identified in this review can provide guidance when evaluating DMHIs to help explain and understand user engagement and can inform the design and development of new digital interventions. © 2021 Journal of Medical Internet Research. All rights reserved.
Overview
CoChat Summary
## TL;DR
This systematic review synthesized 208 empirical articles to identify common barriers and facilitators of engagement with digital mental health interventions (DMHIs). Engagement was shaped by user characteristics, program/content fit, and technology/implementation context, with technical problems, severe symptoms, and poor personalization commonly hindering use.
## Key findings
- The review included 208 articles; study sizes ranged from 6 to more than 2 million participants, and exposure ranged from a short demonstration to up to 1 year of use.
- The authors identified 16 broader constructs influencing engagement, grouped into user-related, program-related, and technology- and environment-related factors.
- Common barriers included severe mental health issues that hampered engagement, technical issues (the primary barrier noted in 25 studies), usability issues, and lack of personalization.
- Common facilitators included social connectedness (e.g., connection to peers or therapists, reported in 18 studies), increased insight into health, and feeling in control of one’s own health.
## Methods
- Systematic review of empirical English-language peer-reviewed studies published from January 1, 2010 to December 2019 on digitally delivered mental health interventions for people aged ≥16 years.
- Searches were conducted in SCOPUS, PubMed, PsycINFO, Web of Science, and the Cochrane Library; 6146 papers were identified, 77 duplicates removed, 480 full texts reviewed, and 208 included.
- The team used inductive thematic analysis to code barriers/facilitators from abstracts, results/findings, and discussion sections, and used a quality reporting tool with 4 criteria.
## Limitations
- The paper states that the included studies were heterogeneous, so the authors could not conduct a meta-analysis.
- The paper notes inconsistency across studies in how engagement was measured (e.g., log-ins, time engaged, total time used, self-report), which makes comparison difficult.
- The review was limited to peer-reviewed empirical articles and to studies before the COVID-19 pandemic; the authors say some interventions may have been missed, and pandemic-related factors were not captured.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
104 Valid · 7 Not valid · 34 Not checked · 122 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Overall, 11 studies did not report the recruitment and/or selection process of study participants [30-40].”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Results > Quality Assessment
What the sources say
- Not matchedcites [30] Pagliari, C, 2012, Stud Health Technol Inform
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites [31] source
- Not checked — no full text of the sourcecites [32] source
- Could not verifycites [33] sourceExperimental — accuracy not yet measured
The paper’s ‘What Is Needed to Benefit From Blended Mental Health Treatment?’ section describes recruitment of therapists for its own consultations, but does not assess recruitment or selection reporting across 11 studies. Searches for the claimed count and for recruitment and selection reporting found no passage addressing it; page numbers were not available in our copy. (LLM, conf=0.75)
- Disputedcites [34] sourceExperimental — accuracy not yet measured
The Methods > Participants section reports where participants were recruited and specifies eligibility and exclusion criteria. Thus, this paper does report recruitment and selection information, contrary to the claim as applied to this cited study. The aggregate count of 11 studies cannot be assessed from this paper alone. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
- Disputedcites [35] sourceExperimental — accuracy not yet measured
The Methods > Recruitment section explicitly describes how participants were approached and selected: through personal and professional networks, followed by snowball and maximum variance sampling. Thus, this paper does not fit the citing sentence’s description of studies that failed to report recruitment and/or selection. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
- Disputedcites [36] sourceExperimental — accuracy not yet measured
The Methods section (page unavailable) reports that workshop trainees were invited to consultation groups and that those wishing to attend were assigned to groups. The Results > Participants section (page unavailable) states that 28 of 50 trainees elected to attend and explains why two were excluded from the analysis. This paper therefore reports how participants entered and were selected for the study, contrary to its inclusion among studies said not to report that process. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [37] source
- Disputedcites [38] sourceExperimental — accuracy not yet measured
The Methods > Procedure section explicitly reports how this study recruited participants: through websites, mental-health forums, social media, and word of mouth. Methods > Participants also reports how many people viewed and completed the survey. This source therefore contradicts its inclusion among studies said not to report recruitment and/or participant selection; it cannot establish the total for the other studies. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [39] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“However, evaluation studies have shown that more severe symptoms hamper actual engagement with digital interventions [51,56,83-101].”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Results > User-Related Constructs
What the sources say
- Not checked — no full text of the sourcecites [51] source
- Partly supportedcites [56] sourceExperimental — accuracy not yet measured
In Qualitative Results (page not supplied), one patient said cancer-related fatigue prevented her from completing an app exercise, supporting a limited example of symptoms hampering engagement. But Results > Maintenance reports greater continuous use among patients with higher depressive symptoms, so this study does not support the broad claim that more severe symptoms generally hamper engagement. (LLM, conf=0.85)
- Could not verifycites [83] sourceExperimental — accuracy not yet measured
The Device performance (p. 5) and Device stability (p. 7) passages concern perovskite solar cells, not people using digital interventions. Searches for symptom severity and engagement found no passage addressing whether more severe symptoms hamper use of those interventions. (LLM, conf=0.79)
- Not checked — no full text of the sourcecites [84] source
- Partly supportedcites [85] sourceExperimental — accuracy not yet measured
The Results (Engagement Conditions; no page given) report that symptom severity mattered to participants’ willingness to use the eating-disorder program: some doubted it was suitable for serious eating-disorder issues. But the study reports perceptions during usability testing, not evidence that more severe symptoms reduced actual engagement across digital interventions. The Discussion (Principal Findings; no page given) also notes that greater impairment may increase motivation in some groups. (LLM, conf=0.87)
- Disputedcites [86] sourceExperimental — accuracy not yet measured
The Feasibility section reports that completion was not significantly correlated with baseline anxiety or depression. It also notes that men with no distress were overrepresented among those who completed less than 20%; the Discussion suggests that men seeking psychological support may be more likely to complete the program. These passages do not show that more severe symptoms hamper engagement and point in the opposite direction. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Partly supportedcites [87] sourceExperimental — accuracy not yet measured
The Results (Adherence and Feasibility; page unavailable) report that higher positive-symptom scores correlated with lower diary completion, while higher negative-symptom scores correlated with lower diary completion and wearable adherence. This supports an association between symptom severity and engagement in this small schizophrenia study, but the claim’s broader wording implies a causal effect across digital interventions that the study does not establish. (LLM, conf=0.88)
- Partly supportedcites [88] sourceExperimental — accuracy not yet measured
In Results > Barriers and Facilitators (page not provided), some respondents said that people under severe psychological distress might be unwilling or unable to try the app. This supports distress as a possible barrier, but not the claim that evaluation studies showed reduced actual engagement. The Limitations section says respondents had not used a functioning app over an extended period, so their feedback could not establish that effect. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [89] source
- Partly supportedcites [90] sourceExperimental — accuracy not yet measured
The Introduction (Background; no page provided) says psychological symptoms may make mindfulness practice harder and may lead participants to disengage. But the Results (Participant Characteristics and Engagement) found no significant relationship between psychosocial characteristics and lesson completion, and the Discussion (Principal Findings) specifically found no significant association between baseline stress and engagement. This study therefore supports a possible barrier, not the claim that more severe symptoms were shown to hamper actual engagement. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Users’ engagement was facilitated by whether the intervention was endorsed by other users [43] or peers [211,241], their friends and family [97], or their current health care provider [152,161,242].”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Results > Technology- and Environment-Related Constructs
What the sources say
- Could not verifycites [43] sourceExperimental — accuracy not yet measured
Citation [242] is attached to the claim about endorsement by a user's current health care provider. The Discussion says clinician and consumer ratings may help users judge whether an intervention is appropriate and engaging, but it does not say that provider endorsement facilitates users' engagement. Searches for provider recommendations and clinician endorsement found no passage addressing that link. (LLM, conf=0.73)
- Partly supportedcites [211] sourceExperimental — accuracy not yet measured
The Results (Enabler 2: Positive Experience of the Consultation Sessions; page unavailable) describe health workers using YouTube clips as a different way to engage clients. That supports a role for providers in introducing digital resources, but the paper does not show that provider endorsement facilitated users’ engagement with a DMHI. The other endorsement sources in the citing sentence have separate citations and are not attributed to this paper. (LLM, conf=0.74)
- Disputedcites [241] sourceExperimental — accuracy not yet measured
Citation [43] is attached to endorsement by other users, not to the later claims about peers, family, or health care providers. In the Results section (page unavailable), attitudes among participants shown user testimonials did not differ significantly from the other conditions. The Discussion likewise reports no significant difference from the control group and says the effect of testimonials on uptake remains unclear. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Partly supportedcites [97] sourceExperimental — accuracy not yet measured
The Results (Posttreatment Attrition; page unavailable) report higher odds of completing posttreatment assessments among participants who heard about Anxiety Online from friends or family. This supports an association with that referral source, but the paper does not establish that friends or family endorsed the intervention or that endorsement facilitated engagement. The other sources of endorsement in the citing sentence have separate citations and are not assessed here. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although some DMHIs have been shown to be as effective as traditional mental health services (eg, psychotherapy and pharmacotherapy) in improving mental health conditions such as depression [7]”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Introduction > Background
What the sources say
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
The Results of Traditional Meta-analysis (page unavailable) report that self-guided iCBT improved depressive symptoms more than control conditions. They do not establish that it is as effective as psychotherapy or pharmacotherapy; the paper’s concluding discussion (page unavailable) notes smaller effects than face-to-face interventions. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, these analyses did not report on factors related to this variability in engagement.”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Introduction > Understanding User Engagement With DMHIs
What the sources say
- Not checked — no full text of the sourcecites [9] source
- Supportedcites [10] source
Section 3.3.4 (Satisfaction and adherence; page unavailable) reports the median and spread of adherence across trials, but does not report factors associated with that variation. Section 2.2 (Information sources; page unavailable) describes extracting adherence as course completion; the reported analysis is descriptive rather than an analysis of engagement-related factors. (LLM, conf=0.84)
- Supportedcites [11] source
The Discussion’s Summary of Evidence reports large differences in engagement but says that diverse measures make direct comparisons difficult. It calls for future reporting of intervention and implementation characteristics to help explain which approaches engage and retain users, consistent with the claim that the review did not analyze factors behind the variability. No page number is provided in our copy. (LLM, conf=0.83)
- Not checked — no full text of the sourcecites [16] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
157 more claims · 82 with their cited sources checked
Create a free account to see all 267 claims and every source verdict.
- It may state two separate claims as one. 57
- Probably not a substantial claim. 63
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Despite decades of research evidence, the uptake of DMHIs into practice is limited due to high dropout rates and poor user engagement of clients, especially in self-guided formats [2021].”
From Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 2): Participatory Design Study including Mental Health Professionals (2025) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ensure tools are convenient and useful in the context of day-to-day life, it is necessary to involve end-users across the design and development process (Mohr et al., 2017; Blandford et al., 2018; Borghouts et al., 2021; Poole, 2013).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Borghouts et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“if a product is not developed in line with the target user’s needs (eg, values, goals, and abilities) or is not engaging and intuitive to use, the likelihood of such a product being integrated, accepted, and adopted by people is low [14,20]”
From Optimization of a Transdiagnostic Mobile Emotion Regulation Intervention for University Students: Protocol for a Microrandomized Trial (2023) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A systematic review of barriers to facilitators of engagement with mobile health (mHealth) interventions reported that a user’s ability to integrate the intervention into their lives impacted engagement [53].”
From A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study (2022) · cites this paper as [53]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similar onboarding procedures have been shown to improve treatment adherence in app-based mindfulness meditation studies [49,51].”
From App-Based Mindfulness Meditation for People of Color Who Experience Race-Related Stress: Protocol for a Randomized Controlled Trial (2022) · cites this paper as [51]
Experimental — accuracy not yet measured
20 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Items 201–250 of 250
Forchuk, C., Reiss, J., Eichstedt, J., Singh, D., Collins, K., Rudnick, A., Walsh, J., Ethridge, P., Kutcher, S., & Fisman, S. (2016) · International Journal of Mental Health · doi:10.1080/00207411.2016.1204823 · Cited by 25 · cited 7×
“This fit was, for example, facilitated by relevance of information to their current situation [14,46,150,152-157] and the ability to customize or personalize the intervention [30,46,83,84,122,134,135,138,158-165].”
BackgroundMethodInfluentialThe efficiency model of support and the creation of digital apothecaries.
Muñoz, R. F. (2017) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12174 · Cited by 25 · cited 1×
“DMHIs can be delivered via smartphone apps, internet websites, wearable devices, virtual reality, or video games [5] and range from self-guided DMHIs to those integrated with human support or traditional therapy [6].”
BackgroundGunn, J., Cameron, J., Densley, K., Davidson, S., Fletcher, S., Palmer, V., Chondros, P., Dowrick, C., & Pirkis, J. (2018) · Patient Education and Counseling · doi:10.1016/j.pec.2017.07.008 · Cited by 25 · cited 6×
“Other demographic variables associated with user engagement were as follows: (1) employment status, with people who worked full time more likely to use the intervention than people who were retired [66] or unemployed [54,68]; (2) education, with participants with higher education reporting more acceptance of intervent…”
BackgroundInfluentialSchuster, R., Kalthoff, I., Walther, A., Köhldorfer, L., Partinger, E., Berger, T., & Laireiter, A.-R. (2019) · Journal of Medical Internet Research · doi:10.2196/11860 · Cited by 25 · cited 3×
“The primary barrier to engagement noted in 25 studies was users’ experience of technical issues [44,50,80,92,100,103,118, 129,138,155,172,179,185,195,205,208,212-220], such as a mobile app crashing and shutting down unexpectedly; in 3 studies, participants did not have the resources required to use an intervention [17…”
BackgroundA feasibility study of a mental health mobile app in the Dominican Republic: The untold story
Caplan, S., Lovera, A. S., & Reyna, P. K. (2018) · International Journal of Mental Health · doi:10.1080/00207411.2018.1553486 · Cited by 25 · cited 3×
“The primary barrier to engagement noted in 25 studies was users’ experience of technical issues [44,50,80,92,100,103,118, 129,138,155,172,179,185,195,205,208,212-220], such as a mobile app crashing and shutting down unexpectedly; in 3 studies, participants did not have the resources required to use an intervention [17…”
BackgroundKerr, D. C., Ornelas, I. J., Lilly, M. M., Calhoun, R., & Meischke, H. (2019) · Journal of Medical Internet Research · doi:10.2196/13449 · Cited by 25 · cited 2×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundDevelopment of a video-delivered relaxation treatment of late-life anxiety for veterans
Gould, C. E., Zapata, A. M. L., Bruce, J., Bereknyei Merrell, S., Wetherell, J. L., O'Hara, R., Kuhn, E., Goldstein, M. K., & Beaudreau, S. A. (2017) · International Psychogeriatrics · doi:10.1017/s1041610217000928 · Cited by 23 · cited 2×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundSchuster, R., Fichtenbauer, I., Sparr, V. M., Berger, T., & Laireiter, A.-R. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018412 · Cited by 23 · cited 3×
“In other studies evaluating a CBT program that included in-person sessions with a therapist, some participants reported preference for both longer individual therapy sessions (greater than the standard 50-70 minutes) [151] and duration of treatment to maximize benefit [150].”
BackgroundFeasibility of mobile mental wellness training for older adults
Similä, H., Immonen, M., Toska-Tervola, J., Enwald, H., Keränen, N., Kangas, M., Jämsä, T., & Korpelainen, R. (2018) · Geriatric Nursing · doi:10.1016/j.gerinurse.2018.02.001 · Cited by 22 · cited 4×
“Usability issues formed a barrier to engaging with an intervention [46,50, 78,84,148-150,157,159,170,224-228].”
BackgroundInfluentialPruitt, L. D., Vuletic, S., Smolenski, D. J., Wagner, A., Luxton, D. D., & Gahm, G. A. (2019) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x18784103 · Cited by 22 · cited 3×
“A total of 6 studies found that higher engagement was seen with adults aged ≥30 years [54,57,64,65,69-71].”
BackgroundO’Brien, K. H. M., Wyman Battalen, A., Sellers, C. M., Spirito, A., Yen, S., Maneta, E., Ryan, C. A., & Braciszewski, J. M. (2019) · Journal of Technology in Human Services · doi:10.1080/15228835.2018.1561347 · Cited by 22 · cited 4×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundInfluentialDevelopment of weCope, a mobile app for illness self-management in schizophrenia
ALMEIDA, R. F. S. D., SOUSA, T. J., COUTO, A. S., MARQUES, A. J., QUEIRÓS, C. M., & MARTINS, C. L. (2019) · Archives of Clinical Psychiatry (São Paulo) · doi:10.1590/0101-60830000000182 · Cited by 22 · cited 4×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundInfluentialFeasibility of perinatal mood screening and text messaging on patients’ personal smartphones
La Porte, L. M., Kim, J. J., Adams, M. G., Zagorsky, B. M., Gibbons, R., & Silver, R. K. (2020) · Archives of Women's Mental Health · doi:10.1007/s00737-019-00981-5 · Cited by 22 · cited 2×
“Studies that found an effect of gender showed that women were more likely to adopt and engage with interventions [44,52-68].”
BackgroundFeng, X. L., & Campbell, A. (2011) · Journal of Technology in Human Services · doi:10.1080/15228835.2011.595276 · Cited by 21 · cited 1×
“A range of factors can influence engagement with DMHIs, such as the relevance of information to the user provided by a digital intervention [13], a lack of user motivation to persist with a self-guided intervention [14], and poor user experience with the technology [15].”
BackgroundDodd, A. L., Mallinson, S., Griffiths, M., Morriss, R., Jones, S. H., & Lobban, F. (2017) · Evidence Based Mental Health · doi:10.1136/eb-2017-102754 · Cited by 21
Batterham, P. J., Calear, A. L., O’Dea, B., Larsen, M. E., J Kavanagh, D., Titov, N., March, S., Hickie, I., Teesson, M., Dear, B. F., et al. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619878069 · Cited by 21 · cited 3×
“Users’ engagement was facilitated by whether the intervention was endorsed by other users [43] or peers [211,241], their friends and family [97], or their current health care provider [152,161,242].”
BackgroundRanney, M. L., Thorsen, M., Patena, J. V., Cunningham, R. M., Boyer, E. W., Walton, M. A., Spirito, A., Zatzick, D. F., & Morrow, K. (2015) · 2015 48th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2015.391 · Cited by 20 · cited 2×
“Uncertainty about the credibility of the information, which related to the evidence base of the intervention and the source of information, was a barrier [74,88,127,140-143].”
BackgroundUsing Facebook to Reach People Who Experience Auditory Hallucinations
Crosier, B. S., Brian, R. M., & Ben-Zeev, D. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5420 · Cited by 20 · cited 3×
“Studies that found an effect of gender showed that women were more likely to adopt and engage with interventions [44,52-68].”
BackgroundHuerta-Ramos, E., Escobar-Villegas, M. S., Rubinstein, K., Unoka, Z. S., Grasa, E., Hospedales, M., Jääskeläinen, E., Rubio-Abadal, E., Caspi, A., Bitter, I., et al. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5716 · Cited by 20 · cited 5×
“Participants expressed a need to receive more structured use, for example, through app reminders or a human coach checking on them on a regular basis [49,50,113,122,133,137,139,148,150,163,175-182].”
BackgroundInfluentialTechnology and Opportunity: People with Serious Mental Illness and Social Connection
Townsend, L., Zippay, A., Caler, K., & Forenza, B. (2016) · Journal of the Society for Social Work and Research · doi:10.1086/686882 · Cited by 19 · cited 3×
“The primary barrier to engagement noted in 25 studies was users’ experience of technical issues [44,50,80,92,100,103,118, 129,138,155,172,179,185,195,205,208,212-220], such as a mobile app crashing and shutting down unexpectedly; in 3 studies, participants did not have the resources required to use an intervention [17…”
BackgroundWalsh, S., Kaselionyte, J., Taylor, S. J. C., & Priebe, S. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1812-x · Cited by 19 · cited 7×
“Factors that make the information relevant and in a language suitable to the user included culturally appropriate content [133,167,168], reading level suitable to the user [168], and content presented with limited jargon or technical language [169].”
BackgroundInfluentialKoppe, H., van de Mortel, T., & Ahern, C. M. (2015) · Australian Journal of Rural Health · doi:10.1111/ajr.12212 · Cited by 18 · cited 2×
“The primary barrier to engagement noted in 25 studies was users’ experience of technical issues [44,50,80,92,100,103,118, 129,138,155,172,179,185,195,205,208,212-220], such as a mobile app crashing and shutting down unexpectedly; in 3 studies, participants did not have the resources required to use an intervention [17…”
BackgroundAdolescents’ Perspectives on a Mobile App for Relationships: Cross-Sectional Survey
O'Dea, B., Achilles, M. R., Werner-Seidler, A., Batterham, P. J., Calear, A. L., Perry, Y., Shand, F., & Christensen, H. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8831 · Cited by 18 · cited 2×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundShrier, L. A., & Spalding, A. (2017) · Journal of Pediatric and Adolescent Gynecology · doi:10.1016/j.jpag.2016.08.009 · Cited by 17 · cited 2×
“Additional positive effects that could facilitate engagement were an increased insight into users’ health [79,84,114,124,134,138-140,158,176,202-205], a feeling of empowerment over being in control of their health [14,32,84,93,95,104,117,122,124,170,174,175,196,206,207], improved skills [89,189,198,208-211], such as m…”
BackgroundEvaluation of the implementation of an internet intervention in well-baby clinics: A pilot study
Drozd, F., Haga, S. M., Lisøy, C., & Slinning, K. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.04.003 · Cited by 16 · cited 1×
“Examples included whether users received training on how to use the intervention [115,247] and if it was introduced early on or at a later stage in ongoing therapy.”
BackgroundLemey, C., Larsen, M. E., DeVylder, J., Courtet, P., Billot, R., Lenca, P., Walter, M., Baca‐García, E., & Berrouiguet, S. (2019) · Journal of Medical Internet Research · doi:10.2196/10111 · Cited by 16 · cited 2×
“Usability issues formed a barrier to engaging with an intervention [46,50, 78,84,148-150,157,159,170,224-228].”
BackgroundGörges, F., Oehler, C., von Hirschhausen, E., Hegerl, U., & Rummel‐Kluge, C. (2020) · Journal of Clinical Psychology · doi:10.1002/jclp.22886 · Cited by 16 · cited 4×
“Additional positive effects that could facilitate engagement were an increased insight into users’ health [79,84,114,124,134,138-140,158,176,202-205], a feeling of empowerment over being in control of their health [14,32,84,93,95,104,117,122,124,170,174,175,196,206,207], improved skills [89,189,198,208-211], such as m…”
BackgroundInfluentialKrause, K., Guertler, D., Moehring, A., Batra, A., Eck, S., Rumpf, H.-J., Bischof, G., Lucht, M., Freyer-Adam, J., Ulbricht, S., et al. (2019) · European Addiction Research · doi:10.1159/000499040 · Cited by 15 · cited 4×
“Studies that found an effect of gender showed that women were more likely to adopt and engage with interventions [44,52-68].”
BackgroundInfluentialUser Experience of Mobile Coaching for Stress-Management to Tackle Prevalent Health Complaints
Harjumaa, M., Halttu, K., Koistinen, K., & Oinas-Kukkonen, H. (2015) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-319-21783-3_11 · Cited by 14 · cited 7×
“The primary barrier to engagement noted in 25 studies was users’ experience of technical issues [44,50,80,92,100,103,118, 129,138,155,172,179,185,195,205,208,212-220], such as a mobile app crashing and shutting down unexpectedly; in 3 studies, participants did not have the resources required to use an intervention [17…”
BackgroundInfluentialHunter-Jones, J. J., Gilliam, S. M., Carswell, A. L., & Hansen, N. B. (2019) · Journal of Racial and Ethnic Health Disparities · doi:10.1007/s40615-019-00617-5 · Cited by 14
Thorsen, M. M., Patena, J. V., Guthrie, K. M., Spirito, A., & Ranney, M. L. (2018) · Behavioral Medicine · doi:10.1080/08964289.2016.1223597 · Cited by 13 · cited 3×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundChudy-Onwugaje, K., Abutaleb, A., Buchwald, A., Langenberg, P., Regueiro, M., Schwartz, D. A., Tracy, J. K., Ghazi, L., Patil, S. A., Quezada, S., et al. (2018) · Inflammatory Bowel Diseases · doi:10.1093/ibd/izy194 · Cited by 13 · cited 2×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundGraham, S., Irving, J., Cano, I., & Edwards, M. (2018) · Alcoholism Treatment Quarterly · doi:10.1080/07347324.2018.1500873 · Cited by 13 · cited 4×
“Other demographic variables associated with user engagement were as follows: (1) employment status, with people who worked full time more likely to use the intervention than people who were retired [66] or unemployed [54,68]; (2) education, with participants with higher education reporting more acceptance of intervent…”
BackgroundMethodInfluentialCrooks, R. E., Bell, M., Patten, S. B., Wiebe, S., Holroyd-Leduc, J., Bulloch, A. G., Macrodimitris, S., Mackie, A., Sauro, K. M., Federico, P., et al. (2017) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2017.03.005 · Cited by 12 · cited 5×
“Examples of usability issues were difficulty finding information in an intervention [78], a time-consuming process to log in to an intervention [159], and difficulty navigating within an intervention [150,157].”
BackgroundInfluential(2017) · Actas Españolas de Psiquiatría · Cited by 10
Low temperature processed efficient and stable perovskite solar cell
Uddin, A., Arafat Mahmud, M., Kumar Elumalai, N., Baishakhi Upama, M., Wang, D., Haque, F., & Xu, C. (2019) · Advanced Materials Letters · doi:10.5185/amlett.2019.2050 · Cited by 10
Psychological Capital and Business Success of Chinese, Minangnese, and Javanese Entrepreneurs
Andri, N., Ronauli, P. T., & Riyanti, B. P. D. (2019) · International Research Journal of Business Studies · doi:10.21632/irjbs.12.2.157-166 · Cited by 9
Patients’ perspectives about the design of a mobile application for psychotic disorders
Simões de Almeida, R., Sousa, T., Marques, A., & Queirós, C. (2018) · Psychology, Community & Health · doi:10.5964/pch.v7i1.192 · Cited by 8 · cited 2×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundA Qualitative Analysis of User Reviews on Mental Health Apps: Who Used it? for What? and Why?
Saoane Thach, K. (2019) · 2019 IEEE-RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf.2019.8713726 · Cited by 8
Schuster, R., Berger, T., & Laireiter, A. (2019) · doi:10.7892/boris.120835 · Cited by 8
East, M. L., Havard, B., & Hastings, N. B. (2016) · Journal of Technology in Human Services · doi:10.1080/15228835.2016.1233842 · Cited by 7 · cited 2×
“Usability issues formed a barrier to engaging with an intervention [46,50, 78,84,148-150,157,159,170,224-228].”
BackgroundMiatello, A., Mulvale, G. M., Hackett, C., Mulvale, A., Kutty, A., & Alshazly, F. (2018) · International Journal of Qualitative Methods · doi:10.1177/1609406918798433 · Cited by 7 · cited 3×
“The primary barrier to engagement noted in 25 studies was users’ experience of technical issues [44,50,80,92,100,103,118, 129,138,155,172,179,185,195,205,208,212-220], such as a mobile app crashing and shutting down unexpectedly; in 3 studies, participants did not have the resources required to use an intervention [17…”
BackgroundFraming of Climate Change Impacts and Use of Management Accounting Practices
Faculty of Business and Law, S. U. O. T., Kumarasiri, J., Jubb, C., & Centre for Transformative Innovation, F. O. B. A. L. (2018) · Asian Academy of Management Journal of Accounting and Finance · doi:10.21315/aamjaf2017.13.2.3 · Cited by 6 · cited 3×
“A facilitating factor in using DMHIs was whether the use of the intervention increased locus of control, meaning that users felt more ownership over their own health [14,84,95,124,174,175].”
BackgroundPsychologists’ motivations for integrating apps into therapy with secondary school-aged young people
Gindidis, S., Stewart, S. E., & Roodenburg, J. (2020) · Journal of Psychologists and Counsellors in Schools · doi:10.1017/jgc.2019.22 · Cited by 6 · cited 3×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundPearls for Treating Retinoblastoma
Shah, S. N., & Berry, J. L. (2018) · touchREVIEWS in Ophthalmology · doi:10.17925/usor.2018.11.2.79 · Cited by 6
User Experiences of a Mobile Mental Well-Being Intervention Among Pregnant Women
Muuraiskangas, S., Mattila, E., Kyttälä, P., Koreasalo, M., & Lappalainen, R. (2016) · Communications in Computer and Information Science · doi:10.1007/978-3-319-32270-4_14 · Cited by 5 · cited 3×
“The primary barrier to engagement noted in 25 studies was users’ experience of technical issues [44,50,80,92,100,103,118, 129,138,155,172,179,185,195,205,208,212-220], such as a mobile app crashing and shutting down unexpectedly; in 3 studies, participants did not have the resources required to use an intervention [17…”
BackgroundOn-line psychological support in the evaluation of specialists and future specialists in Poland
Chęć, M., Ligocka, M., Maciejewska, M., Samochowiec, J., Łodygowska, E., & Samochowiec, A. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.07.015 · Cited by 5 · cited 4×
“As seen in Multimedia Appendix 2, the 208 articles included in this review [27-237] reported on 2 types of user studies: (1) 69 studies were needs assessments that aimed to understand user needs and attitudes toward DMHIs without or before engaging with a specific intervention as part of a study and (2) 135 studies we…”
BackgroundInfluentialStevens, R., Polk, K., Merrill, C., Feng, F., Weiss, M., Brosnan, E., Gerber, M. S., & Barnes, L. E. (2018) · 2018 Systems and Information Engineering Design Symposium (SIEDS) · doi:10.1109/sieds.2018.8374724 · Cited by 5 · cited 2×
“Other demographic variables associated with user engagement were as follows: (1) employment status, with people who worked full time more likely to use the intervention than people who were retired [66] or unemployed [54,68]; (2) education, with participants with higher education reporting more acceptance of intervent…”
BackgroundUsability Assessment of a Post-Traumatic Stress Disorder (PTSD) mHealth App
Rodriguez-Paras, C., & Sasangohar, F. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601937 · Cited by 4 · cited 4×
“Usability issues formed a barrier to engaging with an intervention [46,50, 78,84,148-150,157,159,170,224-228].”
BackgroundInfluentialFrye, C. C., Ly, L. G., Murrieta, J., Sun, L., Cochancela, C. S., & Eikey, E. V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-43687-2_11 · Cited by 3
Self-citation
Research works printed but not linked: 12
- Pagliari, C, 2012, Stud Health Technol Inform, 181, 329
- 10.2196/jmir.4972 · DOI · Paper page
- 10.2196/12869 · DOI · Paper page
- Huerta-Ramos, E, 2017, Actas Esp Psiquiatr, 45, 277
- 10.3109/09638237.2016.1139064 · DOI · Paper page
- 10.1007/s00737-018-0829-y · DOI · Paper page
- 10.2196/resprot.5450 · DOI · Paper page
- 10.2196/mental.5837 · DOI · Paper page
- 10.2196/jmir.6269 · DOI · Paper page
- 10.2196/mental.6202 · DOI · Paper page
- 10.1080/15228835.2016.1233842 · DOI · Paper page
- 10.2196/10035 · DOI · Paper page
Cited by
An overview of and recommendations for more accessible digital mental health services
Lattie, E. G., Stiles-Shields, C., & Graham, A. K. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00003-1 · Cited by 446
Artificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440
“culties with using the program or remembering to engage with it [40].”
BackgroundJakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446
“Many of these strategies and factors, such as well-designed reminders, self-monitoring features, and embedded health professional support, have been applied across various health domains [11,20,21].”
BackgroundLam, R. W., Kennedy, S. H., Adams, C., Bahji, A., Beaulieu, S., Bhat, V., Blier, P., Blumberger, D. M., Brietzke, E., Chakrabarty, T., et al. (2024) · The Canadian Journal of Psychiatry · doi:10.1177/07067437241245384 · Cited by 369
Torous, J., Linardon, J., Goldberg, S. B., Sun, S., Bell, I., Nicholas, J., Hassan, L., Hua, Y., Milton, A., & Firth, J. (2025) · World Psychiatry · doi:10.1002/wps.21299 · Cited by 323
Metadata
- Authors
- Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H.
- Affiliations
- University of California, Irvine (US)
- University of California San Diego (US)
- Corresponding author
- Borghouts, Judith
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-03-24
- Volume
- 23
- Issue
- 3
- Pages
- e24387
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8074985
- OpenAlex
- W3128534511
- Semantic Scholar
- 893b0a390c82140e66abca65226ea876a93696cf
- Cited by
- 1,069
- References
- 250
- Citations by year
- 2026: 240 · 2025: 307 · 2024: 225 · 2023: 168 · 2022: 96 · 2021: 33
- FWCI
- 20.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- digital mental health interventions, user engagement, barriers to engagement, mental health apps, severe mental illness, technical challenges, personalization, social connectedness, user control, intervention design
- MeSH terms
- Mental Disorders, Humans, Mental Health, Technology, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.