Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 250 of the 250 references it cites were found in a registry or an index; 285 of the 439 sources its claims cite were checked for support.
Abstract
Background: Digital mental health interventions (DMHIs), which deliver mental health support via technologies such as mobile apps, can increase access to mental health support, and many studies have demonstrated their effectiveness in improving symptoms. However, user engagement varies, with regard to a user's uptake and sustained interactions with these interventions. Objective: This systematic review aims to identify common barriers and facilitators that influence user engagement with DMHIs. Methods: A systematic search was conducted in the SCOPUS, PubMed, PsycINFO, Web of Science, and Cochrane Library databases. Empirical studies that report qualitative and/or quantitative data were included. Results: A total of 208 articles met the inclusion criteria. The included articles used a variety of methodologies, including interviews, surveys, focus groups, workshops, field studies, and analysis of user reviews. Factors extracted for coding were related to the end user, the program or content offered by the intervention, and the technology and implementation environment. Common barriers included severe mental health issues that hampered engagement, technical issues, and a lack of personalization. Common facilitators were social connectedness facilitated by the intervention, increased insight into health, and a feeling of being in control of one's own health. Conclusions: Although previous research suggests that DMHIs can be useful in supporting mental health, contextual factors are important determinants of whether users actually engage with these interventions. The factors identified in this review can provide guidance when evaluating DMHIs to help explain and understand user engagement and can inform the design and development of new digital interventions. © 2021 Journal of Medical Internet Research. All rights reserved.
Overview
CoChat Summary
## TL;DR
This systematic review synthesized 208 empirical articles to identify common barriers and facilitators of engagement with digital mental health interventions (DMHIs). Engagement was shaped by user characteristics, program/content fit, and technology/implementation context, with technical problems, severe symptoms, and poor personalization commonly hindering use.
## Key findings
- The review included 208 articles; study sizes ranged from 6 to more than 2 million participants, and exposure ranged from a short demonstration to up to 1 year of use.
- The authors identified 16 broader constructs influencing engagement, grouped into user-related, program-related, and technology- and environment-related factors.
- Common barriers included severe mental health issues that hampered engagement, technical issues (the primary barrier noted in 25 studies), usability issues, and lack of personalization.
- Common facilitators included social connectedness (e.g., connection to peers or therapists, reported in 18 studies), increased insight into health, and feeling in control of one’s own health.
## Methods
- Systematic review of empirical English-language peer-reviewed studies published from January 1, 2010 to December 2019 on digitally delivered mental health interventions for people aged ≥16 years.
- Searches were conducted in SCOPUS, PubMed, PsycINFO, Web of Science, and the Cochrane Library; 6146 papers were identified, 77 duplicates removed, 480 full texts reviewed, and 208 included.
- The team used inductive thematic analysis to code barriers/facilitators from abstracts, results/findings, and discussion sections, and used a quality reporting tool with 4 criteria.
## Limitations
- The paper states that the included studies were heterogeneous, so the authors could not conduct a meta-analysis.
- The paper notes inconsistency across studies in how engagement was measured (e.g., log-ins, time engaged, total time used, self-report), which makes comparison difficult.
- The review was limited to peer-reviewed empirical articles and to studies before the COVID-19 pandemic; the authors say some interventions may have been missed, and pandemic-related factors were not captured.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
104 Valid · 7 Not valid · 34 Not checked · 122 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Overall, 11 studies did not report the recruitment and/or selection process of study participants [30-40].”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Results > Quality Assessment
What the sources say
- Not matchedcites [30] Pagliari, C, 2012, Stud Health Technol Inform
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites [31] source
- Not checked — no full text of the sourcecites [32] source
- Could not verifycites [33] sourceExperimental — accuracy not yet measured
The paper’s ‘What Is Needed to Benefit From Blended Mental Health Treatment?’ section describes recruitment of therapists for its own consultations, but does not assess recruitment or selection reporting across 11 studies. Searches for the claimed count and for recruitment and selection reporting found no passage addressing it; page numbers were not available in our copy. (LLM, conf=0.75)
- Disputedcites [34] sourceExperimental — accuracy not yet measured
The Methods > Participants section reports where participants were recruited and specifies eligibility and exclusion criteria. Thus, this paper does report recruitment and selection information, contrary to the claim as applied to this cited study. The aggregate count of 11 studies cannot be assessed from this paper alone. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
- Disputedcites [35] sourceExperimental — accuracy not yet measured
The Methods > Recruitment section explicitly describes how participants were approached and selected: through personal and professional networks, followed by snowball and maximum variance sampling. Thus, this paper does not fit the citing sentence’s description of studies that failed to report recruitment and/or selection. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
- Disputedcites [36] sourceExperimental — accuracy not yet measured
The Methods section (page unavailable) reports that workshop trainees were invited to consultation groups and that those wishing to attend were assigned to groups. The Results > Participants section (page unavailable) states that 28 of 50 trainees elected to attend and explains why two were excluded from the analysis. This paper therefore reports how participants entered and were selected for the study, contrary to its inclusion among studies said not to report that process. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [37] source
- Disputedcites [38] sourceExperimental — accuracy not yet measured
The Methods > Procedure section explicitly reports how this study recruited participants: through websites, mental-health forums, social media, and word of mouth. Methods > Participants also reports how many people viewed and completed the survey. This source therefore contradicts its inclusion among studies said not to report recruitment and/or participant selection; it cannot establish the total for the other studies. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [39] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“However, evaluation studies have shown that more severe symptoms hamper actual engagement with digital interventions [51,56,83-101].”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Results > User-Related Constructs
What the sources say
- Not checked — no full text of the sourcecites [51] source
- Partly supportedcites [56] sourceExperimental — accuracy not yet measured
In Qualitative Results (page not supplied), one patient said cancer-related fatigue prevented her from completing an app exercise, supporting a limited example of symptoms hampering engagement. But Results > Maintenance reports greater continuous use among patients with higher depressive symptoms, so this study does not support the broad claim that more severe symptoms generally hamper engagement. (LLM, conf=0.85)
- Could not verifycites [83] sourceExperimental — accuracy not yet measured
The Device performance (p. 5) and Device stability (p. 7) passages concern perovskite solar cells, not people using digital interventions. Searches for symptom severity and engagement found no passage addressing whether more severe symptoms hamper use of those interventions. (LLM, conf=0.79)
- Not checked — no full text of the sourcecites [84] source
- Partly supportedcites [85] sourceExperimental — accuracy not yet measured
The Results (Engagement Conditions; no page given) report that symptom severity mattered to participants’ willingness to use the eating-disorder program: some doubted it was suitable for serious eating-disorder issues. But the study reports perceptions during usability testing, not evidence that more severe symptoms reduced actual engagement across digital interventions. The Discussion (Principal Findings; no page given) also notes that greater impairment may increase motivation in some groups. (LLM, conf=0.87)
- Disputedcites [86] sourceExperimental — accuracy not yet measured
The Feasibility section reports that completion was not significantly correlated with baseline anxiety or depression. It also notes that men with no distress were overrepresented among those who completed less than 20%; the Discussion suggests that men seeking psychological support may be more likely to complete the program. These passages do not show that more severe symptoms hamper engagement and point in the opposite direction. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Partly supportedcites [87] sourceExperimental — accuracy not yet measured
The Results (Adherence and Feasibility; page unavailable) report that higher positive-symptom scores correlated with lower diary completion, while higher negative-symptom scores correlated with lower diary completion and wearable adherence. This supports an association between symptom severity and engagement in this small schizophrenia study, but the claim’s broader wording implies a causal effect across digital interventions that the study does not establish. (LLM, conf=0.88)
- Partly supportedcites [88] sourceExperimental — accuracy not yet measured
In Results > Barriers and Facilitators (page not provided), some respondents said that people under severe psychological distress might be unwilling or unable to try the app. This supports distress as a possible barrier, but not the claim that evaluation studies showed reduced actual engagement. The Limitations section says respondents had not used a functioning app over an extended period, so their feedback could not establish that effect. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [89] source
- Partly supportedcites [90] sourceExperimental — accuracy not yet measured
The Introduction (Background; no page provided) says psychological symptoms may make mindfulness practice harder and may lead participants to disengage. But the Results (Participant Characteristics and Engagement) found no significant relationship between psychosocial characteristics and lesson completion, and the Discussion (Principal Findings) specifically found no significant association between baseline stress and engagement. This study therefore supports a possible barrier, not the claim that more severe symptoms were shown to hamper actual engagement. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Users’ engagement was facilitated by whether the intervention was endorsed by other users [43] or peers [211,241], their friends and family [97], or their current health care provider [152,161,242].”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Results > Technology- and Environment-Related Constructs
What the sources say
- Could not verifycites [43] sourceExperimental — accuracy not yet measured
Citation [242] is attached to the claim about endorsement by a user's current health care provider. The Discussion says clinician and consumer ratings may help users judge whether an intervention is appropriate and engaging, but it does not say that provider endorsement facilitates users' engagement. Searches for provider recommendations and clinician endorsement found no passage addressing that link. (LLM, conf=0.73)
- Partly supportedcites [211] sourceExperimental — accuracy not yet measured
The Results (Enabler 2: Positive Experience of the Consultation Sessions; page unavailable) describe health workers using YouTube clips as a different way to engage clients. That supports a role for providers in introducing digital resources, but the paper does not show that provider endorsement facilitated users’ engagement with a DMHI. The other endorsement sources in the citing sentence have separate citations and are not attributed to this paper. (LLM, conf=0.74)
- Disputedcites [241] sourceExperimental — accuracy not yet measured
Citation [43] is attached to endorsement by other users, not to the later claims about peers, family, or health care providers. In the Results section (page unavailable), attitudes among participants shown user testimonials did not differ significantly from the other conditions. The Discussion likewise reports no significant difference from the control group and says the effect of testimonials on uptake remains unclear. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Partly supportedcites [97] sourceExperimental — accuracy not yet measured
The Results (Posttreatment Attrition; page unavailable) report higher odds of completing posttreatment assessments among participants who heard about Anxiety Online from friends or family. This supports an association with that referral source, but the paper does not establish that friends or family endorsed the intervention or that endorsement facilitated engagement. The other sources of endorsement in the citing sentence have separate citations and are not assessed here. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although some DMHIs have been shown to be as effective as traditional mental health services (eg, psychotherapy and pharmacotherapy) in improving mental health conditions such as depression [7]”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Introduction > Background
What the sources say
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
The Results of Traditional Meta-analysis (page unavailable) report that self-guided iCBT improved depressive symptoms more than control conditions. They do not establish that it is as effective as psychotherapy or pharmacotherapy; the paper’s concluding discussion (page unavailable) notes smaller effects than face-to-face interventions. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, these analyses did not report on factors related to this variability in engagement.”
§ Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review > Introduction > Understanding User Engagement With DMHIs
What the sources say
- Not checked — no full text of the sourcecites [9] source
- Supportedcites [10] source
Section 3.3.4 (Satisfaction and adherence; page unavailable) reports the median and spread of adherence across trials, but does not report factors associated with that variation. Section 2.2 (Information sources; page unavailable) describes extracting adherence as course completion; the reported analysis is descriptive rather than an analysis of engagement-related factors. (LLM, conf=0.84)
- Supportedcites [11] source
The Discussion’s Summary of Evidence reports large differences in engagement but says that diverse measures make direct comparisons difficult. It calls for future reporting of intervention and implementation characteristics to help explain which approaches engage and retain users, consistent with the claim that the review did not analyze factors behind the variability. No page number is provided in our copy. (LLM, conf=0.83)
- Not checked — no full text of the sourcecites [16] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
157 more claims · 82 with their cited sources checked
Create a free account to see all 267 claims and every source verdict.
- It may state two separate claims as one. 57
- Probably not a substantial claim. 63
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Despite decades of research evidence, the uptake of DMHIs into practice is limited due to high dropout rates and poor user engagement of clients, especially in self-guided formats [2021].”
From Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 2): Participatory Design Study including Mental Health Professionals (2025) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ensure tools are convenient and useful in the context of day-to-day life, it is necessary to involve end-users across the design and development process (Mohr et al., 2017; Blandford et al., 2018; Borghouts et al., 2021; Poole, 2013).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Borghouts et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“if a product is not developed in line with the target user’s needs (eg, values, goals, and abilities) or is not engaging and intuitive to use, the likelihood of such a product being integrated, accepted, and adopted by people is low [14,20]”
From Optimization of a Transdiagnostic Mobile Emotion Regulation Intervention for University Students: Protocol for a Microrandomized Trial (2023) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A systematic review of barriers to facilitators of engagement with mobile health (mHealth) interventions reported that a user’s ability to integrate the intervention into their lives impacted engagement [53].”
From A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study (2022) · cites this paper as [53]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similar onboarding procedures have been shown to improve treatment adherence in app-based mindfulness meditation studies [49,51].”
From App-Based Mindfulness Meditation for People of Color Who Experience Race-Related Stress: Protocol for a Randomized Controlled Trial (2022) · cites this paper as [51]
Experimental — accuracy not yet measured
20 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035 · cited 6×
“Some of the themes identified in this review overlap with previous models conceptualizing engagement with digital health interventions, as well as general technology acceptance and health behavior, such as the Efficiency Model of Support [251], Technology Acceptance Model [253], and Health Belief Model [249].”
BackgroundMethodInfluentialRayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092 · cited 1×
“The search results were uploaded to Rayyan [20], a web-based software program for facilitating systematic reviews.”
MethodThe Health Belief Model: a decade later.
Janz, N. K., & Becker, M. H. (1984) · Health Education Quarterly · doi:10.1177/109019818401100101 · Cited by 8,437 · cited 2×
“…themes identified in this review overlap with previous models conceptualizing engagement with digital health interventions, as well as general technology acceptance and health behavior, such as the Efficiency Model of Support [251], Technology Acceptance Model [253], and Health Belief Model [249].”
BackgroundTechnology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159 · cited 1×
“…themes identified in this review overlap with previous models conceptualizing engagement with digital health interventions, as well as general technology acceptance and health behavior, such as the Efficiency Model of Support [251], Technology Acceptance Model [253], and Health Belief Model [249].”
BackgroundGuest, G., MacQueen, K., & Namey, E. (2012) · doi:10.4135/9781483384436 · Cited by 7,924 · cited 1×
“This process is common in qualitative research [26].”
BackgroundGulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292 · cited 3×
“In line with previous work [2], this again indicates that privacy can be important for people who experience stigma for or reluctance to help-seeking.”
BackgroundIBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429 · cited 2×
“The usability and acceptability of the technology were assessed using qualitative methods and standard measures, such as the survey based on the Unified Theory of Acceptance and Use of Technology [27], the Mobile Application Rating Scale [28], and the System Usability and After-Scenario Questionnaire [29].”
BackgroundMethodMental health literacy: empowering the community to take action for better mental health
Jorm, A. F. (2012) · American Psychologist · doi:10.1037/a0025957 · Cited by 1,783 · cited 1×
“Mental health literacy refers to knowledge about mental health symptoms and appropriate treatment options [238].”
BackgroundMohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 3×
“Although human support enhances engagement more than automated means such as email reminders [250], several studies included in our review found that such automated reminders not only facilitated engagement but were also experienced positively by users.”
BackgroundInfluentialThe association between social relationships and depression: A systematic review
Santini, Z. I., Koyanagi, A., Tyrovolas, S., Mason, C., & Haro, J. M. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.12.049 · Cited by 949 · cited 1×
“Social connectedness may be especially important for mental health interventions, as it can improve mood [254] and help combat depression [255].”
Background
Research works printed but not linked: 12
- Pagliari, C, 2012, Stud Health Technol Inform, 181, 329
- 10.2196/jmir.4972 · DOI · Paper page
- 10.2196/12869 · DOI · Paper page
- Huerta-Ramos, E, 2017, Actas Esp Psiquiatr, 45, 277
- 10.3109/09638237.2016.1139064 · DOI · Paper page
- 10.1007/s00737-018-0829-y · DOI · Paper page
- 10.2196/resprot.5450 · DOI · Paper page
- 10.2196/mental.5837 · DOI · Paper page
- 10.2196/jmir.6269 · DOI · Paper page
- 10.2196/mental.6202 · DOI · Paper page
- 10.1080/15228835.2016.1233842 · DOI · Paper page
- 10.2196/10035 · DOI · Paper page
Cited by
Items 201–300 of 1,065
Bernstein, E. E., Wolfe, E. C., Huguenel, B. M., & Wilhelm, S. (2024) · JMIR mhealth and uhealth · doi:10.2196/45860 · Cited by 22
“A recent review by Borghouts et al [176] examining barriers to and facilitators of user engagement found that scoring high on neuroticism and agreeableness was associated with greater interest in using smartphone apps to reduce stress, whereas scoring high on extraversion was a predictor of…”
Dimitropoulos, G., Bassi, E. M., Bright, K. S., Gondziola, J., Bradley, J., Fersovitch, M., Stamp, L., LaMonica, H. M., Iorfino, F., Gaskell, T., et al. (2023) · JMIR Mental Health · doi:10.2196/49099 · Cited by 20
“RenderX MH status and demographic variables are among the primary user capacity factors described in the literature that can affect eMH use [26,43].”
BackgroundResultInfluentialO’Sullivan, S., McEnery, C., Cagliarini, D., Hinton, J. D. X., Valentine, L., Nicholas, J., Chen, N. A., Castagnini, E., Lester, J., Kanellopoulos, E., et al. (2024) · JMIR Mental Health · doi:10.2196/49217 · Cited by 13
“Factors affecting attrition and dropout from digital interventions have been identified, such as a lack of personalization within digital interventions and severe mental disorders hampering engagement with interventions [32].”
BackgroundAbi Ramia, J., Abi Hana, R., Noun, P., Cuijpers, P., Carswell, K., van't Hof, E., Heim, E., Zoghbi, E., Sijbrandij, M., & El Chammay, R. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1293187 · Cited by 15
Designing personalized mental health interventions for anxiety: CBT therapists’ perspective
Balaskas, A., Schueller, S. M., Doherty, K., Cox, A. L., & Doherty, G. J. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103319 · Cited by 17
“…that one of the main reasons for disengagement from mental health apps is the lack of personalization and customization options (Salehi et al., 2019; Oyebode et al., 2020; Alqahtani and Orji, 2020; Alqahtani et al., 2019; Thach, 2018; Borghouts et al., 2021; Vo et al., 2019; Goodwin et al., 2016).”
Self-citationDonkin, L., Henry, N., Kercher, A., Pedersen, M., Wilson, H., & Chan, A. H. Y. (2024) · Interactive Journal of Medical Research · doi:10.2196/60548 · Cited by 21
“This is particularly valid when considering removing data with incomplete answers (particularly qualitative answers), as this may result in removing data from people who may struggle with literacy but also misrepresent attrition and engagement—both critical issues in digital interventions [45-47].”
Nordberg, S. S., Jaso, B. A., Sah, P., Schuler, K. L., Eyllon, M., Pennine, M., Hoyler, G. H., Barnes, J. B., Murillo, L., O’Dea, H., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/54528 · Cited by 19
Walker, R., Quong, S., Olivier, P. L., Wu, L., Xie, J., & Boyle, J. A. (2022) · JMIR Formative Research · doi:10.2196/39280 · Cited by 16
“A systematic review of user engagement with digital health resources for mental health also found that social connections and customized content are enablers for engagement, while technical and navigation difficulties are a barrier [50].”
BackgroundRantala, E., Järvelä‐Reijonen, E., Pettersson, K., Laine, J., Vartiainen, P., Närväinen, J., Pihlajamäki, J., Poutanen, K. S., Absetz, P., & Karhunen, L. J. (2022) · Nutrients · doi:10.3390/nu14183731 · Cited by 17
“The validity and reliability of the coding was ensured with a peer-checking method common in qualitative research [60,61].”
MethodHäfner, J., Schönfeld, S., Tokgöz, P., Choroschun, K., Schlubach, A., & Dockweiler, C. (2022) · Healthcare · doi:10.3390/healthcare10102019 · Cited by 16
“Symptom severity is a substantial barrier to use even among people who are interested in using it [13].”
BackgroundEditorial: Factors influencing user engagement with digital mental health interventions
Borghouts, J., Pretorius, C., Ayobi, A., Abdullah, S., & Eikey, E. V. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1197301 · Cited by 12
Self-citationSmartphone Apps and Wearables for Health Parameters in Young Adulthood: Cross-Sectional Study
Leuzzi, G., Job, M., Scafoglieri, A., & Testa, M. (2025) · JMIR Human Factors · doi:10.2196/64629 · Cited by 16
“Similarly, the reported percentage of use for mental health apps aligned with previous literature [34,35], except for Borghouts et al [35], who reported a higher usage rate.”
Shankar, R., Foo, T. H., Devi, F., & Xu, Q. (2025) · Journal of Mental Health · doi:10.1080/09638237.2025.2595612 · Cited by 16
Berardi, C., Hinwood, M., Smith, A., Melia, A., & Paolucci, F. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259995 · Cited by 19
Yeager, C. M., & Benight, C. C. (2022) · JMIR Mental Health · doi:10.2196/35048 · Cited by 20
“Using a theoretical framework is essential to begin to whittle down the most important factors [12].”
BackgroundTeleservices use among Latinx immigrant families during the Covid-19 pandemic
Hodges, J. C., & Calvo, R. (2022) · Children and Youth Services Review · doi:10.1016/j.childyouth.2022.106778 · Cited by 15
“Scholars have suggested that contextual factors such as access to digital services may be the critical factor to explain this differential utilization (Borghouts et al., 2021).”
BackgroundWelberry, H., Chau, T., Heffernan, M., Jose, J. C. S., Jorm, L. R., Singh, M. F., Sachdev, P. S., Anstey, K. J., Lautenschlager, N. T., Valenzuela, M., et al. (2023) · Journal of Alzheimer s Disease · doi:10.3233/jad-220990 · Cited by 13
“Olderpeoplemay experiencemorebarriersinusingthenecessarytech-nologysuchasanincreaseinvisualimpairmentand lowcomputerliteracy[7].”
Povey, J., Raphiphatthana, B., Torok, M. H., Nagel, T. M., Mills, P. P. J. R., Sells, J. R. H., Shand, F., Sweet, M., Lowell, A., & Dingwall, K. M. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02262-w · Cited by 15
“To ensure success, participatory design requires consideration of several principles, including acknowledging diversity [22, 23], shared decision-making [17, 19, 24], participant and research team upskilling, and strategies to manage the predictable tensions which arise within participant and stakeholder groups [20, 2…”
BackgroundAmanvermez, Y., Karyotaki, E., Cuijpers, P. J., Čihařová, M., Donker, M. H., Hurks, P. P. M., Salemink, E., Spinhoven, P., Struijs, S. Y., & de Wit, L. M. (2023) · JMIR Formative Research · doi:10.2196/45725 · Cited by 16
“Relevance of the information was found as an important factor in adherence to and user experience with eHealth interventions [31].”
InfluentialWeiner, L. S., Crowley, R. N., Sheeber, L., Koegler, F. H., Davis, J. F., Wells, M., Funkhouser, C. J., Auerbach, R. P., & Allen, N. B. (2024) · JMIR Mental Health · doi:10.2196/51366 · Cited by 24
“Other reviews have concluded that interventions incorporating human support (eg, coaching, manual adherence prompts, or integration with professional face-to-face care) yield greater effectiveness [36,37] and adherence [38,39] than self-guided apps.”
BackgroundKang, B., & Hong, M. (2024) · JMIR Formative Research · doi:10.2196/58791 · Cited by 20
Intention to Use a Mental Health App for Menopause: Health Belief Model Approach
Martin-Key, N. A., Funnell, E. L., Benáček, J., Spadaro, B., & Bahn, S. (2024) · JMIR Formative Research · doi:10.2196/60434 · Cited by 19
“Regarding cues to action, the importance of a mental health app being developed by psychiatrists or a reputable academic institution were recognized as key factors driving cues to action and, in turn, the intention to use the app, supporting previous research [36].”
ResultArıcan, O. H. (2024) · Turkish Journal of Maritime and Marine Sciences · doi:10.52998/trjmms.1566728 · Cited by 25
Meyerhoff, J., Popowski, S. A., Lakhtakia, T., Tack, E., Kornfield, R., Kruzan, K. P., Krause, C. J., Nguyen, T., Rushton, K., Pisani, A. R., et al. (2025) · JMIR Formative Research · doi:10.2196/69602 · Cited by 16
“…their use of a digital safety plan, as well as their application of coping skills, also sits within the context of digital health literature that suggests, for some, framework-based human support and accountability [64,65] can facilitate longitudinal engagement in digital interventions [66].”
Ahmed, A. S., Ho, C. W., Grant, Y., Archer, S., & Carrington, E. V. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-086412 · Cited by 44
“21–25 However, studies documenting acceptability by clinicians are scarce.”
Rothman, B., Slomkowski, M., Speier, A., Rush, A. J., Trivedi, M. H., Lakhan, S. E., Lawson, E., Fahmy, M., Carpenter, D., Chen, D., et al. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119409 · Cited by 18
Olaya, B., Feltz-Cornelis, C. M. V. D., Roijen, L. H., Merecz‐Kot, D., Sinokki, M., Naumanen, P., Shepherd, J., van Krugten, F. C. W., de Mul, M., Staszewska, K., et al. (2022) · Digital Health · doi:10.1177/20552076221131145 · Cited by 13
“Additionally, the use of digital technologies to deliver interventions faces high drop-out rates(19) and the problem of identifying participants at risk for mental disorders.(20) Nevertheless, the interest of employers from small and medium enterprises (SMEs) – where resources to be allocated to the promotion and prev…”
BackgroundExploring engagement with the CBT-informed Actissist smartphone application for early psychosis
Eisner, E., Berry, N., Morris, R., Emsley, R., Haddock, G., Machin, M., Hassan, L., & Bucci, S. (2023) · Journal of Mental Health · doi:10.1080/09638237.2023.2182429 · Cited by 13
“The research literature indicates that such mental health apps appear acceptable, feasible and potentially effective for a range of mental health problems (Borghouts et al., 2021; Wang et al., 2018) including psychosis (Chivilgina et al., 2020).”
BackgroundExpanding, improving, and understanding behaviour research and therapy through digital mental health
Cohen, Z. D., & Schueller, S. M. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104358 · Cited by 10
Self-citationStrudwick, G., Kassam, I., Torous, J. B., & Patenaude, S. (2025) · JMIR Mental Health · doi:10.2196/78791 · Cited by 17
“On the technology side, many tools are not interoperable with existing health information systems [22], are cumbersome to use, or are not developed with direct input from the clinicians and patients they aim to serve [23].”
Harnessing Implementation Science in Clinical Psychology: Past, Present, and Future
Beidas, R. S., Boyd, M. R., Casline, E. P., Scott, K., Patel, Z. S., Mills, C., Mustanski, B. S., Schriger, S. H., Williams, F. S., Waller, C., et al. (2025) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081423-021727 · Cited by 14
“While offering an exciting new direction, much of the challenge related to achieving this vision relates to client engagement with these technologies (Borghouts et al. 2021) as well as implementation challenges (Smith et al. 2023b).”
Truong, H., & McLachlan, C. S. (2022) · Sustainability · doi:10.3390/su14073929 · Cited by 19
Rasouli, S., Ghafurian, M., & Dautenhahn, K. (2022) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3527188.3561932 · Cited by 16
“effective and engaging features for them [7, 32].”
Lukka, L., Salonen, A., Vesterinen, M., Karhulahti, V., Palva, S., & Palva, J. M. (2023) · BMC Digital Health · doi:10.1186/s44247-023-00037-w · Cited by 12
“Generally, users expect digital intervention content to be personalized [73] and relevant to them [74], which is challenged by substantial variance in real-world clinical phenotypes.”
BackgroundNgũnjiri, A., Memiah, P., Kimathi, R., Wagner, F. A., Ikahu, A., Omanga, E., Kweyu, E., Ngunu, C., & Otiso, L. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20217018 · Cited by 15
Opozda, M. J., Galdas, P., Watkins, D., & Smith, J. (2023) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2023.152443 · Cited by 11
Armaou, M. (2024) · Social Sciences · doi:10.3390/socsci13020114 · Cited by 13
“Finally, technology-and environment-related constructs included cost and usability, privacy and confidentiality, social influence, and implementation factors (Borghouts et al. 2021).”
InfluentialKing, V. L., Siegel, G., Priesmeyer, H. R., Siegel, L. H., & Potter, J. S. (2024) · JMIR Formative Research · doi:10.2196/48068 · Cited by 15
“Focusing the content on participants earlier in OUD treatment who may want more recovery advice or improving the experience by augmenting personalization could make the app more engaging [33,34].”
BackgroundAdvancing Psychosocial Treatment for Body Dysmorphic Disorder: A State-of-the-Science Review
Jonathan, G., Armstrong, C. H., Miyares, P. E., Williams, J., & Wilhelm, S. (2024) · Behavior Therapy · doi:10.1016/j.beth.2024.04.002 · Cited by 15
Terceiro, L., Mustafa, M. I., Hägglund, M., & Kharko, A. (2024) · JMIR Research Protocols · doi:10.2196/65099 · Cited by 13
“Studies have examined participant engagement and retention across various settings, for example, mHealth or web-based platforms [21,25], focusing on particular patient groups, for example, older adults with dementia or digital mental health interventions [26-29].”
Schwarz, J., Meier-Diedrich, E., Scholten, M., Stephenson, L., Torous, J. B., Wurster, F., & Blease, C. (2025) · Journal of Medical Internet Research · doi:10.2196/68549 · Cited by 13
“The existing evidence suggests that people with serious mental health conditions tend to have less access to digital health services or use them to a limited extent [71-73].”
Snipes, C., Dorner‐Ciossek, C., Hare, B. D., Besedina, O., Campellone, T. R., Petrova, M., Lakhan, S. E., & Pratap, A. (2025) · JMIR Mental Health · doi:10.2196/64959 · Cited by 14
Exploring Youth Perspectives on Digital Mental Health Platforms: Qualitative Descriptive Study
Daniel, S., Volcko, L., Bassi, E. M., Hews‐Girard, J., Bright, K. S., Barker, M., Norman, L., Pintson, K., Henry, G., Soufi, S., et al. (2025) · JMIR Human Factors · doi:10.2196/69907 · Cited by 16
“To date, research suggests that reasons for lack of engagement in dMH platforms include limited in-person elements, for example, face-to-face support from a parent, peer or professional [13], privacy concerns [25], technical difficulties [25], and inadequate personalization of the platform [25,26].”
Cross, S. P. M., Mangelsdorf, S. N., Valentine, L., O’Sullivan, S., McEnery, C., Scott, I., Gilbertson, T., Louis, S., Myer, J., Liu, P., et al. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100849 · Cited by 18
“Personalisation is increasingly recognised as essential for sustaining engagement and improving outcomes in youth DMHIs (Borghouts et al., 2021; Garrido et al., 2019; Li et al., 2024; Liverpool et al., 2020).”
Asare, M., Lanning, B. A., Isada, S., Rose, T., & Mamudu, H. M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182010820 · Cited by 13
“After reviewing existing instruments [36] and literature [37,38], a 23-item survey consisting of independent variables (8 items), dependent variables (2 items), social media usage behavior (4 items), and covariates (9 items) was developed.”
MethodRobot-mediated interventions for youth mental health
Alves‐Oliveira, P., Budhiraja, T., So, S., Karim, R., Björling, E. A., & Çakmak, M. (2022) · Design for Health · doi:10.1080/24735132.2022.2101825 · Cited by 18
“User retention is a problem often faced in this regard (Borghouts et al. 2021).”
BackgroundCarvalho, L. R., Haas, L. M., Zeni, G. D., Victor, M. M., Techele, S. P., Castanho, J. M., Coimbra, I. M., de Sousa, A. D. F., Ceretta, N., Guirado, A. G., et al. (2023) · European Psychiatry · doi:10.1192/j.eurpsy.2023.2422 · Cited by 17
Schouten, M. J. E., Derksen, M. E., Dekker, J., Goudriaan, A. E., & Blankers, M. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100641 · Cited by 12
“relevant and appropriate) to end-users, seems to be an important factor that can contribute to user engagement, whereas depressive symptoms and low mood might hinder user engagement (Borghouts et al., 2021).”
BackgroundGillis, C., Williams, J., Gillett, G., McGrath, R., Ang, K., Bakolis, I., de la Torre, J. A., Tredget, G., Gaughran, F., Cross, S., et al. (2024) · Issues in Mental Health Nursing · doi:10.1080/01612840.2023.2279207 · Cited by 14
“Current literature on DHIs for people with SMI notes either the success of purpose-built DHIs (Aschbrenner et al., 2016; Macias et al., 2015), or digital devices aimed at mental well-being (Borghouts et al., 2021; Philippe et al., 2022).”
BackgroundLo, B., Durocher, K., Charow, R., Kimball, S., Phạm, Q., Sockalingam, S., Wiljer, D., & Strudwick, G. (2025) · Journal of Medical Internet Research · doi:10.2196/67820 · Cited by 11
“First, as outlined in the Introduction section, a number of existing frameworks have explored the factors that influence user engagement with digital tools [27,32].”
InfluentialDavid, D. O., Baxter, P. E., Belpaeme, T., Billing, E., Cai, H., Cao, H.-L., Ciocan, A., Costescu, C. A., García, D. H., Esteban, P. G., et al. (2025) · Science Robotics · doi:10.1126/scirobotics.adl2266 · Cited by 11
Békés, V., & Doorn, K. A. (2026) · Psychotherapy Research · doi:10.1080/10503307.2026.2615388 · Cited by 13
“A comprehensive systematic review by Borghouts et al. (2021) found that while individuals with more severe symptoms were often more willing to try a DMHI, those same severe symptoms could ultimately hamper their actual engagement.”
Pine, R., Mbinta, J. F., Morenga, L. T., & Fleming, T. M. (2023) · JMIR Serious Games · doi:10.2196/46697 · Cited by 10
“Moreover, Match Emoji enables large portions of the population to receive the same content irrespective of their proficiency with gaming or access to the XSL • FO RenderX internet, addressing a significant barrier to equity and engagement with DMHIs [11].”
BackgroundDECENT: A sociotechnical approach for developing mobile health apps in underserved settings
Ikwunne, T. A., Hederman, L., & Wall, P. J. (2023) · Digital Health · doi:10.1177/20552076231203595 · Cited by 15
Funnell, E. L., Spadaro, B., Martin-Key, N. A., Benáček, J., & Bahn, S. (2024) · JMIR Formative Research · doi:10.2196/48881 · Cited by 13
“Finally, in terms of “functionality,” similarly to previous work, interviewees mentioned that ease of use and in-app guidance would increase app use [55], especially for apps that require a high level of motivation, such as mental health apps.”
BackgroundResultInfluentialBali, C., Feher, Z., Arató, N., Kiss, B. L., Lábadi, B., & Zsido, A. N. (2024) · Scientific Reports · doi:10.1038/s41598-024-63120-w · Cited by 22
“There are proven benefits of using ICT 47,71 , yet many people still lack digital skills 5,8 .”
BackgroundCirocki, A., Indrarathne, B., & Calderón, V. E. A. (2024) · Reflective Practice · doi:10.1080/14623943.2024.2384124 · Cited by 11
“Previous research reveals that teacher PD improves schools, increases teaching quality and effectiveness, and enhances student learning and well-being (e.g. Borghouts et al., 2021; Farrell, 2018; Fischer et al., 2018; Saleem et al., 2021; Timperley, 2011; Vangrieken et al., 2017).”
Jackson, H. M., Gulliver, A., Hasking, P. A., Leach, L., Batterham, P. J., Calear, A. L., & Farrer, L. M. (2024) · Digital Health · doi:10.1177/20552076241277175 · Cited by 17
“18 Our study extends these fi ndings by suggesting that even relatively brief interventions may struggle to sustain user interest, highlighting the need to identify more engaging ways to deliver content for students.”
InfluentialNowels, M., McDarby, M., Brody, L. A., Kleiman, E. M., Henson, S. J. S., Castro, C. M., & Kozlov, E. (2024) · Journal of Medical Internet Research · doi:10.2196/48696 · Cited by 13
“This result is consistent with findings from a systematic review that human factors, such as severe mental health symptoms, can be a barrier to engagement [15].”
Elmer, T., Wolf, M., Snippe, E., & Scholz, U. (2025) · JMIR Mental Health · doi:10.2196/74103 · Cited by 22
“Digital mental health interventions have low entry barriers, can be cost-effective, and have the potential to reach a wide range of individuals, including those reluctant to seek psychotherapy due to stigma [16,17].”
Biliūnaitė, I., Kazlauskas, E., Sanderman, R., & Andersson, G. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.725510 · Cited by 13
“The latter could be important for informal caregivers, who might have negative prior experiences of using such interventions (38) or, consider themselves as less tech savvy (39).”
BackgroundADHDCoach—a virtual clinic for parents of children with ADHD: Development and usability study
Poetar, C.-R., David, D. O., Dobrean, A., Noje, A., Șipoș, R., & Predescu, E. (2023) · Digital Health · doi:10.1177/20552076231161963 · Cited by 14
“Another barrier to the adoption of digital mental health interventions is the lack of personalization.(32) Future studies could benefit from qualitative assessments (e.”
BackgroundIn-Depth Co-Design of Mental Health Monitoring Technologies by People with Lived Experience
Patrickson, B., Musker, M., Thorpe, D., van Kasteren, Y., Bidargaddi, N. P., & The Consumer and Carer Advisory Group (CCAG) (2023) · Future Internet · doi:10.3390/fi15060191 · Cited by 13
“Digital mental health care processes may feature digital tools, but they also encompass broader contextual concerns and service delivery considerations that can profoundly influence the consumer’s lived experience of care [25].”
BackgroundInfluentialHunt, X., Jivan, D. C., Naslund, J. A., Breet, E., & Bantjes, J. R. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.39 · Cited by 15
“Many of the issues raised in this study are ones germane to the literature on mental health apps, including convenience (Carolan and de Visser, 2018) and the personalisation of scalable interventions (Borghouts et al., 2021).”
BackgroundDevelopment of a Virtual Human for Supporting Tobacco Cessation During the COVID-19 Pandemic
Loveys, K., Lloyd, E., Sagar, M. A., & Broadbent, E. (2023) · Journal of Medical Internet Research · doi:10.2196/42310 · Cited by 11
“This may increase engagement with the health information or intervention that they are delivering [12].”
Fisher, A. C., Corrigan, E., Cross, S. P. M., Ryan, K., Staples, L., Tan, R. L., Titov, N., & Dear, B. F. (2023) · Clinical Psychologist · doi:10.1080/13284207.2023.2279657 · Cited by 10
Acceptability of workplace choice architecture modification for healthy behaviours
Rantala, E., Vanhatalo, S., Pérez-Cueto, F. J. A., Pihlajamäki, J., Poutanen, K. S., Karhunen, L. J., & Absetz, P. (2023) · BMC Public Health · doi:10.1186/s12889-023-17331-x · Cited by 10
“We promoted the validity and reliability of the coding through a peer-checking process common in qualitative research [48, 49].”
MethodKlementi, T., Piho, G., & Ross, P. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2024.1411013 · Cited by 16
Kranenburg, L. W., Gillis, J., Mayer, B., & Hoogendijk, W. J. G. (2021) · JMIR Mental Health · doi:10.2196/32123 · Cited by 12
“This potential hypothesis is supported by the recent review of Borghouts [31], which points toward a generally higher engagement for guided (vs unguided) interventions and to the importance of social connectedness as a facilitator of user engagement.”
Addington, E. L., Cummings, P., Jackson, K., Yang, D., & Moskowitz, J. T. (2022) · Affective Science · doi:10.1007/s42761-022-00135-4 · Cited by 12
“…the PARK website at least once, those who never logged in to PARK reported higher depression, anxiety, and impact of the pandemic on their resources, as well as lower meaning and purpose, reiterating earlier findings that psychological symptoms can deter DMHI usage (Borghouts et al., 2021).”
BackgroundInfluentialLlaneza, D. H., Llaneza, A. J., & Kozlov, E. (2022) · Clinical Gerontologist · doi:10.1080/07317115.2022.2154728 · Cited by 13
“Prior research has found similar barriers to app use for mobile mental health services (Borghouts et al., 2021; Huckvale et al., 2020; Stiles-Shields et al., 2017).”
BackgroundMacKean, M., Lecchi, T., Mortimer, R., & Midgley, N. (2023) · Journal of Child Psychotherapy · doi:10.1080/0075417x.2023.2173271 · Cited by 13
“However, digital inequalities among individuals in the population may serve as a barrier for some individuals who would otherwise benefit from this support, meaning they are not accessible for all (Borghouts et al., 2021).”
BackgroundPodcasts in Mental, Physical, or Combined Health Interventions for Adults: Scoping Review
Dascombe, E. M., Morgan, P. J., Drew, R. J., Regan, C., Turner‐McGrievy, G. M., & Young, M. D. (2025) · Journal of Medical Internet Research · doi:10.2196/63360 · Cited by 12
“Correspondingly, these themes align with participants’perceptions of the benefits of other adjacent digital health interventions, such as digital mental health promotion interventions [126,127], lifestyle behavior change apps [128], and eHealth services [19].”
Wu, Q., & Street, R. L. (2023) · Journal of American College Health · doi:10.1080/07448481.2023.2224435 · Cited by 9
“…experiences—such as clinical consultations; 5 social media interactions (ie liking, sharing, and commenting on social networking sites); 6 and family conversations 4 —are related to factors (eg help-seeking attitude, stigma, efficacy) influencing MHS. Compared with mass media (eg…”
Park, S. Y., Yourell, J., McAlister, K. L., & Huberty, J. (2023) · JMIR Formative Research · doi:10.2196/54284 · Cited by 29
“For instance, studies that have explored user behaviors in mobile apps suggest that in-app costs can contribute to negative user perceptions, while free apps are associated with positive user perceptions [36,37].”
BackgroundDigitale Technologien zur Verbesserung der psychischen Gesundheit
Fuhr, D. C., Wolf‐Ostermann, K., Hoel, V., & Zeeb, H. (2024) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-024-03842-4 · Cited by 15
Quayle, E., Schwannauer, M., Varese, F., Cartwright, K. L., Hewins, W., Chan, C., Newton, A., Chitsabesan, P., Richards, C., & Bucci, S. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1325385 · Cited by 9
Thomson, M., Henderson, G., Rogers, T., Locke, B., Vines, J., & MacBeth, A. M. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000522 · Cited by 16
The impact of family history of mental illness on mental health help seeking in university students
Perich, T., & Andriessen, K. (2024) · Journal of Mental Health · doi:10.1080/09638237.2024.2361235 · Cited by 10
“As noted by previous studies, online help-seeking may increase social connectedness and a sense of agency and control (Borghouts et al., 2021) which may also be important for this population.”
Salamanca-Sanabria, A., Liew, S. J., Mair, J. L., Iorio, M. D., Ling, Y. D. Y., Tint, M. T., Wei, Y. T., Lim, K. M. X., Ong, D., Chooi, Y. C., et al. (2024) · Trials · doi:10.1186/s13063-024-08247-x · Cited by 11
“User adherence in mHealth interventions varied based on user-related, content-related, and technology (personal-ise remainders, user-friendly, technically stable App, personal support, and gamification features) related barriers and facilitators of engagement [41, 42].”
BackgroundVomhof, M., Bau, J., Hüter, P., Stehl, S., Haastert, B., Loerbroks, A., Icks, A., Calo, S., Schuster, L., Pischke, C. R., et al. (2024) · JMIR Formative Research · doi:10.2196/55921 · Cited by 10
“Despite the considerable burden attributable to common mental disorders (CMDs), numerous structural obstacles to the use of (face-to-face) psychological interventions, such as waiting times, remain [1].”
BackgroundUser Engagement in an Online Digital Health Intervention to Promote Problem Solving
O'Brien, H. L., Chen, A., Kaneshiro, J., & Zaslavsky, O. (2024) · Interacting with Computers · doi:10.1093/iwc/iwae030 · Cited by 13
“This is also why attrition rates for DHIs are so alarming (Yeager and Benight, 2018; Borghouts et al., 2021) and why developers are concerned with fostering engagement in the first place.”
Farrer, L. M., Jackson, H. M., Gulliver, A., Calear, A. L., Leach, L., Hasking, P. A., Katruss, N., & Batterham, P. J. (2024) · Journal of Medical Internet Research · doi:10.2196/53598 · Cited by 11
“Lack of perceived relevance and personalization have been previously reported as the barriers to engagement with digital mental health interventions [76].”
InfluentialZawadzki, M. J., Torok, Z. A., Peña, M., & Gavrilova, L. (2025) · Annals of Behavioral Medicine · doi:10.1093/abm/kaaf025 · Cited by 11
Zimmermann, E., & Tomczyk, S. (2025) · Journal of Medical Internet Research · doi:10.2196/71510 · Cited by 24
A systematic review on personalization of treatment components in IBIs for mental disorders
Schaeuffele, C., Zagorscak, P., Langerwisch, V., Wilke, J., Medvedeva, Y., & Knaevelsrud, C. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100840 · Cited by 15
“Perceiving an IBI as a good fit may foster engagement (Borghouts et al., 2021).”
Calvert, E., Hackett, K., Torous, J. B., & Giovannetti, T. (2025) · International Psychogeriatrics · doi:10.1016/j.inpsyc.2025.100123 · Cited by 12
“Digital mental health interventions, defined as psychosocial interventions delivered via digital platforms such as smartphones, wearable devices or the internet, have emerged as a promising strategy to expand access to care [4].”
Liu, J., & Gao, L. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.01.074 · Cited by 9
Michalak, E. E., Barnes, S. J., Morton, E. E., O'Brien, H. L., Murray, G., Hole, R., & Meyer, D. (2022) · JMIR Research Protocols · doi:10.2196/36213 · Cited by 12
“Although human or peer support has been shown to enhance engagement with digital health interventions [44,45], this comes with a trade-off in terms of feasibility, particularly in terms of scale-up.”
BackgroundSmit, D., Vrijsen, J. N., Broekman, T. G., Groeneweg, B. F., & Spijker, J. (2022) · JMIR Formative Research · doi:10.2196/39912 · Cited by 15
“Moreover, considering the informal nature and flexibility, free use of our platform, and the fact that our sample mostly consisted of individuals with moderate to severe depressive symptoms, smaller goals such as an increased sense of being (emotionally) supported or finding new hope are probably more feasible [80].”
BackgroundLearnings from user feedback of a novel digital mental health assessment
Funnell, E. L., Spadaro, B., Benáček, J., Martin-Key, N. A., Metcalfe, T., Olmert, T., Barton‐Owen, G., & Bahn, S. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.1018095 · Cited by 14
“In fact, receiving reminders to interact with a DMHI is also associated with higher engagement (59).”
BackgroundInfluentialRiva, G., Lernia, D. D., Tuena, C., Bernardelli, L., Gutiérrez‐Maldonado, J., Ferrer‐García, M., Porras-García, B., Meyer, M. L., Shiban, Y., Castelnuovo, G., et al. (2023) · Psychosomatic Medicine · doi:10.1097/psy.0000000000001198 · Cited by 12
“There is now growing evidence that digital psychological interventions are effective, including efficacy for mental health outcomes that are likely to be influenced by the COVID-19 pandemic (68,69).”
BackgroundDIGITAL HEALTH TOOLS FOR BREASTFEEDING MOTHERS: A COMPARATIVE REVIEW BETWEEN NIGERIA AND THE US
Soyombo, D. A. (2024) · International Journal of Applied Research in Social Sciences · doi:10.51594/ijarss.v6i4.1009 · Cited by 9
Milne‐Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2021) · JMIR Research Protocols · doi:10.2196/35172 · Cited by 14
“Given the accepted importance of engagement as a prerequisite for behavior change [17], several systematic reviews have examined various factors that could influence engagement with digital health interventions [25-28].”
BackgroundBenjet, C. L., Kessler, R. C., Kazdin, A. E., Cuijpers, P. J., Albor, Y., Tapias, N. E. C., Contreras‐Ibáñez, C. C., González, M. S. D., Gildea, S. M., González, N., et al. (2022) · Trials · doi:10.1186/s13063-022-06255-3 · Cited by 10
“User engagement in Internet interventions can vary and can include user-related, content-related, and technology-related barriers and facilitators of engagement [43].”
BackgroundAlfaro, A. J., Sakai, E. Y., Carlson, C., Mehta, P. S., Anderson, J. R., Wynn, M. J., & Gould, C. E. (2022) · Clinical Gerontologist · doi:10.1080/07317115.2022.2115433 · Cited by 8
“The Geri-Mobile Health program was able to address the three common barriers to using mental health apps identified in a recent systematic review (Borghouts et al., 2021).”
Mudau, T., Jithoo, V., & Dietrich, J. J. (2024) · South African Journal of Psychology · doi:10.1177/00812463241249100 · Cited by 10
“…a mental health app does not diminish its potential effectiveness but suggests that mental health app interventions introduced to university students could function as a resource to be used alongside face-to-face therapy and not a replacement for therapy (Borghouts et al., 2021; Koh et al., 2022).”
BackgroundMurray, A. L., Thye, M. D., Obsuth, I., Cai, S., Lui, M., Orr, C., & Saravanan, A. (2025) · JMIR Mental Health · doi:10.2196/56066 · Cited by 20
“One recent comprehensive review examined the barriers and facilitators to mental health DHI engagement, identifying 208 eligible papers for inclusion [102].”
Paleri, V., Valmaggia, L., Kaleva, I., Martland, R., & Riches, S. (2024) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-024-00434-6 · Cited by 18
“Research has demonstrated that the conciseness of digital interventions is vital in supporting greater user engagement (Borghouts et al., 2021), so this may have also impacted overall findings.”
Moretti, F. A., Bortolini, T., Hartle, L., Moll, J., Mattos, P., Furtado, D. R., Fontenelle, L. F., & Fischer, R. D. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1383999 · Cited by 11
Metadata
- Authors
- Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H.
- Affiliations
- University of California, Irvine (US)
- University of California San Diego (US)
- Corresponding author
- Borghouts, Judith
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-03-24
- Volume
- 23
- Issue
- 3
- Pages
- e24387
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8074985
- OpenAlex
- W3128534511
- Semantic Scholar
- 893b0a390c82140e66abca65226ea876a93696cf
- Cited by
- 1,069
- References
- 250
- Citations by year
- 2026: 240 · 2025: 307 · 2024: 225 · 2023: 168 · 2022: 96 · 2021: 33
- FWCI
- 20.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- digital mental health interventions, user engagement, barriers to engagement, mental health apps, severe mental illness, technical challenges, personalization, social connectedness, user control, intervention design
- MeSH terms
- Mental Disorders, Humans, Mental Health, Technology, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.