Engagement and retention in digital mental health interventions: a narrative review
Open accessThe DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Background: While many digital mental health interventions (DMHIs) have been shown to be effective, such interventions also have been criticized for poor engagement and retention rates. However, several questions remain about how users engage with DMHIs, how to define engagement, and what factors might help improve DMHI engagement. Main abstract: In this narrative review, we show that although DMHIs are criticized for poor engagement, research suggests engagement rates are quite variable across studies and DMHIs. In some instances, engagement rates are high, even in real-world settings where there is evidence of a subset of users who could be considered ‘superusers’. We then review research on the barriers and facilitators to DMHI engagement, highlighting that qualitative research of users’ perceptions does not always align with quantitative research assessing relationships between these barriers/facilitators and actual engagement with DMHIs. We also introduce several potential issues in conceptualizations of DMHI engagement that may explain the mixed findings, including inconsistent definitions of engagement and assumptions about linear relationships between engagement and outcomes. Finally, we outline evidence suggesting that engagement with DMHIs is comparable to mobile application use broadly as well as engagement with more traditional forms of mental health care (i.e., pharmacological, psychotherapy). Conclusions: In order to increase the number of people who can benefit from DMHIs, additional research on engagement and retention is necessary. Importantly, we believe it is critical that this research move away from several existing misconceptions about DMHI engagement. We make three recommendations for research on DMHI engagement that we believe, if addressed, are likely to substantially improve the impact of DMHIs: (1) the need to adopt a clearly defined, common definition of engagement, (2) the importance of exploring patterns of optimal engagement rather than taking a ‘one size fits all’ approach, and (3) the importance of defining success within DMHIs based on outcomes rather than the frequency or duration of a user’s engagement with that DMHI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 3×
“In 2005, when digital health was in its infancy, Eysenbach wrote a seminal article entitled “ The Law of Attrition ” highlighting the low retention and engagement rates in eHealth studies of digital interventions [1].”
BackgroundResultInfluentialHow are habits formed: modelling habit formation in the real world
Lally, P., van Jaarsveld, C. H. M., Potts, H. W. W., & Wardle, J. (2010) · European Journal of Social Psychology · doi:10.1002/ejsp.674 · Cited by 2,036 · cited 1×
“Although frequent and consistent usage can help with habit formation [127], this also sets the bar for adherence to such DMHIs exceptionally high.”
BackgroundComputer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133
Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · cited 10×
“Relatedly, lower levels of health literacy, digital literacy, and mental health literacy have all been linked to poorer adherence to DMHIs [29, 36].”
BackgroundResultInfluentialInkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
Premature discontinuation in adult psychotherapy: A meta-analysis
Swift, J. K., & Greenberg, R. P. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028226 · Cited by 978
Objective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965 · cited 1×
“For example, one study of 93 mental health apps found that the median 15-day retention across apps was 3.9% and the median 30-day retention was 3.3%, suggesting minimal dropoff after this initial two-week period [3].”
MethodInfluentialPatient Medication Adherence: Measures in Daily Practice
Jimmy, B., & Jose, J. (2011) · Oman Medical Journal · doi:10.5001/omj.2011.38 · Cited by 956 · cited 1×
“…to treatment compliance, which could include the non-fulfillment adherence described earlier (i.e., not filling a prescription) as well as non-persistence (i.e., discontinuing a medication without a practitioner’s guidance) and non-conform-ance (i.e., not taking the medication as prescribed) [139].”
BackgroundA Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876 · cited 1×
“But most studies examining the relationship between continuous measures of engagement and improved clinical outcomes fail to find an association between DMHI use and improvements in outcomes [9, 12, 21, 22, 116–118].”
Compliance With Medication Regimens for Mental and Physical Disorders
Cramer, J. A., & Rosenheck, R. (1998) · Psychiatric Services · doi:10.1176/ps.49.2.196 · Cited by 725 · cited 1×
“One study found compliance rates ranging from 40% to 90%, with an average compliance rate of 65% [141].”
BackgroundFleming, T., Bavin, L., Lucassen, M., Stasiak, K., Hopkins, S., & Merry, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9275 · Cited by 670 · cited 1×
“…studies of seven publicly available DMHIs found that rates of minimal usage ranged from 21% to 88%, moderate usage ranged from 7% to 42%, and sustained usage (completing all intervention modules or engaging longer than six weeks) or completing the intervention ranged from 0.5% to 28.6% [18].”
BackgroundInfluentialLinardon, J., & Fuller-Tyszkiewicz, M. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000459 · Cited by 573 · cited 1×
“…example, one review of randomized controlled trials (RCTs) on smartphone-delivered DMHIs reported that, across studies, rates of failure to download or use the DMHI ranged from 0 to 58%, whereas rates of complete adherence (i.e., completing all intervention requirements) ranged from 2 to 92% [13].”
BackgroundMeta-analysis of dropout from cognitive behavioral therapy: Magnitude, timing, and moderators.
Fernandez, E., Salem, D., Swift, J. K., & Ramtahal, N. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000044 · Cited by 551 · cited 2×
“In a review of 115 studies on CBT, pretreatment dropout ranged from 11.4% to 21.66% for individuals with an anxiety or depressive disorder [144].”
BackgroundInfluentialJakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446
Artificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440 · cited 2×
“…applied text analysis to determine that when an artificially intelligent chatbot designed for adherence fidelity delivered activities within a DMHI, users wrote more text and used words more directly relevant to the nature of the activity, compared to self-guided versions of those activities [78].”
BackgroundSelf-citationLiverpool, S., Mota, C. P., Sales, C. M. D., Čuš, A., Carletto, S., Hancheva, C., Sousa, S., Cerón, S. C., Moreno-Peral, P., Pietrabissa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16317 · Cited by 408
Karyotaki, E., Kleiboer, A., Smit, F., Turner, D. T., Pastor, A. M., Andersson, G., Berger, T., Botella, C., Breton, J. M., Carlbring, P., et al. (2015) · Psychological Medicine · doi:10.1017/s0033291715000665 · Cited by 408 · cited 2×
“Although less commonly examined, studies have also shown that lower levels of education are associated with a higher risk of dropout [44].”
BackgroundGarrido, S., Millington, C., Cheers, D., Boydell, K., Schubert, E., Meade, T., & Nguyen, Q. V. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00759 · Cited by 400 · cited 4×
“A systematic review of DMHIs for young people also reported that of the reviewed studies that reported on engagement, participants typically completed less than half of the intervention content [8].”
BackgroundInfluentialDigital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Carolan, S., Harris, P. R., & Cavanagh, K. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7583 · Cited by 385 · cited 1×
“Similarly, a systematic review of DMHIs delivered in workplace settings found that although the average level of adherence (i.e., completing all intervention components) across studies was 45%, adherence rates for individual studies ranged from 3 to 95% [14].”
BackgroundIntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety
Mohr, D. C., Tomasino, K. N., Lattie, E. G., Palac, H. L., Kwasny, M. J., Weingardt, K., Karr, C. J., Kaiser, S. M., Rossom, R. C., Bardsley, L. R., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6645 · Cited by 301
Medication Adherence: A Review of the Literature and Implications for Clinical Practice
Julius, R. J., Novitsky, M. A., & Dubin, W. R. (2009) · Journal of Psychiatric Practice · doi:10.1097/01.pra.0000344917.43780.77 · Cited by 301
The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review
Alkhaldi, G., Hamilton, F. L., Lau, R., Webster, R., Michie, S., & Murray, E. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4790 · Cited by 273 · cited 2×
“…found that although there was some evidence that participants who received technology-based prompts engaged more frequently compared to those who received no engagement strategy, this effect was limited to a dichotomous definition of engagement and was considered small to moderate in size [83].”
BackgroundDarcy, A., Daniels, J., Salinger, D., Wicks, P., & Robinson, A. (2021) · JMIR Formative Research · doi:10.2196/27868 · Cited by 260 · cited 1×
“Several existing DMHIs use chatbots, or relational agents, to deliver their intervention content, and research suggests that users can develop a therapeutic alliance with these chatbots [75, 76].”
BackgroundReviewing the Assumptions About Men’s Mental Health: An Exploration of the Gender Binary
Smith, D. T., Mouzon, D. M., & Elliott, M. (2018) · American Journal of Men's Health · doi:10.1177/1557988316630953 · Cited by 243
A randomized controlled trial of a smartphone app for posttraumatic stress disorder symptoms.
Kuhn, E., Kanuri, N., Hoffman, J. E., Garvert, D. W., Ruzek, J. I., & Taylor, C. B. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000163 · Cited by 225 · cited 1×
“But most studies examining the relationship between continuous measures of engagement and improved clinical outcomes fail to find an association between DMHI use and improvements in outcomes [9, 12, 21, 22, 116–118].”
BackgroundBeatty, C., Malik, T., Meheli, S., & Sinha, C. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.847991 · Cited by 224 · cited 1×
“Several existing DMHIs use chatbots, or relational agents, to deliver their intervention content, and research suggests that users can develop a therapeutic alliance with these chatbots [75, 76].”
BackgroundSchlosser, D. A., Campellone, T. R., Truong, B., Etter, K., Vergani, S., Komaiko, K., & Vinogradov, S. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby078 · Cited by 206
Morris, R. R., Schueller, S. M., & Picard, R. W. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4167 · Cited by 206
Tremain, H., McEnery, C., Fletcher, K., & Murray, G. (2020) · JMIR Mental Health · doi:10.2196/17204 · Cited by 193
Bidargaddi, N., Almirall, D., Murphy, S., Nahum-Shani, I., Kovalcik, M., Pituch, T., Maaieh, H., & Strecher, V. (2018) · JMIR mHealth and uHealth · doi:10.2196/10123 · Cited by 189
Lipschitz, J., Miller, C. J., Hogan, T. P., Burdick, K. E., Lippin-Foster, R., Simon, S. R., & Burgess, J. (2019) · JMIR Mental Health · doi:10.2196/11334 · Cited by 183
Engagement in digital interventions.
Nahum-Shani, I., Shaw, S. D., Carpenter, S. M., Murphy, S. A., & Yoon, C. (2022) · American Psychologist · doi:10.1037/amp0000983 · Cited by 177 · cited 2×
“In a recent review, Nahum-Shani et al. defined engagement with digital interventions as “a state of energy investment involving physical, affective, and cognitive energies directed toward a focal stimulus or task” [105].”
BackgroundProviding Human Support for the Use of Digital Mental Health Interventions: Systematic Meta-review
Werntz, A., Amado, S., Jasman, M., Ervin, A., & Rhodes, J. E. (2023) · Journal of Medical Internet Research · doi:10.2196/42864 · Cited by 158
Allexandre, D., Bernstein, A. M., Walker, E., Hunter, J., Roizen, M. F., & Morledge, T. J. (2016) · Journal of Occupational & Environmental Medicine · doi:10.1097/jom.0000000000000680 · Cited by 157 · cited 1×
“Another study found that engagement rates were higher for an online stress management program for workplace settings when it was accompanied by a weekly support group compared to a fully self-guided program, although support groups in this case met face-to-face rather than virtually [69].”
BackgroundBaumel, A., Edan, S., & Kane, J. M. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz147 · Cited by 143 · cited 1×
“Indeed, one study found that levels of engagement with self-guided DMHIs were four times higher in RCTs compared to real-world usage of the same DMHI [16].”
ResultFarrer, L., Christensen, H., Griffiths, K. M., & Mackinnon, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028099 · Cited by 140 · cited 1×
“Of the four reviewed studies, two found incremental benefits of phone reminders over automated reminders [79, 80], but two found no significant effects [81, 82].”
BackgroundPerski, O., Crane, D., Beard, E., & Brown, J. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619880676 · Cited by 135 · cited 1×
“Although few studies have examined whether chatbots can also increase engagement, there is some promising evidence that the addition of a chatbot helps to increase engagement compared to self-guided versions of the same DMHIs [77, 78].”
BackgroundGabrielli, S., Rizzi, S., Bassi, G., Carbone, S., Maimone, R., Marchesoni, M., & Forti, S. (2021) · JMIR mHealth and uHealth · doi:10.2196/27965 · Cited by 125 · cited 1×
“While some research suggests that more severe mental health symptoms may be a barrier to engagement [29, 44, 47], other studies have found better levels of adherence among people with more severe mental health symptoms including depression [34], anxiety, and perceived stress [48].”
BackgroundCarolan, S., & de Visser, R. O. (2018) · JMIR Mental Health · doi:10.2196/mental.9146 · Cited by 121 · cited 9×
“Con-ceivably, these inconsistent results may be due to the fact that mental health symptoms do not directly predict engagement with DMHIs, but may impact a user’s level of motivation, which has been shown to predict engagement more consistently [47, 49].”
BackgroundInfluentialMohr, D. C., Schueller, S. M., Tomasino, K. N., Kaiser, S. M., Alam, N., Karr, C., Vergara, J. L., Gray, E. L., Kwasny, M. J., & Lattie, E. G. (2019) · Journal of Medical Internet Research · doi:10.2196/13609 · Cited by 116 · cited 1×
“However, more recent reviews testing the impact of coaching have either found no significant effect of support on engagement or adherence to DMHIs [36, 55, 59], or inconsistent results across studies [60, 61] or types of engagement [62].”
BackgroundDear, B. F., Staples, L. G., Terides, M. D., Fogliati, V. J., Sheehan, J., Johnston, L., Kayrouz, R., Dear, R., McEvoy, P. M., & Titov, N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.05.004 · Cited by 114 · cited 1×
“However, more recent reviews testing the impact of coaching have either found no significant effect of support on engagement or adherence to DMHIs [36, 55, 59], or inconsistent results across studies [60, 61] or types of engagement [62].”
BackgroundDigital Care for Chronic Musculoskeletal Pain: 10,000 Participant Longitudinal Cohort Study
Bailey, J. F., Agarwal, V., Zheng, P., Smuck, M., Fredericson, M., Kennedy, D. J., & Krauss, J. (2020) · Journal of Medical Internet Research · doi:10.2196/18250 · Cited by 109
Digital Mental Health Interventions for Depression: Scoping Review of User Engagement
Lipschitz, J. M., Van Boxtel, R., Torous, J., Firth, J., Lebovitz, J. G., Burdick, K. E., & Hogan, T. P. (2022) · Journal of Medical Internet Research · doi:10.2196/39204 · Cited by 105 · cited 1×
“Although many DMHIs are criticized for low engagement and retention rates, engagement rates tend to be underreported in published research [6] and are rarely reported publicly for available DMHIs (though there are services that provide estimates of app engagement for a fee).”
BackgroundPham, Q., Khatib, Y., Stansfeld, S., Fox, S., & Green, T. (2016) · Games for Health Journal · doi:10.1089/g4h.2015.0033 · Cited by 104 · cited 1×
“Another study conducted by Pham et al. found steep decreases in DMHI usage between Weeks 1 and 2 and Weeks 3 and 4, but relative stability in the number of users between Weeks 2 and 3 [125].”
Stolz, T., Schulz, A., Krieger, T., Vincent, A., Urech, A., Moser, C., Westermann, S., & Berger, T. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000301 · Cited by 102 · cited 1×
“Another found a significant correlation between DMHI usage and improvements in social anxiety outcomes, but only for a mobile version, not a computer-based version [115].”
BackgroundLeung, C., Pei, J., Hudec, K., Shams, F., Munthali, R., & Vigo, D. (2022) · Journal of Medical Internet Research · doi:10.2196/36004 · Cited by 94
Experimental therapeutics for digital mental health.
Graham, A. K., Lattie, E. G., & Mohr, D. C. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.2075 · Cited by 93
Examining the Reach of Smartphone Apps for Depression and Anxiety
Wasil, A. R., Gillespie, S., Shingleton, R., Wilks, C. R., & Weisz, J. R. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2019.19090905 · Cited by 87 · cited 1×
“1 Other research suggests some DMHIs may have high numbers of monthly active users, whereas others have nearly none [19].”
BackgroundParks, A. C., Williams, A. L., Tugade, M. M., Hokes, K. E., Honomichl, R. D., & Zilca, R. D. (2018) · International Journal of Wellbeing · doi:10.5502/ijw.v8i2.745 · Cited by 87 · cited 1×
“Our research has also found that users who engage at an optimal level (completing an average of at least two activities per week) report significantly greater improvements in outcomes relative to users engaging below the optimal level [39, 122, 123].”
BackgroundMikolasek, M., Witt, C. M., & Barth, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/11271 · Cited by 83 · cited 3×
“While some research suggests that more severe mental health symptoms may be a barrier to engagement [29, 44, 47], other studies have found better levels of adherence among people with more severe mental health symptoms including depression [34], anxiety, and perceived stress [48].”
BackgroundWhat Is the Current and Future Status of Digital Mental Health Interventions?
Baños, R. M., Herrero, R., & Vara, M. D. (2022) · The Spanish Journal of Psychology · doi:10.1017/sjp.2022.2 · Cited by 82
Dahne, J., Lejuez, C. W., Diaz, V. A., Player, M. S., Kustanowitz, J., Felton, J. W., & Carpenter, M. J. (2019) · Behavior Therapy · doi:10.1016/j.beth.2018.12.003 · Cited by 78 · cited 5×
“Similarly, Dahne et al. found that although there was a drop of nearly 20% in active users between the second and third week of their trial, the rate of active users remained flat between the third and sixth weeks (with smaller drops in active users occurring at the seventh and eighth weeks) [9].”
BackgroundResultInfluentialBidargaddi, N., Pituch, T., Maaieh, H., Short, C., & Strecher, V. (2018) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2018.07.004 · Cited by 77 · cited 2×
“…shows that push notifications that are personalized based on real-time assessments of a user’s engagement may have the broadest impact on different forms of DMHI engagement [92], and that notifications with personalized suggestions may be more effective than those with personalized insights [89].”
BackgroundMira, A., Bretón-López, J., García-Palacios, A., Quero, S., Baños, R. M., & Botella, C. (2017) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s130994 · Cited by 71
Hadjistavropoulos, H. D., Schneider, L. H., Edmonds, M., Karin, E., Nugent, M. N., Dirkse, D., Dear, B. F., & Titov, N. (2017) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2017.09.006 · Cited by 71
Leo, A. J., Schuelke, M. J., Hunt, D. M., Metzler, J. P., Miller, J. P., Areán, P. A., Armbrecht, M. A., & Cheng, A. L. (2022) · JMIR Formative Research · doi:10.2196/34889 · Cited by 70 · cited 2×
“Some studies have reported above industry standard engagement rates when participants learned about the DMHI through their employer [101] or during a visit to an orthopedic clinic [64].”
BackgroundHuberty, J., Vranceanu, A.-M., Carney, C., Breus, M., Gordon, M., & Puzia, M. E. (2019) · JMIR mHealth and uHealth · doi:10.2196/15648 · Cited by 67 · cited 1×
“For example, a cross-sectional survey of 12,151 users of the Calm meditation app found that the average length of engagement with their DMHI was 11.49 months and 60% were using the app five or more times per week [20].”
BackgroundInfluentialMuuraiskangas, S., Harjumaa, M., Kaipainen, K., & Ermes, M. (2016) · JMIR Mental Health · doi:10.2196/mental.4465 · Cited by 63 · cited 1×
“In another study, only 8.1% of eligible employees across two companies adopted a DMHI, where employees were invited to information sessions via emails from HR managers [102].”
BackgroundInfluentialStiles-Shields, C., Montague, E., Kwasny, M. J., & Mohr, D. C. (2019) · Psychological Services · doi:10.1037/ser0000261 · Cited by 59 · cited 1×
“Similarly, a small pilot study comparing two different DMHIs found that the DMHI with the lower frequency of logins had a stronger impact on depression, although there was no relationship between DMHI use and improvement in depression overall [120].”
ResultChen, A. T., Wu, S., Tomasino, K. N., Lattie, E. G., & Mohr, D. C. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103187 · Cited by 58 · cited 2×
“In one such study, Chen et al. examined patterns of usage across the Intellicare platform, which houses 13 different DMHIs [25].”
BackgroundSteinglass (2017) · doi:10.1002/da.22624 · Cited by 54 · cited 5×
“…have shown that guided, or supported, DMHIs have stronger effects than self-guided, or unsupported, interventions [53–56], and that higher levels of engagement with coaching predict better outcomes [12], the evidence for how the addition of human support impacts engagement with DMHIs is less clear.”
BackgroundResultInfluentialBennett-Levy, J., Singer, J., DuBois, S., & Hyde, K. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6269 · Cited by 52 · cited 1×
“Similarly, another study found that consultants who were leading e-mental health sessions within workplace environments identified enthusiastic managers and tech-savvy champions as likely facilitators of DMHI uptake [98].”
ResultDigital cognitive behavior therapy intervention for depression and anxiety: retrospective study
Venkatesan, A., Rahimi, L., Kaur, M., & Mosunic, C. (2020) · JMIR Mental Health · doi:10.2196/21304 · Cited by 47 · cited 2×
“Other research has found that changes in depression during an intensive phase of a DMHI program does not predict sustained engagement [27].”
BackgroundAL-Asadi, A. M., Klein, B., & Meyer, D. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3513 · Cited by 40
Wallin, E., Norlund, F., Olsson, E. M. G., Burell, G., Held, C., & Carlsson, T. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9690 · Cited by 36 · cited 2×
“%) initiated the first program module, only 54% of their sample completed the introductory module and 15% initiated a subsequent module [65].”
BackgroundAssessment of Real-World Use of Behavioral Health Mobile Applications by a Novel Stickiness Metric
Carlo, A. D., Hosseini Ghomi, R., Renn, B. N., Strong, M. A., & Areán, P. A. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.11978 · Cited by 31 · cited 1×
“…also has shown that the most downloaded mental health apps are not necessarily the ‘stickiest’ (a ratio of monthly active users to app downloads) [104], leading some researchers to argue that downloads may reflect a DMHI’s level of popularity or marketing success, rather than a solid indicator…”
BackgroundEconomic evaluation of an online single-session intervention for depression in Kenyan adolescents.
Wasil, A. R., Kacmarek, C. N., Osborn, T. L., Palermo, E. H., DeRubeis, R. J., Weisz, J. R., & Yates, B. T. (2021) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000669 · Cited by 20
Beintner, I., & Jacobi, C. (2019) · Internet Interventions · doi:10.1016/j.invent.2017.11.001 · Cited by 14
Metadata
- Authors
- Boucher, E. M., & Raiker, J. S.
- Venue
- BMC Digital Health
- Published
- 2024-08-08
- Volume
- 2
- Issue
- 1
- ISSN
- 2731-684X (ISSN-L)
- OpenAlex
- W4401380885
- Cited by
- 181
- References
- 71
- FWCI
- 12.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.