Human Support in App-Based Cognitive Behavioral Therapies for Emotional Disorders: Scoping Review
Open accessThe DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
Background: Smartphone app–based therapies offer clear promise for reducing the gap in available mental health care for people at risk for or people with mental illness. To this end, as smartphone ownership has become widespread, app-based therapies have become increasingly common. However, the research on app-based therapies is lagging behind. In particular, although experts suggest that human support may be critical for increasing engagement and effectiveness, we have little systematic knowledge about the role that human support plays in app-based therapy. It is critical to address these open questions to optimally design and scale these interventions. Objective: The purpose of this study is to provide a scoping review of the use of human support or coaching in app-based cognitive behavioral therapy for emotional disorders, identify critical knowledge gaps, and offer recommendations for future research. Cognitive behavioral therapy is the most well-researched treatment for a wide range of concerns and is understood to be particularly well suited to digital implementations, given its structured, skill-based approach. Methods: We conducted systematic searches of 3 databases (PubMed, PsycINFO, and Embase). Broadly, eligible articles described a cognitive behavioral intervention delivered via smartphone app whose primary target was an emotional disorder or problem and included some level of human involvement or support (coaching). All records were reviewed by 2 authors. Information regarding the qualifications and training of coaches, stated purpose and content of the coaching, method and frequency of communication with users, and relationship between coaching and outcomes was recorded. Results: Of the 2940 titles returned by the searches, 64 (2.18%) were eligible for inclusion. This review found significant heterogeneity across all of the dimensions of coaching considered as well as considerable missing information in the published articles. Moreover, few studies had qualitatively or quantitatively evaluated how the level of coaching impacts treatment engagement or outcomes. Although users tend to self-report that coaching improves their engagement and outcomes, there is limited and mixed supporting quantitative evidence at present. Conclusions: Digital mental health is a young but rapidly expanding field with great potential to improve the reach of evidence-based care. Researchers across the reviewed articles offered numerous approaches to encouraging and guiding users. However, with the relative infancy of these treatment approaches, this review found that the field has yet to develop standards or consensus for implementing coaching protocols, let alone those for measuring and reporting on the impact. We conclude that coaching remains a significant hole in the growing digital mental health literature and lay out recommendations for future data collection, reporting, experimentation, and analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385
Twenge, J. M., Cooper, A. B., Joiner, T. E., Duffy, M. E., & Binau, S. G. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000410 · Cited by 1,469
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 1×
“In fact, some studies have found that external supports are associated with worse treatment outcomes, as self-contained apps may be more comprehensive in their design or users may feel compelled to be more independently responsible for working through materials [23].”
BackgroundMohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 3×
“Supportive accountability predicts that treatment adherence will increase if coaches are viewed as trustworthy, knowledgeable, helpful, and collaborative; in addition, coaches should increase salience and perceived utility or personal relevance of new behaviors for individual users to increase their motivation and thu…”
BackgroundAndersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · cited 2×
“Nevertheless, the prevailing wisdom is that the provision of human support can improve user engagement and outcomes in digital mental health [91-95].”
BackgroundBorghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · cited 2×
“Currently, although coaching ostensibly outperforms automated messages or reminders in enhancing engagement with digital therapies, the latter may still provide clinically meaningful benefits and are appreciated by users [21] and fully automated chatbots and other conversational agents are becoming more sophisticated…”
BackgroundThe impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037
Objective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965
The Future of Intervention Science: Process-Based Therapy
Hofmann, S. G., & Hayes, S. C. (2019) · Clinical Psychological Science · doi:10.1177/2167702618772296 · Cited by 888
Karyotaki, E., Efthimiou, O., Miguel, C., Maas genannt Bermpohl, F., Furukawa, T. A., Cuijpers, P., Individual Patient Data Meta-Analyses for Depression (IPDMA-DE) Collaboration, Riper, H., Patel, V., Mira, A., et al. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.4364 · Cited by 866
Linardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2019) · World Psychiatry · doi:10.1002/wps.20673 · Cited by 860
The age of anxiety? The birth cohort change in anxiety and neuroticism, 1952-1993.
Twenge, J. M. (2000) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.79.6.1007 · Cited by 786
Microrandomized trials: An experimental design for developing just-in-time adaptive interventions.
Klasnja, P., Hekler, E. B., Shiffman, S., Boruvka, A., Almirall, D., Tewari, A., & Murphy, S. A. (2015) · Health Psychology · doi:10.1037/hea0000305 · Cited by 671
Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546
Internet-based psychological treatments for depression
Johansson, R., & Andersson, G. (2012) · Expert Review of Neurotherapeutics · doi:10.1586/ern.12.63 · Cited by 509 · cited 2×
“Nevertheless, the prevailing wisdom is that the provision of human support can improve user engagement and outcomes in digital mental health [91-95].”
BackgroundNewman, M. G., Szkodny, L. E., Llera, S. J., & Przeworski, A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.008 · Cited by 480 · cited 2×
“Nevertheless, the prevailing wisdom is that the provision of human support can improve user engagement and outcomes in digital mental health [91-95].”
BackgroundGeographic Variation in the Supply of Selected Behavioral Health Providers
Andrilla, C. H. A., Patterson, D. G., Garberson, L. A., Coulthard, C., & Larson, E. H. (2018) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2018.01.004 · Cited by 419 · cited 1×
“Indeed, in many parts of the United States there are fewer than 10 licensed psychologists per 100,000 people, with even fewer presumably offering evidence-based treatments [9].”
BackgroundThe Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376
Ly, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
CBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329 · cited 2×
“For example, coaching may make the most difference for users with more severe symptoms [94] or early on in treatment [44], or the frequency or tone of communications may need to change over time to remain engaging [107].”
BackgroundIntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety
Mohr, D. C., Tomasino, K. N., Lattie, E. G., Palac, H. L., Kwasny, M. J., Weingardt, K., Karr, C. J., Kaiser, S. M., Rossom, R. C., Bardsley, L. R., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6645 · Cited by 301
The role of the individual in the coming era of process-based therapy
Hayes, S. C., Hofmann, S. G., Stanton, C. E., Carpenter, J. K., Sanford, B. T., Curtiss, J. E., & Ciarrochi, J. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.10.005 · Cited by 295
Transdiagnostic internet treatment for anxiety and depression: a randomised controlled trial
Titov, N., Dear, B. F., Schwencke, G., Andrews, G., Johnston, L., Craske, M. G., & McEvoy, P. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.03.007 · Cited by 285
Ly, K. H., Trüschel, A., Jarl, L., Magnusson, S., Windahl, T., Johansson, R., Carlbring, P., & Andersson, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003440 · Cited by 269 · cited 1×
“…Affairs) YesYesVenkatesan et al, 2020 [80]1Vida Health ——dDagöö et al, 2014 [81]; Imamura et al, 2019 [82]; Ly et al, 2012 [83]; Ly et al, 2015 [84]; Ly et al, 2014 [85]; Springgate et al, 2018 [86]; Stolz et al, 2018 [87]; Uwatoko et al, 2018 [88]; Vázquez et al, 2018 [89]; Wilanksy et al,…”
Wildenbos, G. A., Jaspers, M. W. M., Schijven, M. P., & Dusseljee- Peute, L. W. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.01.006 · Cited by 245
Anxiety: There is an app for that. A systematic review of anxiety apps: SUCALA et al.
Sucala, M., Cuijpers, P., Muench, F., Cardoș, R., Soflau, R., Dobrean, A., Achimas-Cadariu, P., & David, D. (2017) · Depression and Anxiety · doi:10.1002/da.22654 · Cited by 232
Harvey, A. G., & Gumport, N. B. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.02.004 · Cited by 221 · cited 1×
“Smartphone-delivered therapies offer clear potential for addressing some of the most critical barriers to accessing mental health care, including prohibitive costs of treatment [5,6], patient-level logistical barriers (eg, need for time off work, transportation, and childcare) [7], and lack of access to providers who…”
BackgroundHarrer, M., Adam, S. H., Fleischmann, R. J., Baumeister, H., Auerbach, R., Bruffaerts, R., Cuijpers, P., Kessler, R. C., Berking, M., Lehr, D., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9293 · Cited by 216 · cited 3×
“A total of 11% (7/64) of projects reported on the number of messages sent by and to coaches, consistently finding that coaches typically initiate contact more than users [32,51,52,54,59,61,78].”
BackgroundTitov, N., Dear, B. F., Ali, S., Zou, J. B., Lorian, C. N., Johnston, L., Terides, M. D., Kayrouz, R., Klein, B., Gandy, M., et al. (2015) · Behavior Therapy · doi:10.1016/j.beth.2014.09.008 · Cited by 210
Torous, J., Wisniewski, H., Liu, G., & Keshavan, M. (2018) · JMIR Mental Health · doi:10.2196/11715 · Cited by 201 · cited 1×
“A frequent strategy advised and used by experts in digital mental health is to include human support [19,20].”
BackgroundMantani, A., Kato, T., Furukawa, T. A., Horikoshi, M., Imai, H., Hiroe, T., Chino, B., Funayama, T., Yonemoto, N., Zhou, Q., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8602 · Cited by 192
Litvin, S., Saunders, R., Maier, M. A., & Lüttke, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0237220 · Cited by 177
Possemato, K., Kuhn, E., Johnson, E., Hoffman, J. E., Owen, J. E., Kanuri, N., De Stefano, L., & Brooks, E. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.09.005 · Cited by 167 · cited 8×
“…namea NoYesWilhelm et al, 2020 [13]1Perspectives BDD (Koa Health) NoNoClough et al, 2015 [67]1PsychAssist YesYesPacella-LaBarbara et al, 2020 [68]; Possemato et al, 2016 [69]; Tiet et al, 2019 [70] 3PTSD Coach (US Department of Veterans Affairs) NoNoHong et al, 2018 [71]1RAW HAND NoYesGuo et al,…”
BackgroundMethodInfluentialThe SmartCAT: An m-Health Platform for Ecological Momentary Intervention in Child Anxiety Treatment
Pramana, G., Parmanto, B., Kendall, P. C., & Silk, J. S. (2014) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0214 · Cited by 162 · cited 2×
“Yes Yes Silk et al, 2020 [73]; Pramana et al, 2014 [74] 2 SmartCAT (University of Pittsburgh)”
BackgroundGraham, A. K., Greene, C. J., Kwasny, M. J., Kaiser, S. M., Lieponis, P., Powell, T., & Mohr, D. C. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1011 · Cited by 162 · cited 1×
“…et al, 2019 [49]1Helpath (CICESE-UT3) Yes (Google Play only)YesChow et al, 2020 [50]1iCanThrive (UVA Apps, LLC) YesYesChen et al, 2019 [51]; Graham et al, 2020 [52]; Mohr et al, 2019 [53]; Mohr et al, 2017 [54]; Orr et al, 2020 [55] 5IntelliCare (suite; Adaptive Health) NoNoArean et al,…”
Johnston, L., Titov, N., Andrews, G., Spence, J., & Dear, B. F. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028079 · Cited by 150
Lenhard, F., Andersson, E., Mataix-Cols, D., Rück, C., Vigerland, S., Högström, J., Hillborg, M., Brander, G., Ljungström, M., Ljótsson, B., et al. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.09.515 · Cited by 146
Ramos, G., & Chavira, D. A. (2022) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2019.10.004 · Cited by 143
App-based psychological interventions: friend or foe?
Leigh, S., & Flatt, S. (2015) · Evidence Based Mental Health · doi:10.1136/eb-2015-102203 · Cited by 140
Dagöö, J., Asplund, R. P., Bsenko, H. A., Hjerling, S., Holmberg, A., Westh, S., Öberg, L., Ljótsson, B., Carlbring, P., Furmark, T., et al. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.02.003 · Cited by 121
Guided internet-based CBT for common mental disorders
Andersson, G., Carlbring, P., Ljótsson, B., & Hedman, E. (2013) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-013-9237-9 · Cited by 119
Mohr, D. C., Schueller, S. M., Tomasino, K. N., Kaiser, S. M., Alam, N., Karr, C., Vergara, J. L., Gray, E. L., Kwasny, M. J., & Lattie, E. G. (2019) · Journal of Medical Internet Research · doi:10.2196/13609 · Cited by 116 · cited 13×
“In total, 3 trials of the IntelliCare suite or its individual apps, designed to help patients with depressive or anxious symptoms, described the relationship between coaching and objective metrics of engagement [38,51,53].”
BackgroundInfluentialBanbury forum consensus statement on the path forward for digital mental health treatment
Mohr, D. C., Azocar, F., Bertagnolli, A., Choudhury, T., Chrisp, P., Frank, R., Harbin, H., Histon, T., Kaysen, D., Nebeker, C., et al. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000561 · Cited by 115
Uptake and usage of IntelliCare: A publicly available suite of mental health and well-being apps
Lattie, E. G., Schueller, S. M., Sargent, E., Stiles-Shields, C., Tomasino, K. N., Corden, M. E., Begale, M., Karr, C. J., & Mohr, D. C. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.06.003 · Cited by 113
The Digital Psychiatrist: In Search of Evidence-Based Apps for Anxiety and Depression
Marshall, J. M., Dunstan, D. A., & Bartik, W. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00831 · Cited by 107
Stawarz, K., Preist, C., & Coyle, D. (2019) · JMIR Mental Health · doi:10.2196/12546 · Cited by 107 · cited 1×
“Given that the digital health field is increasingly moving toward app-based tools [24,25], this study centers specifically on app formats rather than collapse across internet and app-based approaches or focus on differences between them.”
BackgroundOlder Adults Are Less Accurate Than Younger Adults at Identifying Symptoms of Anxiety and Depression
Wetherell, J. L., Petkus, A. J., McChesney, K., Stein, M. B., Judd, P. H., Rockwell, E., Sewell, D. D., & Patterson, T. L. (2009) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e3181b0c081 · Cited by 105
Stolz, T., Schulz, A., Krieger, T., Vincent, A., Urech, A., Moser, C., Westermann, S., & Berger, T. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000301 · Cited by 102 · cited 2×
“…Health ——dDagöö et al, 2014 [81]; Imamura et al, 2019 [82]; Ly et al, 2012 [83]; Ly et al, 2015 [84]; Ly et al, 2014 [85]; Springgate et al, 2018 [86]; Stolz et al, 2018 [87]; Uwatoko et al, 2018 [88]; Vázquez et al, 2018 [89]; Wilanksy et al, 2016 [90] 10No name provided aDeveloper included in…”
Aschbrenner, K. A., Naslund, J. A., Tomlinson, E. F., Kinney, A., Pratt, S. I., & Brunette, M. F. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00178 · Cited by 99
Examining the Reach of Smartphone Apps for Depression and Anxiety
Wasil, A. R., Gillespie, S., Shingleton, R., Wilks, C. R., & Weisz, J. R. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2019.19090905 · Cited by 87 · cited 1×
“In an examination of engagement with the top 50 publicly available apps for depression and anxiety, more than half (63% for depression and 56% for anxiety) of the apps had no active monthly users [16].”
BackgroundMartínez-Miranda, J., Martínez, A., Ramos, R., Aguilar, H., Jiménez, L., Arias, H., Rosales, G., & Valencia, E. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1387-1 · Cited by 79 · cited 1×
“Yes (Google Play only) Yes Martínez-Miranda et al, 2019 [49] 1 Helpath (CICESE-UT3)”
Ly, K. H., Janni, E., Wrede, R., Sedem, M., Donker, T., Carlbring, P., & Andersson, G. (2015) · Internet Interventions · doi:10.1016/j.invent.2014.12.002 · Cited by 78 · cited 6×
“At least weekly messaging Graduate students Not reported BAg for depression 12 adult, diagnosed with MDDf, 50% (6/12) women, mean age 38 (SD 14) years Positive regard for coaching Qualitative Ly et al, 2015 [84]”
BackgroundInfluentialBørøsund, E., Mirkovic, J., Clark, M. M., Ehlers, S. L., Andrykowski, M. A., Bergland, A., Westeng, M., & Solberg Nes, L. (2018) · JMIR Formative Research · doi:10.2196/formative.9954 · Cited by 73 · cited 1×
“Yes Yes Børøsund et al, 2018 [77] 1 StressProffen (Oslo Universitetssykehus HF)”
BackgroundMenezes, P., Quayle, J., Garcia Claro, H., da Silva, S., Brandt, L. R., Diez-Canseco, F., Miranda, J. J., Price, L. N., Mohr, D. C., & Araya, R. (2019) · JMIR Mental Health · doi:10.2196/11698 · Cited by 71 · cited 6×
“No No Menezes et al, 2019 [40] 1 CONEMO (The Latin America Treatment & Innovation Network in Mental Health)”
BackgroundInfluentialSchueller, S. M., Tomasino, K. N., & Mohr, D. C. (2017) · Clinical Psychology: Science and Practice · doi:10.1037/h0101740 · Cited by 70
Wolitzky-Taylor, K., Fenwick, K., Lengnick-Hall, R., Grossman, J., Bearman, S. K., Arch, J., Miranda, J., & Chung, B. (2018) · Community Mental Health Journal · doi:10.1007/s10597-018-0252-x · Cited by 62
Ly, K. H., Carlbring, P., & Andersson, G. (2012) · Trials · doi:10.1186/1745-6215-13-62 · Cited by 61 · cited 1×
“…apps (suite; US Department of Veterans Affairs) YesYesVenkatesan et al, 2020 [80]1Vida Health ——dDagöö et al, 2014 [81]; Imamura et al, 2019 [82]; Ly et al, 2012 [83]; Ly et al, 2015 [84]; Ly et al, 2014 [85]; Springgate et al, 2018 [86]; Stolz et al, 2018 [87]; Uwatoko et al, 2018 [88];…”
Hadjistavropoulos, H. D., Schneider, L. H., Klassen, K., Dear, B. F., & Titov, N. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2018.1457079 · Cited by 61
Ham, K., Chin, S., Suh, Y. J., Rhee, M., Yu, E.-S., Lee, H. J., Kim, J.-H., Kim, S. W., Koh, S.-J., & Chung, K.-M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01592 · Cited by 61 · cited 1×
“Yes (as Haru: ASD) Yes Ham et al, 2019 [48] 1 HARUToday (Inha Intelligent Mobile Computing Lab)”
MethodBerg, C. J., Vanderpool, R. C., Getachew, B., Payne, J. B., Johnson, M. F., Sandridge, Y., Bierhoff, J., Le, L., Johnson, R., Weber, A., et al. (2020) · Journal of Cancer Education · doi:10.1007/s13187-019-01574-7 · Cited by 59
Stiles-Shields, C., Montague, E., Kwasny, M. J., & Mohr, D. C. (2019) · Psychological Services · doi:10.1037/ser0000261 · Cited by 59 · cited 9×
“In the study by Stiles-Shields et al [38], master’s level coaches offered weekly encouraging phone calls or emails ( 10 minutes per patient per week) over 6 weeks.”
BackgroundInfluentialChen, A. T., Wu, S., Tomasino, K. N., Lattie, E. G., & Mohr, D. C. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103187 · Cited by 58 · cited 9×
“In total, 3 trials of the IntelliCare suite or its individual apps, designed to help patients with depressive or anxious symptoms, described the relationship between coaching and objective metrics of engagement [38,51,53].”
BackgroundInfluentialA therapist-guided smartphone app for major depression in young adults: A randomized clinical trial
Raevuori, A., Vahlberg, T., Korhonen, T., Hilgert, O., Aittakumpu-Hyden, R., & Forman-Hoffman, V. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.02.007 · Cited by 52 · cited 2×
“A total of 11% (7/64) of projects reported on the number of messages sent by and to coaches, consistently finding that coaches typically initiate contact more than users [32,51,52,54,59,61,78].”
BackgroundChristoforou, M., Sáez Fonseca, J. A., & Tsakanikos, E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7747 · Cited by 48 · cited 2×
“No No Christoforou et al, 2017 [29] 1 Agoraphobia Free (Health eLiving Partnership Ltd)”
BackgroundDigital cognitive behavior therapy intervention for depression and anxiety: retrospective study
Venkatesan, A., Rahimi, L., Kaur, M., & Mosunic, C. (2020) · JMIR Mental Health · doi:10.2196/21304 · Cited by 47 · cited 9×
“Yes Yes Venkatesan et al, 2020 [80] 1 Vida Health”
BackgroundMethodInfluentialRoy, M. J., Costanzo, M. E., Highland, K. B., Olsen, C., Clayborne, D., & Law, W. (2017) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2017.0221 · Cited by 43 · cited 10×
“slower symptom change Engagement and outcomes Roy et al, 2017 [79]”
BackgroundMethodInfluentialA randomized controlled trial of a smartphone-based application for the treatment of anxiety
Newman, M. G., Jacobson, N. C., Rackoff, G. N., Bell, M. J., & Taylor, C. B. (2021) · Psychotherapy Research · doi:10.1080/10503307.2020.1790688 · Cited by 37
McCausland, J., Paparo, J., & Wootton, B. M. (2021) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465820000843 · Cited by 30 · cited 1×
“Smartphone-delivered therapies offer clear potential for addressing some of the most critical barriers to accessing mental health care, including prohibitive costs of treatment [5,6], patient-level logistical barriers (eg, need for time off work, transportation, and childcare) [7], and lack of access to providers who…”
BackgroundGiosan, C., Cobeanu, O., Mogoaşe, C., Szentagotai, A., Mureşan, V., & Boian, R. (2017) · Trials · doi:10.1186/s13063-017-1960-1 · Cited by 23 · cited 1×
“No No Giosan et al, 2017 [41] 1 DCombat”
BackgroundEbenfeld, L., Kleine Stegemann, S., Lehr, D., Ebert, D. D., Funk, B., Riper, H., & Berking, M. (2020) · Internet Interventions · doi:10.1016/j.invent.2019.100296 · Cited by 20
Otero, P., Hita, I., Torres, Á. J., & Vázquez, F. L. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17124578 · Cited by 15 · cited 1×
“Unclear Unclear Otero et al, 2020 [47] 1 Happy (independent programmers; specific developers not stated in paper)”
BackgroundSzigethy, E., Solano, F., Wallace, M., Perry, D. L., Morrell, L., Scott, K., Bell, M. J., & Oser, M. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019108 · Cited by 10
Rauseo-Ricupero, N., & Torous, J. (2021) · JMIR Research Protocols · doi:10.2196/23771 · Cited by 9 · cited 1×
“Yes Yes Rauseo-Ricupero and Torous, 2021 [63] 1 mindLAMP (Division of Digital Psy-”
Background
Cited by
Torous, J., Linardon, J., Goldberg, S. B., Sun, S., Bell, I., Nicholas, J., Hassan, L., Hua, Y., Milton, A., & Firth, J. (2025) · World Psychiatry · doi:10.1002/wps.21299 · Cited by 323
Providing Human Support for the Use of Digital Mental Health Interventions: Systematic Meta-review
Werntz, A., Amado, S., Jasman, M., Ervin, A., & Rhodes, J. E. (2023) · Journal of Medical Internet Research · doi:10.2196/42864 · Cited by 158
The future of psychological treatments: The Marburg Declaration
Rief, W., Asmundson, G. J. G., Bryant, R. A., Clark, D. M., Ehlers, A., Holmes, E. A., McNally, R. J., Neufeld, C. B., Wilhelm, S., Jaroszewski, A. C., et al. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102417 · Cited by 54
Self-citation
Metadata
- Authors
- Bernstein, E. E., Weingarden, H., Wolfe, E. C., Hall, M. D., Snorrason, I., & Wilhelm, S.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-04-08
- Volume
- 24
- Issue
- 4
- Pages
- e33307
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W4223483364
- Cited by
- 54
- References
- 74
- FWCI
- 8.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.