Exploring the Relationship Between Usage and Outcomes of an Internet-Based Intervention for Individuals With Depressive Symptoms: Secondary Analysis of Data From a Randomized Controlled Trial
Open accessPublished version of a preprint
The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Background: Internet interventions can easily generate objective data about program usage. Increasingly, more studies explore the relationship between usage and outcomes, but they often report different metrics of use, and the findings are mixed. Thus, current evaluations fail to demonstrate which metrics should be considered and how these metrics are related to clinically meaningful change. Objective: This study aimed to explore the relationship between several usage metrics and outcomes of an internet-based intervention for depression. Methods: This is a secondary analysis of data from a randomized controlled trial that examined the efficacy of an internet-based cognitive behavioral therapy for depression (Space from Depression) in an adult community sample. All participants who enrolled in the intervention, regardless of meeting the inclusion criteria, were included in this study. Space from Depression is a 7-module supported intervention, delivered over a period of 8 weeks. Different usage metrics (ie, time spent, modules and activities completed, and percentage of program completion) were automatically collected by the platform, and composite variables from these (eg, activities per session) were computed. A breakdown of the usage metrics was obtained by weeks. For the analysis, the sample was divided into those who obtained a reliable change (RC)—and those who did not. Results: Data from 216 users who completed pre- and posttreatment outcomes were included in the analyses. A total of 89 participants obtained an RC, and 127 participants did not obtain an RC. Those in the RC group significantly spent more time, had more log-ins, used more tools, viewed a higher percentage of the program, and got more reviews from their supporter compared with those who did not obtain an RC. Differences between groups in usage were observed from the first week in advance across the different metrics, although they vanished over time. In the RC group, the usage was higher during the first 4 weeks, and then a significant decrease was observed. Our results showed that specific levels of platform usage, 7 hours total time spent, 15 sessions, 30 tools used, and 50% of program completion, were associated with RC. Conclusions: Overall, the results showed that those individuals who obtained an RC after the intervention had higher levels of exposure to the platform. The usage during the first half of the intervention was higher, and differences between groups were observed from the first week. This study also showed specific usage levels associated with outcomes that could be tested in controlled studies to inform the minimal usage to establish adherence. These results will help to better understand how to use internet-based interventions and what optimal level of engagement can most affect outcomes. Trial Registration: ISRCTN Registry ISRCTN03704676; http://www.isrctn.com/ISRCTN03704676 International Registered Report Identifier (IRRID): RR2-10.1186/1471-244X-14-147
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Associations with adherence have been demonstrated for a range of outcomes, including depression [105,106] and anxiety [107,108].”
From The therapeutic alliance in digital mental health interventions for serious mental illnesses: narrative review (2020) · cites this paper as [105]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 2×
“Although treatment dropout and spontaneous remission might explain some of these trends, as they could in other psychological interventions, understanding more completely how internet-delivered interventions are used and whether their usage differs depending on user characteristics is an important area of investigatio…”
Greiner, M., Pfeiffer, D., & Smith, R. D. (2000) · Preventive Veterinary Medicine · doi:10.1016/s0167-5877(00)00115-x · Cited by 1,923 · cited 1×
“To obtain the optimal cutoff for achieving RC, a receiver operating characteristic (ROC) curve analysis [34] was performed using each of the 4 individual usage metrics (total time spent on the platform, number of sessions, number of activities, and percentage of the program viewed) as test variables against the RC sta…”
Computer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442 · cited 2×
“Different meta-analytic reviews have shown that supported interventions have higher rates of adherence and better outcomes than self-guided ones [1,3,4,25].”
Self-citationInternet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · cited 2×
“Different meta-analytic reviews have shown that supported interventions have higher rates of adherence and better outcomes than self-guided ones [1,3,4,25].”
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 2×
“This paper contributes to the concept of adherence by providing an empirical justification of intended use, that is, “the extent to which individuals should experience the content to derive maximum benefit from the intervention, as defined or implied by its creators” [22].”
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193 · cited 2×
“Our results confirm the largely used statement the more usage, the better [5,16], although it is important to note that our variables account for active (ie, activities completed) and passive (ie, percentage viewed) engagement, and both elements are important to get the most out of these interventions [20].”
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 3×
“In this study, on average, the users utilized 57% of the program, which is similar to completion rates in other internet-based interventions for depression [36,39].”
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 1×
“In this sense, no studies have explored the role of metrics related to the support, such as the number of reviews and the number of user replies to these reviews, which could shed more light on the role of support in the usage of the program and their outcomes [28].”
Bower, P., & Gilbody, S. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.186.1.11 · Cited by 1,084
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · cited 1×
“Internet- and computer-based interventions for depression have been shown to be effective in several meta-analytic reviews, reporting comparable effects to face-to-face treatments [1-5].”
Research works printed but not linked: 1
- Beck, AT, 1996, BDI-II, Beck Depression Inventory: Manual
Cited by
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Tremain, H., McEnery, C., Fletcher, K., & Murray, G. (2020) · JMIR Mental Health · doi:10.2196/17204 · Cited by 193
Richards, D., Enrique, A., Eilert, N., Franklin, M., Palacios, J., Duffy, D., Earley, C., Chapman, J., Jell, G., Sollesse, S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0293-8 · Cited by 154
Self-citationChien, I., Enrique, A., Palacios, J., Regan, T., Keegan, D., Carter, D., Tschiatschek, S., Nori, A., Thieme, A., Richards, D., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.10791 · Cited by 111
Deisenhofer, A., Barkham, M., Beierl, E. T., Schwartz, B., Doorn, K. A., Beevers, C. G., Berwian, I. M., Blackwell, S. E., Bockting, C., Brakemeier, E., et al. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104443 · Cited by 138
“In addition to active data collection, these tools may also be used to gather passive data on granular and objective treatment engagement, such as the tools and pages viewed during a digital therapy session (Enrique, Palacios, Ryan, & Richards, 2019).”
MethodEilert, N., Enrique, A., Wogan, R., Mooney, O., Timulak, L., & Richards, D. (2021) · Depression and Anxiety · doi:10.1002/da.23115 · Cited by 60
“While more research is needed to understand the intricacies of dose–response relationships in Internet‐delivered intervention (Enrique et al., 2019; McVay et al., 2019), this finding may suggest that time, or at least some minimum amount of time, is of the essence in allowing various “active…”
BackgroundSelf-citationMohr, D. C., Kwasny, M., Meyerhoff, J., Graham, A. K., & Lattie, E. G. (2021) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.103972 · Cited by 49
Cillessen, L., van de Ven, M. O., Compen, F. R., Bisseling, E. M., van der Lee, M. L., & Speckens, A. E. (2020) · Journal of Medical Internet Research · doi:10.2196/17526 · Cited by 43
“Usage is relevant to address, as it directly relates to intervention outcomes [20] and can help to optimize interventions [21].”
BackgroundLi, Y., Guo, Y., Hong, Y. A., Zeng, Y., Monroe‐Wise, A., Zeng, C., Zhu, M., Zhang, H., Qiao, J., Xu, Z., et al. (2022) · JMIR mhealth and uhealth · doi:10.2196/25586 · Cited by 47
“Of the few such studies, the most used is the pre–post design with short-term follow-up, typically within 3 months of the intervention [7-10].”
BackgroundLappalainen, P., Lappalainen, R., Keinonen, K., Kaipainen, K., Puolakanaho, A., Muotka, J., & Kiuru, N. (2023) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2022.12.001 · Cited by 41
Martin, F., Wright, H., Moody, L., Whiteman, B., McGillion, M., Clyne, W., Pearce, G., & Turner, A. (2020) · Journal of Medical Internet Research · doi:10.2196/17824 · Cited by 33
“The implementation of the program had positive results—89% of the participants completed the program (ie, attended 3 or more sessions) [51], and the average number of sessions attended was 5.”
BackgroundMethodInfluentialA Randomized Controlled Trial of Internet-Based Self-Help for Stress During the COVID-19 Pandemic
Rackoff, G. N., Fitzsimmons-Craft, E. E., Taylor, C. B., Eisenberg, D., Wilfley, D. E., & Newman, M. G. (2022) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2022.01.227 · Cited by 34
“[26] Interestingly, there were no such dose-response relationships between usage metrics and improvement in stress or anxiety.”
What are you thinking?: Using CBT and Storytelling to Improve Mental Health Among College Students
Hamid, A., Arshad, R., & Shahid, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517603 · Cited by 41
“This fnding is in line with research showing that engagement and adherence are themselves associated with improved outcomes in digital interventions [30, 39, 40, 51].”
ResultInternet Addiction Management: A Comprehensive Review of Clinical Interventions and Modalities
Chadha, Y., Patil, R., Toshniwal, S. S., & Sinha, N. (2024) · Cureus · doi:10.7759/cureus.55466 · Cited by 40
“This discussion also highlights the importance of choosing appropriate, valid, and reliable outcome measures to gauge treatment progress accurately [43].”
BackgroundBenjet, C. L., Albor, Y., Alvis–Barranco, L., Contreras‐Ibáñez, C. C., Montoya, G. P. C., Cudris–Torres, L., González, N., Morelos, J. C., Gutiérrez–García, R. A., Medina‐Mora, M. E., et al. (2023) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000846 · Cited by 60
Enrique Roig, A., Mooney, O., Salamanca-Sanabria, A., Lee, C. T., Farrell, S., & Richards, D. (2020) · JMIR Formative Research · doi:10.2196/20167 · Cited by 29
“Usage refers to the degree to which participants were exposed to the intervention [59].”
Self-citationMoshe, I., Terhorst, Y., Paganini, S., Schlicker, S., Pulkki-Råback, L., Baumeister, H., Sander, L. B., & Ebert, D. D. (2022) · Journal of Medical Internet Research · doi:10.2196/38261 · Cited by 28
“…age predicted higher risk of dropout suggests that the relationship between age and dropout may be more complex than has been previously identified, either owing to the nonlinear relationship between the two or a possible interaction between age and other factors such as computer literacy [33,69].”
Digital Interventions to Enhance Readiness for Psychological Therapy: Scoping Review
Jardine, J., Bowman, R., & Doherty, G. J. (2022) · Journal of Medical Internet Research · doi:10.2196/37851 · Cited by 39
“As symptom changes that occur early in treatment are linked to greater overall treatment success [11,33], targeting those clients who are not yet in the action stage of change before they commence treatment, with interventions designed to move them toward action, could mean that more clients begin…”
Zeng, Y., Guo, Y., Li, L., Hong, Y. A., Li, Y., Zhu, M., Zeng, C., Zhang, H., Cai, W., Liu, C., et al. (2020) · JMIR mhealth and uhealth · doi:10.2196/20847 · Cited by 30
“However, the web-based iCBT intervention conducted in a community setting in Dublin, Ireland, in 2014 only measured pre-and postintervention depressive symptoms [13].”
BackgroundMethodResultInfluentialWright, H., Martin, F., Clyne, W., Clark, C. C. T., Matouskova, G., McGillion, M., & Turner, A. (2021) · Journal of Medical Internet Research · doi:10.2196/28322 · Cited by 25
“Studies show a nonlinear relationship between the time spent on an intervention, the number of sessions completed, and outcomes [32].”
BackgroundLee, C. T., Palacios, J., Richards, D., Hanlon, A. K., Lynch, K., Harty, S., Claus, N., Swords, L., O’Keane, V., Stephan, K. E., et al. (2023) · BMC Psychiatry · doi:10.1186/s12888-022-04462-5 · Cited by 25
“Individual variability in engagement with the online platform can be tracked precisely via granular and objective treatment data (e.g., what modules, when, and for how long), which can be mined to understand moderators of treatment success [62, 63].”
BackgroundSelf-citationEnrique, Á., Duffy, D. J., Lawler, K., Richards, D., & Jones, S. H. (2020) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2480 · Cited by 23
Self-citationPalacios, J. E., Adegoke, A., Wogan, R., Duffy, D. J., Earley, C., Eilert, N., Enrique, Á., Sollesse, S., Chapman, J. E., & Richards, D. (2022) · British Journal of Psychology · doi:10.1111/bjop.12614 · Cited by 24
“Gathering further information on usage, adherence, and long-term engagement of the intervention, which iCBT facilitates (Enrique et al., 2019), could also be key in understanding service users' patterns of behaviour whilst undergoing these treatments, and how best to utilize these patterns to…”
BackgroundSelf-citationPrasad, N., Chien, I., Regan, T. W., Enrique, Á., Palacios, J. E., Keegan, D., Munir, U., Tanno, R., Richardson, H., Nori, A., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0272685 · Cited by 31
Self-citationStrauss, C., Dunkeld, C., & Cavanagh, K. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100413 · Cited by 19
“This is promising given that research has found app usability to be associated with engagement (Enrique et al., 2019).”
BackgroundMarinova, N., Rogers, T., & MacBeth, A. M. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.05.058 · Cited by 20
Zhao, Y., Qian, W., Chen, Y.-R., Wu, D., Luo, Y., Gao, C. F., Wu, K., & Liu, Z. (2025) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.70067 · Cited by 24
Li, H., Yang, S., Chi, H., Xu, L., Zhang, T., Singleton, G., Tang, Y., Stone, W. S., & Wang, J. (2021) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2021.102587 · Cited by 16
Helmark, C., Ahm, R., Andersen, C. M., Skovbakke, S. J., Kok, R., Wiil, U. K., Schmidt, T., Hjelmborg, J., Frostholm, L., Frydendal, D. H., et al. (2021) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztab037 · Cited by 19
Gudmundsson, G. H., Mészáros, J., Björnsdóttir, Á., Ámundadóttir, M. L., Thorvardardottir, G. E., Magnúsdóttir, E., Helgadóttir, H., & Oddsson, S. J. (2022) · JMIR Formative Research · doi:10.2196/39764 · Cited by 17
Community mental healthcare: new developments and innovative strategies
Bajraktarov, S., Kalpak, G., & Jovanović, N. (2020) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000629 · Cited by 17
“According to recent study, internet interventions can easily generate objective data about program use leading to more studies explore the relationship between usage and outcomes [28].”
BackgroundGonzález-Robles, A., Suso‐Ribera, C., Díaz‐García, A., García‐Palacios, A., Castilla, D., & Botella, C. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100420 · Cited by 16
Przybylko, G., Morton, D., Morton, J., & Renfrew, M. (2021) · JMIR Mental Health · doi:10.2196/29866 · Cited by 13
“Notably, outcomes of a digital mental health intervention were shown to be related to higher levels of adherence such as higher levels of time spent on the digital platform, number of sessions completed, percentage of the program viewed, and number of activities compared to the control group [76].”
BackgroundA scoping review of therapist behaviors in guided digital mental health interventions
González-Robles, A., Miguel, C., Richards, D., Duffy, D., & Enrique, Á. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100751 · Cited by 12
“Previous studies have stressed the role of patient engagement in enhancing treatment outcomes and overall adherence (Donkin et al., 2013; Enrique et al., 2019), so although the evidence is limited, these results suggest that the relationship between therapist behaviors and patient engagement should…”
ResultSelf-citationvan Mierlo, T., Rondina, R., & Fournier, R. (2024) · JMIR Formative Research · doi:10.2196/52558 · Cited by 12
“However, it is an important topic as evidence indicates a dose-response relationship, and higher levels of engagement are associated with improved health outcomes [20,21].”
Serio, C. D., Gabarda, A., Uyar-Morency, F., Silfee, V., Ludwig, J. M., Szigethy, E., & Butterworth, S. W. (2022) · JMIR Formative Research · doi:10.2196/34552 · Cited by 12
“Hypothesis 1 There is evidence to show that coaching support in a digital intervention can positively impact engagement [16,29-31].”
BackgroundSchwartz, H. R., McCusker, J., Costa, D. D., Singh, S., Baskaran, S., Belzile, É., & Roost, K. V. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100597 · Cited by 11
Myklebost, S. B., Gjestad, R., İnal, Y., Hammar, Å., & Nordgreen, T. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.795698 · Cited by 12
Cumpanasoiu, D. C., Enrique, Á., Palacios, J. E., Duffy, D. J., McNamara, S., & Richards, D. (2022) · JMIR mhealth and uhealth · doi:10.2196/41815 · Cited by 13
“In our primary RCT, where the current sample data originated, among 8-week measure completers, 5.2% (10/194) of participants in the intervention arm deteriorated (ie, increases in PHQ-9 score ≥6 or GAD-7 score ≥4) [42], which is in line with a recent individual patient data meta-analysis [43] that suggested only 5.8%…”
BackgroundResultInfluentialSelf-citationZainal, N. H., Benjet, C. L., Albor, Y., Núñez-Delgado, M. J., Cruz, R. Z., Contreras‐Ibáñez, C. C., Cudris–Torres, L., de la Peña, F. R., González, N., Guerrero-López, B., et al. (2025) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.70005 · Cited by 9
Bossarte, R. M., Kessler, R. C., Nierenberg, A. A., Chattopadhyay, A., Cuijpers, P. J., Enrique, Á., Foxworth, P. M., Gildea, S. M., Belnap, B. H., Haut, M. W., et al. (2022) · Trials · doi:10.1186/s13063-022-06438-y · Cited by 9
Self-citationMahoney, A., Haskelberg, H., Mason, E. C., Millard, M., & Newby, J. M. (2021) · Personality and Mental Health · doi:10.1002/pmh.1506 · Cited by 10
Guo, Y., Li, Y., Yu, C., He, X., Hong, Y. A., Wang, X., Zhang, N., Zeng, Y., Monroe‐Wise, A., Li, L., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/36809 · Cited by 9
“On average, participants in the intervention group completed 55% of the CBSM coursework, which was comparable with that in other mHealth interventions, whereas those in the wait-list control group completed only 4% of the coursework, as they received no regular monitoring and phone calls [51,52].”
Benjet, C. L., Kessler, R. C., Kazdin, A. E., Cuijpers, P. J., Albor, Y., Tapias, N. E. C., Contreras‐Ibáñez, C. C., González, M. S. D., Gildea, S. M., González, N., et al. (2022) · Trials · doi:10.1186/s13063-022-06255-3 · Cited by 10
“The online platform chosen here, developed by SilverCloud Health, is widely used both commercially (e.g., [39]) and in research (e.g., [27, 40, 41]).”
MethodSelf-citationGonzález-Robles, A., Roca, P., Díaz‐García, A., García‐Palacios, A., & Botella, C. (2022) · JMIR Mental Health · doi:10.2196/40268 · Cited by 10
“Although research exists on the association among these variables, the findings mostly refer to posttreatment results [63-65].”
Digital Medicine – The New Frontier for AI in Healthcare
Ho, D., & Teo, G. (2020) · Advanced Therapeutics · doi:10.1002/adtp.202000015 · Cited by 7
Hammerfald, K., Jahren, H. H., & Solbakken, O. A. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1494729 · Cited by 7
Silverman, A. L., Ferguson, I., Bullis, J. R., Bajwa, H., Mei, S., & Beard, C. (2025) · Journal of Mood and Anxiety Disorders · doi:10.1016/j.xjmad.2025.100106 · Cited by 7
“To this end, one study found that completion of 50 % of SilverCloud program content was associated with a higher probability of reliable change [8].”
Geraghty, A. W. A., Becque, T., Roberts, L. C., Hill, J. C., Foster, N. E., Yardley, L., Stuart, B. L., Turner, D. A., Griffiths, G. O., Webley, F., et al. (2025) · Health Technology Assessment · doi:10.3310/gdps2418 · Cited by 6
Hämäläinen, T., Kaipainen, K., Keinonen, K., Lappalainen, P., Puolakanaho, A., Lappalainen, R., & Kiuru, N. H. (2022) · Journal of Cognitive Psychotherapy · doi:10.1891/jcp-2021-0038 · Cited by 7
Rondina, R., van Mierlo, T., & Fournier, R. (2022) · JMIR Research Protocols · doi:10.2196/37231 · Cited by 9
“This is hypothesized in digital health that greater overall engagement may lead to better health outcomes [19,20,36].”
(2025) · doi:10.2196/67171 · Cited by 5
“The provision of support and guidance is another important factor potentially related to intervention adherence [28].”
Pescatello, M. S., Pedersen, T. R., & Baldwin, S. A. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1822559 · Cited by 9
“Some studies using SilverCloud have found a stronger relationship between usage an outcome we did in this study(e.g., Enrique et al., 2019).”
ResultWright, H., Martin, F., Clyne, W., Clark, C. C. T., McGillion, M. H., Matouskova, G., & Turner, A. (2020) · JMIR Research Protocols · doi:10.2196/24264 · Cited by 6
“It is noteworthy that there is not always a linear relationship between time spent in a digital intervention, the number of sessions completed, and participant outcomes [44].”
BackgroundThe Feasibility of a Family-Focused CBT Skills Self-Help App
Kriegshauser, K. D., Sexton, C. C., Bozsik, F. M., Blossom, J. B., Wiese, A. D., Larsen, M. A., & Hale, L. R. (2022) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2022.09.001 · Cited by 3
Wähnke, L., Dose, C., Klemp, M., Mühlenmeister, J., Plück, J., & Döpfner, M. (2024) · JMIR Pediatrics and Parenting · doi:10.2196/54051 · Cited by 3
“Consistent with research on the use of online treatment for depression, we found both more log-ins and higher task completion rates (frequency and intensity) in the first than in the second half of the intervention [46].”
van Mierlo, T., Fournier, R., Yeung, S. K., & Lahutina, S. (2025) · JMIR Research Protocols · doi:10.2196/73773 · Cited by 5
“Optimizing engagement is crucial, as research suggests dose-response relationships; higher engagement is associated with better outcomes such as improvements in mental health [15-17].”
Miller, S., Yardley, L., Smith, P. W. F., Weal, M. J., Anderson, A., Stuart, B. L., Little, P. S., & Morrison, L. G. (2021) · JMIR Formative Research · doi:10.2196/24239 · Cited by 4
“Although widely used, broad, summative measures of usage, such as time spent or number of pages or components viewed in an intervention, have been criticized for their inability to explain how usage leads to positive outcomes [15,17-20].”
Deng, T., Wang, D., Ma, J., Wang, T., Li, B., Hussain, T., Yue, Y., & Wang, P. (2025) · The Journal of Psychology · doi:10.1080/00223980.2025.2568758 · Cited by 3
“Future investigations should incorporate objective metrics via software tracking to enhance measurement precision and validity (Enrique et al., 2019).”
Wright, H., Walker-Clarke, A., Drummond, A. E., Kidd, L., Yeates, G., Williams, D., McWilliams, D. J., Clyne, W., Clark, C. C. T., Kimani, P., et al. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01421-z · Cited by 4
Chua, J. Y. X., Choolani, M. A., Chee, C. Y. I., Yi, H., Lalor, J., Chong, Y. S., & Shorey, S. (2025) · Journal of Medical Internet Research · doi:10.2196/64882 · Cited by 9
Macrynikola, N., Tezanos, K. M., Doerr, J., Suazo, N., Villareal, L., Whiteley, L., & Yen, S. (2025) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.20240065 · Cited by 1
Zhang, T., Feng, W., Sun, Y., Li, Y., Hu, J., Du, X., Lai, L., Ke, Y., Hui, B. P. H., & Ren, Z. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100859 · Cited by 2
Uchida, H., Igusa, T., Machida, C., Shimada, T., & Hirao, K. (2026) · Psychiatry and Clinical Neurosciences Reports · doi:10.1002/pcn5.70284 · Cited by 1
“76 The maximum Youden index point will be the optimal SPSRS intervention time.”
Hisler, G. C., Young, K. S., Cumpanasoiu, D. C., Palacios, J. E., Duffy, D. J., Enrique, Á., Keegan, D., & Richards, D. (2024) · Counselling and Psychotherapy Research · doi:10.1002/capr.12771 · Cited by 4
Self-citation#Documented: Picturing Student Intersectionality on Instagram
Relles, S. R., & Duncheon, J. C. (2024) · The Educational Forum · doi:10.1080/00131725.2024.2367202 · Cited by 1
Lee, C. T., Palacios, J. E., Richards, D., Hanlon, A. K., Lynch, K., Harty, S., Claus, N., Swords, L., O’Keane, V., Stephan, K. E., et al. (2022) · doi:10.31234/osf.io/4j6z8 · Cited by 1
Self-citationEvia, Á. F. V. D. L. G., Eberle, J. W., Baee, S., Wolfe, E. C., Boukhechba, M., Funk, D., Teachman, B. A., & Barnes, L. E. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/yucqf
Bossarte, R. M., Kessler, R. C., Nierenberg, A. A., Cuijpers, P. J., Enrique, Á., Foxworth, P. M., Gildea, S. M., Belnap, B. H., Haut, M. W., Law, K. B., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-452029/v1
Self-citationDigital interventions to enhance readiness for psychological therapy: A scoping review (Preprint)Preprint
Jardine, J., Bowman, R., & Doherty, G. J. (2022) · doi:10.2196/preprints.37851
Gudmundsson, G. H., Mészáros, J., Björnsdóttir, Á., Ámundadóttir, M. L., Thorvardardottir, G. E., Magnúsdóttir, E., Helgadóttir, H., & Oddsson, S. (2022) · doi:10.2196/preprints.39764
González-Robles, A., Roca, P., Díaz‐García, A., García‐Palacios, A., & Botella, C. (2022) · doi:10.2196/preprints.40268
Zhao, Y., Qian, W., Chen, Y., Wu, D., Luo, Y., Wu, K., & Liu, Z. (2024) · doi:10.2196/preprints.57766
Pandya, S. P. (2024) · Creative Nursing · doi:10.1177/10784535241287443 · Cited by 1
“…support from scholars who suggest that online interventions are gaining prominence due to their cost-effectiveness, ease of access, and showing comparable effect sizes with face-to-face programs (Goodyear et al., 2023), though much depends on usage and participant engagement (Enrique et al., 2019).”
Baumeister, A., Schuurmans, L., Schultz, J., Schröder, J., Moritz, S., & Jelinek, L. (2024) · Behaviour Research and Therapy · doi:10.1016/j.brat.2024.104673
Evia, Á. F. V. D. L. G., Eberle, J. W., Baee, S., Wolfe, E. C., Boukhechba, M., Funk, D. H., Teachman, B. A., & Barnes, L. E. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000945 · Cited by 2
“Another approach, which we take in the present paper, has been to group users by multiple engagement metrics (e.g., using data-driven cluster analysis) and analyze whether these groups show differential symptom reduction [16,17,19,30–32].”
Lee, C. T., Palacios, J. E., Richards, D., Hanlon, A. K., Lynch, K., Harty, S., Claus, N., Swords, L., O’Keane, V., Stephan, K. E., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22612702
Self-citationLee, C. T., Palacios, J. E., Richards, D., Hanlon, A. K., Lynch, K., Harty, S., Claus, N., Swords, L., O’Keane, V., Stephan, K. E., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22612705
Self-citationWright, H., Walker-Clarke, A., Drummond, A., Kidd, L., Yeates, G., Williams, D., McWilliams, D., Clyne, W., Clark, C. C. T., Kimani, P., et al. (2023) · Figshare · doi:10.6084/m9.figshare.24669888
Effects of a Hybrid Maternal Role Enhancement Program for Working Mothers
Song, J., Roh, E. H., & Chae, H.-J. (2026) · International Journal of Nursing Practice · doi:10.1111/ijn.70134
Bartelt, S., Werner, T., von Boros, L., Schäfer, S. K., Koehler, F., Wirth, B. E., Lieb, K., Tuescher, O., & Wessa, M. (2026) · Scientific Reports · doi:10.1038/s41598-026-67088-7
Metadata
- Authors
- Enrique, A., Palacios, J. E., Ryan, H., & Richards, D.
- Affiliations
- SilverCloud (Ireland) (IE)
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-08-01
- Volume
- 21
- Issue
- 8
- Pages
- e12775
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6694731
- OpenAlex
- W2950346625
- Cited by
- 81
- References
- 43
- Citations by year
- 2026: 3 · 2025: 12 · 2024: 10 · 2023: 8 · 2022: 24 · 2021: 11 · 2020: 13
- FWCI
- 13.50
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Arrow@dit (Dublin Institute of Technology) (submittedVersion, cc-by-nc-sa)
- Trinity's Access to Research Output (TARA) (Trinity College Dublin) (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- online intervention, usage metrics, program completion, reliable change, medication adherence, engagement, digital mental health interventions, depressive symptoms, community-dwelling adults
- MeSH terms
- Internet-Based Intervention, Adult, Depression, Depressive Disorder, Female, Humans, Male, Time Factors, Cognitive Behavioral Therapy, Randomized Controlled Trials as Topic, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.