Exploring the Role of Persuasive Design in Unguided Internet-Delivered Cognitive Behavioral Therapy for Depression and Anxiety Among Adults: Systematic Review, Meta-analysis, and Meta-regression
Open accessThe DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Abstract
Background: Internet-delivered cognitive behavioral therapy (ICBT) is an effective treatment that can overcome barriers to mental health care. Various research groups have suggested that unguided ICBT (ie, ICBT without therapist support) and other eHealth interventions can be designed to enhance user engagement and thus outcomes. The persuasive systems design framework captures most design recommendations for eHealth interventions, but there is little empirical evidence that persuasive design is related to clinical outcomes in unguided ICBT. Objective: This study aims to provide an updated meta-analysis of randomized controlled trials of unguided ICBT for depression and anxiety, describe the frequency with which various persuasive design principles are used in such interventions, and use meta-regression to explore whether a greater number of persuasive design elements predicts efficacy in unguided ICBT for depression and anxiety. Methods: We conducted a systematic review of 5 databases to identify randomized controlled trials of unguided ICBT for depression and anxiety. We conducted separate random effects meta-analyses and separate meta-regressions for depression and anxiety interventions. Each meta-regression included 2 steps. The first step included, as a predictor, whether each intervention was transdiagnostic. For the meta-regression of ICBT for depression, the first step also included the type of control condition. The number of persuasive design principles identified for each intervention was added as a predictor in the second step to reveal the additional variance in effect sizes explained by persuasive design. Results: Of the 4471 articles we identified in our search, 46 (1.03%) were eligible for inclusion in our analyses. Our meta-analyses showed effect sizes (Hedges g) ranging from 0.22 to 0.31 for depression interventions, depending on the measures taken to account for bias in the results. We found a mean effect size of 0.45 (95% CI 0.33-0.56) for anxiety interventions, with no evidence that the results were inflated by bias. Included interventions were identified as using between 1 and 13 persuasive design principles, with an average of 4.95 (SD 2.85). The meta-regressions showed that a greater number of persuasive design principles predicted greater efficacy in ICBT for depression (R2 change=0.27; B=0.04; P=.02) but not anxiety (R2 change=0.05; B=0.03; P=.17). Conclusions: These findings show wide variability in the use of persuasive design in unguided ICBT for depression and anxiety and provide preliminary support for the proposition that more persuasively designed interventions are more efficacious, at least in the treatment of depression. Further research is needed to clarify the role of persuasive design in ICBT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Outlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949 · cited 1×
“Second, we checked Cook distance values to identify any outlier studies that had unduly large influences on the results [43].”
MethodHayes, S. C. (2004) · Behavior Therapy · doi:10.1016/s0005-7894(04)80013-3 · Cited by 2,493 · cited 1×
“We included interventions using third-wave CBT approaches (eg, mindfulness-based CBT and acceptance and commitment therapy) [31] because prior research has not demonstrated significant differences in outcomes between traditional CBT and third-wave approaches [32,33].”
MethodPersuasive Systems Design: Key Issues, Process Model, and System Features
Oinas-Kukkonen, H., & Harjumaa, M. (2009) · Communications of the Association for Information Systems · doi:10.17705/1cais.02428 · Cited by 1,663 · cited 6×
“The 28 principles are described in Multimedia Appendix 1 [17].”
BackgroundMethodResultInfluentialInternet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586
Persuasive technology: using computers to change what we think and do
Fogg, B. J. (2002) · Ubiquity · doi:10.1145/764008.763957 · Cited by 1,554
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · cited 2×
“Previous meta-analyses of unguided ICBT for depression have found comparable mean effect sizes (Hedges g or Cohen d ) ranging from 0.24 to 0.36 [12,92-95].”
BackgroundMethodInfluentialAndrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 7×
“The mean number of persuasive design principles identified across interventions (4.95, excluding the principle of tunneling ) was comparable with the mean of 5.4 principles identified by Kelders et al [25] among mental health interventions in their review.”
MethodResultInfluentialBarriers to mental health treatment: results from the WHO World Mental Health surveys
Andrade, L. H., Alonso, J., Mneimneh, Z., Wells, J. E., Al-Hamzawi, A., Borges, G., Bromet, E., Bruffaerts, R., de Girolamo, G., de Graaf, R., et al. (2014) · Psychological Medicine · doi:10.1017/s0033291713001943 · Cited by 1,289 · cited 1×
“…the demonstrated efficacy of psychotherapeutic and pharmacological interventions for depression and anxiety [2-4], many people face structural barriers to accessing mental health care (eg, financial barriers, transportation barriers, inconvenience, and limited availability of services) [5,6].”
BackgroundAdvantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160
Cited by
Beahm, J. D., McCall, H. C., Carleton, R. N., Titov, N., Dear, B., & Hadjistavropoulos, H. D. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100481 · Cited by 23
Self-citationBeahm, J. D., Landry, C. A., McCall, H. C., Carleton, R. N., & Hadjistavropoulos, H. D. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19084744 · Cited by 11
“Persuasive design is a set of design principles intended to promote engagement with technology [54] that can produce greater symptom reduction from ICBT [55].”
BackgroundSelf-citationBraun, L., Freund, J., Thielecke, J., Baumeister, H., Ebert, D. D., & Titzler, I. (2022) · JMIR Mental Health · doi:10.2196/39122 · Cited by 11
“In quantitative studies, various factors were found to be possible predictors of intervention adherence, including guidance [11], the use of persuasive design elements [12,13], or individual factors such as planning [14].”
BackgroundTechnology-based cognitive behavioral therapy interventions
Newby, J. M., Upton, E., Mason, E., & Black, M. (2024) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2024.02.004 · Cited by 11
Sørensen, N. M., Skaarnes, H., Mathiasen, K., Thastum, M., & Lomholt, J. J. (2025) · JMIR Formative Research · doi:10.2196/66966 · Cited by 3
“Some research conducted with adult populations indicates that using user-centered practices may help increase engagement [46,47], but more research is generally needed.”
Rubel, J., Quest, J., Pruessner, L., Timm, C., Hartmann, S., Barnow, S., Rittmeyer, L., Rosenbaum, D., & Lalk, C. (2023) · JMIR Research Protocols · doi:10.2196/41440 · Cited by 2
“The between-group effect size estimate is based on recent meta-analytic evidence for effect sizes in unguided web-based psychological interventions for anxiety disorders (Cohen d=0.45; see, for example, McCall et al [46]).”
BackgroundInfluential
Metadata
- Authors
- McCall, H. C., Hadjistavropoulos, H. D., & Sundström, C. R. F.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-04-29
- Volume
- 23
- Issue
- 4
- Pages
- e26939
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W3153845720
- Cited by
- 41
- References
- 75
- FWCI
- 1.50
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.