Comparing human and automated support for depression: Fractional factorial randomized controlled trial
Open accessAbstract
Web-based interventions for people with depressive symptoms are needed and show promising effects. However, it is a consistent finding that human support is needed and this makes implementation costly. This study investigates the adherence and effectiveness of a human-supported and automated-supported web-based intervention for people with mild to moderate depressive symptomatology, and studies the impact of four persuasive technology components. People with mild to moderate depressive symptoms according to the Center of Epidemiological Studies depression scale self-report questionnaire were included, but no diagnosis was made for the study. Participants (n = 239) were randomized into one of eight intervention arms, where each level of each component is present in half of the intervention arms. On clinical outcomes, there was a significant interaction effect between support condition and time, but there was no difference on the extent of improvement from baseline to follow-up, only a difference in the time-path of improvement. Effect sizes from baseline to follow-up were 0.89 for automated and 1.00 for human support. There was no significant difference on adherence between support condition. We conclude that an automated-supported web-based intervention for treatment of depression with persuasive technology may achieve similar adherence and effectiveness as the same intervention with human support.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Automated (and personalized) support has been shown to produce equivalent clinical outcomes to human support in RCTs of computerized treatments.
“Automated (and personalized) support has been shown to produce equivalent clinical outcomes to human support in RCTs of computerized treatments 67”
From The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials (2019) · cites this paper as [67]
The Clinical outcomes section reports no significant difference between support conditions at follow-up, and the Implications section suggests automated support can be as effective at six months in this web-based depression intervention. But the Limitations section explicitly says this was not an equivalence trial and that equivalence cannot be stated with certainty; the claim also generalizes from this study to RCTs of computerized treatments. (LLM, conf=0.90)
Experimental — accuracy not yet measuredOur findings contradict previous research in which a Web-based intervention with automated feedback for people with depression and anxiety was as effective as the same intervention with personal feedback.
“Our findings contradict previous research in which a Web-based intervention with automated feedback for people with depression and anxiety was as effective as the same intervention with personal feedback [22].”
From Web-based self-help intervention for partners of cancer patients based on acceptance and commitment therapy and self-compassion training: a randomized controlled trial with automated versus personal feedback (2021) · cites this paper as [22]
The Implications section reports that automated support may be as effective as human support at six-month follow-up, but calls for a larger study. Recruitment and participants (§2.2) shows that participants were selected for mild to moderate depressive symptoms, not for both diagnosed depression and anxiety; severe anxiety was an exclusion criterion. The claim captures the comparison but overstates its certainty and population. (LLM, conf=0.85)
Experimental — accuracy not yet measuredAn automated feedback Web-based intervention for people with mild depressive symptoms can be as effective and reach similar adherence as the same intervention with personal feedback.
“Also, research showed that an automated feedback Web-based intervention for people with mild depressive symptoms can be as effective and reach similar adherence as the same intervention with personal feedback [22].”
The effectiveness of the web-based intervention Living to the Full, both with and without support from a counselor, in reducing depression and associated anxiety in adults has been established in randomized controlled trials.
“The effectiveness of this web-based intervention (both with and without support from a counselor) in reducing depression and associated anxiety in adults has been established in RCTs [21, 40, 41, 61].”
CBT for depression can be effectively administered in web-based settings.
“More recently, studies have shown that CBT for depression can be effectively administered in web-based settings (Andersson and Cuijpers, 2009, Andrews et al., 2010, Kelders et al., 2015, Richards and Richardson, 2012).”
From Development and initial evaluation of blended cognitive behavioural treatment for major depression in routine specialized mental health care (2016) · cites this paper as Kelders et al., 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267 · see citing works
Maximum Likelihood from Incomplete Data Via the <i>EM</i> Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444 · see citing works
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139 · see citing works
(1999) · Cited by 5,934 · see citing works
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · see citing works
Morris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502 · see citing works
SPINHOVEN, P., ORMEL, J., SLOEKERS, P. P. A., KEMPEN, G. I. J. M., SPECKENS, A. E. M., & HEMERT, A. M. V. (1997) · Psychological Medicine · doi:10.1017/s0033291796004382 · Cited by 2,158 · see citing works
Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions
Noar, S. M., Benac, C. N., & Harris, M. S. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.673 · Cited by 2,136 · see citing works
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033 · see citing works
The Personal Involvement Inventory: Reduction, Revision, and Application to Advertising
Zaichkowsky, J. L. (1994) · Journal of Advertising · doi:10.1080/00913367.1943.10673459 · Cited by 1,737 · see citing works
Persuasive Systems Design: Key Issues, Process Model, and System Features
Oinas-Kukkonen, H., & Harjumaa, M. (2009) · Communications of the Association for Information Systems · doi:10.17705/1cais.02428 · Cited by 1,663 · see citing works
Statistics for experimenters: design, innovation, and discovery
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3429 · Cited by 1,657 · see citing works
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · see citing works
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · see citing works
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · see citing works
Self-citationBarak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802094429 · Cited by 1,283 · see citing works
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · see citing works
Collins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082 · see citing works
Allen, L. (2001) · Cited by 983 · see citing works
A Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876 · see citing works
Cuijpers, P., & Smit, F. (2004) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2004.00301.x · Cited by 595 · see citing works
Olssøn, I., Mykletun, A., & Dahl, A. A. (2005) · BMC Psychiatry · doi:10.1186/1471-244x-5-46 · Cited by 580 · see citing works
Internet-based self-help for depression: randomised controlled trial
Andersson, G., Bergström, J., Holländare, F., Carlbring, P., Kaldo, V., & Ekselius, L. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.187.5.456 · Cited by 529 · see citing works
Internet-based psychological treatments for depression
Johansson, R., & Andersson, G. (2012) · Expert Review of Neurotherapeutics · doi:10.1586/ern.12.63 · Cited by 509 · see citing works
A strategy for optimizing and evaluating behavioral interventions
Collins, L. M., Murphy, S. A., Nair, V. N., & Strecher, V. J. (2005) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm3001_8 · Cited by 492 · see citing works
Fry, J. P., & Neff, R. A. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1138 · Cited by 447 · see citing works
Titov, N., Andrews, G., Davies, M., McIntyre, K., Robinson, E., & Solley, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010939 · Cited by 406 · see citing works
Petrou, A. D. (2003) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10328 · Cited by 387 · see citing works
de Vries, H., & Brug, J. (1999) · Patient Education and Counseling · doi:10.1016/s0738-3991(98)00127-x · Cited by 327 · see citing works
Haringsma, R., Engels, G. I., Beekman, A. T. F., & Spinhoven, P. (2004) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1130 · Cited by 299 · see citing works
Morrison, L. G., Yardley, L., Powell, J., & Michie, S. (2012) · Telemedicine and e-Health · doi:10.1089/tmj.2011.0062 · Cited by 290 · see citing works
Promoting motivation with virtual agents and avatars: role of visual presence and appearance
Baylor, A. L. (2009) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2009.0148 · Cited by 275 · see citing works
Johansson, R., Sjöberg, E., Sjögren, M., Johnsson, E., Carlbring, P., Andersson, T., Rousseau, A., & Andersson, G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0036905 · Cited by 268 · see citing works
Web-Based Smoking-Cessation Programs
Strecher, V. J., McClure, J. B., Alexander, G. L., Chakraborty, B., Nair, V. N., Konkel, J. M., Greene, S. M., Collins, L. M., Carlier, C. C., Wiese, C. J., et al. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.12.024 · Cited by 266 · see citing works
Guided and unguided self-help for social anxiety disorder: randomised controlled trial
Furmark, T., Carlbring, P., Hedman, E., Sonnenstein, A., Clevberger, P., Bohman, B., Eriksson, A., Hållén, A., Frykman, M., Holmström, A., et al. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.060996 · Cited by 256 · see citing works
eHealth Evaluation and Dissemination Research
Glasgow, R. E. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.023 · Cited by 220 · see citing works
AH 12 years later: a comprehensive survey of adaptive hypermedia methods and techniques
Knutov, E., Bra, P. M. D., & Pechenizkiy, M. (2009) · New Review of Hypermedia and Multimedia · doi:10.1080/13614560902801608 · Cited by 219 · see citing works
Fledderus, M., Bohlmeijer, E. T., Pieterse, M. E., & Schreurs, K. M. G. (2012) · Psychological Medicine · doi:10.1017/s0033291711001206 · Cited by 209 · see citing works
Self-citationComputerised cognitive-behavioural therapy for depression: systematic review
Kaltenthaler, E., Parry, G., Beverley, C., & Ferriter, M. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.106.025981 · Cited by 206 · see citing works
Blankers, M., Koeter, M. W. J., & Schippers, G. M. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1448 · Cited by 194 · see citing works
Hilvert-Bruce, Z., Rossouw, P. J., Wong, N., Sunderland, M., & Andrews, G. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.04.001 · Cited by 193 · see citing works
Musiat, P., & Tarrier, N. (2014) · Psychological Medicine · doi:10.1017/s0033291714000245 · Cited by 188 · see citing works
Behavior Change Support Systems: A Research Model and Agenda
B, H. O.-K. A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13226-1_3 · Cited by 186 · see citing works
Winning Isn't Everything: Competition, Achievement Orientation, and Intrinsic Motivation
Tauer, J. M., & Harackiewicz, J. M. (1999) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1999.1383 · Cited by 178 · see citing works
Carlbring, P., Hägglund, M., Luthström, A., Dahlin, M., Kadowaki, Å., Vernmark, K., & Andersson, G. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.12.020 · Cited by 177 · see citing works
The narrative reconstruction of psychotherapy and psychological health
Adler, J. M., Skalina, L. M., & McAdams, D. (2008) · Psychotherapy Research · doi:10.1080/10503300802326020 · Cited by 169 · see citing works
Kelders, S. M., Van Gemert-Pijnen, J. E. W. C., Werkman, A., Nijland, N., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1624 · Cited by 156 · see citing works
Self-citationPots, W. T. M., Fledderus, M., Meulenbeek, P. A. M., ten Klooster, P. M., Schreurs, K. M. G., & Bohlmeijer, E. T. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.146068 · Cited by 133 · see citing works
Self-citationRandomized Controlled Trial of Web-Based Treatment of Social Phobia Without Clinician Guidance
Titov, N., Andrews, G., Choi, I., Schwencke, G., & Johnston, L. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670903179160 · Cited by 122 · see citing works
Cuijpers, P., van Straten, A., Warmerdam, L., & van Rooy, M. J. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-181 · Cited by 106 · see citing works
JORM, A. F., & GRIFFITHS, K. M. (2006) · Psychological Medicine · doi:10.1017/s0033291705005659 · Cited by 104 · see citing works
Pros and cons of online cognitive–behavioural therapy
Andersson, G., & Cuijpers, P. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.054080 · Cited by 101 · see citing works
Internet-based exercise intervention systems: Are more interactive designs better?
Hurling, R., Fairley, B. W., & Dias, M. B. (2006) · Psychology & Health · doi:10.1080/14768320600603257 · Cited by 94 · see citing works
Kelders, S. M., Bohlmeijer, E. T., & Van Gemert-Pijnen, J. E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2258 · Cited by 88 · see citing works
Self-citationDevelopment of a web-based intervention for the indicated prevention of depression
Kelders, S. M., Pots, W. T., Oskam, M. J., Bohlmeijer, E. T., & van Gemert-Pijnen, J. E. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-26 · Cited by 80 · see citing works
Self-citationMorgan, A. J., Jorm, A. F., & Mackinnon, A. J. (2012) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.111.101394 · Cited by 77 · see citing works
Predictors of outcome in Internet-based cognitive behavior therapy for severe health anxiety
Hedman‐Lagerlöf, E., Lindefors, N., Andersson, G., Andersson, E., Lekander, M., Rück, C., & Ljótsson, B. (2013) · Behaviour Research and Therapy · doi:10.1016/j.brat.2013.07.009 · Cited by 47 · see citing works
Ritterband, L. M., Cox, D. J., Gordon, T. L., Borowitz, S. M., Kovatchev, B. P., Walker, L. S., & Sutphen, J. L. (2006) · Children's Health Care · doi:10.1207/s15326888chc3501_5 · Cited by 39 · see citing works
Answering the “What Works?” Question in Health Behavior Change
Norman, G. J. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.02.005 · Cited by 28 · see citing works
Involvement as a Working Mechanism for Persuasive Technology
Kelders, S. M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20306-5_1 · Cited by 25 · see citing works
Self-citationTalbot, F. (2012) · Behaviour Change · doi:10.1017/bec.2012.4 · Cited by 15 · see citing works
User-centered design for personalization
Velzen, V. L. S. (2010) · doi:10.3990/1.9789036531399 · Cited by 4 · see citing works
Flagged first, then by citations
1 of the 63 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [20]20. Fogg, B. J. (2003). Persuasive technology: Using computers to change what we think and do. Boston: Morgan Kaufmann Publishers.
Cited by
Sorted by citations
Spijkerman, M. P. J., Pots, W. T. M., & Bohlmeijer, E. T. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.03.009 · Cited by 975 · see citing works
“In another recent study (Kelders et al., 2015), a human-supported web-based ACT intervention and an automated-supported we-based ACT intervention, both of which aimed to aid people with mild to moderate depressive symptoms, were compared to one another in terms of adherence and effectiveness.”
MethodSelf-citationLinardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2019) · World Psychiatry · doi:10.1002/wps.20673 · Cited by 886 · see citing works
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390 · see citing works
Mixing Online and Face-to-Face Therapy: How to Benefit From Blended Care in Mental Health Care
Wentzel, J., van der Vaart, R., Bohlmeijer, E. T., & van Gemert-Pijnen, J. E. W. C. (2016) · JMIR Mental Health · doi:10.2196/mental.4534 · Cited by 371 · see citing works
Self-citationLipschitz, J. M., Pike, C. K., Hogan, T. P., Murphy, S. A., & Burdick, K. E. (2023) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-023-00297-3 · Cited by 230 · see citing works
Schueller, S. M., Tomasino, K. N., & Mohr, D. C. (2017) · Clinical Psychology: Science and Practice · doi:10.1037/h0101740 · Cited by 70 · see citing works
Musiat, P., Johnson, C., Atkinson, M., Wilksch, S., & Wade, T. (2022) · Psychological Medicine · doi:10.1017/s0033291721004621 · Cited by 166 · see citing works
Allexandre, D., Bernstein, A. M., Walker, E., Hunter, J., Roizen, M. F., & Morledge, T. J. (2016) · Journal of Occupational & Environmental Medicine · doi:10.1097/jom.0000000000000680 · Cited by 157 · see citing works
Lau, Y., Htun, T. P., Wong, S. N., Tam, W. S. W., & Klainin-Yobas, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6712 · Cited by 149 · see citing works
Doss, B. D., Feinberg, L. K., Rothman, K., Roddy, M. K., & Comer, J. S. (2017) · Journal of Family Psychology · doi:10.1037/fam0000349 · Cited by 149 · see citing works
Morgan, A. J., Rapee, R. M., Salim, A., Goharpey, N., Tamir, E., McLellan, L. F., & Bayer, J. K. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2017.02.010 · Cited by 137 · see citing works
Hornstein, S., Zantvoort, K., Lueken, U., Funk, B., & Hilbert, K. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1170002 · Cited by 134 · see citing works
Schotanus-Dijkstra, M., Drossaert, C. H. C., Pieterse, M. E., Boon, B. J. F., Walburg, J. A., & Bohlmeijer, E. T. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.04.002 · Cited by 127 · see citing works
Self-citationMohr, D. C., Schueller, S. M., Tomasino, K. N., Kaiser, S. M., Alam, N., Karr, C., Vergara, J. L., Gray, E. L., Kwasny, M. J., & Lattie, E. G. (2019) · Journal of Medical Internet Research · doi:10.2196/13609 · Cited by 116 · see citing works
Kelders, S. M., Sommers‐Spijkerman, M., & Goldberg, J. M. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9923 · Cited by 113 · see citing works
Self-citationKooistra, L. C., Ruwaard, J., Wiersma, J. E., van Oppen, P., van der Vaart, R., van Gemert-Pijnen, J. E. W. C., & Riper, H. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.01.003 · Cited by 92 · see citing works
Hunt, M. G., Miguez, S. M., Dukas, B., Onwude, O., & White, S. J. (2021) · JMIR mhealth and uhealth · doi:10.2196/26152 · Cited by 98 · see citing works
Forbes, A., Keleher, M. R., Venditto, M., & DiBiasi, F. (2023) · Journal of Medical Internet Research · doi:10.2196/43727 · Cited by 94 · see citing works
Aardoom, J. J., Dingemans, A. E., Spinhoven, P., van Ginkel, J. R., de Rooij, M., & van Furth, E. F. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5709 · Cited by 94 · see citing works
Treating to target in major depressive disorder: response to remission to functional recovery
McIntyre, R. S., Lee, Y. L., & Mansur, R. B. (2015) · CNS Spectrums · doi:10.1017/s1092852915000826 · Cited by 83 · see citing works
Gan, D. Z. Q., McGillivray, L., Larsen, M. E., Christensen, H. M., & Torok, M. H. (2022) · Digital Health · doi:10.1177/20552076221098268 · Cited by 81 · see citing works
Achilles, M. R., Anderson, M., Li, S., Subotic-Kerry, M., Parker, B., & O’Dea, B. (2020) · Digital Health · doi:10.1177/2055207620926064 · Cited by 77 · see citing works
Shim, M., Mahaffey, B., Bleidistel, M., & Gonzalez, A. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.09.003 · Cited by 72 · see citing works
Linardon, J., Messer, M., Lee, S., & Rosato, J. (2021) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/s40519-020-01005-3 · Cited by 76 · see citing works
Mira, A., Bretón-López, J., García-Palacios, A., Quero, S., Baños, R. M., & Botella, C. (2017) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s130994 · Cited by 71 · see citing works
“63 However, in order to draw more definitive conclusions about differences between the two intervention groups, they would need more statistical power, as in the present study.”
InfluentialTherapist behaviours in internet-based cognitive behaviour therapy (ICBT) for depressive symptoms
Holländare, F., Gustafsson, S. A., Berglind, M., Grape, F., Carlbring, P., Andersson, G., Hadjistavropoulos, H., & Tillfors, M. (2016) · Internet Interventions · doi:10.1016/j.invent.2015.11.002 · Cited by 65 · see citing works
Zhang, Y., Xue, J., & Huang, Y. (2020) · Medicine · doi:10.1097/md.0000000000020493 · Cited by 63 · see citing works
Cheung, K., Ling, W., Karr, C. J., Weingardt, K. R., Schueller, S. M., & Mohr, D. C. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy023 · Cited by 61 · see citing works
Online-based interventions for sexual health among individuals with cancer: a systematic review
Kang, H. S., Kim, H. K., Park, S. M., & Kim, J. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-2972-6 · Cited by 55 · see citing works
Acceptability of Digital Mental Health Interventions for Depression and Anxiety: Systematic Review
Lau, C. K. Y., Saad, A., Camara, B., Rahman, D., & Bolea-Alamanac, B. (2024) · Journal of Medical Internet Research · doi:10.2196/52609 · Cited by 51 · see citing works
Renfrew, M. E., Morton, D. P., Morton, J. K., Hinze, J. S., Beamish, P., Przybylko, G., & Craig, B. A. (2020) · Journal of Medical Internet Research · doi:10.2196/15592 · Cited by 53 · see citing works
Andersson, G., Käll, A., Juhlin, S., Wahlström, C., de Fine Licht, E., Färdeman, S., Franck, A., Tholcke, A., Nachtweij, K., Fransson, E., et al. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104265 · Cited by 51 · see citing works
Burger, F., Neerincx, M. A., & Brinkman, W. (2019) · Journal of Medical Internet Research · doi:10.2196/12599 · Cited by 45 · see citing works
Köhle, N., Drossaert, C. H. C., ten Klooster, P. M., Schreurs, K. M. G., Hagedoorn, M., Van Uden-Kraan, C. F., Verdonck-de Leeuw, I. M., & Bohlmeijer, E. T. (2021) · Supportive Care in Cancer · doi:10.1007/s00520-021-06051-w · Cited by 45 · see citing works
“Our findings contradict previous research in which a Webbased intervention with automated feedback for people with depression and anxiety was as effective as the same intervention with personal feedback [22].”
BackgroundResultInfluentialSelf-citationLandoll, R. R., Vargas, S. E., Samardzic, K. B., Clark, M. F., & Guastaferro, K. (2021) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab146 · Cited by 42 · see citing works
Watkins, E., Newbold, A., Tester-Jones, M., Collins, L. M., & Mostazir, M. (2023) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2023.1937 · Cited by 40 · see citing works
Glover, A. C., Schueller, S. M., Winiarski, D. A., Smith, D. L., Karnik, N. S., & Zalta, A. K. (2019) · JMIR Mental Health · doi:10.2196/15144 · Cited by 40 · see citing works
Kip, H., Jong, N. B.-D., van Gemert‐Pijnen, J. E. W. C., & Kelders, S. M. (2024) · Journal of Medical Internet Research · doi:10.2196/59601 · Cited by 41 · see citing works
Self-citationHolistic development of eHealth technology
Kip, H., & van Gemert-Pijnen, L. (. E. W. C. ). (2018) · Routledge eBooks · doi:10.4324/9781315385907-7 · Cited by 36 · see citing works
Tokgöz, P., Hrynyschyn, R., Hafner, J., Schönfeld, S., & Dockweiler, C. (2021) · JMIR Mental Health · doi:10.2196/26268 · Cited by 36 · see citing works
“[26,35,38,63,64] and problem-solving therapy (4/52, 8”
InfluentialLokman, S., Leone, S. S., Sommers‐Spijkerman, M., van der Poel, A., Smit, F., & Boon, B. J. F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6581 · Cited by 37 · see citing works
Jonathan, G., Dopke, C. A., Michaels, T., Bank, A., Martin, C. R., Adhikari, K., Krakauer, R. L., Ryan, C., McBride, A., Babington, P., et al. (2021) · JMIR Mental Health · doi:10.2196/20424 · Cited by 36 · see citing works
Campos, D., Bretón-López, J., Botella, C., Mira, A., Castilla, D., Mor, S., Baños, R., & Quero, S. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2060-4 · Cited by 32 · see citing works
Remote Psychological Interventions for Fear of Cancer Recurrence: Scoping Review.
Cincidda, C., Pizzoli, S. F. M., & Pravettoni, G. (2022) · JMIR Cancer · doi:10.2196/29745 · Cited by 34 · see citing works
“To date, the literature has demonstrated that blended therapy displays encouraging effects [48,62] and has shown efficacy in reducing FCR among early-stage survivors of cancer [63].”
BackgroundCampos, D., Mira, A., Bretón-López, J., Castilla, D., Botella, C., Baños, R. M., & Quero, S. (2018) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s153041 · Cited by 30 · see citing works
Health Behavior Change Support Systems as a research discipline; A viewpoint
Kelders, S. M., Oinas-Kukkonen, H., Oörni, A., & van Gemert-Pijnen, J. E. W. C. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.06.022 · Cited by 32 · see citing works
Self-citationKip, H., Oberschmidt, K., & Bierbooms, J. J. P. A. (2020) · International Journal of Forensic Mental Health · doi:10.1080/14999013.2020.1808914 · Cited by 32 · see citing works
Enrique, Á., Mooney, O., Salamanca-Sanabria, A., Lee, C. T., Farrell, S., & Richards, D. (2020) · JMIR Formative Research · doi:10.2196/20167 · Cited by 29 · see citing works
Cuijpers, P. J., Harrer, M., & Furukawa, T. A. (2026) · World Psychiatry · doi:10.1002/wps.70002 · Cited by 31 · see citing works
An open trial of internet-based cognitive behavioral therapy for first year medical students
Lattie, E. G., Kashima, K. J., & Duffecy, J. L. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100279 · Cited by 29 · see citing works
Technology-Supported Interventions for Pregnant Women: A Systematic Review
Lee, Y., & Cho, S. (2019) · CIN: Computers, Informatics, Nursing · doi:10.1097/cin.0000000000000535 · Cited by 24 · see citing works
Involvement as a Working Mechanism for Persuasive Technology
Kelders, S. M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20306-5_1 · Cited by 25 · see citing works
Self-citationAardoom, J. J., Dingemans, A. E., Fokkema, M., Spinhoven, P., & van Furth, E. F. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.11.012 · Cited by 26 · see citing works
Witlox, M., Kraaij, V., Garnefski, N., de Waal, M. W. M., Smit, F., Hoencamp, E., Gussekloo, J., Bohlmeijer, E. T., & Spinhoven, P. (2018) · Trials · doi:10.1186/s13063-018-2731-3 · Cited by 23 · see citing works
Self-citationRothman, K., Roddy, M. K., & Doss, B. D. (2019) · Family Relations · doi:10.1111/fare.12378 · Cited by 25 · see citing works
Moskowitz, J. T., Addington, E. L., Shiu, E. W., Bassett, S. M., Schuette, S., Kwok, I., Freedman, M. E., Leykin, Y., Saslow, L. R., Cohn, M., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25922 · Cited by 21 · see citing works
Austin, J., Drossaert, C. H. C., van Dijk, J., Sanderman, R., Børøsund, E., Mirković, J., Schotanus-Dijkstra, M., Peeters, N. J., Klooster, J. W. J. R. V. '., Schroevers, M. J., et al. (2022) · JMIR Cancer · doi:10.2196/37502 · Cited by 23 · see citing works
Self-citationMutter, A., Küchler, A., Idrees, A. R., Kählke, F., Terhorst, Y., & Baumeister, H. (2023) · BMC Psychology · doi:10.1186/s40359-023-01312-1 · Cited by 22 · see citing works
Linardon, J., King, T., Shatte, A. B. R., & Fuller‐Tyszkiewicz, M. (2021) · Behavior Modification · doi:10.1177/01454455211021764 · Cited by 20 · see citing works
Design for Engagement of Online Positive Psychology Interventions
Kelders, S. M. (2019) · Springer eBooks · doi:10.1007/978-3-030-20020-6_13 · Cited by 20 · see citing works
Self-citationda Silva, V. C., Gorgulho, B. M., Marchioni, D. M. L., Matos, S. M. A., Giatti, L., de Araújo, T. A., Alonso, A. C., Santos, I. S., Lotufo, P. A., & Benseñor, I. M. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192214934 · Cited by 16 · see citing works
Internet Interventions in Clinical Psychology
Andersson, G., & Carlbring, P. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00211-9 · Cited by 15 · see citing works
Yuva: An e-health model for dealing with psychological issues of adolescents
Srivastava, S., Pant, M., & Nagar, A. K. (2017) · Journal of Computational Science · doi:10.1016/j.jocs.2017.05.030 · Cited by 15 · see citing works
van Tilburg, M. L., Kloek, C. J. J., Staal, J. B., Bossen, D., & Veenhof, C. (2020) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2020.1756015 · Cited by 14 · see citing works
Dopke, C. A., McBride, A., Babington, P., Jonathan, G., Michaels, T., Ryan, C., Duffecy, J. L., Mohr, D. C., & Goulding, E. H. (2021) · JMIR Formative Research · doi:10.2196/25810 · Cited by 14 · see citing works
Campos, D., Bretón-López, J., Botella, C., Mira, A., Castilla, D., Baños, R., Tortella-Feliu, M., & Quero, S. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0996-1 · Cited by 13 · see citing works
Zarski, A.-C., Weisel, K. K., Berger, T., Krieger, T., Schaub, M. P., Berking, M., Görlich, D., Jacobi, C., & Ebert, D. D. (2024) · Psychotherapy and Psychosomatics · doi:10.1159/000536149 · Cited by 13 · see citing works
Are Digitally Delivered Psychological Interventions for Depression the Way Forward? A Review
Stefanopoulou, E., Lewis, D., Taylor, M., Broscombe, J., Ahmad, J., & Larkin, J. (2018) · Psychiatric Quarterly · doi:10.1007/s11126-018-9576-5 · Cited by 11 · see citing works
A systematic review on personalization of treatment components in IBIs for mental disorders
Schaeuffele, C., Zagorscak, P., Langerwisch, V., Wilke, J., Medvedeva, Y., & Knaevelsrud, C. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100840 · Cited by 11 · see citing works
Tönis, K. J. M., Kraiss, J. T., Drossaert, C. H. C., Karreman, J., Oostinga, M. S. D., Kloos, N., Austin, J., & Bohlmeijer, E. T. (2024) · Journal of Happiness Studies · doi:10.1007/s10902-024-00793-0 · Cited by 9 · see citing works
Self-citationDahlin, M., Carlbring, P., Håkansson, A., & Andersson, G. (2020) · Digital Psychiatry · doi:10.1080/2575517x.2020.1822730 · Cited by 9 · see citing works
Application of the Supportive Accountability Model in Digital Health Interventions: Scoping Review
Kwok, G., Cheung, S., Duffecy, J. L., & Devine, K. A. (2025) · Journal of Medical Internet Research · doi:10.2196/72639 · Cited by 8 · see citing works
Schramm, E., Breuninger, C., Zehender, N., Hegerl, U., Elsner, A., Maun, A., Schmölz, M., Roick, C., Grodd, M., & Graf, E. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-04035-6 · Cited by 4 · see citing works
Shafin, N. A., Saedudin, R. R., & Abdullah, N. H. (2020) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v18.i3.pp1464-1473 · Cited by 5 · see citing works
Mobile app use and the mental health of elite athletes
Collins, R., Yang, R., D’Souza, B. N., Gore, A., Bay, C., Erondu, I., & Menon, S. N. (2025) · Sports Psychiatry · doi:10.1024/2674-0052/a000104 · Cited by 5 · see citing works
Rodrigues, T. C., Reijnders, T., de Buisonjé, D. R., Santhanam, P., Kowatsch, T., Breeman, L. D., Janssen, V. R., Kraaijenhagen, R. A., Atsma, D. E., & Evers, A. W. M. (2021) · doi:10.2196/preprints.30057 · Cited by 4 · see citing works
Social Media and Mental Health in Youth During COVID-19: A Narrative Review
(2021) · International Journal of Psychological Research and Reviews · doi:10.28933/ijprr-2021-08-2905 · Cited by 3 · see citing works
Àgora de salut vol. V (número complet)
varios, A. (2018) · Àgora de salut · doi:10.6035/agorasalut.2018.5 · Cited by 3 · see citing works
Zhang, K., Jiang, Y., Xi, K., & Sun, N. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1718371 · Cited by 3 · see citing works
Bastoni, S., Doğan, K., & Kelders, S. M. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2619650 · Cited by 2 · see citing works
Self-citationThe Use of Technology to Augment Clinical Care in Depression and Anxiety Disorders: An Evidence Map
Maher, A. R., Apaydin, E. A., Raaen, L. B., Motala, A., Shanman, R., & Hempel, S. (2019) · RAND Corporation eBooks · doi:10.7249/rr2177 · Cited by 2 · see citing works
Rodrigues, T. C., de Buisonjé, D. R., Reijnders, T., Santhanam, P., Kowatsch, T., Breeman, L. D., Janssen, V. R., Kraaijenhagen, R. A., Atsma, D. E., & Evers, A. W. M. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100726 · Cited by 1 · see citing works
Emotional Eating in Primary Care: Considerations for Assessment and Management
Wozniak, J. D., & Huang, H. Y. (2024) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000405 · Cited by 1 · see citing works
Barakat, S., Rom, S., Kim, M., Aouad, P., & Maguire, S. (2025) · European Eating Disorders Review · doi:10.1002/erv.3176 · Cited by 1 · see citing works
Digital Mental Health Treatments for Depression
Ramos, G., Karyotaki, E., Mohr, D. C., & Schueller, S. M. (2025) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2025.08.023 · Cited by 1 · see citing works
Saar, C. R., Brandes, O., & Baumel, A. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1586668 · Cited by 1 · see citing works
Linardon, J. (2025) · International Journal of Eating Disorders · doi:10.1002/eat.70015 · Cited by 1 · see citing works
Amarti, K., Čihařová, M., Provoost, S., Schulte, M. H. J., Kleiboer, A. M., el Hassouni, A., Gonçalves, G., & Riper, H. M. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100900 · Cited by 1 · see citing works
Sanz, C. M., Díaz-Sanahuja, L., Pastor, A. M., Bretón-López, J. M., & Arbona, C. B. (2018) · Àgora de salut · doi:10.6035/agorasalut.2018.5.29 · Cited by 1 · see citing works
Haviari, S., & Mentré, F. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02191-9 · Cited by 1 · see citing works
Adu, M. K., Eboreime, O., Shalaby, R., Eboreime, E., Agyapong, B., Dias, R. D. L., Sapara, A. O., & Agyapong, V. I. O. (2024) · JMIR Formative Research · doi:10.2196/59003 · Cited by 1 · see citing works
Børtveit, L., Nordgreen, T., & Nordahl‐Hansen, A. (2024) · Acta Psychologica · doi:10.1016/j.actpsy.2024.104510 · Cited by 1 · see citing works
Kip, H. (2021) · doi:10.3990/1.9789036551311 · Cited by 1 · see citing works
Doss, B. D., Feinberg, L. K., Rothman, K., Roddy, M. K., & Comer, J. S. (2019) · Gezinstherapie Wereldwijd · doi:10.1007/s12440-019-00096-4
Rodrigues, T. C., de Buisonjé, D. R., Reijnders, T., Santhanam, P., Kowatsch, T., Breeman, L. D., Janssen, V. R., Kraaijenhagen, R. A., Atsma, D. E., & Evers, A. W. M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4592380
Amarti, K., Čihařová, M., Provoost, S., Schulte, M. H. J., Kleiboer, A. M., el Hassouni, A., Gonçalves, G., & Riper, H. M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5357442
Schramm, E., Breuninger, C., Zehender, N., Hegerl, U., Elsner, A., Maun, A., Schmölz, M., Roick, C., Grodd, M., & Graf, E. (2022) · Figshare · doi:10.6084/m9.figshare.20400921
- Authors
- Kelders, S. M., Bohlmeijer, E. T., Pots, W. T. M., & van Gemert-Pijnen, J. E. W. C.
- Affiliations
- University of Twente (NL)
- Corresponding author
- Kelders, Saskia M.
- Venue
- Behaviour Research and Therapy
- Publisher
- Elsevier BV
- Published
- 2015-09
- Volume
- 72
- Pages
- 72-80
- ISSN
- 0005-7967 (ISSN-L)
- OpenAlex
- W855558648
- Cited by
- 105
- References
- 63
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 11 · 2023: 7 · 2022: 7 · 2021: 16 · 2020: 9 · 2019: 12 · 2018: 9 · 2017: 8 · 2016: 9 · 2015: 3
- FWCI
- 15.73
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Behaviour Research and Therapy (publishedVersion)
- PubMed (publishedVersion)
- University of Twente Research Information (submittedVersion, other-oa)
- University of Twente Research Information (submittedVersion)
- Funders
- University of Twente
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- depression, online intervention, automated support, human support, persuasive technology, medication adherence, intervention effectiveness, digital mental health
- MeSH terms
- Adult, Depression, Female, Humans, Male, Middle Aged, Patient Compliance, Surveys and Questionnaires, Social Support, Cognitive Behavioral Therapy, Treatment Outcome, Internet, Text Messaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review