Assessing the Efficacy and Acceptability of a Web-Based Intervention for Resilience Among College Students: Pilot Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Background: College students are at elevated risk for developing mental health problems and face specific barriers around accessing evidence-based treatment. Web-based interventions that focus on mental health promotion and strengthening resilience represent one possible solution. Providing support to users has shown to reduce dropout in these interventions. Further research is needed to assess the efficacy and acceptability of these interventions and explore the viability of automating support. Objective: This study investigated the feasibility of a new web-based resilience program based on positive psychology, provided with human or automated support, in a sample of college students. Methods: A 3-armed closed pilot randomized controlled trial design was used. Participants were randomized to the intervention with human support (n=29), intervention with automated support (n=26), or waiting list (n=28) group. Primary outcomes were resilience and well-being, respectively measured by the Connor–Davidson Resilience Scale and Pemberton Happiness Index. Secondary outcomes included measures of depression and anxiety, self-esteem, and stress. Outcomes were self-assessed through online questionnaires. Intention-to-treat and per-protocol analyses were conducted. Results: All participants demonstrated significant improvements in resilience and related outcomes, including an unexpected improvement in the waiting list group. Within- and between-group effect sizes ranged from small to moderate and within-group effects were typically larger for the human than automated support group. A total of 36 participants began the program and completed 46.46% of it on average. Participants were generally satisfied with the program and found it easy to use. Conclusions: Findings support the feasibility of the intervention. Preliminary evidence for the equal benefit of human and automated support needs to be supported by further research with a larger sample. Results of this study will inform the development of a full-scale trial, from which stronger conclusions may be drawn. Trial Registration: International Standard Randomized Controlled Trial Number (ISRCTN) 11866034; http://www.isrctn.com/ISRCTN11866034 International Registered Report Identifier (IRRID): RR2-10.1016/j.invent.2019.100254
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The brief resilience scale: Assessing the ability to bounce back
Smith, B. W., Dalen, J., Wiggins, K., Tooley, E., Christopher, P., & Bernard, J. (2008) · International Journal of Behavioral Medicine · doi:10.1080/10705500802222972 · Cited by 6,439 · cited 2×
“The Brief Resilience Scale (BRS) [53] is a 6-item self-report measure assessing resilience or ability to bounce back or recover from stress.”
An Ultra-Brief Screening Scale for Anxiety and Depression: The PHQ–4
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2009) · Psychosomatics · doi:10.1016/s0033-3182(09)70864-3 · Cited by 4,261
A methodological review of resilience measurement scales
Windle, G., Bennett, K. M., & Noyes, J. (2011) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-9-8 · Cited by 2,079 · cited 1×
“Notably, effects for resilience tended to be larger on the BRS (which measures a resilient outcome) in the human support group and larger on the CD-RISC (which measures the assets and resources that lead to a resilient outcome) in the automated support group [66].”
Positive psychology interventions: a meta-analysis of randomized controlled studies
Bolier, L., Haverman, M., Westerhof, G. J., Riper, H., Smit, F., & Bohlmeijer, E. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-119 · Cited by 1,996 · cited 3×
“However, findings from 2 meta-analyses on resilience and positive psychology interventions demonstrated small effect sizes for resilience and psychological well-being, respectively [12,14].”
Whitehead, A. L., Julious, S. A., Cooper, C. L., & Campbell, M. J. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280215588241 · Cited by 1,936 · cited 1×
“A sample size of 25 per arm is recommended for pilot trials when effect sizes are expected to be small [36].”
Mental disorders among college students in the World Health Organization World Mental Health Surveys
Auerbach, R. P., Alonso, J., Axinn, W. G., Cuijpers, P., Ebert, D. D., Green, J. G., Hwang, I., Kessler, R. C., Liu, H., Mortier, P., et al. (2016) · Psychological Medicine · doi:10.1017/s0033291716001665 · Cited by 1,587 · cited 1×
“The 12-month prevalence rate for mental disorders among college students is an estimated 20% yet only a small proportion of these students receive adequate treatment [2].”
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · cited 1×
“Several meta-analyses show that supported web-based interventions yield lower rates of dropout and better clinical outcomes than unguided interventions [21,22,25,26].”
Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802094429 · Cited by 1,283 · cited 1×
“Several meta-analyses show that supported web-based interventions yield lower rates of dropout and better clinical outcomes than unguided interventions [21,22,25,26].”
The Relationship Between Self‐Compassion and Well‐Being: A Meta‐Analysis
Zessin, U., Dickhäuser, O., & Garbade, S. (2015) · Applied Psychology: Health and Well-Being · doi:10.1111/aphw.12051 · Cited by 1,237 · cited 1×
“A description of module content is provided in Multimedia Appendix 2 [6,8,37-46] and a screenshot of the program is provided in Multimedia Appendix 3.”
Prati, G., & Pietrantoni, L. (2009) · Journal of Loss and Trauma · doi:10.1080/15325020902724271 · Cited by 978
Joyce, S., Shand, F., Tighe, J., Laurent, S. J., Bryant, R. A., & Harvey, S. B. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-017858 · Cited by 864
What are the benefits of mindfulness? A practice review of psychotherapy-related research.
Davis, D. M., & Hayes, J. A. (2011) · Psychotherapy · doi:10.1037/a0022062 · Cited by 831 · cited 1×
“A description of module content is provided in Multimedia Appendix 2 [6,8,37-46] and a screenshot of the program is provided in Multimedia Appendix 3.”
Random allocation software for parallel group randomized trials
Saghaei, M. (2004) · BMC Medical Research Methodology · doi:10.1186/1471-2288-4-26 · Cited by 793
The resilience framework as a strategy to combat stress-related disorders
Kalisch, R., Baker, D. G., Basten, U., Boks, M. P., Bonanno, G. A., Brummelman, E., Chmitorz, A., Fernàndez, G., Fiebach, C. J., Galatzer-Levy, I., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0200-8 · Cited by 782
Steinhardt, M., & Dolbier, C. (2008) · Journal of American College Health · doi:10.3200/jach.56.44.445-454 · Cited by 759 · cited 2×
“Encouragingly, initial research on resilience interventions among college students has demonstrated significant improvements in resilience and reductions in stress and symptoms of depression and anxiety [16-18].”
Chmitorz, A., Kunzler, A., Helmreich, I., Tüscher, O., Kalisch, R., Kubiak, T., Wessa, M., & Lieb, K. (2018) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.11.002 · Cited by 663
Dropout from Internet‐based treatment for psychological disorders
Melville, K. M., Casey, L. M., & Kavanagh, D. J. (2010) · British Journal of Clinical Psychology · doi:10.1348/014466509x472138 · Cited by 597 · cited 2×
“Despite the advantages of internet-delivery, one of the greatest limitations of web-based interventions are the high rates of dropout that can occur in these interventions [24].”
Ekers, D., Webster, L., Van Straten, A., Cuijpers, P., Richards, D., & Gilbody, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100100 · Cited by 565
Self-citationHarrer, M., Adam, S. H., Baumeister, H., Cuijpers, P., Karyotaki, E., Auerbach, R. P., Kessler, R. C., Bruffaerts, R., Berking, M., & Ebert, D. D. (2019) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1759 · Cited by 445 · cited 1×
“Encouragingly, research investigating technology-delivered preventive interventions with college students has demonstrated small to moderate effect sizes for mental health outcomes [19,20] and preliminary support exists for the efficacy of web-based resilience interventions [23].”
Vanhove, A. J., Herian, M. N., Perez, A. L. U., Harms, P. D., & Lester, P. B. (2016) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12123 · Cited by 443 · cited 1×
“For resilience interventions specifically, similar effect sizes have been observed in adults for resilience outcomes [9,14,15].”
Biau, D. J., Kernéis, S., & Porcher, R. (2008) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-008-0346-9 · Cited by 428 · cited 1×
“Because of greater variability in participant responses, it is likely that the sample was not large enough to differentiate between groups [69].”
Leppin, A. L., Bora, P. R., Tilburt, J. C., Gionfriddo, M. R., Zeballos-Palacios, C., Dulohery, M. M., Sood, A., Erwin, P. J., Brito, J. P., Boehmer, K. R., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111420 · Cited by 405 · cited 4×
“Resilience interventions seek to promote resilience at an individual, group, or population level with the aim of preparing individuals for the occurrence of future life stressors [9].”
InfluentialPsychological interventions to foster resilience in healthcare professionals
Kunzler, A. M., Helmreich, I., Chmitorz, A., König, J., Binder, H., Wessa, M., & Lieb, K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012527.pub2 · Cited by 390
Client preferences affect treatment satisfaction, completion, and clinical outcome: a meta-analysis
Lindhiem, O., Bennett, C. B., Trentacosta, C. J., & McLear, C. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.06.002 · Cited by 315 · cited 2×
“These findings support research showing higher levels of treatment adherence and retention when preference and allocation are matched [31,32].”
Behavioural activation for depression
Veale, D. (2008) · Advances in Psychiatric Treatment · doi:10.1192/apt.bp.107.004051 · Cited by 282
Hervás, G., & Vázquez, C. (2013) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-11-66 · Cited by 274 · cited 2×
“The PHI has demonstrated good convergent and incremental validity and strong internal consistency ( α >.89) [52].”
Guided and unguided self-help for social anxiety disorder: randomised controlled trial
Furmark, T., Carlbring, P., Hedman, E., Sonnenstein, A., Clevberger, P., Bohman, B., Eriksson, A., Hållén, A., Frykman, M., Holmström, A., et al. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.060996 · Cited by 256 · cited 2×
“…findings show that automated support is associated with slightly poorer rates of treatment efficacy and adherence compared to human support [28,30], continued improvements in developing high-quality automated support can lead to comparable outcomes, while reducing therapist time and…”
Comparing Mental Health Issues Among Undergraduate and Graduate Students
Wyatt, T., & Oswalt, S. B. (2013) · American Journal of Health Education · doi:10.1080/19325037.2013.764248 · Cited by 232
Psychological interventions for resilience enhancement in adults
Helmreich, I., Kunzler, A., Chmitorz, A., König, J., Binder, H., Wessa, M., & Lieb, K. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012527 · Cited by 223 · cited 4×
“This usually takes place through the enhancement of one or more resilience factors (assets and resources) [6].”
InfluentialComputer-Assisted Cognitive-Behavior Therapy for Depression: A Systematic Review and Meta-Analysis
Wright, J. H., Owen, J. J., Richards, D., Eells, T. D., Richardson, T., Brown, G. K., Barrett, M., Rasku, M. A., Polser, G., & Thase, M. E. (2019) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.18r12188 · Cited by 200
Self-citationThe Psychometric Properties of PHQ-4 Depression and Anxiety Screening Scale Among College Students
Khubchandani, J., Brey, R., Kotecki, J., Kleinfelder, J., & Anderson, J. (2016) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2016.01.014 · Cited by 168
Rose, R. D., Buckey, J. C., Zbozinek, T. D., Motivala, S. J., Glenn, D. E., Cartreine, J. A., & Craske, M. G. (2013) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.11.003 · Cited by 153 · cited 1×
“Encouragingly, research investigating technology-delivered preventive interventions with college students has demonstrated small to moderate effect sizes for mental health outcomes [19,20] and preliminary support exists for the efficacy of web-based resilience interventions [23].”
Conley, C. S., Durlak, J. A., Shapiro, J. B., Kirsch, A. C., & Zahniser, E. (2016) · Prevention Science · doi:10.1007/s11121-016-0662-3 · Cited by 110 · cited 2×
“The internet is increasingly being used to deliver and improve the availability of interventions for mental health and well-being [19-22].”
Richards, D., Timulak, L., O'Brien, E., Hayes, C., Vigano, N., Sharry, J., & Doherty, G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.10.005 · Cited by 109
Self-citationKelders, S. M., Bohlmeijer, E. T., Pots, W. T. M., & van Gemert-Pijnen, J. E. W. C. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.06.014 · Cited by 105 · cited 6×
“This suggests that the greatest benefit resides in providing some form of contact, and opening the possibility of automating this contact [27].”
InfluentialEnrique, A., Palacios, J. E., Ryan, H., & Richards, D. (2019) · Journal of Medical Internet Research · doi:10.2196/12775 · Cited by 81 · cited 1×
“Usage refers to the degree to which participants were exposed to the intervention [59].”
Self-citationMira, A., Bretón-López, J., García-Palacios, A., Quero, S., Baños, R. M., & Botella, C. (2017) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s130994 · Cited by 71 · cited 4×
“This may have been due to a greater sense of agency in the automated support group as participants were not dependent on a therapist and the quality of automated support [27,29].”
InfluentialRichards, D., Murphy, T., Viganó, N., Timulak, L., Doherty, G., Sharry, J., & Hayes, C. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.06.007 · Cited by 59 · cited 1×
“In line with previous research on web-based interventions [70], participants liked the flexibility and accessibility of the program and disliked not having enough time to complete it.”
Self-citationRichards, D., Timulak, L., & Hevey, D. (2013) · Counselling and Psychotherapy Research · doi:10.1080/14733145.2012.733715 · Cited by 55
Self-citationRichards, D., Duffy, D., Blackburn, B., Earley, C., Enrique, A., Palacios, J., Franklin, M., Clarke, G., Sollesse, S., Connell, S., et al. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1639-5 · Cited by 52
Richards, D., & Timulak, L. (2013) · British Journal of Guidance & Counselling · doi:10.1080/03069885.2012.726347 · Cited by 40 · cited 1×
“The Satisfaction With Treatment (SAT) [60] is an 8-item self-report measure of attitudes toward the web-based intervention.”
Self-citationRichards, D., Timulak, L., Doherty, G., Sharry, J., Colla, A., Joyce, C., & Hayes, C. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-147 · Cited by 35 · cited 2×
“It was recommended that participants spend at least an hour a week on the program based on previous studies with the same platform [47,48].”
Self-citationSignificant events in an Internet‐delivered (Space from Depression) intervention for depression
Richards, D., Dowling, M., O'Brien, E., Viganò, N., & Timulak, L. (2018) · Counselling and Psychotherapy Research · doi:10.1002/capr.12142 · Cited by 13
Cited by
Digital training for building resilience: systematic review, meta-analysis, and meta-regression
Ang, W. H. D., Chew, H. S. J., Dong, J., Yi, H., Mahendren, R., & Lau, Y. (2022) · Stress and Health · doi:10.1002/smi.3154 · Cited by 83
Edge, D., Watkins, E. R., Limond, J., & Mugadza, J. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104292 · Cited by 42
A Randomized Controlled Trial of Internet-Based Self-Help for Stress During the COVID-19 Pandemic
Rackoff, G. N., Fitzsimmons-Craft, E. E., Taylor, C. B., Eisenberg, D., Wilfley, D. E., & Newman, M. G. (2022) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2022.01.227 · Cited by 34
“[15] Intervention studies have suggested that targeting these constructs can support mental health during times of stress, [16,17] and perceptions of purpose, strengths, and support have been associated with better mental health in studies conducted during the pandemic.”
Kaligis, F., Ismail, R. I., Wiguna, T., Prasetyo, S., Gunardi, H., Indriatmi, W., Pasaribu, M. M., Pandia, V., Minayati, K., Magdalena, C. C., et al. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1207583 · Cited by 10
Metadata
- Authors
- Enrique Roig, A., Mooney, O., Salamanca-Sanabria, A., Lee, C. T., Farrell, S., & Richards, D.
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-11-11
- Volume
- 4
- Issue
- 11
- Pages
- e20167
- ISSN
- 2561-326X (ISSN-L)
- OpenAlex
- W3088440568
- Cited by
- 29
- References
- 43
- FWCI
- 3.24
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.