A randomised controlled trial of computerised cognitive behaviour therapy for the treatment of depression in primary care: the Randomised Evaluation of the Effectiveness and Acceptability of Computerised Therapy (REEACT) trial
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Background: Computerised cognitive behaviour therapy (cCBT) has been developed as an efficient form of therapy delivery with the potential to enhance access to psychological care. Independent research is needed which examines both the clinical effectiveness and cost-effectiveness of cCBT over the short and longer term. Objectives: To compare the clinical effectiveness and cost-effectiveness of cCBT as an adjunct to usual general practitioner (GP) care against usual GP care alone, for a free-to-use cCBT program (MoodGYM; National Institute for Mental Health Research, Australian National University, Canberra, Australia) and a commercial pay-to-use cCBT program (Beating the Blues®; Ultrasis, London, UK) for adults with depression, and to determine the acceptability of cCBT and the experiences of users. Design: A pragmatic, multicentre, three-armed, parallel, randomised controlled trial (RCT) with concurrent economic and qualitative evaluations. Simple randomisation was used. Participants and researchers were not blind to treatment allocation. Setting: Primary care in England. Participants: Adults with depression who scored ≥ 10 on the Patient Health Questionnaire-9 (PHQ-9). Interventions: Participants who were randomised to either of the two intervention groups received cCBT (Beating the Blues or MoodGYM) in addition to usual GP care. Participants who were randomised to the control group were offered usual GP care. Main outcome measures: The primary outcome was depression at 4 months (PHQ-9). Secondary outcomes were depression at 12 and 24 months; measures of mental health and health-related quality of life at 4, 12 and 24 months; treatment preference; and the acceptability of cCBT and experiences of users. Results: Clinical effectiveness:210 patients were randomised to Beating the Blues, 242 patients were randomised to MoodGYM and 239 patients were randomised to usual GP care (total 691). There was no difference in the primary outcome (depression measured at 4 months) either between Beating the Blues and usual GP care [odds ratio (OR) 1.19, 95% confidence interval (CI) 0.75 to 1.88] or between MoodGYM and usual GP care (OR 0.98, 95% CI 0.62 to 1.56). There was no overall difference across all time points for either intervention compared with usual GP care in a mixed model (Beating the Blues versus usual GP care,p = 0.96; and MoodGYM versus usual GP care,p = 0.11). However, a small but statistically significant difference between MoodGYM and usual GP care at 12 months was found (OR 0.56, 95% CI 0.34 to 0.93). Free-to-use cCBT (MoodGYM) was not inferior to pay-to-use cCBT (Beating the Blues) (OR 0.91, 90% CI 0.62 to 1.34;p = 0.69). There were no consistent benefits of either intervention when secondary outcomes were examined. There were no serious adverse events thought likely to be related to the trial intervention. Despite the provision of regular technical telephone support, there was low uptake of the cCBT programs.Cost-effectiveness:cost-effectiveness analyses suggest that neither Beating the Blues nor MoodGYM appeared cost-effective compared with usual GP care alone.Qualitative evaluation:participants were often demotivated to access the computer programs, by reason of depression. Some expressed the view that a greater level of therapeutic input would be needed to promote engagement. Conclusions: The benefits that have previously been observed in developer-led trials were not found in this large pragmatic RCT. The benefits of cCBT when added to routine primary care were minimal, and uptake of this mode of therapy was relatively low. There remains a clinical and economic need for effective low-intensity psychological treatments for depression with improved patient engagement. Trial registration: This trial is registered as ISRCTN91947481. Funding: This project was funded by the National Institute for Health Research Health Technology Assessment programme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792 · cited 2×
“Imputed values are, thus, sampled from values in the original data set and will not lie outside the bounds of the original data distribution.(66) METHODS”
MethodEuroQol: the current state of play
Brooks, R. (1996) · Health Policy · doi:10.1016/0168-8510(96)00822-6 · Cited by 5,815
A Purposeful Approach to the Constant Comparative Method in the Analysis of Qualitative Interviews
Boeije, H. (2002) · Quality and Quantity · doi:10.1023/a:1020909529486 · Cited by 3,073 · cited 3×
“Data were analysed using the constant comparative method as described by Boeije.(80) One researcher (SK) analysed all the transcripts and three co-investigators (PB, KL and HL) analysed a subset of 16 interview transcripts.”
BackgroundMethodInfluentialHow Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory
Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007) · Prevention Science · doi:10.1007/s11121-007-0070-9 · Cited by 2,795 · cited 1×
“Multiple imputation by chained equations was performed for a total of 10 imputations (m), as previous research has suggested that three to five m are sufficient to provide adequate estimates but that increasing m improves efficiency.(67) EQ-5D and SF-6D scores were imputed at every follow-up time point (baseline, 4, 1…”
MethodMultiple Imputation of Missing Values
Royston, P. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400301 · Cited by 2,340 · cited 2×
“Main analyses were conducted on multiply imputed data sets because of the presence of missing data in the trial.(53) A sensitivity analysis was performed to explore and quantify uncertainty in the cost-effectiveness results.”
MethodCase-finding instruments for depression: Two questions are as good as many
Whooley, M. A., Avins, A. L., Miranda, J., & Browner, W. S. (1997) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1997.00076.x · Cited by 1,826
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · cited 1×
“Trials where there has been an intensive level of support have generally demonstrated a greater level of effect than less supported programs.(91) Nevertheless, the pragmatic nature of the REEACT trial meant that the level of support that was offered is one that is at least as intensive as the support offered in many N…”
ResultLöwe, B., Kroenke, K., Herzog, W., & Gräfe, K. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(03)00198-8 · Cited by 1,558 · cited 1×
“It has also been shown to be sensitive to change over time.(37,38)”
BackgroundLewis, G., Pelosi, A. J., Araya, R., & Dunn, G. (1992) · Psychological Medicine · doi:10.1017/s0033291700030415 · Cited by 1,487 · cited 1×
“Participants’ current profile of depression and anxiety were obtained at baseline for a total of 685 participants using a diagnostic gold standard (CIS–R).(19) Data for six participants were lost because of file corruption (two in the Beating the Blues group, one in the usual GP care group and three in the MoodGYM gro…”
MethodSelf-citation
Cited by
Ebert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437
ADHD: Current Concepts and Treatments in Children and Adolescents
Drechsler, R., Brem, S., Brandeis, D., Grünblatt, E., Berger, G., & Walitza, S. (2020) · Neuropediatrics · doi:10.1055/s-0040-1701658 · Cited by 415
Gilbody, S., Littlewood, E., Hewitt, C., Brierley, G., Tharmanathan, P., Araya, R., Barkham, M., Bower, P., Cooper, C., Gask, L., et al. (2015) · BMJ · doi:10.1136/bmj.h5627 · Cited by 409
Self-citationCatalá-López, F., Hutton, B., Núñez-Beltrán, A., Page, M. J., Ridao, M., Macías Saint-Gerons, D., Catalá, M. A., Tabarés-Seisdedos, R., & Moher, D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0180355 · Cited by 396
Josephine, K., Josefine, L., Philipp, D., David, E., & Harald, B. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.021 · Cited by 341
Etzelmueller, A., Vis, C., Karyotaki, E., Baumeister, H., Titov, N., Berking, M., Cuijpers, P., Riper, H., & Ebert, D. D. (2020) · Journal of Medical Internet Research · doi:10.2196/18100 · Cited by 356
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundRussell, G., Mandy, W., Elliott, D., White, R., Pittwood, T., & Ford, T. (2019) · Molecular Autism · doi:10.1186/s13229-019-0260-x · Cited by 366
Luo, C., Sanger, N., Singhal, N., Pattrick, K., Shams, I., Shahid, H., Hoang, P., Schmidt, J., Lee, J., Haber, S., et al. (2020) · eClinicalMedicine · doi:10.1016/j.eclinm.2020.100442 · Cited by 167
“Littlewood 2015 Triple arm RCT comparing a combination of either Beating the Blues and Usual Care, MoodGYM and Usual Care, or just Usual Care; blinding of outcome assessors; Intentionto-treat-analysis; ANOVA analysis; Sample Size: face-toface 239, 242 in MoodGYM, and 210 in Beating the Blues N =…”
MethodPaganini, S., Teigelkötter, W., Buntrock, C., & Baumeister, H. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.018 · Cited by 144
Twomey, C., & O’Reilly, G. (2017) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867416656258 · Cited by 133
Gilbody, S., Brabyn, S., Lovell, K., Kessler, D., Devlin, T., Smith, L., Araya, R., Barkham, M., Bower, P., Cooper, C., et al. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.192435 · Cited by 116
“…large-scale pragmatic trial (the first Randomised Evaluation of the Effectiveness and Acceptability of Computerised Therapy (REEACT) trial) 8,9 we compared two commonly used cCBT packages (MoodGYM or Beating the Blues) v. usual primary care under real-world conditions to test their…”
BackgroundMethodSelf-citationHornstein, S., Zantvoort, K., Lueken, U., Funk, B., & Hilbert, K. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1170002 · Cited by 134
Massoudi, B., Holvast, F., Bockting, C. L. H., Burger, H., & Blanker, M. H. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.11.050 · Cited by 101
Zhang, Z., Zhang, L., Zhang, G., Jin, J., & Zheng, Z. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1610-5 · Cited by 99
The Safety of Mindfulness-Based Interventions: a Systematic Review of Randomized Controlled Trials
Wong, S. Y. S., Chan, J. Y. C., Zhang, D., Lee, E. K. P., & Tsoi, K. K. F. (2018) · Mindfulness · doi:10.1007/s12671-018-0897-0 · Cited by 92
User Acceptance of Computerized Cognitive Behavioral Therapy for Depression: Systematic Review
Rost, T., Stein, J., Löbner, M., Kersting, A., Luck-Sikorski, C., & Riedel-Heller, S. G. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7662 · Cited by 91
“There is evidence that computerized cognitive behavioral therapy (cCBT) is effective in the treatment of various mental disorders, including depression [6-10].”
BackgroundMitchell, L. M., Joshi, U., Patel, V., Lu, C., & Naslund, J. A. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.01.092 · Cited by 80
“…0.57 0.57 0.9 0.93 0.88 0.9 0.95 0.87 Part B. Quality Assessment Items Jolstedt 2018 Kenter 2015 Klein 2018 Kolovos 2016 Kooistra 2019 Lenhard 2017 Littlewood 2015 van Luenen 2019 Nobis 2018 Nordgren 2014 Phillips 2014 Powell 2020 RomeroSanchiz 2017 Ruby 2013 Titov 2015 Warmerdam 2010 Wijnen…”
InfluentialEbert, D. D., Harrer, M., Apolinário-Hagen, J., & Baumeister, H. (2019) · Advances in Experimental Medicine and Biology · doi:10.1007/978-981-32-9721-0_29 · Cited by 76
Digital interventions in mental health: Evidence syntheses and economic modelling
Gega, L., Jankovic, D., Saramago, P., Marshall, D., Dawson, S., Brabyn, S., Nikolaidis, G. F., Melton, H., Churchill, R., & Bojke, L. (2022) · Health Technology Assessment · doi:10.3310/rcti6942 · Cited by 48
Ambrosi, E., Mezzalira, E., Canzan, F., Leardini, C., Vita, G., Marini, G., & Longhini, J. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105820 · Cited by 50
Jankovic, D., Bojke, L., Marshall, D., Saramago Goncalves, P., Churchill, R., Melton, H., Brabyn, S., & Gega, L. (2021) · Applied Health Economics and Health Policy · doi:10.1007/s40258-020-00607-3 · Cited by 36
“Two papers reported the results of identical analyses [6, 7]; all other papers reported unique results (such as a different analytical perspective or length of follow-up), even when multiple papers were based on the same study.”
ResultSelf-citationDuarte, A., Walker, S., Littlewood, E., Brabyn, S., Hewitt, C., Gilbody, S., & Palmer, S. (2017) · Psychological Medicine · doi:10.1017/s0033291717000289 · Cited by 30
“The trial methodology and the clinical results have been previously reported (Gilbody et al. 2015; Littlewood et al. 2015).”
BackgroundMethodResultInfluentialSelf-citationInternet-Based Self-help Interventions for Depression in Routine Care
Ebert, D. D., & Baumeister, H. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.1394 · Cited by 29
Löbner, M., Stein, J., Rost, T., Förster, F., Dorow, M., Keller, J., Weidauer, E., & Riedel-Heller, S. (2017) · Psychiatrische Praxis · doi:10.1055/s-0043-107471 · Cited by 18
Proportionate methods for evaluating a simple digital mental health tool
Davies, E. B., Craven, M. P., Martin, J. L., & Simons, L. (2017) · Evidence Based Mental Health · doi:10.1136/eb-2017-102755 · Cited by 15
“Three methods of data collection were used to gain insight into naturalistic use of In Hand: (1) sampling and analysis of quantitative mobile analytical data (eg, number of individual user sessions, number of interactions with each section of the app); (2) a user survey with questions adapted from a validated well-bei…”
MethodDigital revolution in depression: A technologies update for clinicians
Lazar, M. A., Pan, Z., Ragguett, R.-M., Lee, Y., Subramaniapillai, M., Mansur, R. B., Rodrigues, N., & McIntyre, R. S. (2017) · Personalized Medicine in Psychiatry · doi:10.1016/j.pmip.2017.09.001 · Cited by 14
Metadata
- Authors
- Littlewood, E., Duarte, A., Hewitt, C., Knowles, S., Palmer, S., Walker, S., Andersen, P., Araya, R., Barkham, M., Bower, P., Brabyn, S., Brierley, G., Cooper, C., Gask, L., Kessler, D., Lester, H., Lovell, K., Muhammad, U., Parry, G., Richards, D. A., Richardson, R., Tallon, D., Tharmanathan, P., White, D., Gilbody, S., & on behalf of the REEACT Team
- Venue
- Health Technology Assessment
- Published
- 2015-12
- Volume
- 19
- Issue
- 101
- Pages
- 1-174
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2222519982
- Cited by
- 90
- References
- 40
- FWCI
- 20.35
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.