Implementing multifactorial psychotherapy research in online virtual environments (IMPROVE-2): study protocol for a phase III trial of the MOST randomized component selection method for internet cognitive-behavioural therapy for depression
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Depression is a global health challenge. Although there are effective psychological and pharmaceutical interventions, our best treatments achieve remission rates less than 1/3 and limited sustained recovery. Underpinning this efficacy gap is limited understanding of how complex psychological interventions for depression work. Recent reviews have argued that the active ingredients of therapy need to be identified so that therapy can be made briefer, more potent, and to improve scalability. This in turn requires the use of rigorous study designs that test the presence or absence of individual therapeutic elements, rather than standard comparative randomised controlled trials. One such approach is the Multiphase Optimization Strategy, which uses efficient experimentation such as factorial designs to identify active factors in complex interventions. This approach has been successfully applied to behavioural health but not yet to mental health interventions. A Phase III randomised, single-blind balanced fractional factorial trial, based in England and conducted on the internet, randomized at the level of the patient, will investigate the active ingredients of internet cognitive-behavioural therapy (CBT) for depression. Adults with depression (operationalized as PHQ-9 score ≥ 10), recruited directly from the internet and from an UK National Health Service Improving Access to Psychological Therapies service, will be randomized across seven experimental factors, each reflecting the presence versus absence of specific treatment components (activity scheduling, functional analysis, thought challenging, relaxation, concreteness training, absorption, self-compassion training) using a 32-condition balanced fractional factorial design (2IV7-2). The primary outcome is symptoms of depression (PHQ-9) at 12 weeks. Secondary outcomes include symptoms of anxiety and process measures related to hypothesized mechanisms. Better understanding of the active ingredients of efficacious therapies, such as CBT, is necessary in order to improve and further disseminate these interventions. This study is the first application of a component selection experiment to psychological interventions in depression and will enable us to determine the main effect of each treatment component and its relative efficacy, and cast light on underlying mechanisms, so that we can systematically enhance internet CBT. Current Controlled Trials ISRCTN24117387 . Registered 26 August 2014
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Rumination reconsidered: a psychometric analysis.
Treynor, W., Gonzalez, R., & Nolen-Hoeksema, S. (2003) · Cognitive Therapy and Research · doi:10.1023/a:1023910315561 · Cited by 3,808
Construction and factorial validation of a short form of the Self-Compassion Scale
Raes, F., Pommier, E., Neff, K. D., & Van Gucht, D. (2011) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.702 · Cited by 2,997 · cited 1×
“In addition, participants will complete a series of self-report questionnaires designed to capture the primary mechanism which each treatment component is hypothesized to most strongly influence, including rumination (5-item Brooding scale) [41], change in habitual coping (adapted Self-Report Habit Index) [53] (SRHI),…”
BackgroundMediators and Moderators of Treatment Effects in Randomized Clinical Trials
Kraemer, H. C., Wilson, G. T., Fairburn, C. G., & Agras, W. S. (2002) · Archives of General Psychiatry · doi:10.1001/archpsyc.59.10.877 · Cited by 2,562
The Work and Social Adjustment Scale: a simple measure of impairment in functioning
Mundt, J. C., Marks, I. M., Shear, M. K., & Greist, J. M. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.5.461 · Cited by 2,515
Mediators and Mechanisms of Change in Psychotherapy Research
Kazdin, A. E. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091432 · Cited by 2,504 · cited 1×
“Because little progress has been made in specifying the active ingredients of CBT for depression [5, 9, 10], there have been no significant gains in the effectiveness of CBT for depression for over 30 years.”
BackgroundConstructive and unconstructive repetitive thought
Watkins, E. R. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.2.163 · Cited by 2,421 · cited 1×
“This module is based on the concreteness training intervention found to reduce symptoms of depression [30] and derived from experimental research indicating the benefits of shifting into a concrete processing style [48, 49].”
BackgroundSelf-citationGrand challenges in global mental health
Collins, P. Y., Patel, V., Joestl, S. S., March, D., Insel, T. R., Daar, A. S., Bordin, I. A., Costello, E. J., Durkin, M., Fairburn, C., et al. (2011) · Nature · doi:10.1038/475027a · Cited by 2,043
Leary, M. R., Tate, E. B., Adams, C. E., Batts Allen, A., & Hancock, J. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.92.5.887 · Cited by 1,728
Research works printed but not linked: 31
- WHO. The Global Burden of Disease 2004 Update. Switzerland: WHO Press; 2008.
- Judd LL. The clinical course of unipolar major depressive disorders. Arch Gen Psychiatry. 1997;5:989–91. · DOI · Paper page
- Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJL. Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data. Lancet. 2006;36:1747–57. · DOI · Paper page
- Hollon SD, Munoz RF, Barlow DH, Beardslee WR, Bell CC, Guillermo BB, Gregory NC, Franciosi LP, Kazdin AE, Kohn L, Linehan MM, Markowitz JC, Persons JB, Niederehe G, Somers D. Psychosocial intervention development for the prevention and treatment of depression: Promoting innovation and increasing access. Biol Psychiatry. 2002;52:610–30. · DOI · Paper page
- Leykin Y, Muñoz RF, Contreras O. Are consumers of Internet health information “cyberchondriacs”? Characteristics of 24,965 users of a depression screening site. Depress Anxiety. 2012;29:71–7. · DOI
- IOM (Institute of Medicine). Psychosocial interventions for mental and substance use disorders: A framework for establishing evidence-based standards. Washington: The National Academies Press; 2015.
- Collins LM, Kugler KC, Gwadz MV. Optimization of multicomponent behavioral and biobehavioral interventions for the prevention and treatment of HIV/AIDS. AIDS Behav. 2015;20:197–214. · DOI · Paper page
- Collins LM, Murphy SA, Nair VN, Strecher VJ. A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med. 2005;30:65–73. · DOI · Paper page
- Collins LM, Nahum-Shani I, Almirall D. Optimization of behavioral dynamic treatment regimens based on the sequential, multiple assignment, randomized trial (SMART). Clin Trials. 2014;11:426–34. · DOI · Paper page
- Wu CJ, Hamada MS. Experiments: planning, analysis, and optimization. 3rd ed. New York: John Wiley & Sons; 2011.
- Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Br Med J. 2008;337:a1655. doi: 10.1136/bmj.a1655 . · DOI · Paper page
- Schlam TR, Fiore MC, Smith SS, Fraser S, Bolt DM, Collins LM, Mermelstein R, Piper ME, Cook JW, Jorenby DE, Loh WY, Baker TB. Comparative effectiveness of intervention components for producing long-term abstinence from smoking: A factorial screening experiment. Addiction. 2016;111:142–55. · DOI · Paper page
- Piper ME, Fiore MC, Smith SS, Fraser D, Bolt DM, Collins LM, Mermelstein R, Schlam TR, Cook JW, Jorenby DE, Loh WY, Baker TB. Identifying effective intervention components for smoking cessation: A factorial screening experiment. Addiction. 2016;111:129–41. · DOI · Paper page
- Beck AT, Rush AJ, Shaw BF, Emery G. Cognitive Therapy of Depression. New York: Guilford Press; 1979.
- Watkins ER, Nolen-Hoeksema S. A habit-goal framework of depressive rumination. J Abnorm Psychol. 2014;123:24–34. doi: 10.1037/a0035540 . · DOI · Paper page
- Baskin TW, Tierney SC, Minami T, Wampold BE. Establishing specificity in psychotherapy: A meta-analysis of structural equivalence of placebo controls. J Cons Clin Psychol. 2003;71:973–9. · DOI · Paper page
- Bebbington PE, Nyani T. The Psychosis Screening Questionnaire. Internat J Meth Psychiatric Res. 1995;5:11–9.
- First MB, Spitzer RL MG, Williams JBW. Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition With Psychotic Screen (SCID-I/P W/ PSY SCREEN). New York: Biometrics Research, New York State Psychiatric Institute; 2002.
- Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the Penn State Worry Questionnaire. Behav Res Ther. 1990;28:487–95. · DOI · Paper page
- Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch Intern Med. 2006;166:1092–7. · DOI · Paper page
- Muthen BO, Curran PJ. General longitudinal modeling of individual differences in experimental designs: a latent variable framework for analysis and power estimation. Psych Methods. 1997;2:371–402. · DOI · Paper page
- Martell CR, Addis ME, Jacobson NS. Depression in context: Strategies for guided action. New York: Norton; 2001.
- Watkins ER. Rumination-focused Cognitive Behavioural Therapy for Depression. New York: Guilford Press; 2016.
- Watkins ER, Moberly NJ, Moulds ML. Processing mode causally influences emotional reactivity: Distinct effects of abstract versus concrete construal on emotional response. Emotion. 2008;8:364–78. · DOI · Paper page
- Csikszentmihalyi M. Flow: The classic work on how to achieve happiness. London: Rider; 2002.
- Gardner B, Abraham C, Lally P, de Bruijn G. Towards parsimony in habit measurement: Testing the convergent and predictive validity of an automaticity subscale of the Self-Report Habit Index. Int J Behav Nutr Phys Act. 2012;9(1):102. · DOI · Paper page
- Carver CS. Generalization, adverse events, and development of depressive symptoms. J Person. 1998;66:609–20. · DOI · Paper page
- Hollon SD, Kendall PC. Cognitive self-statements in depression: development of an automatic thoughts questionnaire. Cognitive Ther Res. 1980;4:383–95. · DOI · Paper page
- Tabachnick BG, Fidell LS. Using multivariate statistics. 4th ed. Needham Heights, MA: Allyn & Bacon; 2001.
- Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010;8:18. · DOI · Paper page
- Dunn G, Maracy M, Tomenson B. Estimating treatment effects from randomized clinical trials with noncompliance and loss to follow-up: the role of instrumental variable methods. Stat Methods Med Res. 2005;14:369–95. · DOI · Paper page
Cited by
Internet-delivered psychological treatments: from innovation to implementation
Andersson, G., Titov, N., Dear, B. F., Rozental, A., & Carlbring, P. (2019) · World Psychiatry · doi:10.1002/wps.20610 · Cited by 750
Treatment selection in depression.
Cohen, Z. D., & DeRubeis, R. J. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050817-084746 · Cited by 435
“Modular psychotherapies that can be accessed online are fertile grounds for future efforts to personalize treatment for depression (Watkins et al. 2016).”
BackgroundFurukawa, T. A., Suganuma, A., Ostinelli, E. G., Andersson, G., Beevers, C. G., Shumake, J., Berger, T., Boele, F. W., Buntrock, C., Carlbring, P., et al. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00077-8 · Cited by 255
Wasil, A. R., Venturo-Conerly, K. E., Shingleton, R. M., & Weisz, J. R. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103498 · Cited by 160
Behavioural activation therapy for depression in adults
Uphoff, E., Ekers, D., Robertson, L., Dawson, S., Sanger, E., South, E., Samaan, Z., Richards, D., Meader, N., & Churchill, R. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013305.pub2 · Cited by 98
Metadata
- Authors
- Watkins, E., Newbold, A., Tester-Jones, M., Javaid, M., Cadman, J., Collins, L. M., Graham, J., & Mostazir, M.
- Venue
- BMC Psychiatry
- Published
- 2016-10-06
- Volume
- 16
- Issue
- 1
- Pages
- 345-345
- ISSN
- 1471-244X (ISSN-L)
- OpenAlex
- W2528092645
- Cited by
- 51
- References
- 31
- FWCI
- 6.16
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- South West Academic Health Services Research Network
- Cornwall Partnership NHS Trust
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Implementing multifactorial psychotherapy research in online virtual environments (IMPROVE-2): study protocol for a phase III trial of the MOST randomized component selection method for internet cognitive-behavioural therapy for depression. https://app.cochat.ai/papers/10.1186/s12888-016-1054-8
- The paper
- Watkins, E., Newbold, A., Tester-Jones, M., Javaid, M., Cadman, J., Collins, L. M., Graham, J., & Mostazir, M. (2016). Implementing multifactorial psychotherapy research in online virtual environments (IMPROVE-2): study protocol for a phase III trial of the MOST randomized component selection method for internet cognitive-behavioural therapy for depression. BMC Psychiatry. https://doi.org/10.1186/s12888-016-1054-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.