Cited by 40Statistical Methods in Clinical TrialsMeta-analysis and systematic reviewsPsychotherapy Techniques and Applications

The DOI matches its Crossref record; 276 of the 276 references it cites were found in a registry or an index.

Control interventions in randomised trials among people with mental health disorders

Open access

Abstract

BACKGROUND: Control interventions in randomised trials provide a frame of reference for the experimental interventions and enable estimations of causality. In the case of randomised trials assessing patients with mental health disorders, many different control interventions are used, and the choice of control intervention may have considerable impact on the estimated effects of the treatments being evaluated. OBJECTIVES: To assess the benefits and harms of typical control interventions in randomised trials with patients with mental health disorders. The difference in effects between control interventions translates directly to the impact a control group has on the estimated effect of an experimental intervention. We aimed primarily to assess the difference in effects between (i) wait-list versus no-treatment, (ii) usual care versus wait-list or no-treatment, and (iii) placebo interventions (all placebo interventions combined or psychological, pharmacological, and physical placebos individually) versus wait-list or no-treatment. Wait-list patients are offered the experimental intervention by the researchers after the trial has been finalised if it offers more benefits than harms, while no-treatment participants are not offered the experimental intervention by the researchers. SEARCH METHODS: In March 2018, we searched MEDLINE, PsycInfo, Embase, CENTRAL, and seven other databases and six trials registers. SELECTION CRITERIA: We included randomised trials assessing patients with a mental health disorder that compared wait-list, usual care, or placebo interventions with wait-list or no-treatment . DATA COLLECTION AND ANALYSIS: Titles, abstracts, and full texts were reviewed for eligibility. Review authors independently extracted data and assessed risk of bias using Cochrane's risk of bias tool. GRADE was used to assess the quality of the evidence. We contacted researchers working in the field to ask for data from additional published and unpublished trials. A pre-planned decision hierarchy was used to select one benefit and one harm outcome from each trial. For the assessment of benefits, we summarised continuous data as standardised mean differences (SMDs) and dichotomous data as risk ratios (RRs). We used risk differences (RDs) for the assessment of adverse events. We used random-effects models for all statistical analyses. We used subgroup analysis to explore potential causes for heterogeneity (e.g. type of placebo) and sensitivity analyses to explore the robustness of the primary analyses (e.g. fixed-effect model). MAIN RESULTS: We included 96 randomised trials (4200 participants), ranging from 8 to 393 participants in each trial. 83 trials (3614 participants) provided usable data. The trials included 15 different mental health disorders, the most common being anxiety (25 trials), depression (16 trials), and sleep-wake disorders (11 trials). All 96 trials were assessed as high risk of bias partly because of the inability to blind participants and personnel in trials with two control interventions. The quality of evidence was rated low to very low, mostly due to risk of bias, imprecision in estimates, and heterogeneity. Only one trial compared wait-list versus no-treatment directly but the authors were not able to provide us with any usable data on the comparison. Five trials compared usual care versus wait-list or no-treatment and found a SMD -0.33 (95% CI -0.83 to 0.16, I² = 86%, 523 participants) on benefits. The difference between all placebo interventions combined versus wait-list or no-treatment was SMD -0.37 (95% CI -0.49 to -0.25, I² = 41%, 65 trials, 2446 participants) on benefits. There was evidence of some asymmetry in the funnel plot (Egger's test P value of 0.087). Almost all the trials were small. Subgroup analysis found a moderate effect in favour of psychological placebos SMD -0.49 (95% CI -0.64 to -0.30; I² = 53%, 39 trials, 1656 participants). The effect of pharmacological placebos versus wait-list or no-treatment on benefits was SMD -0.14 (95% CI -0.39 to 0.11, 9 trials, 279 participants) and the effect of physical placebos was SMD -0.21 (95% CI -0.35 to -0.08, I² = 0%, 17 trials, 896 participants). We found large variations in effect sizes in the psychological and pharmacological placebo comparisons. For specific mental health disorders, we found significant differences in favour of all placebos for sleep-wake disorders, major depressive disorder, and anxiety disorders, but the analyses were imprecise due to sparse data. We found no significant differences in harms for any of the comparisons but the analyses suffered from sparse data. When using a fixed-effect model in a sensitivity analysis on the comparison for usual care versus wait-list and no-treatment, the results were significant with an SMD of -0.46 (95 % CI -0.64 to -0.28). We reported an alternative risk of bias model where we excluded the blinding domains seeing how issues with blinding may be seen as part of the review investi

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/14651858.mr000050.pub2

Cites

276 of 276 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Items 201–276 of 276

Flagged first, then by citations

Research works printed but not linked: 67

  1. Abikoff H Inclusion of study in Cochrane Systematic Review [personal communication] Email to A Todorovac
  2. Allen JB Inclusion of study in Cochrane Systematic Review [personal communication] Email to A Todorovac
  3. Allen JB Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  4. Alvarez, 1997, The effects of anger management training on depression, anger, self-concept, and treatment responsibility in a sample of drug-dependent individuals in a therapeutic community, Dissertation Abstracts International: Section B: the Sciences and Engineering, 58, 2108
  5. Ayen I Inclusion of study in Cochrane Systematic Review (personal communication) Email to EG Faltinsen
  6. Attributional Outcomes: the Subtle Messages of Treatments for Attention Deficit Disorder Dissertation, University of Illinois at Urbana-Champaign 1986
  7. Bornovalova M Inclusion of study in Cochrane Systematic Review (personal communication) Email to A Todorovac.
  8. Bornovalova MA Distress tolerance treatment for inner-city drug users: a preliminary trial Doctor’s Dissertation, University of Maryland 2008
  9. Brill, 1964, Controlled study of psychiatric outpatient treatment, Archives of General Psychiatry, 10, 581, 10.1001/archpsyc.1964.01720240035006 · DOI
  10. Karst M Inclusion of study in Cochrane Systematic Review (personal communication) Email to: EG Faltinsen
  11. Kelley J Inclusion of study in Cochrane Systematic Review (personal communication) Email to: A Todorovac
  12. Kilmann PR Boland JP Nankin HR Sablis RF West MO The sexual interactions of men with secondary erectile dysfunction Paper presented at the annual meeting of the American Psychological Association in Los Angeles 1985 1 46 9 · DOI
  13. Klerman, 1974, Treatment of depression by drugs and psychotherapy, American Journal of Psychiatry, 131, 186, 10.1176/ajp.131.2.186 · DOI
  14. Kwan R Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  15. Lai K Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  16. Legrand F Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  17. Pillman BM Computerized cognitive remediation with recently detoxified alcoholics Dissertation, California School of Professional Psychology, Fresno Campus 2000
  18. Powers, 2008, The effect of attributional processes concerning medication taking on return of fear, Journal of Consulting and Clinical Psychology, 76, 478, 10.1037/0022-006X.76.3.478 · DOI
  19. Proudfoot J Re: Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  20. Rapee R Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  21. Rapee R Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  22. Rosa-Alcázar, 2009, The role of non-specific effects in the psychological treatment of adolescents with social phobia, Anuario de Psicologia, 40, 43
  23. Szymanski J Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  24. Teri L Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  25. Rational-emotive therapy, placebo, and no-treatment effects on public-speaking anxiety Doctoral dissertation, Temple University AnnArbor, Mich.: University Microfilms 1971 71-31 063
  26. Vanderplate C Electromyograph biofeedback Treatment of sleep onset Insomnia: a controlled Investigation Dissertation, University of Southern Mississippi 1978
  27. Dolhanty J Symptom control and self-efficacy with electronic self-monitoring of bulimia nervosa: a randomized controlled trial Dissertation, York University, North York, Ontario 2005
  28. Laessle, 1988, Structured ambulatory group therapy in bulimia, PPmP Psychotherapie, Psychosomatik und Medizinische Psychologie, 38, 324
  29. Schultz DE The effectiveness of stress management on anxiety and depression Doctor’s Dissertation, California School of Professional Psychology Fresno Campus 2002
  30. Abikoff H Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  31. Allen JB Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  32. Allen JB Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  33. American Psychiatric Association, 1952, Diagnostic and Statistical Manual of Mental Disorders
  34. American Psychiatric Association, 1968, Diagnostic and Statistical Manual of Mental Disorders
  35. American Psychiatric Association, 1980, Diagnostic and Statistical Manual of Mental Disorders
  36. Ayen I Inclusion of study in Cochrane Systematic Review [personal communication] Email to: EG Faltinsen
  37. Bornovalova M Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  38. Boutron, 2021, Cochrane Handbook for Systematic Reviews of Interventions version 6.2
  39. Cohen, 1988, Statistical Power Analysis for the Behavioral Sciences. 2nd edition.
  40. Comer, 2013, Bergin and Garfields’s Handbook of Psychotherapy and Behavior Change, 21
  41. Espie, 1989, An evaluation of tailored psychological treatment of insomnia, Journal of Behavior Therapy and Experimental Psychiatry, 20, 143, 10.1016/0005-7916(89)90047-5 · DOI
  42. Heitmann J Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  43. Higgins JP Altman DG Sterne JA Chapter 8: Assessing risk of bias in included studies. In: Higgins JP, Green S, Editors. Cochrane Handbook for Systematic Reviews of Interventions version 5.1.0 (updated June 2017). The Cochrane Collaboration, 2017 Available from www.training.cochrane.org/handbook
  44. Hróbjartsson, 2012, Randomized Clincial Trials of Nonpharmacological Treatments, 11
  45. ICH Expert Working Group International conference on harmonisation of technical requirements for registration of pharmaceuticals for human use. ICH harmonised tripartite guideline. Guideline for good clinical practice E6(R1) www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E6/E6_R1_Guideline.pdf
  46. Lo, 2009, Institute of Medicine (US) Committee on Conflict of Interest in Medical Research, Education, and Practice. Conflict of Interest in Medical Research, Education, and Practice
  47. Karst M Inclusion of study in Cochrane Systematic Review [personal communication] Email to: EG Faltinsen
  48. Kelley J Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  49. Kilmann, 1988, The sexual interactions of men with secondary erectile dysfunction, Journal of Sex Education and Therapy, 14, 46, 10.1080/01614576.1988.11074924 · DOI
  50. Kwan, 2014, Acupressure for agitation in nursing home residents with dementia:study protocol for a randomized controlled trial, Trials, 15, 1
  51. Kwan R Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  52. Lai K Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  53. Legrand F Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  54. Milich, 1991, Effects of methylphenidate on the persistence of ADHD boys following failure experiences, Journal of Abnormal Child Psychology, 19, 519, 10.1007/BF00925818 · DOI
  55. Miranda J Inclusion of study in Cochrane Systematic Review [personal communication] Email to: EG Faltinsen
  56. Peterson, 2002, Cognitive recovery following alcohol detoxification: A computerised remediation study, Neuropsychological Rehabilitation, 12, 63, 10.1080/09602010143000167 · DOI
  57. Proudfoot J Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  58. Rapee R Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  59. Rapee R Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  60. Review Manager (RevMan 5) Nordic Cochrane Centre, The Cochrane Collaboration 2014
  61. Spitzer, 1989, Structured Clinical Interview for DSM-III-R Personality Disorders (SCID-II)
  62. Szymanski J Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  63. Teri L Inclusion of study in Cochrane Systematic Review [personal communication] Email to: A Todorovac
  64. Wampold, 2010, Great Psychotherapy Debate (Counseling and Psychotherapy) - The Evidence for What Makes Psychotherapy Work
  65. Weissman, 1974, Treatment effects on the social adjustment of depressed patients, Archives of General Psychiatry, 30, 771, 10.1001/archpsyc.1974.01760120033006 · DOI
  66. Wilson, 1978, Disulfiram implantation. A placebo-controlled trial with two-year follow-up, Journal of Studies on Alcohol, 39, 809, 10.15288/jsa.1978.39.809 · DOI
  67. Klein, 2004, Design and rationale of controlled study of long-term methylphenidate and multimodal psychosocial treatment in children with ADHD, Journal of the American Academy of Child and Adolescent Psychiatry, 43, 792, 10.1097/01.chi.0000128798.91601.fe · DOI

Cited by

Sorted by citations

See all 40

Metadata

Authors
Faltinsen, E., Todorovac, A., Staxen Bruun, L., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J.
Affiliations
  • University of Southern Denmark (DK)
  • Region Zealand (DK)
  • Psychiatric Research Unit; Region Zealand Psychiatry; Slagelse Denmark
  • University of Copenhagen (DK)
Venue
Cochrane Database of Systematic Reviews
Publisher
Wiley
Published
2022-04-04
Volume
2022
Issue
4
Pages
MR000050-MR000050
ISSN
  • 1361-6137 (ISSN-L)
  • 1465-1858
OpenAlex
W4224087072
Cited by
40
References
276
Citations by year
2026: 9 · 2025: 8 · 2024: 7 · 2023: 5 · 2022: 9
FWCI
1.06
Type
journal article
Language
en
Open access
Locations
  • Cochrane Database of Systematic Reviews (publishedVersion)
  • PubMed Central (publishedVersion)
  • Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, other-oa)
  • University of Southern Denmark Research Portal (University of Southern Denmark) (publishedVersion, other-oa)
  • PubMed (publishedVersion)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
Keywords
control measures, waitlist control, placebo interventions, mental illness, anxiety disorders, depression, schizophrenia, risk of bias, causal inference, benefit-harm balance, standardized mean difference, relative risk, risk difference
MeSH terms
Anxiety, Anxiety Disorders, Major Depressive Disorder, Humans, Mental Health, Psychotherapy, Randomized Controlled Trials as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review