The DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
The Selection and Design of Control Conditions for Randomized Controlled Trials of Psychological Interventions
Abstract
The randomized controlled trial (RCT) provides critical support for evidence-based practice using psychological interventions. The control condition is the principal method of removing the influence of unwanted variables in RCTs. There is little agreement or consistency in the design and construction of control conditions. Because control conditions have variable effects, the results of RCTs can depend as much on control condition selection as on the experimental intervention. The aim of this paper is to present a framework for the selection and design of control conditions for these trials. Threats to internal validity arising from modern RCT methodology are reviewed and reconsidered. The strengths and weaknesses of several categories of control conditions are examined, including the ones that are under experimental control, the ones that are under the control of clinical service providers, and no-treatment controls. Considerations in the selection of control conditions are discussed and several recommendations are proposed. The aim of this paper is to begin to define principles by which control conditions can be selected or developed in a manner that can assist both investigators and grant reviewers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It should also be noted that the type of active control group used is also potentially important (see Mohr et al., 2009).”
From Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of “Far Transfer”: Evidence From a Meta-Analytic Review (2016) · cites this paper as Mohr et al., 2009
In the citing paper
“the improvement found in patients on waiting lists has been found to be lower than that expected on the basis of spontaneous remission 19 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [19]
In the citing paper
“Psychological placebo conditions were not included, because they have considerable effects on depression 24 and probably also on anxiety disorders 19 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [19]
In the citing paper
“As indicated earlier, improvements found in patients on waiting lists are lower than can be expected on the basis of spontaneous remission 19,185 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [19]
In the citing paper
“Considering the type of control condition as a potential moderator, we followed the suggestions of Mohr et al. (2009) who divided control conditions into three classes: (a) conditions where the investigator defines and manages the treatment, (b) conditions where the treatment is not determined by the investigator or provided by the study, and (c) no-treatment control conditions.”
From The effect of internet-delivered cognitive behavioral therapy for depression and anxiety on quality of life: A meta-analysis of randomized controlled trials (2023) · cites this paper as Mohr et al. (2009)
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
(2002) · Cited by 13,211
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · cited 1×
“but the RCT design has evolved considerably. Paradoxically, some contemporary RCT procedures designed to address threats to internal validity may create new problems. Below, we review three threats to internal validity that arise from modern RCT methodology. These threats have not been adequately considered to date an…”
BackgroundUnützer, J., Katon, W., Callahan, C. M., Williams, Jr., Hunkeler, E., Harpole, L., Hoffing, M., Della Penna, R. D., Noël, P. H., Lin, E. H. B., et al. (2002) · JAMA · doi:10.1001/jama.288.22.2836 · Cited by 2,405
Research design in clinical psychology
(1952) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195201)8:1<3::aid-jclp2270080102>3.0.co;2-0 · Cited by 2,147
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
Cognitive Therapy vs Medications in the Treatment of Moderate to Severe Depression
DeRubeis, R. J., Hollon, S. D., Amsterdam, J. D., Shelton, R. C., Young, P. R., Salomon, R. M., O’Reardon, J. P., Lovett, M. L., Gladis, M. M., Brown, L. L., et al. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.4.409 · Cited by 989
Self-citationPsychological Treatments That Cause Harm
Lilienfeld, S. O. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00029.x · Cited by 959
A stage model of behavioral therapies research: getting started and moving on from stage I.
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.2.133 · Cited by 846 · cited 1×
“(see www.clinicaltrials.gov) for pharmaceutical trials. Similar phase models for the evaluation of psychological interventions have been proposed [”
BackgroundA Stage Model of Behavioral Therapies Research: Getting Started and Moving on From Stage I
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy/8.2.133 · Cited by 846
Foa, E. B., Dancu, C. V., Hembree, E. A., Jaycox, L. H., Meadows, E. A., & Street, G. P. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.2.194 · Cited by 808
Borkovec, T. D., & Costello, E. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.611 · Cited by 756
. Caution regarding the use of pilot studies to guide power calculations for study proposals.
Kraemer, H. C., Mintz, J., Noda, A., Tinklenberg, J., & Yesavage, J. A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.484 · Cited by 702 · cited 1×
“Thus, in later clinical trial phases the importance of adequate control for threats to internal validity increases, while concerns regarding power generally decrease. The Need for GuidelinesThe foregoing discussion illustrates both the importance and complexities in the development and selection of control conditions,…”
The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy.
Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S., Halperin, G., Bishop, M., Berman, J. S., & Schweizer, E. (1999) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.6.1.95 · Cited by 572 · cited 1×
“Clinicians also tend to arrive with an allegiance to the treatment they are to deliver, or develop one during the trial. If clinicians provide a treatment that they are well trained in, believe in, or know to be the experimental treatment, they will likely be more skilled and enthusiastic in their delivery of that tre…”
BackgroundThe meanings and measurement of clinical significance.
Kazdin, A. E. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.3.332 · Cited by 522
Meta‐Analysis of Therapist Effects in Psychotherapy Outcome Studies
Crits-Christoph, P., Baranackie, K., Kurcias, J., Beck, A., Carroll, K., Perry, K., Luborsky, L., McLellan, A., Woody, G., Thompson, L., et al. (1991) · Psychotherapy Research · doi:10.1080/10503309112331335511 · Cited by 433
Simon, G. E., Ludman, E. J., Tutty, S., Operskalski, B., & Korff, M. V. (2004) · JAMA · doi:10.1001/jama.292.8.935 · Cited by 395
Methodology, design, and evaluation in psychotherapy research.
Kazdin, A. E. (1994) · Cited by 332
Negative outcome in psychotherapy: A critical review.
Mohr, D. C. (1995) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.1995.tb00022.x · Cited by 330
Self-citationTesting Statistical Hypotheses of Equivalence
Wellek, S. (2002) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420035964 · Cited by 318
Telephone-administered psychotherapy for depression
Mohr, D. C., Hart, S. L., Julian, L., Catledge, C., Honos-Webb, L., Vella, L., & Tasch, E. T. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.9.1007 · Cited by 298
Self-citationMohr, D. C., Likosky, W., Bertagnolli, A., Goodkin, D. E., Van Der Wende, J., Dwyer, P., & Dick, L. P. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.2.356 · Cited by 240
Self-citationSevere Agoraphobia: A Controlled Prospective Trial of Behaviour Therapy
Gelder, M. G., & Marks, I. M. (1966) · British Journal of Psychiatry · doi:10.1192/bjp.112.484.309 · Cited by 229
Behavioral exercise programs in the management of chronic obstructive pulmonary disease.
Atkins, C. J. (1984) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.52.4.591 · Cited by 169
Placebo psychotherapy: Synonym or oxymoron?
Kirsch, I. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20126 · Cited by 164
Treatment of Acute Psychosis Without Neuroleptics: Two-Year Outcomes From the Soteria Project
Bola, J. R., & Mosher, L. R. (2003) · The Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000061148.84257.f9 · Cited by 159
Characteristics of effective psychological treatments of depression: a metaregression analysis
Cuijpers, P. J., van Straten, A., Warmerdam, L., & Smits, N. (2008) · Psychotherapy Research · doi:10.1080/10503300701442027 · Cited by 128
Behavioral self-control training for problem drinkers: Components of efficacy.
Harris, K. B., & Miller, W. R. (1990) · Psychology of Addictive Behaviors · doi:10.1037/h0080586 · Cited by 101
Cottraux, J. A., Note, I. D., Yao, S. N., Mey-Guillard, C. D., Bonasse, F., Djamoussian, D., Mollard, E., Note, B., & Chen, Y. S. (2008) · Psychotherapy and Psychosomatics · doi:10.1159/000112887 · Cited by 93
Preventing Depression in High-Risk College Women: A Report of an 18-month Follow-up
Peden, A. R., Rayens, M. K., Hall, L. A., & Beebe, L. H. (2001) · Journal of American College Health · doi:10.1080/07448480109596316 · Cited by 86
Practical behavioral trials to advance evidence-based behavioral medicine
Glasgow, R. E., Davidson, K. W., Dobkin, P. L., Ockene, J. K., & Spring, B. J. (2006) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm3101_3 · Cited by 79
Self-citationAmount of therapist contact and outcome in a multidimensional depression treatment program
Schmidt, M. M., & Miller, W. R. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb00349.x · Cited by 77
Credibility and outcome of cognitive—behavioural and psychodynamic—interpersonal psychotherapy
Hardy, G. E., Barkham, M., Shapiro, D. A., Reynolds, S. A., Rees, A., & Stiles, W. B. (1995) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1995.tb01489.x · Cited by 68
Scientific and practical advantages of comparative design in psychotherapy outcome research.
Basham, R. B. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.1.88 · Cited by 67
Walach, H., Bösch, H., Lewith, G. T., Naumann, J., Schwarzer, B., Falk, S., Kohls, N., Haraldsson, E., Wiesendanger, H., Nordmann, A. J., et al. (2008) · Psychotherapy and Psychosomatics · doi:10.1159/000116609 · Cited by 56
Gaudiano, B. A., & Herbert, J. D. (2004) · Psychotherapy and Psychosomatics · doi:10.1159/000082022 · Cited by 48
Reynolds, C. F., Degenholtz, H. B., Parker, L. S., Schulberg, H. C., Mulsant, B. H., Post, E. P., Rollman, B. L., & the PROSPECT Study Group (2001) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.466 · Cited by 46
Herbert, J. D., & Gaudiano, B. A. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20133 · Cited by 44 · cited 1×
“It might be argued that these control conditions set the bar too low, particularly given that many psychological targets will improve somewhat with almost any intervention [”
BackgroundOutcomes of a comprehensive treatment program for adolescents with a substance-use disorder
Spooner, C., Mattick, R. P., & Noffs, W. (2001) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(01)00166-0 · Cited by 30
Relaxation therapy for hypertension: setting-specific effects.
Jacob, R. G., Shapiro, A. P., O'Hara, P., Portser, S., Kruger, A., Gatsonis, C. G., & Ding, Y. (1992) · Psychosomatic Medicine · doi:10.1097/00006842-199201000-00011 · Cited by 28
Dishman, R. K., Berthoud, H. R., Booth, F. W., Cotman, C. W., Edgerton, V. R., Fleshner, M., Gandevia, S. C., Gómez‐Pinilla, F., Greenwood, B. N., Hillman, C. H., et al. (2006) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/j.1600-0838.2006.00610_1.x · Cited by 24
Experimental analysis of specific treatment factors: Efficacy and practice implications
Lohr, J. M., Olatunji, B. O., Parker, L., & DeMaio, C. M. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20128 · Cited by 20
Velazquez, E. J., & Califf, R. M. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02207-8 · Cited by 8
Research works printed but not linked: 5
- 10.1093%2Fclipsy%2F6.1.95 · DOI
- 10.1037%2F%2F0022-006X.61.4.611 · doi:10.1037//0022-006x.61.4.611 · Paper page
- 10.1136%2Fbmj.321.7273.1383 · DOI · Paper page
- 10.1037%2F0022-006X.52.4.591 · doi:10.1037/0022-006x.52.4.591 · Paper page
- 10.1097%2F00005053-200304000-00002 · doi:10.1097/00005053-200304000-00002
Cited by
From ideas to efficacy: The ORBIT model for developing behavioral treatments for chronic diseases
Czajkowski, S. M., Powell, L. H., Adler, N., Naar-King, S., Reynolds, K. D., Hunter, C. M., Laraia, B., Olster, D. H., Perna, F. M., Peterson, J. C., et al. (2015) · Health Psychology · doi:10.1037/hea0000161 · Cited by 1,161
Time for united action on depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Patel, V., Kieling, C., Berk, M., Buchweitz, C., Cuijpers, P., Furukawa, T. A., Kessler, R. C., Kohrt, B. A., Maj, M., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)02141-3 · Cited by 1,104
Melby-Lervåg, M., Redick, T. S., & Hulme, C. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635612 · Cited by 983
“(Mohr et al. 2009) Sc re en in g”
Psychotherapy relationships that work II.
Norcross, J. C., & Lambert, M. J. (2011) · Psychotherapy · doi:10.1037/a0022180 · Cited by 797
Meta-analysis of dropout in treatments for posttraumatic stress disorder
Imel, Z. E., Laska, K., Jakupcak, M., & Simpson, T. L. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0031474 · Cited by 633
Metadata
- Authors
- Mohr, D. C., Spring, B., Freedland, K. E., Beckner, V., Arean, P., Hollon, S. D., Ockene, J., & Kaplan, R.
- Affiliations
- Northwestern University (US)
- Washington University in St. Louis (US)
- University of California, San Francisco (US)
- Vanderbilt University (US)
- University of Massachusetts Chan Medical School (US)
- University of California, Los Angeles (US)
- Venue
- Psychotherapy and Psychosomatics
- Publisher
- S. Karger AG
- Published
- 2009
- Volume
- 78
- Issue
- 5
- Pages
- 275-284
- ISSN
- 0033-3190 (ISSN-L)
- 1423-0348
- OpenAlex
- W1983555748
- Cited by
- 565
- References
- 44
- Citations by year
- 2026: 43 · 2025: 56 · 2024: 47 · 2023: 40 · 2022: 52 · 2021: 39 · 2020: 41 · 2019: 38 · 2018: 46 · 2017: 31 · 2016: 23 · 2015: 18 · 2014: 27 · 2013: 18 · 2012: 16
- FWCI
- 2.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Psychotherapy and Psychosomatics (publishedVersion)
- PubMed (publishedVersion)
- eScholarship@UMassChan (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- control conditions, randomized controlled trials, psychological intervention, internal validity, threats to validity, placebo comparison, waitlist control, evidence-based practice
- MeSH terms
- Mental Disorders, Humans, Research Design, Randomized Controlled Trials as Topic, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.