The Selection and Design of Control Conditions for Randomized Controlled Trials of Psychological Interventions
The DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
Abstract
The randomized controlled trial (RCT) provides critical support for evidence-based practice using psychological interventions. The control condition is the principal method of removing the influence of unwanted variables in RCTs. There is little agreement or consistency in the design and construction of control conditions. Because control conditions have variable effects, the results of RCTs can depend as much on control condition selection as on the experimental intervention. The aim of this paper is to present a framework for the selection and design of control conditions for these trials. Threats to internal validity arising from modern RCT methodology are reviewed and reconsidered. The strengths and weaknesses of several categories of control conditions are examined, including the ones that are under experimental control, the ones that are under the control of clinical service providers, and no-treatment controls. Considerations in the selection of control conditions are discussed and several recommendations are proposed. The aim of this paper is to begin to define principles by which control conditions can be selected or developed in a manner that can assist both investigators and grant reviewers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It should also be noted that the type of active control group used is also potentially important (see Mohr et al., 2009).”
From Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of “Far Transfer”: Evidence From a Meta-Analytic Review (2016) · cites this paper as Mohr et al., 2009
In the citing paper
“the improvement found in patients on waiting lists has been found to be lower than that expected on the basis of spontaneous remission 19 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [19]
In the citing paper
“Psychological placebo conditions were not included, because they have considerable effects on depression 24 and probably also on anxiety disorders 19 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [19]
In the citing paper
“As indicated earlier, improvements found in patients on waiting lists are lower than can be expected on the basis of spontaneous remission 19,185 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [19]
In the citing paper
“Considering the type of control condition as a potential moderator, we followed the suggestions of Mohr et al. (2009) who divided control conditions into three classes: (a) conditions where the investigator defines and manages the treatment, (b) conditions where the treatment is not determined by the investigator or provided by the study, and (c) no-treatment control conditions.”
From The effect of internet-delivered cognitive behavioral therapy for depression and anxiety on quality of life: A meta-analysis of randomized controlled trials (2023) · cites this paper as Mohr et al. (2009)
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
(2002) · Cited by 13,211
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · cited 1×
“but the RCT design has evolved considerably. Paradoxically, some contemporary RCT procedures designed to address threats to internal validity may create new problems. Below, we review three threats to internal validity that arise from modern RCT methodology. These threats have not been adequately considered to date an…”
BackgroundUnützer, J., Katon, W., Callahan, C. M., Williams, Jr., Hunkeler, E., Harpole, L., Hoffing, M., Della Penna, R. D., Noël, P. H., Lin, E. H. B., et al. (2002) · JAMA · doi:10.1001/jama.288.22.2836 · Cited by 2,405
Research design in clinical psychology
(1952) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195201)8:1<3::aid-jclp2270080102>3.0.co;2-0 · Cited by 2,147
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
Cognitive Therapy vs Medications in the Treatment of Moderate to Severe Depression
DeRubeis, R. J., Hollon, S. D., Amsterdam, J. D., Shelton, R. C., Young, P. R., Salomon, R. M., O’Reardon, J. P., Lovett, M. L., Gladis, M. M., Brown, L. L., et al. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.4.409 · Cited by 989
Self-citationPsychological Treatments That Cause Harm
Lilienfeld, S. O. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00029.x · Cited by 959
A stage model of behavioral therapies research: getting started and moving on from stage I.
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.2.133 · Cited by 846 · cited 1×
“(see www.clinicaltrials.gov) for pharmaceutical trials. Similar phase models for the evaluation of psychological interventions have been proposed [”
BackgroundA Stage Model of Behavioral Therapies Research: Getting Started and Moving on From Stage I
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy/8.2.133 · Cited by 846
Research works printed but not linked: 5
- 10.1093%2Fclipsy%2F6.1.95 · DOI
- 10.1037%2F%2F0022-006X.61.4.611 · doi:10.1037//0022-006x.61.4.611 · Paper page
- 10.1136%2Fbmj.321.7273.1383 · DOI · Paper page
- 10.1037%2F0022-006X.52.4.591 · doi:10.1037/0022-006x.52.4.591 · Paper page
- 10.1097%2F00005053-200304000-00002 · doi:10.1097/00005053-200304000-00002
Cited by
Items 101–200 of 565
Sansom‐Daly, U. M., Wakefield, C. E., Ellis, S. J., McGill, B. C., Donoghoe, M. W., Butow, P. N., Bryant, R. A., Sawyer, S. M., Patterson, P., Anazodo, A. C., et al. (2021) · Cancers · doi:10.3390/cancers13102460 · Cited by 78
“This gold-standard trial design also controlled for participants’ expectations of treatment effects [48].”
BackgroundBonsack, C., Manetti, S. G., Favrod, J., Montagrin, Y., Besson, J., Bovet, P., & Conus, P. (2011) · Psychotherapy and Psychosomatics · doi:10.1159/000323466 · Cited by 73
Meffert, S. M., Neylan, T. C., McCulloch, C. E., Blum, K., Cohen, C. R., Bukusi, E. A., Verdeli, H., Markowitz, J. C., Kahn, J. G., Bukusi, D., et al. (2021) · PLOS Medicine · doi:10.1371/journal.pmed.1003468 · Cited by 67
“For studies that examine new effects of an intervention such as IPT for comorbid MDD and PTSD among HIV+GBV+ women, current guidance indicates that stakeholder interests are best served by allowing the intervention to demonstrate its effects without an overly formidable comparator that could prevent further investigat…”
BackgroundPromoting healthy weight with “stability skills first”: A randomized trial.
Kiernan, M., Brown, S. D., Jake‐Schoffman, D. E., Lee, K., King, A. C., Taylor, C. B., Schleicher, N. C., & Perri, M. G. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0030544 · Cited by 77
“As is often the case in applied research, incorporating multiple components into an intervention and comparing the intervention to standard care constitutes the first stage of inquiry (Mohr et al., 2009).”
Ahrens, J., Shao, R., Blackport, D., Macaluso, S., Viana, R., Teasell, R. W., & Mehta, S. (2022) · Topics in Stroke Rehabilitation · doi:10.1080/10749357.2022.2049505 · Cited by 77
“Consistent with our results, research has shown it is more difficult to detect a treatment effect if an intervention is compared to an active comparator than to a less stringent control condition.(45) The interventions included in the current review were led by individuals from various backgrounds.”
ResultHimelhoch, S., Medoff, D., Maxfield, J., Dihmes, S., Dixon, L., Robinson, C., Potts, W., & Mohr, D. C. (2013) · AIDS and Behavior · doi:10.1007/s10461-013-0465-5 · Cited by 64
“f2f therapy was chosen as the control condition in order to control for time and attention as well as provide an ethical and active treatment for major depression [21].”
MethodSelf-citationMotl, R. W., Hubbard, E. A., Bollaert, R. E., Adamson, B., Kinnett-Hopkins, D., Balto, J. M., Sommer, S., Pilutti, L. A., & McAuley, E. (2017) · Multiple Sclerosis Journal - Experimental Translational and Clinical · doi:10.1177/2055217317734886 · Cited by 71
“Such an approach was considered acceptable as we were evaluating a novel behavioral intervention approach based on modern e-learning, and this condition is considered reasonable for monitoring health/wellbeing of participants when compared with controls.(30) Participants in the waitlist control condition were offered…”
MethodCuijpers, P., Quero, S., Papola, D., Cristea, I. A., & Karyotaki, E. (2021) · Psychological Medicine · doi:10.1017/s0033291719003581 · Cited by 62
“As indicated in the Introduction, each type of control condition in psychotherapy research has its own problems (Gold et al., 2017; Mohr et al., 2009).”
BackgroundChait, S. R., Thompson, J. K., & Jacobsen, P. B. (2014) · Body Image · doi:10.1016/j.bodyim.2014.09.004 · Cited by 62
Wetzelaer, P., Farrell, J. M., Evers, S., Jacob, G. A., Lee, C. W., Wilde, O. B.-D., van Breukelen, G., Faßbinder, E., Fretwell, H., Harper, R. P., et al. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0319-3 · Cited by 69
“These issues could be a potential threat to internal validity [65].”
Systematic review of control groups in nutrition education intervention research
Byrd‐Bredbenner, C., Wu, F., Spaccarotella, K., Quick, V., Martin‐Biggers, J. T., & Zhang, Y. (2017) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-017-0546-3 · Cited by 72
“To reduce the risk of a Type 1 error (acceptance of an ineffective intervention) [1, 9, 17], treatment received by control condition participants should differ from those in the experimental condition only in the non-receipt of the”
BackgroundMethodInfluentialUppendahl, J. R., Alözkan, C., Cuijpers, P. J., de Vries, R., & Sijbrandij, M. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00933 · Cited by 73
Heim, N., Bobou, M., Tanzer, M., Jenkinson, P. M., Steinert, C., & Fotopoulou, A. (2023) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.13576 · Cited by 61
Cognitive-Behavioral Self-Help Treatment for Nightmares: A Randomized Controlled Trial
Lancee, J., Spoormaker, V. I., & van den Bout, J. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000320894 · Cited by 68
“(n = 121; 30.3p), whereby the intervention conditions (IRT/exposure) predicted dropout. In the waiting list and recording conditions, participants received their self-help guide only if they filled out the post-test. In the intervention conditions, no such incentives were provided which may have resulted in different…”
BackgroundAlschuler, K. N., Arewasikporn, A., Nelson, I. K., Molton, I. R., & Ehde, D. M. (2018) · Rehabilitation Psychology · doi:10.1037/rep0000223 · Cited by 60
“We selected a wait-list control comparator because clinical trials methodologists (Hart, Fann, & Novack, 2008; Mohr et al., 2009) argued that waitlist or usual care controls are appropriate for early phase, proof-of-principle trials where the goal is to promote innovation.”
MethodZiadni, M. S., Gonzalez-Castro, L., Anderson, S., Krishnamurthy, P., & Darnall, B. D. (2021) · Journal of Medical Internet Research · doi:10.2196/29672 · Cited by 59
“The study used a WLC group because the ER class web-based delivery is a new approach that has not been previously tested [54,55].”
van Gelderen, M. J., Nijdam, M. J., Haagen, J. F. G., & Vermetten, E. (2020) · Psychotherapy and Psychosomatics · doi:10.1159/000505977 · Cited by 59
Comparison groups in yoga research: A systematic review and critical evaluation of the literature
Park, C. L., Groessl, E. J., Maiya, M., Sarkin, A. J., Eisen, S. V., Riley, K. E., & Elwy, A. R. (2014) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2014.08.008 · Cited by 71
Systematic Review on Exercise Training as a Neuroplasticity-Inducing Behavior in Multiple Sclerosis
Sandroff, B. M., Jones, C. D., Baird, J. F., & Motl, R. W. (2020) · Neurorehabilitation and neural repair · doi:10.1177/1545968320921836 · Cited by 60
Ayling, K., Brierley, S., Johnson, B., Heller, S. R., & Eiser, C. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953528 · Cited by 59
“We successfully adapted a checklist previously used to assess standard care quality in HIV antiretroviral adherence trials (de Bruin et al., 2009) and applied it to trials of behaviour change interventions for young people with type 1 diabetes.”
InfluentialRaghuraman, S., Stuttard, N., & Hunt, N. C. (2020) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2486 · Cited by 70
“Additionally, the use of WLC may be associated with other methodological concerns related to increased risk of bias (Mohr et al., 2009) and larger effect sizes for the psychotherapy group (Furukawa et al., 2014).”
BackgroundMaurer, L., Espie, C. A., Omlin, X., Emsley, R., & Kyle, S. D. (2021) · SLEEP · doi:10.1093/sleep/zsab223 · Cited by 62
Kubota, Y., Okuyama, T., Uchida, M., Umezawa, S., Nakaguchi, T., Sugano, K., Ito, Y., Katsuki, F., Nakano, Y., Nishiyama, T., et al. (2015) · Psycho-Oncology · doi:10.1002/pon.4000 · Cited by 58
“Second, the fact that we utilized a WCG might have caused overestimation of the effectiveness of the intervention because participants assigned to a waiting list control appeared to improve less than would be expected for people who are concerned about their behavior [27,28].”
MethodZhu, Z., Zhang, L., Jiang, J., Li, W., Cao, X., Zhou, Z., Zhang, T., & Li, C. (2014) · PubMed Central · doi:10.11919/j.issn.1002-0829.214173 · Cited by 86
“Some studies have found that a well-designed psychological placebo can achieve a similar treatment effect to that achieved by a formal psychological treatment.([4,11]) Research about the placebo effect in the treatment of mental disorders has found that placebos can produce real physiological changes that may be thera…”
BackgroundInfluentialBonnert, M., Olén, O., Lalouni, M., Hedman‐Lagerlöf, E., Särnholm, J., Serlachius, E., & Ljótsson, B. (2018) · Behavior Therapy · doi:10.1016/j.beth.2018.05.002 · Cited by 62
A Randomized Controlled Trial of Cognitive Behavioral Group Therapy for Bipolar Disorder
Gomes, B. C., Abreu, L. N., Brietzke, E., Caetano, S. C., Kleinman, A., Nery, F. G., & Lafer, B. (2011) · Psychotherapy and Psychosomatics · doi:10.1159/000320738 · Cited by 52
“All approaches have demonstrated some efficacy in either acute or long-term studies when compared with treatment as usual (TAU) or other controlled conditions [”
ResultWaghorn, G., Dias, S., Gladman, B., Harris, M., & Saha, S. (2014) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.12148 · Cited by 52
“Reporting followed the CONSORT guidelines for reporting randomised controlled trials in parallel group designs (Mohr et al., 2009; Mohr et al., 2010; Schulz, Altman & Moher, 2010).”
BackgroundMethodGuihan, M., Bombardier, C. H., Ehde, D. M., Rapacki, L. M., Rogers, T. J., Bates‐Jensen, B. M., Thomas, F. P., Parachuri, R., & Holmes, S. A. (2014) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2014.01.012 · Cited by 54
Thompson, C., de la Cruz, L. F., Mataix‐Cols, D., & Onwumere, J. (2017) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2017.02.020 · Cited by 62
“Of the studies that were RCTs, most used wait-list controls which, whilst being pragmatic, are not necessarily the ideal comparator for psychological trials (Basham, 1986; Hart et al., 2008; Mohr et al., 2009).”
MethodPayne, B. R., & Stine-Morrow, E. A. L. (2017) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2017.00256 · Cited by 44
Howren, M. B., Kellerman, Q. D., Hillis, S. L., Cvengros, J. A., Lawton, W. J., & Christensen, A. J. (2015) · Annals of Behavioral Medicine · doi:10.1007/s12160-015-9741-0 · Cited by 62
“Consequently, the present intervention must be viewed in relation to the control condition employed in this trial (see (38)).”
MethodCella, M., Chalder, T., & White, P. D. (2011) · Psychotherapy and Psychosomatics · doi:10.1159/000327582 · Cited by 49
“The use of LCA and LCR in relation to treatment outcome has the potential to improve treatment effectiveness by identifying potentially modifiable and unique sets of characteristics which may be more clinically valid and have a better response to different treatments. Further, investigation of symptom heterogeneity ca…”
BackgroundJohns, S. A., Tarver, W. L., Secinti, E., Mosher, C. E., Stutz, P. V., Carnahan, J. L., Talib, T. L., Shanahan, M. L., Faidley, M. T., Kidwell, K. M., et al. (2021) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2021.103290 · Cited by 48
“Relative to active comparison groups, notreatment controls often produce the largest effect size in favor of the experimental treatment [71].”
BackgroundByrd‐Bredbenner, C., Martin‐Biggers, J. T., Alleman, G. P., Worobey, J., Hongu, N. K., & Quick, V. (2017) · Contemporary Clinical Trials · doi:10.1016/j.cct.2017.10.012 · Cited by 59
Possible Detrimental Effects of Cognitive Behaviour Therapy for Chronic Fatigue Syndrome
Heins, M. J., Knoop, H., Prins, J. B., Stulemeijer, M., van der Meer, J. W. M., & Bleijenberg, G. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000315130 · Cited by 47
“mentioned the frequency of self-reported symptom deterioration during therapy. Based on the numbers they reported (i.e. 13p deterioration in the CBT group and 10p in the control group), we performed a χ 2 test and did not find a statistically significant difference between patients receiving CBT and those receiving ca…”
MethodGomes, A. I., Pereira, A. I., Roberto, M. S., Boraska, K., & Barros, L. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250231 · Cited by 57
Sun, S., Nardi, W., Loucks, E. B., & Operario, D. (2021) · Mindfulness · doi:10.1007/s12671-021-01710-9 · Cited by 46
Werner‐Seidler, A., Hitchcock, C., Bevan, A., McKinnon, A., Gillard, J., Dahm, T., Chadwick, I., Panesar, I., Breakwell, L., Mueller, V., et al. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.03.004 · Cited by 50
“Furthermore, active control groups that are matched to the experimental group in terms of treatment length, credibility and implementation often have a considerable impact on treatment outcome (Mohr et al., 2008).”
Feinstein, A., Amato, M. P., Brichetto, G., Chataway, J., Chiaravalloti, N. D., Dalgas, U., DeLuca, J., Feys, P., Filippi, M., Freeman, J. A., et al. (2020) · BMC Neurology · doi:10.1186/s12883-020-01772-7 · Cited by 49
Cuijpers, P., Karyotaki, E., Andersson, G., Li, J., Mergl, R., & Hegerl, U. (2015) · European Psychiatry · doi:10.1016/j.eurpsy.2015.06.005 · Cited by 44
“It is not surprising therefore that the effect sizes of psychotherapy studies are especially large when compared to waiting list controls [47,48].”
BackgroundResultNakao, S., Nakagawa, A., Oguchi, Y., Mitsuda, D., Kato, N., Nakagawa, Y., Tamura, N., Kudo, Y., Abe, T., Hiyama, M., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/10743 · Cited by 45
Elwy, A. R., Johnston, J. M., Bormann, J. E., Hull, A. E., & Taylor, S. L. (2014) · Medical Care · doi:10.1097/mlr.0000000000000228 · Cited by 52
“Unlike studies of drug effects where a placebo is relatively straightforward, control condition selection is much more complex for behavioral interventions.(18,22)”
BackgroundBradizza, C. M., Stasiewicz, P. R., Zhuo, Y., Ruszczyk, M., Maisto, S. A., Lucke, J. F., Brandon, T. H., Eiden, R. D., Slosman, K. S., & Giarratano, P. (2017) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntw398 · Cited by 44
Overbeek, M. M. M., de Schipper, J. C., Lamers-Winkelman, F., & Schuengel, C. (2012) · Trials · doi:10.1186/1745-6215-13-12 · Cited by 52
“Part of the reasons may be that professionals are reluctant to deny or delay intervention for children at risk [23].”
BackgroundMethodInfluentialPatient and Clinician Perceptions of Therapeutic Alliance as Predictors of Improvement in Depression
Bolle, M. D., Johnson, J. G., & Fruyt, F. D. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000320895 · Cited by 49
“The present study has some limitations that may affect its generalizability. First, it has a naturalistic design, with some inherent caveats, including non-random assignment of patients to psychiatrists, non-manualized psychotherapeutic treatments, and the absence of measures of treatment fidelity, therapist competenc…”
BackgroundJelinek, L., Moritz, S., & Hauschildt, M. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.06.003 · Cited by 52
“Secondly, other biasing effects need to be mentioned, particularly the lack of therapist and patient blinding in the RCT that may affect the outcome if patients learn that they are not receiving the experimental treatment (Mohr et al., 2009).”
BackgroundMcLouth, L. E. S., Ford, C. G., Pustejovsky, J. E., Park, C. L., Sherman, A. C., Trevino, K. M., & Salsman, J. M. (2020) · Psycho-Oncology · doi:10.1002/pon.5562 · Cited by 48
Sosnoff, J. J., Moon, Y., Wajda, D. A., Finlayson, M. L., McAuley, E., Peterson, E. W., Morrison, S., & Motl, R. W. (2014) · Clinical Rehabilitation · doi:10.1177/0269215514564899 · Cited by 42
Senders, A., Hanes, D., Bourdette, D., Carson, K., Marshall, L. M., & Shinto, L. (2019) · Multiple Sclerosis Journal · doi:10.1177/1352458518786650 · Cited by 41
van Passel, B., Danner, U. N., Dingemans, A. E., Aarts, E., Sternheim, L. C., Becker, E. S., Elburg, A. A. V., van Furth, E. F., Hendriks, G., & Cath, D. C. (2020) · Psychotherapy and Psychosomatics · doi:10.1159/000505733 · Cited by 47
Methodological challenges in treatment outcome research with ethnic minorities
Lau, A. S., Chang, D. F., & Okazaki, S. (2010) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/a0021371 · Cited by 41
“A TAU control consists of the routine intervention(s) ordinarily provided by clinicians in the settings from which participants are recruited (Mohr et al., 2009).”
Pettman, D., O'Mahen, H., Skoog Svanberg, A., von Essen, L., Axfors, C., Blomberg, O., & Woodford, J. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-032659 · Cited by 24
Control interventions in randomised trials among people with mental health disorders
Faltinsen, E., Todorovac, A., Staxen Bruun, L., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000050.pub2 · Cited by 40
Aesthetic experiences and their transformative power: a systematic review
Pizzolante, M., Pelowski, M. J., Demmer, T. R., Bartolotta, S., Sarcinella, E. D., Gaggioli, A., & Chirico, A. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1328449 · Cited by 67
Affected other interventions: a systematic review and meta‐analysis across addictions
Merkouris, S., Rodda, S. N., & Dowling, N. A. (2022) · Addiction · doi:10.1111/add.15825 · Cited by 47
“no intervention, waiting-list control, assessment only, treatment referral or nonspecific treatment component controls [27, 28]); (4) the affected other and addicted person were 18 years of age or older; and (5) they assessed any affected other, addicted person or relationship functioning outcome.”
BackgroundGu, J., Cavanagh, K., & Strauss, C. (2018) · Mindfulness · doi:10.1007/s12671-017-0867-y · Cited by 40
“…to matched control conditions, which hold constant all factors except for the core, specific elements of the intervention, is important because this makes it possible to determine whether the specific elements of the intervention are responsible for beneficial outcomes (Mohr et al. 2009).”
BackgroundInfluentialYmer, L., McKay, A., Wong, D. K., Frencham, K., Grima, N., Tran, J., Nguyen, S., Junge, M. F., Murray, J. M., Spitz, G., et al. (2021) · Annals of Physical and Rehabilitation Medicine · doi:10.1016/j.rehab.2021.101560 · Cited by 47
Jenkins, P. E., Luck, A., Violato, M., Robinson, C., & Fairburn, C. G. (2021) · International Journal of Eating Disorders · doi:10.1002/eat.23554 · Cited by 45
“First, the waiting list control condition was included to control threats to internal validity but should not be considered as equivalent to no treatment and may inflate between-group effects (Mohr et al., 2009).”
BackgroundEvaluation of randomized controlled trials: a primer and tutorial for mental health researchers
Harrer, M., Cuijpers, P. J., Schuurmans, L., Kaiser, T., Buntrock, C., van Straten, A., & Ebert, D. D. (2023) · Trials · doi:10.1186/s13063-023-07596-3 · Cited by 48
Motl, R. W., Sandroff, B. M., Wingo, B. C., McCroskey, J., Pilutti, L. A., Cutter, G., Bollaert, R. E., & McAuley, E. (2018) · Contemporary Clinical Trials · doi:10.1016/j.cct.2018.06.017 · Cited by 41
Kleiboer, A., Sorbi, M., van Silfhout, M., Kooistra, L., & Passchier, J. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.07.009 · Cited by 37
“Additionally, it is suggested that asking people to wait and refrain from treatment may decrease natural help-seeking (Mohr et al., 2009).”
BackgroundHosek, S., Harper, G. W., Lemos, D., Burke-Miller, J. K., Lee, S., Friedman, L. B., & Martinez, J. (2018) · AIDS and Behavior · doi:10.1007/s10461-018-2034-4 · Cited by 37
“According to Mohr and colleagues [11], failure to maintain equivalence in interventionist selection and therapeutic alliance will threaten the internal validity of a study and may influence the outcomes of an RCT.”
BackgroundSchröder, A., Heider, J., Zaby, A., & Göllner, R. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-012-9474-3 · Cited by 49
“PMR provides treatment (e.g., relaxation training, group support) that does not contain elements of CBT for somatoform symptoms (e.g., psychophysiological education, cognitive restructuring, refocusing attention, and activity enhancement) (Mohr et al. 2009).”
BackgroundBos, E. H., van Wel, E. B., Appelo, M. T., & Verbraak, M. J. P. M. (2011) · Psychotherapy and Psychosomatics · doi:10.1159/000321793 · Cited by 41
“for a detailed analysis of care service use).It has been noted that the use of TAU as a control condition may produce other problems, such as lack of influence of the investigators over this condition, possible differential treatment monitoring, and clinician selection effects [”
BackgroundWakefield, C. E., Sansom-Daly, U. M., McGill, B. C., McCarthy, M., Girgis, A., Grootenhuis, M., Barton, B., Patterson, P., Osborn, M., Lowe, C., et al. (2015) · Trials · doi:10.1186/s13063-015-0681-6 · Cited by 35
“The PSG arm holds constant the amount of treatment contact, human interaction variables (such as facilitator warmth and interaction between participants), as well as controlling for participants’ expectations of receiving some form of treatment [37].”
BackgroundMelkonian, M., McDonald, S., Scott, A. J., Karin, E., Dear, B. F., & Wootton, B. M. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.08.037 · Cited by 41
Bond, D. S., O’Leary, K. C., Thomas, J. G., Lipton, R. B., Papandonatos, G. D., Roth, J. L., Rathier, L. A., Daniello, R., & Wing, R. R. (2013) · Contemporary Clinical Trials · doi:10.1016/j.cct.2013.03.004 · Cited by 39
Grol, M., Schwenzfeier, A., Stricker, J., Booth, C., Temple-McCune, A., Derakshan, N., Hirsch, C. R., Becker, E. S., & Fox, E. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.01.005 · Cited by 43
“That is, an ‘active’ control training will better match the experimental training in terms of treatment credibility which could otherwise affect (inflate) the results by influencing participants’ outcome expectancies and thus lead to differences that may not reflect effects due to the trained process per se (MelbyLerv…”
Androwis, G. J., Sandroff, B. M., Niewrzol, P., Fakhoury, F. N., Wylie, G. R., Yue, G. H., & DeLuca, J. (2021) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2021.102936 · Cited by 44
Maina, G., Rosso, G., Rigardetto, S., Chiadò Piat, S., & Bogetto, F. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000318296 · Cited by 34
“already found that higher levels of initial depression were generally associated with a diminished efficacy.Ratings of depressive symptoms suggested that the improvement in depression was correlated with the improvement in OCD: patients in both treatment groups showed a significant improvement over the study period in…”
ResultHilari, K., Behn, N., Marshall, J., Simpson, A., Thomas, S., Northcott, S., Flood, C., McVicker, S. J., Jofre‐Bonet, M., Moss, B., et al. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0397-6 · Cited by 38
Can attention control conditions have detrimental effects on behavioral medicine randomized trials?
Pagoto, S. L., McDermott, M. M., Reed, G., Greenland, P., Mazor, K. M., Ockene, J. K., Whited, M., Schneider, K., Appelhans, B., Leung, K., et al. (2013) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3182765dd2 · Cited by 35
“In addition to pain, placebo effects have been observed for depression (27,29), and the mechanisms may include social support, regression to the mean, Hawthorne effect, and expectancy effects (27,30).”
BackgroundSelf-citationBakhshi, F., Nayeri, N. D., Khosravi, A., & Najafi, Z. (2020) · Indian Journal of Palliative Care · doi:10.4103/ijpc.ijpc_183_19 · Cited by 33
“However, in clinical trial studies, especially RCT, the control group should be matched with the overall structure of the intervention group,[54] as the control group’s conditions affect the internal validity of the articles.[55] Among RCT-designed articles, only five articles used a matched structured control group w…”
MethodMistretta, E. G., & Davis, M. C. (2021) · Mindfulness · doi:10.1007/s12671-021-01766-7 · Cited by 47
“Meta-analytic procedures were performed in accordance with Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) protocol guidelines (Mohr et al., 2009).”
Overbeek, M. M. M., de Schipper, J. C., Lamers-Winkelman, F., & Schuengel, C. (2013) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2013.07.007 · Cited by 38
Mediators and Treatment Factors in Intervention for Children Exposed to Interparental Violence
Overbeek, M. M. M., de Schipper, J. C., Willemen, A. M., Lamers-Winkelman, F., & Schuengel, C. (2015) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2015.1012720 · Cited by 42
Non-pharmacological interventions for prophylaxis of vestibular migraine
Webster, K. E., Dor, A., Galbraith, K., Kassem, L. H., Harrington-Benton, N. A., Judd, O., Kaski, D. N., Maarsingh, O. R., MacKeith, S. A. C., Ray, J., et al. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015321.pub2 · Cited by 34
Comprehensive Treatment Models for Children and Youth With Autism Spectrum Disorders
Odom, S. L. (2014) · Wiley eBooks · doi:10.1002/9781118911389.hautc30 · Cited by 40
Comtois, K. A., Mata-Greve, F., Johnson, M., Pullmann, M. D., Mosser, B., & Areán, P. A. (2022) · JMIR mhealth and uhealth · doi:10.2196/41689 · Cited by 51
LeLaurin, J. H., Freytes, I. M., Findley, K. E., Schmitzberger, M., Eliazar-Macke, N. D., Orozco, T., & Uphold, C. R. (2020) · Clinical Rehabilitation · doi:10.1177/0269215520957004 · Cited by 33
Domhardt, M., Nowak, H., Engler, S., Baumel, A., Grund, S., Mayer, A., Terhorst, Y., & Baumeister, H. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102084 · Cited by 32
A case for the advancement of the design and study of online positive psychological interventions
Parks, A. C. (2014) · The Journal of Positive Psychology · doi:10.1080/17439760.2014.936969 · Cited by 31
“While there are important reasons why researchers may choose to use no-intervention control conditions – for example, to maximize statistical power – it is important to supplement such research with studies that use rigorous comparison conditions (Mohr et al., 2009).”
BackgroundYu, A. M., Balasubramanaiam, B., Offringa, M., & Kelly, L. E. (2018) · Pediatric Research · doi:10.1038/s41390-018-0019-7 · Cited by 35
Purpose-guided trial design in health-related behavioral intervention research.
Freedland, K. E. (2020) · Health Psychology · doi:10.1037/hea0000867 · Cited by 33
Self-citationMcLouth, L. E. S., Boucher, K. M., Damron, B. H., Pappas, L. M., Walters, S. T., Flores, K. G., Boonyasiriwat, W., Vernon, S. W., Stroup, A. M., Schwartz, M. D., et al. (2015) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-15-0150 · Cited by 28
“, dose) versus that of the intervention content and delivery (36).”
BackgroundTurner, K. M., Huntley, A. L., Yardley, T., Dawson, S., & Dawson, S. (2024) · Trials · doi:10.1186/s13063-024-07956-7 · Cited by 38
“…the discussion around the need to clarify the content of usual care has stemmed from the recognition that its content might vary between trial sites and that its content will affect the effect size found, so needs to be carefully described when interpreting and reporting trial findings [6, 30, 34].”
BackgroundMethodInfluentialWannemueller, A., Joehren, P., Haug, S., Hatting, M., Elsesser, K., & Sartory, G. (2011) · Psychotherapy and Psychosomatics · doi:10.1159/000320977 · Cited by 29
Eltahawy, L., Essig, T., Myszkowski, N., & Trub, L. R. (2023) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2023.100035 · Cited by 42
Cowley, B. U., Holmström, É., Juurmaa, K., Kovarskis, L., & Krause, C. M. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00205 · Cited by 41
“The WLC is a minimum viable control for non-specific effects of history, maturation, repeated testing, instrument drift, statistical regression, selection bias, and population inhomogeneity effects (Mohr et al., 2009).”
MethodVink, M., & Vink-Niese, F. (2020) · Work · doi:10.3233/wor-203174 · Cited by 35
“Selection bias is the bias introduced by how participants are selected and who researchers include or exclude from their studies [26].”
BackgroundDickson, S. J., Kuhnert, R., Lavell, C. H., & Rapee, R. M. (2022) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-022-00402-7 · Cited by 55
Mailey, E. L., & McAuley, E. (2014) · Women & Health · doi:10.1080/03630242.2014.899542 · Cited by 32
Hedman‐Lagerlöf, M., Hedman‐Lagerlöf, E., Ljótsson, B., Wicksell, R. K., Flink, I. K., & Andersson, E. (2018) · Journal of Pain · doi:10.1016/j.jpain.2018.07.012 · Cited by 36
Ritzert, T. R., Forsyth, J. P., Sheppard, S. C., Boswell, J. F., Berghoff, C. R., & Eifert, G. H. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.03.001 · Cited by 28
Mailey, E. L., & Hsu, W. (2017) · Journal of Health Psychology · doi:10.1177/1359105316687627 · Cited by 35
Ward‐Ciesielski, E. F., Tidik, J. A., Edwards, A. J., & Linehan, M. M. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.011 · Cited by 32
“A larger sample size may be necessary to detect differences between two active interventions, leaving the present study vulnerable to a type II error (Freedland et al., 2011; Mohr et al., 2009).”
Russell, L., Ugalde, A., Milne, D., Austin, D., & Livingston, P. M. (2018) · JMIR Mental Health · doi:10.2196/mental.9645 · Cited by 31
Will behavioral treatments for cognitive impairment in multiple sclerosis become standards-of-care?
Sandroff, B. M., & DeLuca, J. (2019) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2019.02.010 · Cited by 32
Yiend, J., Lam, C. L. M., Schmidt, N. B., Crane, B., Heslin, M., Kabir, T., McGuire, P. K., Meek, C., Mouchlianitis, E. D., PETERS, E. R., et al. (2022) · Psychological Medicine · doi:10.1017/s0033291722001520 · Cited by 24
“Nevertheless, a frequent choice of control condition in feasibility trials is the ‘ no treatment ’ control (e.g. waitlist) or ‘ treat-ment as usual ’ , since the avoidance of Type II errors is deemed to be the priority (Mohr et al., 2009).”
InfluentialDigital Interventions to Enhance Readiness for Psychological Therapy: Scoping Review
Jardine, J., Bowman, R., & Doherty, G. J. (2022) · Journal of Medical Internet Research · doi:10.2196/37851 · Cited by 39
“For the attention controls, we distinguished between nonspecific treatment component controls and specific treatment component controls [92].”
Metadata
- Authors
- Mohr, D. C., Spring, B., Freedland, K. E., Beckner, V., Arean, P., Hollon, S. D., Ockene, J., & Kaplan, R.
- Affiliations
- Northwestern University (US)
- Washington University in St. Louis (US)
- University of California, San Francisco (US)
- Vanderbilt University (US)
- University of Massachusetts Chan Medical School (US)
- University of California, Los Angeles (US)
- Venue
- Psychotherapy and Psychosomatics
- Publisher
- S. Karger AG
- Published
- 2009
- Volume
- 78
- Issue
- 5
- Pages
- 275-284
- ISSN
- 0033-3190 (ISSN-L)
- 1423-0348
- OpenAlex
- W1983555748
- Cited by
- 565
- References
- 44
- Citations by year
- 2026: 43 · 2025: 56 · 2024: 47 · 2023: 40 · 2022: 52 · 2021: 39 · 2020: 41 · 2019: 38 · 2018: 46 · 2017: 31 · 2016: 23 · 2015: 18 · 2014: 27 · 2013: 18 · 2012: 16
- FWCI
- 2.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Psychotherapy and Psychosomatics (publishedVersion)
- PubMed (publishedVersion)
- eScholarship@UMassChan (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- control conditions, randomized controlled trials, psychological intervention, internal validity, threats to validity, placebo comparison, waitlist control, evidence-based practice
- MeSH terms
- Mental Disorders, Humans, Research Design, Randomized Controlled Trials as Topic, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.