The DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
The Selection and Design of Control Conditions for Randomized Controlled Trials of Psychological Interventions
Abstract
The randomized controlled trial (RCT) provides critical support for evidence-based practice using psychological interventions. The control condition is the principal method of removing the influence of unwanted variables in RCTs. There is little agreement or consistency in the design and construction of control conditions. Because control conditions have variable effects, the results of RCTs can depend as much on control condition selection as on the experimental intervention. The aim of this paper is to present a framework for the selection and design of control conditions for these trials. Threats to internal validity arising from modern RCT methodology are reviewed and reconsidered. The strengths and weaknesses of several categories of control conditions are examined, including the ones that are under experimental control, the ones that are under the control of clinical service providers, and no-treatment controls. Considerations in the selection of control conditions are discussed and several recommendations are proposed. The aim of this paper is to begin to define principles by which control conditions can be selected or developed in a manner that can assist both investigators and grant reviewers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It should also be noted that the type of active control group used is also potentially important (see Mohr et al., 2009).”
From Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of “Far Transfer”: Evidence From a Meta-Analytic Review (2016) · cites this paper as Mohr et al., 2009
In the citing paper
“the improvement found in patients on waiting lists has been found to be lower than that expected on the basis of spontaneous remission 19 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [19]
In the citing paper
“Psychological placebo conditions were not included, because they have considerable effects on depression 24 and probably also on anxiety disorders 19 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [19]
In the citing paper
“As indicated earlier, improvements found in patients on waiting lists are lower than can be expected on the basis of spontaneous remission 19,185 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [19]
In the citing paper
“Considering the type of control condition as a potential moderator, we followed the suggestions of Mohr et al. (2009) who divided control conditions into three classes: (a) conditions where the investigator defines and manages the treatment, (b) conditions where the treatment is not determined by the investigator or provided by the study, and (c) no-treatment control conditions.”
From The effect of internet-delivered cognitive behavioral therapy for depression and anxiety on quality of life: A meta-analysis of randomized controlled trials (2023) · cites this paper as Mohr et al. (2009)
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
(2002) · Cited by 13,211
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · cited 1×
“but the RCT design has evolved considerably. Paradoxically, some contemporary RCT procedures designed to address threats to internal validity may create new problems. Below, we review three threats to internal validity that arise from modern RCT methodology. These threats have not been adequately considered to date an…”
BackgroundUnützer, J., Katon, W., Callahan, C. M., Williams, Jr., Hunkeler, E., Harpole, L., Hoffing, M., Della Penna, R. D., Noël, P. H., Lin, E. H. B., et al. (2002) · JAMA · doi:10.1001/jama.288.22.2836 · Cited by 2,405
Research design in clinical psychology
(1952) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195201)8:1<3::aid-jclp2270080102>3.0.co;2-0 · Cited by 2,147
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
Cognitive Therapy vs Medications in the Treatment of Moderate to Severe Depression
DeRubeis, R. J., Hollon, S. D., Amsterdam, J. D., Shelton, R. C., Young, P. R., Salomon, R. M., O’Reardon, J. P., Lovett, M. L., Gladis, M. M., Brown, L. L., et al. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.4.409 · Cited by 989
Self-citationPsychological Treatments That Cause Harm
Lilienfeld, S. O. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00029.x · Cited by 959
A stage model of behavioral therapies research: getting started and moving on from stage I.
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.2.133 · Cited by 846 · cited 1×
“(see www.clinicaltrials.gov) for pharmaceutical trials. Similar phase models for the evaluation of psychological interventions have been proposed [”
BackgroundA Stage Model of Behavioral Therapies Research: Getting Started and Moving on From Stage I
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy/8.2.133 · Cited by 846
Research works printed but not linked: 5
- 10.1093%2Fclipsy%2F6.1.95 · DOI
- 10.1037%2F%2F0022-006X.61.4.611 · doi:10.1037//0022-006x.61.4.611 · Paper page
- 10.1136%2Fbmj.321.7273.1383 · DOI · Paper page
- 10.1037%2F0022-006X.52.4.591 · doi:10.1037/0022-006x.52.4.591 · Paper page
- 10.1097%2F00005053-200304000-00002 · doi:10.1097/00005053-200304000-00002
Cited by
From ideas to efficacy: The ORBIT model for developing behavioral treatments for chronic diseases
Czajkowski, S. M., Powell, L. H., Adler, N., Naar-King, S., Reynolds, K. D., Hunter, C. M., Laraia, B., Olster, D. H., Perna, F. M., Peterson, J. C., et al. (2015) · Health Psychology · doi:10.1037/hea0000161 · Cited by 1,161
Time for united action on depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Patel, V., Kieling, C., Berk, M., Buchweitz, C., Cuijpers, P., Furukawa, T. A., Kessler, R. C., Kohrt, B. A., Maj, M., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)02141-3 · Cited by 1,104
Melby-Lervåg, M., Redick, T. S., & Hulme, C. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635612 · Cited by 983
“(Mohr et al. 2009) Sc re en in g”
Psychotherapy relationships that work II.
Norcross, J. C., & Lambert, M. J. (2011) · Psychotherapy · doi:10.1037/a0022180 · Cited by 797
Meta-analysis of dropout in treatments for posttraumatic stress disorder
Imel, Z. E., Laska, K., Jakupcak, M., & Simpson, T. L. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0031474 · Cited by 633
The Lancet Psychiatry Commission on psychological treatments research in tomorrow's science
Holmes, E. A., Ghaderi, A., Harmer, C. J., Ramchandani, P. G., Cuijpers, P., Morrison, A. P., Roiser, J. P., Bockting, C. L. H., O'Connor, R. C., Shafran, R., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30513-8 · Cited by 624
Cuijpers, P., Cristea, I. A., Karyotaki, E., Reijnders, M., & Huibers, M. J. H. (2016) · World Psychiatry · doi:10.1002/wps.20346 · Cited by 572
Psychological treatment of generalized anxiety disorder: A meta-analysis
Cuijpers, P., Sijbrandij, M., Koole, S., Huibers, M., Berking, M., & Andersson, G. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.01.002 · Cited by 527
Furukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521
“The need for a control condition in evaluating efficacy/effectiveness of any health intervention is accepted beyond doubt but what constitutes an appropriate control in psychotherapy trials has long been hotly debated (1, 2).”
BackgroundAn overview of and recommendations for more accessible digital mental health services
Lattie, E. G., Stiles-Shields, C., & Graham, A. K. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00003-1 · Cited by 446
Freedland, K. E., Mohr, D. C., Davidson, K. W., & Schwartz, J. E. (2011) · Psychosomatic Medicine · doi:10.1097/psy.0b013e318218e1fb · Cited by 369
“Control group stringency generally increases as research progresses from early treatment development work to definitive efficacy trials (16).”
BackgroundSelf-citationThe validation of an active control intervention for Mindfulness Based Stress Reduction (MBSR)
MacCoon, D. G., Imel, Z. E., Rosenkranz, M. A., Sheftel, J. G., Weng, H. Y., Sullivan, J. C., Bonus, K. A., Stoney, C. M., Salomons, T. V., Davidson, R. J., et al. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.10.011 · Cited by 335
“, “emphasis was placed upon not describing or training mindfulness skills to the control group”), rather thantheskillfulprovisionofcommontherapeuticelements,whichmay bias tests of intervention effects (Mohr et al., 2009).”
BackgroundInfluentialKing, A. C., Hekler, E. B., Grieco, L. A., Winter, S. J., Sheats, J. L., Buman, M. P., Banerjee, B., Robinson, T. N., & Cirimele, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062613 · Cited by 332
“The next step in this line of research is to investigate systematically the efficacy of the smartphone apps relative to such a control [39].”
BackgroundExploratory randomized controlled trial evaluating the impact of a waiting list control design
Cunningham, J. A., Kypri, K., & McCambridge, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-150 · Cited by 321
“While there are ethical advantages to a waiting list design because it allows for the provision of care (if delayed) to research participants who are seeking help, whilst permitting a non-intervention evaluation, it has been noted that such designs may overestimate intervention effects [1-7].”
Psychological therapies for pathological and problem gambling
Cowlishaw, S., Merkouris, S., Dowling, N., Anderson, C., Jackson, A., & Thomas, S. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008937.pub2 · Cited by 321
Cognitive-Behavioral Therapy for Depression in Parkinson's Disease: A Randomized, Controlled Trial
Dobkin, R. D., Menza, M., Allen, L. A., Gara, M. A., Mark, M. H., Tiu, J., Bienfait, K. L., & Friedman, J. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111669 · Cited by 310
“, time, spontaneous remission, regression to the mean, history, effects of repeated testing) and are appropriate for use in early phase psychotherapy trials (23, 43), the role of non-specific factors, such as the increased attention and social contact received by the CBT group, cannot be adequately explored.”
The effects of fifteen evidence-supported therapies for adult depression: A meta-analytic review
Cuijpers, P., Karyotaki, E., de Wit, L., & Ebert, D. D. (2020) · Psychotherapy Research · doi:10.1080/10503307.2019.1649732 · Cited by 276
Black, C. J., Thakur, E. R., Houghton, L. A., Quigley, E. M. M., Moayyedi, P., & Ford, A. C. (2020) · Gut · doi:10.1136/gutjnl-2020-321191 · Cited by 299
Huang, J., Nigatu, Y. T., Smail-Crevier, R., Zhang, X., & Wang, J. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.09.018 · Cited by 256
Freedland, K. E., King, A. C., Ambrosius, W. T., Mayo-Wilson, E., Mohr, D. C., Czajkowski, S. M., Thabane, L., Collins, L. M., Rebok, G. W., Treweek, S. P., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.011 · Cited by 218
“[24] noted that stakeholder interests s hift across the phases of intervention research, and that this affects comparator choices.”
BackgroundInfluentialSelf-citationGold, S. M., Enck, P., Hasselmann, H., Friede, T., Hegerl, U., Mohr, D. C., & Otte, C. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30153-0 · Cited by 236
Self-citationNicolson, P. J. A., Bennell, K. L., Dobson, F. L., Van Ginckel, A., Holden, M. A., & Hinman, R. S. (2017) · British Journal of Sports Medicine · doi:10.1136/bjsports-2016-096458 · Cited by 209
Systematic review of the association between physical activity and burnout
Naczenski, L. M., de Vries, J. D., van Hooff, M. L. M., & Kompier, M. A. J. (2017) · Journal of Occupational Health · doi:10.1539/joh.17-0050-ra · Cited by 214
Methodological Recommendations for Trials of Psychological Interventions
Guidi, J., Brakemeier, E.-L., Bockting, C. L. H., Cosci, F., Cuijpers, P., Jarrett, R. B., Linden, M., Marks, I., Peretti, C. S., Rafanelli, C., et al. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000490574 · Cited by 205
Fiest, K. M., Walker, J. R., Bernstein, C. N., Graff, L. A., Zarychanski, R., Abou-Setta, A. M., Patten, S. B., Sareen, J., Bolton, J. M., Marriott, J. J., et al. (2016) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2015.10.004 · Cited by 198
“Waitlist control is an appropriate control for psychological trials, but it produces less change than pill placebo and treatment as usual (Mohr et al., 2009).”
Managing depression in older age: psychological interventions
Cuijpers, P., Karyotaki, E., Pot, A. M., Park, M., & Reynolds, C. F. (2014) · Maturitas · doi:10.1016/j.maturitas.2014.05.027 · Cited by 192
Melby-Lervåg, M., & Hulme, C. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0862-z · Cited by 189
Baumeister, H., Hutter, N., & Bengel, J. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008381.pub2 · Cited by 188
Egger, F., Benzing, V., Conzelmann, A., & Schmidt, M. (2019) · PLOS ONE · doi:10.1371/journal.pone.0212482 · Cited by 176
Was Eysenck right after all? A reassessment of the effects of psychotherapy for adult depression
Cuijpers, P., Karyotaki, E., Reijnders, M., & Ebert, D. D. (2019) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796018000057 · Cited by 173
“But studies with care-as-usual control groups have also problems, mainly because it can differ considerably what careas-usual means (Mohr et al. 2009; Gold et al. 2017).”
BackgroundA Systematic Review of Treatments for Anxiety in Youth with Autism Spectrum Disorders
Vasa, R. A., Carroll, L. M., Nozzolillo, A. A., Mahajan, R., Mazurek, M. O., Bennett, A. E., Wink, L. K., & Bernal, M. P. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2184-9 · Cited by 168
“In WL control studies, parents are equally likely to be affected by bias, particularly since they are not blind to treatment condition (Cunningham et al. 2013; Mohr et al. 2009).”
BackgroundBoyd, B. A., Hume, K., McBee, M. T., Alessandri, M., Gutierrez, A., Johnson, L., Sperry, L., & Odom, S. L. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-013-1877-9 · Cited by 166
“In treatment efficacy research, the control condition plays a large role in detecting between group differences (Mohr et al. 2009).”
BackgroundDetermining what works in the treatment of PTSD
Wampold, B. E., Imel, Z. E., Laska, K. M., Benish, S., Miller, S. D., Flűckiger, C., Del Re, A. C., Baardseth, T. P., & Budge, S. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.06.005 · Cited by 163
Josefsson, T., Ivarsson, A., Gustafsson, H., Stenling, A., Lindwall, M., Tornberg, R., & Böröy, J. (2019) · Mindfulness · doi:10.1007/s12671-019-01098-7 · Cited by 161
Priebe, S., Richardson, M., Cooney, M., Adedeji, O., & McCabe, R. (2011) · Psychotherapy and Psychosomatics · doi:10.1159/000320976 · Cited by 161
“One may also develop and test interventions compared to an appropriate control [”
BackgroundMeditation or exercise for preventing acute respiratory infection: a randomized controlled trial
Barrett, B., Hayney, M. S., Muller, D., Rakel, D., Ward, A., Obasi, C. N., Brown, R., Zhang, Z., Zgierska, A., Gern, J., et al. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1376 · Cited by 156
Sansom-Daly, U. M., Peate, M., Wakefield, C. E., Bryant, R. A., & Cohn, R. J. (2012) · Health Psychology · doi:10.1037/a0025977 · Cited by 157
Adamson, B., Ensari, I., & Motl, R. W. (2015) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2015.01.005 · Cited by 186
Chatterton, M. L., Stockings, E., Berk, M., Barendregt, J. J., Carter, R., & Mihalopoulos, C. (2017) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.116.195321 · Cited by 162
Mohr, D. C., Ho, J., Hart, T. L., Baron, K. G., Berendsen, M., Beckner, V., Cai, X., Cuijpers, P., Spring, B., Kinsinger, S. W., et al. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0262-3 · Cited by 139
Self-citationPsychological interventions for diabetes-related distress in adults with type 2 diabetes mellitus
Chew, B. H., Vos, R. C., Metzendorf, M.-I., Scholten, R. J., & Rutten, G. E. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011469.pub2 · Cited by 138
Bonnert, M., Olén, O., Lalouni, M., Benninga, M. A., Bottai, M., Engelbrektsson, J., Hedman‐Lagerlöf, E., Lenhard, F., Melin, B., Simrén, M., et al. (2016) · The American Journal of Gastroenterology · doi:10.1038/ajg.2016.503 · Cited by 147
Heitkemper, E. M., Mamykina, L., Travers, J., & Smaldone, A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx025 · Cited by 130
“When psychological or behavioral interventions are tested in RCTs, it is important to internal validity that the control group receive the same level of attention (attention control) as the intervention.(49) Therefore, we utilized the domain “other bias” to examine whether attention control conditions were provided.”
MethodCuijpers, P., Cristea, I. A., Ebert, D. D., Koot, H. M., Auerbach, R. P., Bruffaerts, R., & Kessler, R. C. (2016) · Depression and Anxiety · doi:10.1002/da.22461 · Cited by 137
“This finding remained significant in the multivariate metaregression analyses and is in line with previous metaanalyses.[28, 29] The results of this metaanalysis should be interpreted in the light of several limitations.”
BackgroundResultDlugonski, D., Motl, R. W., Mohr, D. C., & Sandroff, B. M. (2012) · Psychology, Health & Medicine · doi:10.1080/13548506.2011.652640 · Cited by 133
“We utilized a waitlist control as recommended for developmental trials (Mohr et al., 2009).”
MethodSelf-citationvan Luenen, S., Garnefski, N., Spinhoven, P., Spaan, P., Dusseldorp, E., & Kraaij, V. (2017) · AIDS and Behavior · doi:10.1007/s10461-017-1757-y · Cited by 145
“This is counterintuitive, since participants on a waiting list do not receive any treatment, which would lead us to expect large differences between the intervention and the control condition [106].”
BackgroundKing, A. C., Bickmore, T. W., Campero, M. I., Pruitt, L. A., & Yin, J. L. (2013) · Journal of Health Communication · doi:10.1080/10810730.2013.798374 · Cited by 114
“If this investigation indicated initial program efficacy, subsequent dismantling research could be undertaken to systematically examine different program components to further understand which adaptations may have had the greatest influence on intervention success (Czaja, Schulz, Lee, & Belle, for the REACH Investigat…”
BackgroundInfluentialHow to prove that your therapy is effective, even when it is not: a guideline
Cuijpers, P., & Cristea, I. A. (2016) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796015000864 · Cited by 122
“Several meta-analytic studies have shown that waiting list control groups result in much larger effects for the therapy than other control groups (Mohr et al. 2009, 2014; Barth et al. 2013; Furukawa et al. 2014).”
BackgroundFerguson, R. J., Sigmon, S. T., Pritchard, A. J., Labrie, S. L., Goetze, R. E., Fink, C. M., & Garrett, A. (2016) · Cancer · doi:10.1002/cncr.29891 · Cited by 113
Bishop, F. L., Fenge-Davies, A. L., Kirby, S., & Geraghty, A. W. A. (2015) · Psychology & Health · doi:10.1080/08870446.2014.953529 · Cited by 121
“…or harmful interventions), while early phase trials (phase I and II) designed to develop and pilot-test new interventions should not focus on internal validity as these trials are often small and might fail to detect a clinically meaningful effect (making a type II error) (Mohr et al., 2009).”
BackgroundInfluentialEnhancing social relationships through positive psychology activities: a randomised controlled trial
O’Connell, B. H., O’Shea, D., & Gallagher, S. (2016) · The Journal of Positive Psychology · doi:10.1080/17439760.2015.1037860 · Cited by 121
“Furthermore, the present study employed an ‘active’ control activity, addressing another frequent methodological concern of previous PPA research (Mohr et al., 2009; Parks, 2014).”
Hedman, E., Axelsson, E., Andersson, E., Lekander, M., & Ljótsson, B. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.181396 · Cited by 119
Guidi, J., Fava, G. A., Fava, M., & Papakostas, G. I. (2011) · Psychological Medicine · doi:10.1017/s0033291710000826 · Cited by 118
“Third, the use of control conditions (CM or TAU) also varied across the studies (Mohr et al. 2009).”
ResultBolier, L., Haverman, M., Kramer, J., Westerhof, G. J., Riper, H., Walburg, J. A., Boon, B., & Bohlmeijer, E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2603 · Cited by 116
“A waiting-list control group is ethically acceptable when there is no immediate risk or treatment indication [43], thus fitting the preventive nature of this study.”
Placebo effects in psychotherapy: a framework
Enck, P., & Zipfel, S. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00456 · Cited by 115
Johns, S. A., Brown, L. F., Beck-Coon, K., Talib, T. L., Monahan, P. O., Giesler, R. B., Tong, Y., Wilhelm, L., Carpenter, J. S., Von Ah, D., et al. (2016) · Supportive Care in Cancer · doi:10.1007/s00520-016-3220-4 · Cited by 112
“Because the impact of MBSR on CRF has already been evaluated using wait-list controls, a necessary step to establish the specific effects of MBSR [22] is to conduct a more rigorous trial comparing MBSR specifically targeting CRF to another active treatment.”
BackgroundSocially Assistive Robots as Mental Health Interventions for Children: A Scoping Review
Kabacińska, K., Prescott, T. J., & Robillard, J. M. (2021) · International Journal of Social Robotics · doi:10.1007/s12369-020-00679-0 · Cited by 113
“,[45]) allows for detecting a large effect size, which may be appropriate for preliminary studies with a small number of participants [67].”
BackgroundSommers‐Spijkerman, M., Trompetter, H. R., Schreurs, K. M. G., & Bohlmeijer, E. T. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000268 · Cited by 128
Sandroff, B. M., Johnson, C. L., & Motl, R. W. (2016) · Neuroradiology · doi:10.1007/s00234-016-1767-x · Cited by 115
“, reducing type II error), thus warranting further investigation [38].”
BackgroundPoisnel, G., Arenaza‐Urquijo, E., Collette, F., Klimecki, O. M., Marchant, N. L., Wirth, M., de La Sayette, V., Rauchs, G., Salmon, E., Vuilleumier, P., et al. (2018) · Alzheimer's & Dementia: Translational Research & Clinical Interventions · doi:10.1016/j.trci.2018.10.011 · Cited by 103
“A well-designed control should also include a rationale for the positive expectation for intervention success by both the teachers and participants [34].”
Campo, R. A., Agarwal, N., LaStayo, P. C., O’Connor, K., Pappas, L., Boucher, K. M., Gardner, J., Smith, S., Light, K. C., & Kinney, A. Y. (2014) · Journal of Cancer Survivorship · doi:10.1007/s11764-013-0315-5 · Cited by 102
“, physical activity) components of the Qigong intervention [40].”
BackgroundComparison of psychotherapies for adult depression to pill placebo control groups: a meta-analysis
Cuijpers, P. J., Turner, E. H., Mohr, D. C., Hofmann, S. G., Andersson, G., Berking, M., & Coyne, J. C. (2013) · Psychological Medicine · doi:10.1017/s0033291713000457 · Cited by 110
“Several more common options for control conditions exist, ranging from no treatment and waitlist controls, which may also lead to unblinding, to comparison conditions that control for the effects of nonspecific and specific treatment factors, which may limit unblinding of patients (Posternak & Zimmerman, 2007; Mohr et…”
BackgroundSelf-citationMaurer, L. F., Schneider, J., Miller, C. B., Espie, C. A., & Kyle, S. D. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101493 · Cited by 95
Training on Working Memory and Inhibitory Control in Young Adults
Maraver, M. J., Bajo, M. T., & Gomez-Ariza, C. J. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00588 · Cited by 96
“Finally, the presence and type of control groups is an essential requirement to dissociate the effectiveness of training (Mohr et al., 2009; Dougherty et al., 2016; Melby-Lervåg et al., 2016).”
BackgroundSosnoff, J. J., Finlayson, M. L., McAuley, E., Morrison, S., & Motl, R. W. (2013) · Clinical Rehabilitation · doi:10.1177/0269215513501092 · Cited by 99
Elsman, E. B. M., Baaj, M. A., van Rens, G. H. M. B., Sijbrandi, W., van den Broek, E. G. C., van der Aa, H. P. A., Schakel, W., Heymans, M. W., de Vries, R., Vervloed, M. P. J., et al. (2019) · Survey of Ophthalmology · doi:10.1016/j.survophthal.2019.01.010 · Cited by 121
Impact of Yoga on Inflammatory Biomarkers: A Systematic Review
Sass, D., Schulz, P., Berger, A. M., Case, A. J., Kupzyk, K. A., & Ross, A. C. (2018) · Biological Research For Nursing · doi:10.1177/1099800418820162 · Cited by 116
The use of waitlists as control conditions in anxiety disorders research
Patterson, B., Boyle, M. H., Kivlenieks, M., & Van Ameringen, M. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.08.015 · Cited by 94
Sansom-Daly, U. M., Wakefield, C. E., Bryant, R. A., Butow, P., Sawyer, S., Patterson, P., Anazodo, A., Thompson, K., & Cohn, R. J. (2012) · BMC Cancer · doi:10.1186/1471-2407-12-339 · Cited by 94
“However, the additional use of a non-specific treatment arm (the PSG) is now considered gold standard, as this arm holds constant the attention received by participants, amount of treatment contact and human interaction variables (such as clinician warmth and interaction between participants), and controls for partici…”
BackgroundDesign and Implementation of Clinical Trials in Rehabilitation Research
Hart, T., & Bagiella, E. (2012) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2011.11.039 · Cited by 108
Ebert, D., Tarnowski, T., Gollwitzer, M., Sieland, B., & Berking, M. (2013) · Psychotherapy and Psychosomatics · doi:10.1159/000345967 · Cited by 93
Fava, G. A., Guidi, J., Rafanelli, C., & Rickels, K. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000480038 · Cited by 93
Multimodal e-mental health treatment for depression: a feasibility trial
Mohr, D. C., Duffecy, J., Jin, L., Ludman, E. J., Lewis, A., Begale, M., & McCarthy Jr, M. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1370 · Cited by 82
“Because this is the first test of a novel intervention, a single arm trial testing feasibility rather than efficacy is an appropriate design [17].”
BackgroundSelf-citationBolinski, F., Boumparis, N., Kleiboer, A., Cuijpers, P., Ebert, D. D., & Riper, H. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100321 · Cited by 87
Matsumoto, K., Sutoh, C., Asano, K., Seki, Y., Urao, Y., Yokoo, M., Takanashi, R., Yoshida, T., Tanaka, M., Noguchi, R., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/12091 · Cited by 83
Geraedts, A. S., Kleiboer, A. M., Twisk, J., Wiezer, N. M., van Mechelen, W., & Cuijpers, P. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3539 · Cited by 89
“However, it is known that studies that use a waiting-list control comparator have a tendency to show stronger effect sizes of the intervention because they are less likely to positively affect the outcome compared with active control groups, such as CAU [39].”
Lalouni, M., Ljótsson, B., Bonnert, M., Ssegonja, R., Benninga, M., Bjureberg, J., Högström, J., Sahlin, H., Simrén, M., Feldman, I., et al. (2019) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2018.11.043 · Cited by 88
Parks, A. C., Williams, A. L., Tugade, M. M., Hokes, K. E., Honomichl, R. D., & Zilca, R. D. (2018) · International Journal of Wellbeing · doi:10.5502/ijw.v8i2.745 · Cited by 87
“In order to account for regression to the mean and expectation effects, it is important to evaluate active interventions against one or more comparison groups (Mohr et al., 2009).”
BackgroundLinden, M., Baumann, K., Lieberei, B., Lorenz, C., & Rotter, M. (2011) · Psychotherapy and Psychosomatics · doi:10.1159/000321580 · Cited by 102
“which have also been used in posttraumatic disorders and have some similarities to our approach.Nevertheless, referring to wisdom and the set of wisdom strategies like factual and procedural knowledge, long-term perspective, empathy with the offender and role change, emotional serenity, value relativism, etc., is a pr…”
Morina, N., Malek, M., Nickerson, A., & Bryant, R. A. (2017) · Depression and Anxiety · doi:10.1002/da.22618 · Cited by 85
“Put another way, there is convergent opinion that measuring an active treatment against a waitlist may inflate the effect size of the active treatment (Cunningham, Kypri, & McCambridge, 2013; Mohr et al., 2009).”
BackgroundTroeung, L., Egan, S. J., & Gasson, N. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-19 · Cited by 85
“However, it is generally sufficient to demonstrate efficacy against a non-active control in pilot studies [47].”
BackgroundCheung, J. M. Y., Jarrin, D. C., Ballot, O., Bharwani, A. A., & Morin, C. M. (2018) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2018.11.001 · Cited by 92
mHealth Interventions for Disadvantaged and Vulnerable People with Type 2 Diabetes
Mayberry, L. S., Lyles, C. R., Oldenburg, B. F., Osborn, C. Y., Parks, M., & Peek, M. E. (2019) · Current Diabetes Reports · doi:10.1007/s11892-019-1280-9 · Cited by 95
Dorrepaal, E., Thomaes, K., Smit, J. H., van Balkom, A. J. L. M., Veltman, D. J., Hoogendoorn, A. W., & Draijer, N. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000335044 · Cited by 82
Exercise to reduce work-related fatigue among employees: a randomized controlled trial
de Vries, J. D., van Hooff, M. L. M., Guerts, S. A., & Kompier, M. A. J. (2017) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.3634 · Cited by 114
“Future research may design the control group in a way to control for the factor attention (59, 60).”
Internet-Delivered Exposure Therapy for Fibromyalgia: A Randomized Controlled Trial
Hedman-Lagerlöf, M., Hedman-Lagerlöf, E., Axelsson, E., Ljótsson, B., Engelbrektsson, J., Hultkrantz, S., Lundbäck, K., Björkander, D., Wicksell, R. K., Flink, I., et al. (2018) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000566 · Cited by 79
Rogers, J. M., Foord, R., Stolwyk, R. J., Wong, D. K., & Wilson, P. H. (2018) · Neuropsychology Review · doi:10.1007/s11065-018-9378-4 · Cited by 100
Cognitive rehabilitation for people with mild to moderate dementia
Kudlicka, A., Martyr, A., Bahar‐Fuchs, A., Sabatés, J., Woods, B. T., & Clare, L. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013388.pub2 · Cited by 111
de Vries, J. D., van Hooff, M. L. M., Geurts, S. A. E., & Kompier, M. A. J. (2016) · PLoS ONE · doi:10.1371/journal.pone.0152137 · Cited by 98
“Despite the limitations associated with a wait list design, we believe the choice for such a design is justified, because it is suitable for a first evaluation of a novel intervention [76] and because a proven effective standard intervention to reduce studyrelated fatigue does not exist yet.”
BackgroundO’Connell, B. H., O’Shea, D. E., & Gallagher, S. M. (2017) · Journal of Clinical Psychology · doi:10.1002/jclp.22469 · Cited by 98
“However, despite their acceptance, the research underlying this evidence base has recently faced methodological critique due to poor experimental trial quality and insufficient control groups (Mohr et al., 2009; Parks, 2014) and reporting (Bolier et al.”
BackgroundGoldberg, S. B., Sun, S., Carlbring, P., & Torous, J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00923-7 · Cited by 75
Yu, D. S.-F., Li, P. W.-C., Lin, R. S.-Y., Kee, F., Chiu, A., & Wu, W. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104524 · Cited by 76
Lamers, F., Jonkers, C. C. M., Bosma, H., Kempen, G. I. J. M., Meijer, J. A. M. J., Penninx, B. W. J. H., Knottnerus, J. A., & van Eijk, J. T. M. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000313690 · Cited by 76
“These guidelines encompass regular check-ups of medical symptoms, but do not explicitly involve detection and treatment of depressive symptoms. Although usual-care treatment controls for many threats to internal validity, it can also bring potential problems, as pointed out by Mohr et al. [”
BackgroundMatos, M., Albuquerque, I., Galhardo, A. B., Cunha, M. I. V. A., de Lima, M. P., Palmeira, L., Petrocchi, N., McEwan, K., Maratos, F. A., & Gilbert, P. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263480 · Cited by 102
New Modalities of Assessment and Treatment Planning in Depression: The Sequential Approach
Fava, G. A., & Tomba, E. (2010) · CNS Drugs · doi:10.2165/11531580-000000000-00000 · Cited by 80
Wagner, L. I., Tooze, J. A., Hall, D. L., Levine, B. J., Beaumont, J., Duffecy, J., Victorson, D., Gradishar, W., Leach, J., Saphner, T., et al. (2021) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djab100 · Cited by 67
“Alternative attention control designs are needed (57).”
Self-citationPettman, D., O’Mahen, H., Blomberg, O., Svanberg, A. S., von Essén, L., & Woodford, J. (2023) · BMC Psychiatry · doi:10.1186/s12888-023-04547-9 · Cited by 125
“Comparators Eligible control conditions included: (1) no-treatment control; (2) wait-list control (WLC); (3) treatment-asusual (TAU); (4) non-specific factors component control; (5) specific factors component control; and (6) active comparator, based on standard definitions [58].”
MethodMichopoulos, I., Furukawa, T. A., Noma, H., Kishimoto, S., Onishi, A., Ostinelli, E. G., Ciharova, M., Miguel, C., Karyotaki, E., & Cuijpers, P. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.12.012 · Cited by 69
Sandroff, B. M., Balto, J. M., Klaren, R. E., Sommer, S., DeLuca, J., & Motl, R. W. (2016) · Neurocase · doi:10.1080/13554794.2016.1237658 · Cited by 72
“Preliminary findings from small, Phase I feasibility trials can provide critical information that a potential innovative treatment might be beneficial (i.e., reducing Type II error), thus warranting further investigation (Mohr et al., 2009).”
BackgroundWittenborn, A. K., Liu, T., Ridenour, T. A., Lachmar, E. M., Mitchell, E. A., & Seedall, R. B. (2018) · Journal of Marital and Family Therapy · doi:10.1111/jmft.12350 · Cited by 80
Metadata
- Authors
- Mohr, D. C., Spring, B., Freedland, K. E., Beckner, V., Arean, P., Hollon, S. D., Ockene, J., & Kaplan, R.
- Affiliations
- Northwestern University (US)
- Washington University in St. Louis (US)
- University of California, San Francisco (US)
- Vanderbilt University (US)
- University of Massachusetts Chan Medical School (US)
- University of California, Los Angeles (US)
- Venue
- Psychotherapy and Psychosomatics
- Publisher
- S. Karger AG
- Published
- 2009
- Volume
- 78
- Issue
- 5
- Pages
- 275-284
- ISSN
- 0033-3190 (ISSN-L)
- 1423-0348
- OpenAlex
- W1983555748
- Cited by
- 565
- References
- 44
- Citations by year
- 2026: 43 · 2025: 56 · 2024: 47 · 2023: 40 · 2022: 52 · 2021: 39 · 2020: 41 · 2019: 38 · 2018: 46 · 2017: 31 · 2016: 23 · 2015: 18 · 2014: 27 · 2013: 18 · 2012: 16
- FWCI
- 2.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Psychotherapy and Psychosomatics (publishedVersion)
- PubMed (publishedVersion)
- eScholarship@UMassChan (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- control conditions, randomized controlled trials, psychological intervention, internal validity, threats to validity, placebo comparison, waitlist control, evidence-based practice
- MeSH terms
- Mental Disorders, Humans, Research Design, Randomized Controlled Trials as Topic, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.