Research Setting Versus Clinic Setting: Which Produces Better Outcomes in Cognitive Therapy for Depression?
Open accessAbstract
Objective To compare the outcomes of cognitive therapy for depression under controlled and clinically representative conditions, while holding several therapist and clinical assessment factors constant. Method Treatment outcomes for a sample of 23 adults with a primary diagnosis of Major Depressive Disorder who received cognitive therapy in an outpatient clinic were compared with outcomes of 18 clients who were treated in the cognitive therapy condition of a large, multi-site randomized clinical trial of treatments for depression. All participants had been treated by one of two therapists who served as clinicians in both settings. Individuals in the two samples were diagnostically and demographically similar (approximately 50% Female, 83% White). A variety of client characteristics, assessed prior to treatment, as well as the outcomes of treatment, were examined. Results Significantly superior treatment outcomes were observed in the individuals treated in the research study, relative to clients in the outpatient clinic, and the difference was not accounted for by intake characteristics. Individuals treated by the therapists in the RCT experienced almost three times as much improvement in depressive symptoms as clients seen in the outpatient setting. Conclusions If replicated, the findings suggest that differences exist between treatment outcomes in research and outpatient settings and that these differences may not simply be due to therapist experience and training, or differences in patient populations. Future research should further examine the impact of fidelity monitoring, treatment expectation and motivation, and the duration and timing of treatment protocols on clinical outcomes.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Patients in real-world settings present with greater symptom severity, complexity and diversity than is often observed among patients in early phase randomized controlled trials.
“Evaluations in such real‐world settings are, however, essential because patients are known to present with greater symptom severity, complexity and diversity than is often observed among patients in early phase RCTs (Gibbons et al., 2013).”
From Five-year observational study of Internet-delivered cognitive behavioural pain management when offered as routine care by an online therapy clinic (2022) · cites this paper as Gibbons et al., 2013
The Results report more Axis II comorbidity in the clinic sample (74% versus 39%), supporting greater complexity in that comparison. They do not support greater symptom severity: mean intake depression scores did not differ significantly and were numerically higher in the RCT sample. The paper also does not establish the broader claim about patient diversity across real-world settings and early-phase RCTs. (LLM, conf=0.90)
Experimental — accuracy not yet measuredTherapist drift occurs less in the context of a closely monitored intervention.
“However, such drift occurs less in the context of a closely monitored intervention, as shown by Gibbons et al . (2013).”
From Supervisor practice when guiding therapists working with depression: The impact of supervisor and patient characteristics (2018) · cites this paper as Gibbons et al ., 2013
The Discussion suggests that therapists may have been less adherent to cognitive therapy protocols when they were not closely supervised or monitored. But it says the clinic collected no fidelity data, so the study could not determine whether adherence differed. The claim presents a plausible explanation as a demonstrated finding. (LLM, conf=0.88)
Experimental — accuracy not yet measuredPatient complexity does not fully explain differences in outcome between RCTs and routine practice.
“However, this is not a complete explanation, as patient complexity does not fully explain differences in outcome between RCTs and routine practice (e.g. Gibbons et al ., 2013; Weisz et al ., 2006).”
From Supervisor practice when guiding therapists working with depression: The impact of supervisor and patient characteristics (2018) · cites this paper as Gibbons et al ., 2013
The Discussion (page not provided) reports that controlling for Axis II comorbidity did not appear to account for the outcome differences between the research and clinic samples. That supports the claim's central point, but the paper treats the explanation as tentative and limits its comparison to one research sample, one outpatient sample, and one disorder; the citing sentence states the conclusion more generally and definitively. (LLM, conf=0.84)
Experimental — accuracy not yet measuredRCT supervision seems to differ from supervision in clinical practice.
“Although supervision in RCT settings has not been directly compared with supervision in clinical settings, RCT supervision seems to differ from supervision in clinical practice.”
From Supervisor practice when guiding therapists working with depression: The impact of supervisor and patient characteristics (2018) · cites this paper as Gibbons et al ., 2013
Clinical improvement and recovery rates for patients with depression in routine clinical settings are not always as high as in RCTs.
“Unfortunately, clinical improvement and recovery rates for patients with depression in routine clinical settings are not always as high as in RCTs.”
From Supervisor practice when guiding therapists working with depression: The impact of supervisor and patient characteristics (2018) · cites this paper as Gibbons et al ., 2013
Patients with depression treated in RCT settings have almost three times as much symptom improvement as those treated in an outpatient setting.
“Those treated in RCT settings have been found to have almost three times as much symptom improvement as those treated in an outpatient setting (Gibbons et al ., 2013).”
From Supervisor practice when guiding therapists working with depression: The impact of supervisor and patient characteristics (2018) · cites this paper as Gibbons et al ., 2013
RCT clinicians receive closer, more structured supervision.
“RCT clinicians receive closer, more structured supervision (Gibbons et al ., 2013; Roth et al ., 2010; Tracey et al ., 2012).”
From Supervisor practice when guiding therapists working with depression: The impact of supervisor and patient characteristics (2018) · cites this paper as Gibbons et al ., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · see citing works
Cognitive Therapy for Depression
(2012) · PsycEXTRA Dataset · doi:10.1037/e675542012-001 · Cited by 9,678 · see citing works
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771 · see citing works
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · see citing works
Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients
Beck, A. T., Steer, R. A., Ball, R., & Ranieri, W. F. (1996) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6703_13 · Cited by 5,965 · see citing works
Self-citationCognitive Therapy of Depression
HOLLON, S. D., & BECK, A. T. (1979) · Cognitive-Behavioral Interventions · doi:10.1016/b978-0-12-404480-7.50012-5 · Cited by 4,685 · see citing works
Self-citationElkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300 · see citing works
Cognitive Therapy: Basics and Beyond
Beck, J. S. (1995) · Medical Entomology and Zoology · Cited by 2,208 · see citing works
Cognitive therapy of personality disorders
(1991) · Choice Reviews Online · doi:10.5860/choice.28-2993 · Cited by 1,770 · see citing works
Cognitive Therapy: Basics and Beyond
Blair, D. T. (1996) · Journal of Psychosocial Nursing and Mental Health Services · doi:10.3928/0279-3695-19961101-24 · Cited by 1,588 · see citing works
A psychometric evaluation of the Beck Depression Inventory–II.
Dozois, D. J. A., Dobson, K. S., & Ahnberg, J. L. (1998) · Psychological Assessment · doi:10.1037/1040-3590.10.2.83 · Cited by 1,517 · see citing works
Lobbestael, J., Leurgans, M., & Arntz, A. (2011) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.693 · Cited by 1,124 · see citing works
Kazdin, A. E. (2008) · American Psychologist · doi:10.1037/0003-066x.63.3.146 · Cited by 1,112 · see citing works
Cognitive Therapy vs Medications in the Treatment of Moderate to Severe Depression
DeRubeis, R. J., Hollon, S. D., Amsterdam, J. D., Shelton, R. C., Young, P. R., Salomon, R. M., O’Reardon, J. P., Lovett, M. L., Gladis, M. M., Brown, L. L., et al. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.4.409 · Cited by 989 · see citing works
Self-citationJacobson, N. S., Roberts, L. J., Berns, S. B., & McGlinchey, J. B. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.3.300 · Cited by 853 · see citing works
Jacobson, N. S., Roberts, L. J., Berns, S. B., & McGlinchey, J. B. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.3.300 · Cited by 853 · see citing works
The Current State of Cognitive Therapy: A 40-Year Retrospective
Beck, A. T. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.9.953 · Cited by 816 · see citing works
Self-citation(2004) · Cited by 780 · see citing works
Journal of Consulting and Clinical Psychology
Rice, T. K., & Wallace, D. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese1296 · Cited by 593 · see citing works
Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.671 · Cited by 560 · see citing works
Leichsenring, F., & Leibing, E. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.7.1223 · Cited by 546 · see citing works
Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.829 · Cited by 533 · see citing works
Leichsenring, F., Rabung, S., & Leibing, E. (2004) · Archives of General Psychiatry · doi:10.1001/archpsyc.61.12.1208 · Cited by 513 · see citing works
Stewart, R. E., & Chambless, D. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016032 · Cited by 483 · see citing works
Cognitive Therapy and Pharmacotherapy for Depression: Singly and in Combination
Hollon, S. D. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820100018004 · Cited by 481 · cited 1× · see citing works
“The efficacy of cognitive therapy for depression has been supported in several clinical trials (Elkin et al. 1989; Hollon et al. 1992; Murphy et al. 1984).”
MethodLambert, M. (2007) · Psychotherapy Research · doi:10.1080/10503300601032506 · Cited by 461 · cited 1× · see citing works
“Additionally, clinicians may have worked more effectively with research clients whose outcomes were being systematically monitored (Lambert 2007) through the RCT.”
BackgroundCognitive Therapy and Pharmacotherapy
Murphy, G. E. (1984) · Archives of General Psychiatry · doi:10.1001/archpsyc.1984.01790120037006 · Cited by 438 · see citing works
The effects of psychological therapies under clinically representative conditions: a meta-analysis
Shadish, W. R., Navarro, A. M., Matt, G. E., & Phillips, G. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.4.512 · Cited by 381 · see citing works
Westbrook, D., & Kirk, J. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.09.006 · Cited by 183 · see citing works
Hunsley, J. D., & Lee, C. M. (2007) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.38.1.21 · Cited by 164 · see citing works
Fisher, W. H. (2008) · Psychiatric Services · doi:10.1176/appi.ps.59.5.579 · Cited by 147 · see citing works
Therapist competence in cognitive therapy for depression: Predicting subsequent symptom change.
Strunk, D. R., Brotman, M. A., DeRubeis, R. J., & Hollon, S. D. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019631 · Cited by 128 · see citing works
Self-citationAcceleration of changes in session impact during contrasting time-limited psychotherapies.
Reynolds, S. A., Stiles, W. B., Barkham, M., Shapiro, D. A., Hardy, G. E., & Rees, A. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.64.3.577 · Cited by 90 · see citing works
Cognitive therapy and pharmacotherapy
Murphy, G. E., Simons, A. D., Wetzel, R. D., & Lustman, P. J. (1984) · Journal of Clinical Psychopharmacology · doi:10.1097/00004714-198406000-00029 · Cited by 88 · see citing works
Strunk, D. R., Cooper, A. A., Ryan, E. T., DeRubeis, R. J., & Hollon, S. D. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0029281 · Cited by 77 · see citing works
Self-citationAcceleration of changes in session impact during contrasting time-limited psychotherapies.
Reynolds, S. A., Stiles, W. B., Barkham, M., et al. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.3.577 · Cited by 58 · see citing works
The clinical effectiveness of cognitive therapy for depression in an outpatient clinic
Gibbons, C. J., Fournier, J. C., Stirman, S. W., DeRubeis, R. J., Crits-Christoph, P., & Beck, A. T. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.12.030 · Cited by 46 · see citing works
Self-citationCombining Cognitive Therapy and Medication for Mood Disorders
(2006) · Psychiatric Annals · doi:10.3928/00485713-20060501-01 · Cited by 28 · see citing works
Selecting, Training, and Supervising Therapists
Newman, C. F., & Beck, J. S. (2007) · Oxford University Press eBooks · doi:10.1093/med:psych/9780195304633.003.0012 · Cited by 5 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Johnsen, T. J., & Friborg, O. (2015) · Psychological Bulletin · doi:10.1037/bul0000015 · Cited by 331 · see citing works
Waller, G., & Turner, H. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.12.005 · Cited by 256 · see citing works
Empirically Supported Treatment: Recommendations for a New Model
Tolin, D. F., McKay, D., Forman, E. M., Klonsky, E. D., & Thombs, B. D. (2015) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12122 · Cited by 219 · see citing works
Empirically supported treatment: Recommendations for a new model.
Tolin, D. F., McKay, D., Forman, E. M., Klonsky, E. D., & Thombs, B. D. (2015) · Clinical Psychology Science and Practice · doi:10.1037/h0101729 · Cited by 79 · see citing works
Facets of clinicians' anxiety and the delivery of cognitive behavioral therapy
Levita, L., Salas Duhne, P. G., Girling, C., & Waller, G. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.12.015 · Cited by 34 · see citing works
White, E. K., Groeneveld, K. M., Tittle, R. K., Bolhuis, N. A., Martin, R., Royer, T. G., & Fotuhi, M. (2017) · NeuroRegulation · doi:10.15540/nr.4.1.37 · Cited by 42 · see citing works
Peynenburg, V. A., Hadjistavropoulos, H. D., Thiessen, D., Titov, N., & Dear, B. F. (2022) · Journal of Medical Internet Research · doi:10.2196/40637 · Cited by 21 · see citing works
Hadjistavropoulos, H. D., Peynenburg, V., Thiessen, D., Schneider, L. H., Nugent, M., Wilhelms, A., Karin, E., Titov, N., & Dear, B. F. (2022) · European Journal of Pain · doi:10.1002/ejp.1866 · Cited by 16 · see citing works
“Despite the encouraging evidence from RCTs, there have been no large- scale reports of Internet- delivered cognitive behavioural PMPs when offered on a routine basis (Buhrman et al., 2016).”
BackgroundInfluentialAndersson, E., Ljótsson, B., Hedman-Lagerlöf, M., Nygren, L., Persson, M., Rosengren, K., Gezelius, A., Andersson, L., Sundquist, T., Ivanov, V. Z., et al. (2021) · Psychological Medicine · doi:10.1017/s0033291720000781 · Cited by 10 · see citing works
Simpson‐Southward, C., Waller, G., & Hardy, G. E. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.11.013 · Cited by 10 · see citing works
Provision of Care by “Real World” Telemental Health Providers
Bunnell, B. E., Kazantzis, N., Paige, S. R., Barrera, J. F., Thakkar, R. N., Turner, D., & Welch, B. M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.653652 · Cited by 9 · see citing works
Simpson-Southward, C., Waller, G., & Hardy, G. (2018) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x18000089 · Cited by 6 · see citing works
Keane, I., & Smout, M. (2024) · Australian Psychologist · doi:10.1080/00050067.2024.2415066 · Cited by 1 · see citing works
King, D., & Wanigarathna, N. (2024) · Studies in systems, decision and control · doi:10.1007/978-3-031-63402-4_9 · Cited by 1 · see citing works
Peynenburg, V. A., Hadjistavropoulos, H. D., Thiessen, D., Titov, N., & Dear, B. F. (2022) · doi:10.2196/preprints.40637
- Authors
- Gibbons, C. R., Wiltsey Stirman, S., DeRubeis, R. J., Newman, C. F., & Beck, A. T.
- Affiliations
- University of Pennsylvania (US)
- Venue
- Cognitive Therapy and Research
- Published
- 2012-11-13
- Volume
- 37
- Issue
- 3
- Pages
- 605-612
- ISSN
- 0147-5916 (ISSN-L)
- 1573-2819
- PMC
- PMC3661278
- OpenAlex
- W2001316200
- Cited by
- 15
- References
- 40
- Citations by year
- 2024: 2 · 2022: 2 · 2021: 2 · 2020: 1 · 2018: 1 · 2017: 1 · 2015: 6
- FWCI
- 2.18
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Cognitive Therapy and Research (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R00MH080100, R37MH047383, R10MH055875, R25MH080916)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Psychological Treatments and Assessments
- Keywords
- cognitive therapy, depression, major depressive disorder, outpatient clinics, treatment outcomes, randomized controlled trials, therapist experience, fidelity monitoring, treatment expectations, treatment motivation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review