The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Open accessAbstract
OBJECTIVE: The authors conducted a meta-analytic review of adherence-outcome and competence-outcome findings, and examined plausible moderators of these relations. METHOD: A computerized search of the PsycINFO database was conducted. In addition, the reference sections of all obtained studies were examined for any additional relevant articles or review chapters. The literature search identified 36 studies that met the inclusion criteria. RESULTS: R-type effect size estimates were derived from 32 adherence-outcome and 17 competence-outcome findings. Neither the mean weighted adherence-outcome (r = .02) nor competence-outcome (r = .07) effect size estimates were found to be significantly different from zero. Significant heterogeneity was observed across both the adherence-outcome and competence-outcome effect size estimates, suggesting that the individual studies were not all drawn from the same population. Moderator analyses revealed that larger competence-outcome effect size estimates were associated with studies that either targeted depression or did not control for the influence of the therapeutic alliance. CONCLUSIONS: One explanation for these results is that, among the treatment modalities represented in this review, therapist adherence and competence play little role in determining symptom change. However, given the significant heterogeneity observed across findings, mean effect sizes must be interpreted with caution. Factors that may account for the nonsignificant adherence-outcome and competence-outcome findings reported within many of the studies reviewed are addressed. Finally, the implication of these results and directions for future process research are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In a meta-analysis of adherence and competence (55), effects were small (d50.04,n528 for adherence; d50.14, n518 for competence; see Figure 1).”
From How important are the common factors in psychotherapy? An update (2015) · cites this paper as [55]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In a meta-analysis of adherence and competence (55), effects were small (d50.04,n528 for adherence; d50.14, n518 for competence; see Figure 1).”
From How important are the common factors in psychotherapy? An update (2015) · cites this paper as [55]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literatures on measuring fidelity, learning, and homework compliance provide a foundation, but greater integration and precision (e.g., regarding timing, specific active elements, etc.) is needed (Stir man, 2020; Webb, DeRubeis, & Barber, 2010).”
From Measuring the active elements of cognitive-behavioral therapies (2023) · cites this paper as Webb, DeRubeis, & Barber, 2010
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“the average effect of the alliance is larger than the effects of other treatment variables such as therapist adherence to treatment manual or therapist competence (Webb et al., 2010).”
From Synchrony in Psychotherapy: A Review and an Integrative Framework for the Therapeutic Alliance (2016) · cites this paper as Webb et al., 2010
In the citing paper
“Results from meta-analyses of adherence-outcome and competence-outcome associations are mixed, with non-significant associations in adult samples (rs = .02 and .07, for adherence-outcome and competence-outcome, respectively64) and a small but significant effect for adherence-outcome (r = .10) but not competence-outcome (r = .02) in youth samples65.”
From A common factors perspective on mindfulness-based interventions (2022) · cites this paper as [64]
In the citing paper
“Potential explanations offered for this lack of association include unreliability in adherence and competence measures and range restriction (owing to selecting highly adherent and/or competent therapists to deliver treatments in research studies)64.”
From A common factors perspective on mindfulness-based interventions (2022) · cites this paper as [64]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
(2000) · Cited by 9,198
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348600 · Cited by 4,249
Editorial Office (1997) · Obesity Surgery · doi:10.1381/096089297765555359 · Cited by 3,941
Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355
Relation between working alliance and outcome in psychotherapy: A meta-analysis
Horvath, A. O., & Symonds, B. D. (1991) · Journal of Counseling Psychology · doi:10.1037/0022-0167.38.2.139 · Cited by 2,673
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442
Elkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
Journal of Psychotherapy Practice and Research
Terrell, C. D. (1993) · JAMA · doi:10.1001/jama.1993.03510010107047 · Cited by 1,686
Dimidjian, S., Hollon, S. D., Dobson, K. S., Schmaling, K. B., Kohlenberg, R. J., Addis, M. E., Gallop, R., McGlinchey, J. B., Markley, D. K., Gollan, J. K., et al. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.4.658 · Cited by 1,607 · cited 1×
“For example, in their randomized placebo-controlled trial, Dimidjian et al. (2006) used the Cognitive Therapy Scale (CTS; Young & Beck, 1980) to assess the competence with which their cognitive therapy condition was implemented.”
MethodTherapist success and its determinants.
Luborsky, L., Mclellan, A., Woody, G. E., O'Brien, C., & Auerbach, A. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790290084010 · Cited by 782
Predicting the effect of cognitive therapy for depression: A study of unique and common factors.
Castonguay, L. G., Goldfried, M. R., Wiser, S. L., Raue, P. J., & Hayes, A. M. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.3.497 · Cited by 713
Treatment integrity and therapeutic change: issues and research recommendations
Perepletchikova, F., & Kazdin, A. E. (2005) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpi045 · Cited by 638
The conceptualization and measurement of therapeutic alliance: An empirical review
Elvins, R., & Green, J. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2008.04.002 · Cited by 534
Handbook of Cognitive Behavioural Therapies
Dobson, K. S. (1988) · Medical Entomology and Zoology · Cited by 515
Responsiveness in psychotherapy.
Stiles, W. B., Honos‐Webb, L., & Surko, M. (1998) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1998.tb00166.x · Cited by 473
Determinants of change in cognitive therapy for depression
DeRubeis, R. J., & Feeley, M. (1990) · Cognitive Therapy and Research · doi:10.1007/bf01172968 · Cited by 401
Self-citationFeeley, M., DeRubeis, R. J., & Gelfand, L. A. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.4.578 · Cited by 349
Self-citationTherapist competence ratings in relation to clinical outcome in cognitive therapy of depression.
Shaw, B. F., Elkin, I., Yamaguchi, J., Olmsted, M. P., Vallis, M., Dobson, K. S., Lowery, A., Sotsky, S. M., Watkins, J. T., & Imber, S. D. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.6.837 · Cited by 306
Hogue, A., Henderson, C. E., Dauber, S., Barajas, P. C., Fried, A., & Liddle, H. A. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.4.544 · Cited by 284 · cited 2×
“Furthermore, findings from a few of the studies reviewed (e.g., Barber et al, 2006, 2008; Hogue et al., 2008; Piper et al., 1991) suggest that, at least in some contexts, the relation between adherence or competence and outcome may be nonlinear (e.g., quadratic).”
BackgroundPiper, W. E. (1991) · Archives of General Psychiatry · doi:10.1001/archpsyc.1991.01810340078010 · Cited by 273
Barber, J. P., Gallop, R., Crits-Christoph, P. F., Frank, A. F., Thase, M. E., Weiss, R. D., & Gibbons, M. B. C. (2006) · Psychotherapy Research · doi:10.1080/10503300500288951 · Cited by 222
Self-citationThe accuracy of therapists' interpretations and the outcome of dynamic psychotherapy.
Crits-Christoph, P. F., Cooper, A. A., & Luborsky, L. B. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.56.4.490 · Cited by 221
Transference interpretations in dynamic psychotherapy: do they really yield sustained effects?
Høglend, P., Bøgwald, K., Amlo, S., Marble, A., Ulberg, R., Sjaastad, M., Sørbye, O., Heyerdahl, O., & Johansson, P. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.07061028 · Cited by 218
Effects of therapist adherence and competence on patient outcome in brief dynamic therapy.
Barber, J. P., Crits-Christoph, P. F., & Luborsky, L. B. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.64.3.619 · Cited by 217
Self-citationBrief Psychotherapy of Bereavement Reactions
Horowitz, M. J. (1984) · Archives of General Psychiatry · doi:10.1001/archpsyc.1984.01790160024002 · Cited by 208
Hill, C. E., O'Grady, K. E., & Elkin, I. (1992) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.60.1.73 · Cited by 190
Toward a working through of some core conflicts in psychotherapy research
Barber, J. P. (2009) · Psychotherapy Research · doi:10.1080/10503300802609680 · Cited by 183
Self-citationAre all psychotherapies equivalent
Stiles, W. B., Shapiro, D., & Elliott, R. (1986) · American Psychologist · doi:10.1037//0003-066x.41.2.165 · Cited by 178
Strunk, D. R., Brotman, M. A., & DeRubeis, R. J. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.03.011 · Cited by 169
Self-citationGaston, L., Thompson, L. W., Gallagher-Thompson, D. E., Cournoyer, L., & Gagnon, R. (1998) · Psychotherapy Research · doi:10.1093/ptr/8.2.190 · Cited by 149
Sharpless, B. A., & Barber, J. P. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2008.09.008 · Cited by 147
Self-citationLoeb, K. L., Wilson, G. T., Labouvie, E. W., Pratt, E. M., Hayaki, J., Walsh, B. T., Agras, W. S., & Fairburn, C. G. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.6.1097 · Cited by 139
Empirical studies of psychoanalytical theories
Masling, J. M. (1983) · Medical Entomology and Zoology · Cited by 135
Therapist Competence and Outcome of Cognitive Therapy for Depression
Trepka, C., Rees, A., Shapiro, D. A., Hardy, G. E., & Barkham, M. (2004) · Cognitive Therapy and Research · doi:10.1023/b:cotr.0000021536.39173.66 · Cited by 134
Prediction of outcome of brief psychotherapy from therapist interpretive interventions.
Marziali, E. (1984) · Archives of General Psychiatry · doi:10.1001/archpsyc.1984.01790140091011 · Cited by 108
Contribution of the therapeutic alliance to outcome in active versus control psychotherapies.
Carroll, K. M., Nich, C., & Rounsaville, B. J. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.65.3.510 · Cited by 95
Therapist Competence, Comorbidity and Cognitive-Behavioral Therapy for Depression
Kuyken, W., & Tsivrikos, D. (2008) · Psychotherapy and Psychosomatics · doi:10.1159/000172619 · Cited by 90
Handbook of cognitive-behavioral therapies, 3rd ed.
Dobson, K. S., & Dozois, D. J. A. (2010) · Cited by 87
Negative factors in brief psychotherapy: An empirical assessment.
Sachs, J. S. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.4.557 · Cited by 81
Therapist competence and patient outcome in interpersonal psychotherapy of depression.
O’Malley, S. S., Foley, S. H., Rounsaville, B. J., Watkins, J. T., Sotsky, S. M., Imber, S. D., & Elkin, I. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.4.496 · Cited by 80
Castonguay, L. (1993) · Journal of Psychotherapy Integration · doi:10.1037/h0101171 · Cited by 79
Huppert, J., Barlow, D., Gorman, J., Shear, M., & Woods, S. (2006) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2005.10.001 · Cited by 77
Measuring therapist technique in psychodynamic psychotherapies. Development and use of a new scale.
Ogrodniczuk, J. S., & Piper, W. E. (1999) · PubMed Central · Cited by 76
Strengthening research methodology: Psychological measurement and evaluation.
(2006) · American Psychological Association eBooks · doi:10.1037/11384-000 · Cited by 71
Piper, W. E., Debbané, E. G., Bienvenu, J., de Carufel, F., & Garant, J. (1986) · British Journal of Medical Psychology · doi:10.1111/j.2044-8341.1986.tb02659.x · Cited by 66
Barber, J., Gallop, R., Crits-Christoph, P., Barrett, M. S., Klostermann, S., McCarthy, K., & Sharpless, B. A. (2008) · Psychoanalytic Psychology · doi:10.1037/0736-9735.25.3.461 · Cited by 58
Self-citationPreliminary results on the inventory of therapeutic strategies.
Gaston, L., & Ring, J. M. (1992) · PubMed · Cited by 55
Alliance and Technique for Predicting Outcome in Short-and Long-Term Analytic Psychotherapy
Gaston, L., Piper, W. E., Debbané, E. G., Bienvenu, J., & Garant, J. (1994) · Psychotherapy Research · doi:10.1080/10503309412331333952 · Cited by 55
Kazdin, A. E. (2006) · American Psychological Association eBooks · doi:10.1037/11384-005 · Cited by 50
Svartberg, M., & Stiles, T. C. (1994) · Psychotherapy Research · doi:10.1080/10503309412331333872 · Cited by 45
Martin, A., Weisenfeld, U., & Bekmeier‐Feuerhahn, S. (2009) · management revue · doi:10.5771/0935-9915-2009-2-117 · Cited by 44
Martin, A., Weisenfeld, U., & Bekmeier‐Feuerhahn, S. (2009) · Econstor (Econstor) · doi:10.1688/1861-9908_mrev_2009_02_martin_etal · Cited by 43
The Influence of Therapist Adherence and Competence on Client Reprocessing of Child Abuse Memories.
Paivio, S. C., Holowaty, K. A. M., & Hall, I. E. (2004) · Psychotherapy · doi:10.1037/0033-3204.41.1.56 · Cited by 42
Svartberg, M., & Stiles, T. C. (1992) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.60.2.304 · Cited by 41
Advanced Methods in Meta-Analytic Research
Rosenthal, D. A., Hoyt, W. T., Ferrin, J. M., Miller, S. M., & Cohen, N. D. (2006) · Rehabilitation Counseling Bulletin · doi:10.1177/00343552060490040501 · Cited by 31
Hoffart, A., Sexton, H. C., Nordahl, H. M., & Stiles, T. C. (2005) · Psychotherapy Research · doi:10.1080/10503300500091702 · Cited by 26
Supportive-expressive psychodynamic therapy for cocaine dependence: A closer look.
Crits-Christoph, P. F., Gibbons, M. B. C., Gallop, R., Ring‐Kurtz, S., Barber, J. P., Worley, M. J., Present, J., & Hearon, B. A. (2008) · Psychoanalytic Psychology · doi:10.1037/0736-9735.25.3.483 · Cited by 22
Self-citationBarber, J. P., Gallop, R., Crits-Christoph, P. F., Frank, A. F., Thase, M. E., Weiss, R. D., & Gibbons, M. B. C. (2006) · Cited by 21
Self-citationAlliance predicts patients' outcome beyond in-treatment change in symptoms.
Barber, J. P., Connolly, M. B., Crits-Christoph, P., Gladis, L., & Siqueland, L. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.6.1027 · Cited by 8
Self-citationMinonne, G. (2008) · Deep Blue (University of Michigan) · Cited by 7
Ogrodniczuk, J. S. (1997) · Library and Archives Canada (Government of Canada) · doi:10.7939/r31c1tm9p · Cited by 2
Flagged first, then by citations
Research works printed but not linked: 3
- *Hall IE Therapist adherence and technical skills in two versions of emotion-focused trauma therapy 2007 University of Windsor Windsor, Ontario, Canada Unpublished doctoral dissertation
- Hedges LV Olkin I Statistical methods for meta-analysis 1985 Academic Press Orlando, FL
- *Spektor D Therapists’ adherence to manualized treatments in the context of ruptures (Doctoral dissertation) 2008 Available from ProQuest Dissertations and These database. (UMI No. 3333897)
Cited by
Sorted by citations
How important are the common factors in psychotherapy? An update
Wampold, B. E. (2015) · World Psychiatry · doi:10.1002/wps.20238 · Cited by 1,728
Psychological Treatments for the World: Lessons from Low- and Middle-Income Countries
Singla, D. R., Kohrt, B. A., Murray, L. K., Anand, A., Chorpita, B. F., & Patel, V. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045217 · Cited by 913
How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis.
Flückiger, C., Del Re, A. C., Wampold, B. E., Symonds, D., & Horvath, A. O. (2012) · Journal of Counseling Psychology · doi:10.1037/a0025749 · Cited by 576
Synchrony in Psychotherapy: A Review and an Integrative Framework for the Therapeutic Alliance
Koole, S. L., & Tschacher, W. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00862 · Cited by 456
“Moreover, the average effect of the alliance is larger than the effects of other treatment variables such as therapist adherence to treatment manual or therapist competence (Webb et al., 2010).”
BackgroundExpanding the lens of evidence-based practice in psychotherapy: A common factors perspective.
Laska, K. M., Gurman, A. S., & Wampold, B. E. (2014) · Psychotherapy · doi:10.1037/a0034332 · Cited by 443
Metadata
- Authors
- Webb, C. A., DeRubeis, R. J., & Barber, J. P.
- Affiliations
- University of Pennsylvania (US)
- Philadelphia VA Medical Center (US)
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2010
- Volume
- 78
- Issue
- 2
- Pages
- 200-211
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- PMC
- PMC4246504
- OpenAlex
- W2081283342
- Cited by
- 657
- References
- 66
- Citations by year
- 2026: 21 · 2025: 21 · 2024: 31 · 2023: 37 · 2022: 27 · 2021: 68 · 2020: 40 · 2019: 54 · 2018: 64 · 2017: 47 · 2016: 38 · 2015: 52 · 2014: 44 · 2013: 49 · 2012: 30
- FWCI
- 39.60
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (MH60998 (R01), MH061410 (R01))
- Social Sciences and Humanities Research Council of Canada
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Social Sciences › Psychology › Clinical Psychology › Counseling, Therapy, and Family Dynamics
- Keywords
- therapist adherence, therapist competence, treatment outcomes, therapeutic relationship, depression treatment, process research, symptom change, moderators of treatment outcome
- MeSH terms
- Mental Disorders, Clinical Competence, Humans, Guideline Adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
