The global therapist competence scale for youth psychosocial treatment: Development and initial validation
Abstract
Objective: We describe the development and initial psychometric properties of the observer‐rated Global Therapist Competence Scale for Youth Psychosocial Treatment (G‐COMP) in the context of cognitive‐behavioral treatment (CBT) for youth anxiety disorders. Method: Independent coders rated 744 sessions from a sample of 68 youth (mean age = 10.56 years) using the G‐COMP and the instruments of alliance, involvement, CBT adherence, CBT competence. Results: Inter‐rater reliability coefficients, ICC(2,2), were greater than .60 for the 5 G‐COMP domain scores. G‐COMP scores yielded small to medium correlations with instruments of alliance (r s = .17–.44) and youth involvement in treatment (r s = .08–.53), and medium to large correlations with instruments of CBT competence and adherence (r s = .26–.63). Therapists in the research setting were rated higher compared to newly trained therapists in community clinics. Conclusion: Preliminary reliability and validity of the G‐COMP are promising, but future research is needed with non‐CBT samples.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A measure of general therapy competence that has been used with Coping Cat will be included to help assess the quality of treatment delivery, including exposure practices.
“We will also include a measure of general therapy competence that has been used with Coping Cat and can help assess the quality of treatment delivery, including exposure practices [185].”
From A Sequential Multiple Assignment Randomized Trial (SMART) study of medication and CBT sequencing in the treatment of pediatric anxiety disorders (2021) · cites this paper as [185]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 23,433 · see citing works
Alliance in individual psychotherapy
Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011) · Psychotherapy · doi:10.1037/a0022186 · Cited by 2,072 · see citing works
Constantino, M. J., Arnkoff, D. B., Glass, C. R., Ametrano, R. M., & Smith, J. Z. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20754 · Cited by 367 · see citing works
Relation of the alliance with outcomes in youth psychotherapy: a meta-analysis
McLeod, B. D. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.02.001 · Cited by 301 · see citing works
Self-citationAssessing fidelity in individual and family therapy for adolescent substance abuse
Hogue, A., Dauber, S., Chinchilla, P., Fried, A., Henderson, C., Inclan, J., Reiner, R. H., & Liddle, H. A. (2008) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2007.09.002 · Cited by 78 · see citing works
Flagged first, then by citations
Research works printed but not linked: 52
- Accurso EC, Hawley KM, & Garland AF (2013). Psychometric properties of the therapeutic alliance scale for caregivers and parents. Psychological Assessment, 25, 244– 252. 23088205 PMC3647370
- American Psychiatric Association. (1994). Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition Washington, American Psychological Association.
- Arnkoff D, Glass C, & Shapiro S (2002). Expectations and preferences In Norcross JC (Ed.), Psychotherapy relationships that work: Therapist contributions and responsiveness to patients (pp. 335– 356): London: Oxford University Press.
- Barber JP, Foltz C, Crits-Christoph P, & Chittams J (2004). Therapists’ adherence and competence and treatment discrimination in the NIDA Collaborative Cocaine Treatment Study. Journal of Clinical Psychology, 60, 29– 41. 14692007
- Barber JP, Gallop R, Crits-Christoph P, Frank A, Thase ME Weiss RD, (2006). The role of therapist adherence, therapist competence, and alliance in predicting outcome of individual drug counseling: Results from the National Institute Drug Abuse Collaborative Cocaine Treatment Study. Psychotherapy Research, 16(2), 229– 240.
- Barber JP, Sharpless BA, Klostermann S, & McCarthy KS (2007). Assessing intervention competence and its relation to therapy outcome: A selected review derived from the outcome literature. Professional Psychology: Research and Practice, 38, 493– 500.
- Bordin ES (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, research & practice, 16(3), 252.
- Boswell JF, Gallagher MW, Sauer-Zavala SE, Bullis J, Jack M, Shear MK, … York N (2013). Patient characteristics and variability in adherence and competence in cognitive-behavioral therapy for panic disorder. Journal of Consulting & Clinical Psychology, 81, 443– 454. 23339537 PMC3855020
- Carroll KM, Nich C, Sifry RL, Nuro KF, Frankforter TL, Ball SA, … Rounsaville BJ (2000). A general system for evaluating therapist adherence and competence in psychotherapy research in the addictions. Drug and Alcohol Dependence, 57, 225– 238. 10661673
- Castonguay LG (1993). ‘Common factors’ and ‘nonspecific variables’: Clarification of the two concepts and recommendations for research. Journal of Psychotherapy Integration, 3, 267– 286.
- Castonguay LG, & Beutler LE (2006). Principles of therapeutic change: A task force on participants, relationships, and techniques factors. Journal of Clinical Psychology, 62, 631– 638. 16538667
- Chiu AW, McLeod BD, Har K & Wood JJ (2009). Child–therapist alliance and clinical outcomes in cognitive behavioral therapy for child anxiety disorders. Journal of Child Psychology and Psychiatry, 50, 751– 758. 19175814
- Chu BC, & Kendall PC (2004). Positive association of child involvement and treatment outcome within a manual-based cognitive-behavioral treatment for children with anxiety. Journal of Consulting and Clinical Psychology, 72, 821– 829. 15482040
- Chu BC & Kendall PC (2009). Therapist responsiveness to child engagement: Flexibility within manual-based CBT for anxious youth. Journal of Clinical Psychology, 65, 736– 754. 19391153
- Claiborn CD, Goodyear RK, and Horner PA (2002). Feedback In Norcross JC (Ed.), Psychotherapy relationships that work (pp 217– 233). New York: Oxford University Press.
- Clark LA, & Watson D (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309– 319. PMC6754793 30896212
- Crits-Christoph P & Gibbons MBC (2002). Relational interpretations In Norcross JC (Ed.), Psychotherapy relationships that work (pp. 285– 300). New York: Oxford University Press.
- Elliott R, Bohart AC, Watson JC, & Greenberg LS (2011). Empathy. Psychotherapy, 48(1), 43. 21401273
- Farber BA, & Doolin EM (2011). Positive regard. Psychotherapy, 48(1), 58. 21401275
- Fjermestad KW, McLeod BD, Heiervang ER, Havik OE, Ost L, & Haugland BSM (2012). Factor structure and validity of the therapy process observational coding system for child psychotherapy – alliance scale. Journal of Clinical Child and Adolescent Psychology, 41, 246– 254. 22417197
- Fjermestad KW, McLeod BD, Tully CB, & Liber JM (2016). Therapist characteristics and interventions: Enhancing alliance and involvement with youth In Maltzman S (Ed.), Oxford handbook of treatment processes and outcomes in counseling psychology. New York: Oxford University Press.
- Follette WC, & Greenberg LS (2006). Techniques factors in treating dysphoric disorders In Castonguay LG & Beutler LE (Eds.), Principles of Therapeutic Change That Work (pp. 83– 109). New York: Oxford University Press.
- Frank JD (1971). Therapeutic factors in psychotherapy. American Journal of Psychotherapy, 25, 350– 361. 4936109
- Hawley KM, & Weisz JR (2005). Youth versus parent working alliance in usual care: Distinctive associations with retention, satisfaction, and treatment outcome. Journal of Clinical Child and Adolescent Psychology, 34, 117– 128. 15677286
- Henggeler SW, Schoenwald SK, Liao JG, Letourneau EJ, & Edwards DL (2002). Transporting efficacious treatments to field settings: The link between supervisory practices and therapist fidelity in MST programs. Journal of Clinical Child and Adolescent Psychology, 31, 155– 167. 12056100
- Henry WP, Strupp HH, Butler SF, Schacht TE, & Binder JL (1993). Effects of training in time-limited dynamic psychotherapy: Changes in therapist behavior. Journal of Consulting and Clinical Psychology, 61(3), 434. 8326044
- Hill CE, & Knox S (2002). Self-disclosure In Norcross JC (Ed.), Psychotherapy relationships that work (pp. 255– 265). New York: Oxford.
- Hudson JL, Kendall PC, Chu BC, Gosch E, Martin E, Taylor A, & Knight A (2014). Child involvement, alliance, and therapist flexibility: Process variables in cognitive-behavioural therapy for anxiety disorders in childhood. Behaviour Research and Therapy, 52, 1– 8. 24246476 PMC3942362
- Institute of Medicine (2015). Psychological interventions for mental and substance use disorders: A framework for establishing evidence-based standards. Washington, DC: National Academies Press. 26203478
- Kendall PC, & Hedtke KA (2006). Cognitive-behavioral therapy for anxious children: Therapist manual (3rd ed.). Ardmore, PA: Workbook.
- Kendall PC, Hudson JL, Gosch E, Flannery-Schroeder E, & Suveg C (2008). Cognitive-behavioral therapy for anxiety disordered youth: A randomized clinical trial evaluating child and family modalities. Journal of Consulting and Clinical Psychology, 76, 282– 297. 18377124
- Kline P (1979). Psychometrics and psychology. Academic Press, London.
- Leichsenring F, Salzer S, Beutel ME, Herpertz S, Hiller W, Hoyer J, … & Ritter V (2013). Psychodynamic therapy and cognitive-behavioral therapy in social anxiety disorder: a multicenter randomized controlled trial. American Journal of Psychiatry, 170, 759– 767. 23680854
- Liber JM, McLeod BD, Van Widenfelt BM, Goedhart AW, van der Leeden AJM, Utens EMWJ, … Treffers PDA (2010). Examining the relation between the therapeutic alliance, treatment adherence, and outcome of cognitive behavioral therapy for children with anxiety disorders. Behavior Therapy, 41, 172– 186. 20412883
- Luborsky L, McLellan AT, Woody GE, O’Brien CP, & Auerbach A (1985). Therapist success and its determinants. Archives of General Psychiatry, 42, 602– 611. 4004503
- McLeod BD, & Weisz JR (2005). The therapy process observational coding system-alliance scale: Measure characteristics and prediction of outcome in usual clinical practice. Journal of Consulting and Clinical Psychology, 73, 323– 333. 15796640
- McLeod BD, Smith MM, Southam-Gerow MA, Weisz JR, & Kendall PC (2015). Measuring treatment differentiation for implementation research: The therapy process observational coding system for child psychotherapy revised strategies scale. Psychological Assessment, 27, 314– 325. 25346995 PMC4355313
- McLeod BD, Southam-Gerow MA, Rodriguez A, Quinoy A, Arnold C, Kendall PC, & Weisz JR (2016). Development and initial psychometrics for a therapist competence instrument for CBT for youth anxiety. Journal of Clinical Child and Adolescent Psychology. Advance online publication. PMC6112610 27929671
- Nock MK, Ferriter C, & Holmberg E (2007). Parent beliefs about treatment credibility and effectiveness: Assessment and relation to subsequent treatment participation. Journal of Child and Family Studies, 16, 27– 38.
- Nock MK, & Kazdin AE (2001). Parent expectancies for child therapy: Assessment and relation to participation in treatment. Journal of Child and Family Studies, 10, 155– 180.
- Norcross JC (2002). Psychotherapy relationships that work: Therapist contributions and responsiveness to patients. New York, NY US: Oxford University Press. 21827260
- Norcross JC (Ed.). (2011). Psychotherapy relationships that work: Evidence-based responsiveness (2nd ed.). New York, NY, US: Oxford University Press.
- Orlinsky DE, & Howard KI (1987). A generic model of psychotherapy. Journal of Integrative & Eclectic Psychotherapy, 6, 6– 27.
- Shirk SR, Karver MS, & Brown R (2011). The alliance in child and adolescent psychotherapy. Psychotherapy, 48, 17– 24. 21401270
- Southam-Gerow MA, McLeod BD, Arnold CA, Rodriguez A, Cox JR, … Kendall PC (2016). Initial development of a treatment adherence measure for cognitive-behavioral therapy for child anxiety. Psychological Assessment, 28, 70– 80. 26011477 PMC4668226
- Southam-Gerow MA, Weisz JR, Chu BC, McLeod BD, Gordis EB, & Connor-Smith JK (2010). Does CBT for youth anxiety outperform usual care in community clinics?: An initial effectiveness test. Journal of the American Academy of Child and Adolescent Psychiatry, 49, 1043– 1052. 20855049 PMC2945382
- Spruill J, Rozensky RH, Stigall TT, Vasquez M, Bingham RP, & De Vaney Olvey C (2004). Becoming a competent clinician: Basic competencies in intervention. Journal of Clinical Psychology, 60, 741– 754. 15195337
- Stallard P, Myles P, & Branson A (2014). The Cognitive Behaviour Therapy Scale for Children and Young People (CBTS-CYP): Development and psychometric properties. Behavioural and cognitive psychotherapy, 42(03), 269– 282. 24495357
- Swift JK, & Callahan JL (2011). Decreasing treatment dropout by addressing expectations for treatment length. Psychotherapy Research, 21, 193– 200. 21271460
- Tryon GS, & Winograd G (2011). Goal consensus and collaboration. Psychotherapy, 48(1), 50– 57. 21401274
- Vallis TM, Shaw BF, & Dobson KS, (1986). The cognitive therapy scale: Psychometric properties. Journal of Consulting and Clinical Psychology, 54, 381– 385. 3722567
- Woody SR, & Ollendick TH (2006). Technique factors in treating anxiety disorders In Castonguay LG & Beutler LE (Eds.), Principles of therapeutic change that work (pp. 167– 186). New York: Oxford University Press.
Cited by
Sorted by citations
Peterson, B. S., West, A. E., Weisz, J. R., Mack, W. J., Kipke, M. D., Findling, R. L., Mittman, B. S., Bansal, R., Piantadosi, S., Takata, G., et al. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03314-y · Cited by 13 · see citing works
Self-citation
- Authors
- Brown, R. C., Southam‐Gerow, M. A., McLeod, B. D., Wheat, E. B., Tully, C. B., Reise, S. P., Kendall, P. C., & Weisz, J. R.
- Venue
- Journal of Clinical Psychology
- Publisher
- Wiley
- Published
- 2017-09-25
- Volume
- 74
- Issue
- 4
- Pages
- 649-664
- ISSN
- 0021-9762
- 1097-4679
- PMC
- PMC6314178
- Cited by
- 8
- References
- 5
- Language
- en
- Funders
- National Institute of Mental Health (RO1 MH086529)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review