Internal validity of project MATCH treatments: Discriminability and integrity.

Abstract

Project MATCH (Matching Alcoholism Treatments to Client Heterogeneity) is a multisite collaborative project designed to evaluate patient-treatment interactions in alcoholism treatment. To evaluate whether major threats to the internal validity of the independent (treatment) variable in Project MATCH could be ruled out, we investigated several aspects of treatment integrity and discriminability. In this study, 1,726 alcohol-dependent participants at 10 sites were randomized to 3 treatments: cognitive-behavioral treatment (CBT), motivational enhancement therapy (MET), and 12-step facilitation (TSF). Participants received treatment either as outpatients or as aftercare following a more intensive inpatient or day hospital treatment. For both the outpatient and aftercare arms of the study, treatments were discriminable in that therapists implemented each of the treatments according to manual guidelines and rarely used techniques associated with comparison approaches. Participants received a high level of exposure to their study treatments, and the intended contrast in treatment dose between MET and the 2 more intensive treatments (CBT and TSF) was obtained. Alcoholics Anonymous involvement was significantly higher for participants assigned to TSF versus MET or CBT, whereas the treatments did not differ in utilization of other nonstudy treatments. Nonspecific aspects of treatment such as therapist skillfulness and level of the therapeutic alliance were comparable across treatment conditions.

Cites (29)

1. Intraclass correlations: Uses in assessing rater reliability.
   Shrout, Patrick E., Fleiss, Joseph L. · 1979 · Psychological Bulletin
2. Applied Multivariate Statistics for the Social Sciences
   James P. Stevens · 2012 · Routledge eBooks
3. Factor analysis in the development and refinement of clinical assessment instruments.
   Floyd, Frank J., Widaman, Keith F. · 1995 · Psychological Assessment
4. Untitled work
   2002
5. A Primer of Multivariate Statistics
   David Strauss, Richard Jackson Harris · 1975 · Biometrics
6. Factor structure of the working alliance inventory
   Tracey, Terence J., Kokotovic, Anna M. · 1989 · Psychological Assessment: A Journal of Consulting and Clinical Psychology
7. The psychotherapeutic process: A research handbook.
   Leslie S. Greenberg, William M. Pinsof · 1986
8. Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
   Waltz, Jennifer, Addis, Michael E., Koerner, Kelly, Jacobson, Neil S. · 1993 · Journal of Consulting and Clinical Psychology
9. Motivation for treatment: A review with special emphasis on alcoholism.
   William R. Miller · 1985 · Psychological Bulletin
10. Handbook of psychotherapy and behavior change, 4th ed.
    Allen E. Bergin, Sol L. Garfield · 1994

Show all 29 references

Cited by (208)

1. Brief interventions for alcohol problems: a meta‐analytic review of controlled investigations in treatment‐seeking and non‐treatment‐seeking populations
   Moyer, Anne, Finney, John W., Swearingen, Carolyn E., Vergun, Pamela · 2002 · Addiction
2. A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research
   Borrelli, Belinda, Sepinwall, Deborah, Ernst, Denise, Bellg, Albert J., Czajkowski, Susan, Breger, Rosemary, DeFrancesco, Carol, Levesque, Chantal, Sharp, Daryl L., Ogedegbe, Gbenga et al. · 2005 · Journal of Consulting and Clinical Psychology
3. Assessing competence in the use of motivational interviewing
   Moyers, Theresa B., Martin, Tim, Manuel, Jennifer K., Hendrickson, Stacey M.L., Miller, William R. · 2005 · Journal of Substance Abuse Treatment
4. Brief intervention for harm reduction with alcohol-positive older adolescents in a hospital emergency department.
   Monti, Peter M., Colby, Suzanne M., Barnett, Nancy P., Spirito, Anthony, Rohsenow, Damaris J., Myers, Mark, Woolard, Robert, Lewander, William · 1999 · Journal of Consulting and Clinical Psychology
5. We don't train in vain: a dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy
   Sholomskas, Diane E., Syracuse-Siewert, Gia, Rounsaville, Bruce J., Ball, Samuel A., Nuro, Kathryn F., Carroll, Kathleen M. · 2005 · Journal of Consulting and Clinical Psychology

See all 208

Related (10)

1. Implementing treatment and protecting the validity of the independent variable in treatment matching studies
   Carroll, K M, Kadden, R M, Donovan, D M, Zweben, A, Rounsaville, B J · 1994 · Journal of Studies on Alcohol, Supplement
2. Matching patients with alcohol disorders to treatments: Clinical implications from Project MATCH
   Project MATCH Research Group · 1998 · Journal of Mental Health
3. Lessons Learned From Project MATCH
   Glenn D. Walters · 2002 · Addictive Disorders & Their Treatment
4. Matching Alcoholism Treatments to Client Heterogeneity: Project MATCH Three‐Year Drinking Outcomes
   Project MATCH Research Group · 1998 · Alcoholism Clinical and Experimental Research
5. Project MATCH secondary a priori hypotheses
   PROJECT MATCH RESEARCH GROUP · 1997 · Addiction

See all