Making a case for treatment integrity as a psychosocial treatment quality indicator for youth mental health care.
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Measures of treatment integrity are needed to advance clinical research in general and are viewed as particularly relevant for dissemination and implementation research. Although some efforts to develop such measures are underway, a conceptual and methodological framework will help guide these efforts. The purpose of this article is to demonstrate how frameworks adapted from the psychosocial treatment, therapy process, healthcare, and business literatures can be used to address this gap. We propose that components of treatment integrity (i.e., adherence, differentiation, competence, alliance, client involvement) pulled from the treatment technology and process literatures can be used as quality indicators of treatment implementation and thereby guide quality improvement efforts in practice settings. Further, we discuss how treatment integrity indices can be used in feedback systems that utilize benchmarking to expedite the process of translating evidence-based practices to service settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Donabedian, A. (1988) · JAMA · doi:10.1001/jama.260.12.1743 · Cited by 5,895 · cited 5×
“, symptom reduction , client satisfaction , client functioning ; Donabedian , 1988 ) .”
InfluentialKluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620
Unmet Need for Mental Health Care Among U.S. Children: Variation by Ethnicity and Insurance Status
Kataoka, S. H., Zhang, L., & Wells, K. B. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.9.1548 · Cited by 1,566
Dane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 2×
“Relational components like these are viewed by some as critical to the success of the techni - cal elements ( Dane & Schneider , 1998 ; Donabedian , 1988 ) .”
BackgroundWampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091 · cited 1×
“Efforts to define competence can be placed under the technical (“specific”) or “nonspecific” aspects of the therapy process (e.g., Wampold et al., 1997).”
BackgroundBeidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Weisz, J. R. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.147 · Cited by 827
Effectiveness, Transportability, and Dissemination of Interventions: What Matters When?
Schoenwald, S. K., & Hoagwood, K. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.9.1190 · Cited by 763 · cited 1×
“…and implementation researchers have asserted that the treatment development and evaluation process (i.e., the stage model for psychotherapy treatment development; Carroll & Nuro, 2002) needs to include steps that assess fit between EBTs and different practice contexts (Schoenwald & Hoagwood, 2001).”
BackgroundHerschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.02.005 · Cited by 713
Chorpita, B. F., & Daleiden, E. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0014565 · Cited by 687 · cited 1×
“, Chorpita & Daleiden , 2009 ) , we sug - gest that treatment integrity definitions move away from focusing upon specific manualized treatments to the broader evidence - based principles .”
BackgroundTherapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657
Treatment integrity and therapeutic change: issues and research recommendations
Perepletchikova, F., & Kazdin, A. E. (2005) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpi045 · Cited by 638
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.106 · Cited by 628
Is it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608
Kendall, P. C., Hudson, J. L., Gosch, E., Flannery-Schroeder, E., & Suveg, C. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.2.282 · Cited by 579 · cited 1×
“TIMS involves developing and applying these measurement tools across data from three different randomized controlled trials: one efficacy trial (Kendall et al., 2008) and two effectiveness studies (Southam-Gerow et al.”
MethodWeisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.671 · Cited by 560
Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.829 · Cited by 533
Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011) · Psychiatric Services · doi:10.1176/appi.ps.002052011 · Cited by 421
Mendel, P., Meredith, L. S., Schoenbaum, M., Sherbourne, C. D., & Wells, K. B. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0144-9 · Cited by 407
Evidence-based Kernels: Fundamental Units of Behavioral Influence
Embry, D. D., & Biglan, A. (2008) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-008-0036-x · Cited by 396 · cited 1×
“Embry & Biglan , 2008 ) .”
Chorpita, B. F., Daleiden, E. L., Ebesutani, C., Young, J., Becker, K. D., Nakamura, B. J., Phillips, L., Ward, A., Lynch, R., Trent, L., et al. (2011) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2011.01247.x · Cited by 393 · cited 2×
“EBTs contain a set of therapeutic interventions designed to address and remediate particular youth emotional or behavioral problems (e.g., Chorpita et al., 2011; McLeod & Weisz, 2004).”
BackgroundGARLAND, A. F., HAWLEY, K. M., BROOKMAN-FRAZEE, L., & HURLBURT, M. S. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31816765c2 · Cited by 389
Franklin, M. E., Abramowitz, J. S., Kozak, M. J., Levitt, J. T., & Foa, E. B. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.4.594 · Cited by 387
Relation of the alliance with outcomes in youth psychotherapy: a meta-analysis
McLeod, B. D. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.02.001 · Cited by 301
Self-citationHogue, A., Henderson, C. E., Dauber, S., Barajas, P. C., Fried, A., & Liddle, H. A. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.4.544 · Cited by 284
Clarke, G., Debar, L., Lynch, F., Powell, J., Gale, J., O'Connor, E., Ludman, E., Bush, T., Lin, E. H. B., & Korff, M. V. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/s0890-8567(09)62194-8 · Cited by 215 · cited 1×
“Unfortunately, findings from effectiveness research in practice settings (e.g., community clinics), where most youth actually receive mental health services, have been mixed (e.g., Clarke et al., 2005; Southam-Gerow et al., 2010; Weisz, Jensen-Doss, & Hawley, 2006; Weisz et al., 2012).”
BackgroundSoutham-Gerow, M. A., Weisz, J. R., Chu, B. C., McLeod, B. D., Gordis, E. B., & Connor-Smith, J. K. (2010) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2010.06.009 · Cited by 211
Self-citationHill, C. E., O'Grady, K. E., & Elkin, I. (1992) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.60.1.73 · Cited by 190
Karver, M., Shirk, S., Handelsman, J. B., Fields, S., Crisp, H., Gudmundsen, G., & McMakin, D. (2008) · Journal of Emotional and Behavioral Disorders · doi:10.1177/1063426607312536 · Cited by 141
Using Dissertations to Examine Potential Bias in Child and Adolescent Clinical Trials.
McLeod, B. D., & Weisz, J. R. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.2.235 · Cited by 125 · cited 3×
“…aspects is supported by data finding that both account for variation in outcomes ( see Karver , Handelsman , Fields , & Bickman , 2006 ; McLeod , 2011 ; McLeod & Weisz , 2004 ; Shirk & Karver , 2011 ) as well as the importance each aspect plays in quality of care research ( Donabedian , 1988 ) .”
ResultSelf-citationZima, B. T., Hurlburt, M. S., Knapp, P., Ladd, H., Tang, L., Duan, N., Wallace, P., Rosenblatt, A., Landsverk, J., & Wells, K. B. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200502000-00005 · Cited by 117 · cited 3×
“A few years later, Zima et al. (2005) engaged in an effort to identify quality indicators for outpatient mental health care for children diagnosed with attention deficit/hyperactivity disorder, conduct disorder, and major depression.”
BackgroundMethodHogue, A., & Dauber, S. (2013) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2012.12.001 · Cited by 23
Cited by
McLeod, B. D., Sutherland, K. S., Martinez, R. G., Conroy, M. A., Snyder, P. A., & Southam-Gerow, M. A. (2017) · Prevention Science · doi:10.1007/s11121-016-0703-y · Cited by 143
Self-citationHogue, A., Dauber, S., Lichvar, E., Bobek, M., & Henderson, C. E. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0548-2 · Cited by 122
Langberg, J. M., Dvorsky, M. R., Molitor, S. J., Bourchtein, E., Eddy, L. D., Smith, Z. R., Oddo, L. E., & Eadeh, H.-M. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000265 · Cited by 74
Goense, P. B., Assink, M., Stams, G.-J., Boendermaker, L., & Hoeve, M. (2016) · Aggression and Violent Behavior · doi:10.1016/j.avb.2016.08.003 · Cited by 68
Hogue, A., Bobek, M., Dauber, S., Henderson, C. E., McLeod, B. D., & Southam-Gerow, M. A. (2017) · Journal of Child & Adolescent Substance Abuse · doi:10.1080/1067828x.2017.1322020 · Cited by 61
Self-citation
Metadata
- Authors
- McLeod, B. D., Southam-Gerow, M. A., Tully, C. B., Rodríguez, A., & Smith, M. M.
- Venue
- Clinical Psychology: Science and Practice
- Published
- 2013-03
- Volume
- 20
- Issue
- 1
- Pages
- 14-32
- ISSN
- 0969-5893 (ISSN-L)
- 1468-2850
- OpenAlex
- W1972496843
- Cited by
- 117
- References
- 34
- FWCI
- 13.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.