The DOI matches its Crossref record.
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Abstract
Manipulation checks should be used in psychotherapy trials to confirm that therapists followed the treatment manuals and performed the therapy competently. This article is a review of some strategies that have been used to document treatment integrity; also, their limitations are discussed here. Recommendations for improving these checks are presented. Specific guidelines are offered regarding when and how to assess both therapist adherence to treatment protocols and competence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Ratings of adherence to the intervention protocols are made for 20% of randomly selected sessions. Criteria for protocol adherence is defined for each session as a score of ≥90% on an adherence rating scale39–41.”
In the citing paper
“For both SIDI and SC, specific therapist behaviors were considered “prescribed” and “proscribed” (Waltz et al., 1993) to assure that the treatment delivered in each was distinct.”
From Initial RCT of a distress tolerance treatment for individuals with substance use disorders (2012) · cites this paper as Waltz et al., 1993
In the citing paper
“The Research Team referred to fidelity measurement literature, which highlights the importance of including inconsistent or 'proscribed' therapist behaviours to determine deviations from fidelity (e.g. Waltz et al., 1993; Plumb & Vilardaga, 2010).”
From The development of the acceptance and commitment therapy fidelity measure (ACT-FM): a delphi study and field test (2019) · cites this paper as Waltz et al., 1993
In the citing paper
“This is important because the time and cost involved is often cited as a reason for omitting fidelity measurement in clinical trials (Waltz et al., 1993.)”
From The development of the acceptance and commitment therapy fidelity measure (ACT-FM): a delphi study and field test (2019) · cites this paper as Waltz et al., 1993
In the citing paper
“MATD includes elements that could occur during treatment, comprising elements that are required, allowed, or not allowed during the treatments of interest [6,8,10].”
From The fidelity of treatment delivery can be assessed in treatment outcome studies: a successful illustration from behavioral medicine (2009) · cites this paper as [8]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Still being checked.
Cited by
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671
Dane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557
A component analysis of cognitive-behavioral treatment for depression.
Jacobson, N. S., Dobson, K. S., Truax, P. A., Addis, M. E., Koerner, K., Gollan, J. K., Gortner, E., & Prince, S. E. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.2.295 · Cited by 1,413
Self-citationWiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355
Metadata
- Authors
- Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S.
- Affiliations
- University of Washington (US)
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 1993
- Volume
- 61
- Issue
- 4
- Pages
- 620-630
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W4250647220
- Cited by
- 873
- References
- 0
- Citations by year
- 2026: 29 · 2025: 19 · 2024: 14 · 2023: 23 · 2022: 32 · 2021: 36 · 2020: 23 · 2019: 41 · 2018: 31 · 2017: 29 · 2016: 46 · 2015: 35 · 2014: 49 · 2013: 56 · 2012: 29
- FWCI
- 6.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Clark Digital Commons (Clark University) (submittedVersion)
- Funders
- National Institutes of Health (5k02mh000868-07, 5r01mh043101-06)
- National Institute of Mental Health (MH44063-03, MH00868-02, MH43101-03)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- implementation fidelity, manipulation checks, therapist adherence, therapist competence, treatment manual
- MeSH terms
- Behavior Therapy, Clinical Competence, Clinical Protocols, Evaluation Studies as Topic, Humans, Professional-Patient Relations, Psychotherapy, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. https://app.cochat.ai/papers/10.1037/0022-006x.61.4.620
- The paper
- Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology. https://doi.org/10.1037/0022-006x.61.4.620
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.