Assessing treatment integrity in acceptance and commitment therapy: strategies and suggestions
Open accessThe DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Abstract
In this paper, we briefly review the current literature on treatment integrity and discuss the relevance of this procedure for detecting, measuring and ensuring that the proposed mechanisms of change in cognitive behavior therapy, in this case of acceptance and commitment therapy (ACT; S.C. Hayes, Strosahl, & Wilson, 1999), take place. We discuss aspects such as how to develop an integrity coding system that takes into account the nuances of the ACT model, critical factors when deciding the different processes to include in the coding manual, and suggestions for how to operationalize the distinction between adherence and competence from an ACT perspective. In addition, we also provide more specific guidance about issues as how to select the segments to be coded, the training of those who will code the intervention, and the interrater reliability process. Finally, we provide the reader with a complete example of a treatment integrity coding manual that was specifically adapted for a randomized controlled trial in the treatment of obsessive compulsive disorder (Twohig et al., 2010a). The aim of the current paper is to provide some essential tools for ACT researchers to develop treatment integrity protocols so that they are more encouraged to adopt such methods in their studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Fidelity was assessed using the 16-item ACT Integrity Coding System (Plumb & Vilardaga, 2010).”
From Acceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes (2016) · cites this paper as Plumb & Vilardaga, 2010
In the citing paper
“Ratings of adherence to the intervention protocols are made for 20% of randomly selected sessions. Criteria for protocol adherence is defined for each session as a score of ≥90% on an adherence rating scale39–41.”
In the citing paper
“Ten per cent of sessions were randomly selected and assessed for treatment fidelity by one of two independent ACT therapists with training and experience in delivering ACT using an adapted form of the ACT Treatment Integrity Coding Manual.99”
From Acceptance and commitment therapy for older people with treatment-resistant generalised anxiety disorder: The FACTOID feasibility study (2021) · cites this paper as [99]
In the citing paper
“This is a well-established tool for assessing treatment fidelity in ACT interventions that assesses fidelity in four areas: (1) ACT (six items: deliteralisation/defusion, willingness/acceptance, creative hopelessness/workability, values and goals, committed action, and ACT therapeutic relationship); (2) other (one item: general assessment);”
From Acceptance and commitment therapy for older people with treatment-resistant generalised anxiety disorder: The FACTOID feasibility study (2021) · cites this paper as [99]
In the citing paper
“Clinical psychology graduate students with a minimum of 1 year of practicum training in ACT rated each workshop using an adherence manual adapted from Plumb & Vilardaga (2010) that assessed coverage of the 6 ACT flexibility processes and the absence of ACT-inconsistent approaches”
From Using acceptance and commitment therapy to increase self-compassion: A randomized controlled trial (2014) · cites this paper as Plumb & Vilardaga (2010)
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Acceptance and commitment therapy: model, processes and outcomes
Hayes, S. C., Luoma, J. B., Bond, F. W., Masuda, A., & Lillis, J. (2006) · Behaviour Research and Therapy · doi:10.1016/j.brat.2005.06.006 · Cited by 6,587
(1999) · Cited by 5,934
Mediators and Mechanisms of Change in Psychotherapy Research
Kazdin, A. E. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091432 · Cited by 2,504 · cited 1×
“Despite the difficulties and null findings, treatment integrity is viewed as a vital part of empirical validation of psychotherapy research and measurement as evaluating the implementation of interventions allows treatment development researchers to increase the efficiency and effectiveness of available therapies by i…”
BackgroundResearch design in clinical psychology
(1952) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195201)8:1<3::aid-jclp2270080102>3.0.co;2-0 · Cited by 2,147
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091 · cited 2×
“Such findings may highlight the importance of common (or nonspecific) factors, such as therapeutic alliance, treatment credibility and client’s expectations given that a previous meta-analysis has indicated that common factors might be more influential for outcome across studies than treatmentspecific factors (Wampold…”
BackgroundTesting the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Handbook of Applied Multivariate Statistics and Mathematical Modeling
(2000) · Elsevier eBooks · doi:10.1016/b978-0-12-691360-6.x5000-9 · Cited by 838
Gregg, J. A., Callaghan, G. M., Hayes, S. C., & Glenn-Lawson, J. L. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.2.336 · Cited by 695
Forman, E. M., Herbert, J. D., Moitra, E., Yeomans, P. D., & Geller, P. A. (2007) · Behavior Modification · doi:10.1177/0145445507302202 · Cited by 687
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657
Cited by
Luoma, J. B., Kohlenberg, B. S., Hayes, S. C., & Fletcher, L. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0026070 · Cited by 336
Acceptance and commitment therapy for fibromyalgia: A randomized controlled trial.
Wicksell, R. K., Kemani, M., Jensen, K., Kosek, E., Kadetoff, D., Sorjonen, K., Ingvar, M., & Olsson, G. L. (2013) · European Journal of Pain · doi:10.1002/j.1532-2149.2012.00224.x · Cited by 244
“Treatment integrity was evaluated using a scoring system specifically developed for clinical studies on ACT (Plumb and Vilardaga, 2010).”
MethodUsing acceptance and commitment therapy to increase self-compassion: A randomized controlled trial
Yadavaia, J. E., Hayes, S. C., & Vilardaga, R. (2014) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2014.09.002 · Cited by 188
“…psychology graduate students with a minimum of 1 year of practicum training in ACT rated each workshop using an adherence manual adapted from Plumb and Vilardaga (2010) that assessed coverage of the 6 ACT flexibility processes and the absence of ACT-inconsistent approaches, e.g. cognitive…”
MethodSelf-citationAcceptance and commitment therapy for problematic internet pornography use: A randomized trial
Crosby, J. M., & Twohig, M. P. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.02.001 · Cited by 184
Acceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes
Villatte, J. L., Vilardaga, R., Villatte, M., Plumb Vilardaga, J. C., Atkins, D. C., & Hayes, S. C. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.12.001 · Cited by 136
“Intervention fidelity Fidelity was assessed using the 16-item ACT Integrity Coding System (Plumb & Vilardaga, 2010).”
MethodSelf-citation
Metadata
- Authors
- Plumb, J. C., & Vilardaga, R.
- ORCID
- Vilardaga, Roger
- Venue
- International Journal of Behavioral Consultation and Therapy
- Published
- 2010
- Volume
- 6
- Issue
- 3
- Pages
- 263-295
- ISSN
- 1555-7855 (ISSN-L)
- OpenAlex
- W2072426643
- Semantic Scholar
- 4565efbfefc334f287ad65ab18d940d523d33681
- Cited by
- 75
- References
- 45
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 2 · 2023: 7 · 2022: 6 · 2021: 11 · 2020: 4 · 2019: 9 · 2018: 8 · 2016: 6 · 2015: 7 · 2014: 5 · 2012: 1
- FWCI
- 1.06
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- International Journal of Behavioral Consultation and Therapy (publishedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Keywords
- implementation fidelity, acceptance and commitment therapy, intervention fidelity, inter-rater reliability, programming training, mechanisms of change, obsessive-compulsive disorder, randomized controlled trials
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing treatment integrity in acceptance and commitment therapy: strategies and suggestions. https://app.cochat.ai/papers/10.1037/h0100912
- The paper
- Plumb, J. C., & Vilardaga, R. (2010). Assessing treatment integrity in acceptance and commitment therapy: strategies and suggestions. International Journal of Behavioral Consultation and Therapy. https://doi.org/10.1037/h0100912
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.