Cited by 24Psychotherapy Techniques and ApplicationsPosttraumatic Stress Disorder ResearchHealth Policy Implementation Science

A novel approach to the assessment of fidelity to a cognitive behavioral therapy for PTSD using clinical worksheets: A proof of concept with cognitive processing therapy

Stirman, Shannon Wiltsey, Gutner, Cassidy A., Gamarra, Jennifer, Suvak, Michael K., Vogt, Dawne, Johnson, Clara, Wachen, Jennifer Schuster, Dondanville, Katherine A. +5 more·2021·Behavior Therapy

Abstract

Fidelity monitoring is a critical indicator of psychotherapy quality and is central to successful implementation. A major barrier to fidelity in routine care is the lack of feasible, scalable, and valid measurement strategies. A reliable, low-burden fidelity assessment would promote sustained implementation of cognitive behavioral therapies (CBTs). The current study examined fidelity measurement for cognitive processing therapy (CPT) for posttraumatic stress disorder (PTSD) using clinical worksheets. External raters evaluated patient worksheets done as a part of treatment, both guided by the therapist and completed independently as homework. Results demonstrated that fidelity ratings from CPT session worksheets were feasible and efficient. Notably, they were strongly correlated with observer ratings of the fidelity of CPT strategies that were present on the worksheets. Agreement among ratings conducted by individuals with a range of experience with CPT was acceptable to high. There was not a main effect of therapist-guided, in-session worksheet ratings on PTSD symptom change. However, patient competence in completing worksheets independently was associated with greater PTSD symptom decline and in-session, therapist-guided worksheet completion was associated with larger symptom decreases among patients with high levels of competence. With further research and refinement, rating of worksheets may be an efficient way to examine therapist and patient skill in key CPT elements, and their interactions, compared to the gold standard of observer ratings of therapy video-recordings. Additional research is needed to determine if worksheets are an accurate and scalable alternative to gold standard observer ratings in settings in which time and resources are limited.

Integrity signals

Registry

Crossref · 10.1016/j.beth.2020.08.005

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Another bias-reducing approach is the use of independent ratings of therapy recordings or materials.

    “Another bias-reducing approach is the use of independent ratings of therapy recordings or materials (e.g., worksheets completed by the client in session; Stirman et al., 2021).”

    From Measuring the active elements of cognitive-behavioral therapies (2023) · cites this paper as Stirman et al., 2021

The citation lists haven’t been fetched yet

References 48 · Cited by 24

Authors
Stirman, S. W., Gutner, C. A., Gamarra, J., Suvak, M. K., Vogt, D., Johnson, C., Wachen, J. S., Dondanville, K. A., Yarvis, J. S., Mintz, J., Peterson, A. L., Young-McCaughan, S., & Resick, P. A.
Affiliations
  • VA Palo Alto Health Care System (US)
  • Boston University (US)
  • University of California, Los Angeles (US)
  • Suffolk University (US)
  • National Center for PTSD (US)
  • The University of Texas at San Antonio Health Science Center (US)
  • Carl R. Darnall Army Medical Center (US)
  • Duke Medical Center (US)
Corresponding author
Stirman, Shannon Wiltsey
Venue
Behavior Therapy
Publisher
Elsevier BV
Published
2021-05
Volume
52
Issue
3
Pages
656-672
ISSN
0005-7894 (ISSN-L)
OpenAlex
W3085246926
Cited by
24
References
48
Citations by year
2026: 2 · 2025: 4 · 2024: 5 · 2023: 4 · 2022: 6 · 2021: 2 · 2020: 1
FWCI
1.29
Type
journal article
Language
en
Open access
closed
Locations
  • Behavior Therapy (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • Medical Research and Materiel Command
  • National Institute of Mental Health (21 MH112099169)
  • Congressionally Directed Medical Research Programs (W81XWH-08-02-0114, W81XWH-08-02-109, W81XWH-08-02-0116)
  • U.S. Department of Defense
Topics
  • Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
  • Social Sciences › Psychology › Clinical Psychology › Posttraumatic Stress Disorder Research
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Keywords
intervention fidelity, cognitive processing therapy, post-traumatic stress disorder, fidelity assessment, observer ratings, homework completion, patient competence, PTSD symptom change, cognitive behavioral therapy, implementation
MeSH terms
Humans, Mental Processes, Psychotherapy, Stress Disorders, Post-Traumatic, Cognitive Behavioral Therapy, Treatment Outcome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review