A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
BACKGROUND: This randomized trial will compare three methods of assessing fidelity to cognitive-behavioral therapy (CBT) for youth to identify the most accurate and cost-effective method. The three methods include self-report (i.e., therapist completes a self-report measure on the CBT interventions used in session while circumventing some of the typical barriers to self-report), chart-stimulated recall (i.e., therapist reports on the CBT interventions used in session via an interview with a trained rater, and with the chart to assist him/her) and behavioral rehearsal (i.e., therapist demonstrates the CBT interventions used in session via a role-play with a trained rater). Direct observation will be used as the gold-standard comparison for each of the three methods. METHODS/DESIGN: This trial will recruit 135 therapists in approximately 12 community agencies in the City of Philadelphia. Therapists will be randomized to one of the three conditions. Each therapist will provide data from three unique sessions, for a total of 405 sessions. All sessions will be audio-recorded and coded using the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale. This will enable comparison of each measurement approach to direct observation of therapist session behavior to determine which most accurately assesses fidelity. Cost data associated with each method will be gathered. To gather stakeholder perspectives of each measurement method, we will use purposive sampling to recruit 12 therapists from each condition (total of 36 therapists) and 12 supervisors to participate in semi-structured qualitative interviews. DISCUSSION: Results will provide needed information on how to accurately and cost-effectively measure therapist fidelity to CBT for youth, as well as important information about stakeholder perspectives with regard to each measurement method. Findings will inform fidelity measurement practices in future implementation studies as well as in clinical practice. TRIAL REGISTRATION: NCT02820623 , June 3rd, 2016.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These and other research efforts [12, 39] aim to demonstrate the relevance and practical utility of behavioral economic concepts such as bounded rationality for implementation research and, in particular when considering the decision-making approaches and perspectives of different stakeholders.”
From Implementation science issues in understanding, collecting, and using cost estimates: A multi-stakeholder perspective (2021) · cites this paper as [39]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · cited 2×
“Although use of these economic evaluation methods is widespread in medicine [29], they are rarely utilized in implementation studies [5].”
BackgroundMethodIntention—Behavior Relations: A Conceptual and Empirical Review
Sheeran, P. (2002) · European Review of Social Psychology · doi:10.1080/14792772143000003 · Cited by 3,688 · cited 2×
“These measures have demonstrated predictive, face, and construct validity [45].”
BackgroundInfluence : science and practice
Cialdini, R. B. (1985) · Cited by 3,581
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 2×
“has been identified in implementation science frameworks as the mechanism by which desired outcomes are achieved [3–5], and as an indicator of quality of care [6].”
BackgroundPredicting and Changing Behavior
Fishbein, M., & Ajzen, I. (2011) · doi:10.4324/9780203838020 · Cited by 2,807
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
Assessment in medical education
Epstein, R. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmra054784 · Cited by 1,872
Research synthesis: the practice of cognitive interviewing
Beatty, P. C., & Willis, G. B. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfm006 · Cited by 1,615 · cited 1×
“All of the measures will be piloted and cognitive response testing will be used to identify ambiguous wording [50].”
MethodComparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r.
Rice, M. E., & Harris, G. T. (2005) · Law and Human Behavior · doi:10.1007/s10979-005-6832-7 · Cited by 1,608
Research works printed but not linked: 2
- IOM (Institute of Medicine). Psychosocial interventions for mental and substance use disorders: A framework for establishing evidence-based standards. Washington: The National Academies Press; 2015. 26203478
- Sherill J Pragmatic Strategies for Assessing Psychotherapy Quality in Practice 2015 Washington National Institutes of Mental Health
Cited by
Eisman, A. B., Quanbeck, A., Bounthavong, M., Panattoni, L., & Glasgow, R. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01143-x · Cited by 126
“These and other research efforts [12, 39] aim to demonstrate the relevance and practical utility of behavioral economic concepts such as bounded rationality for implementation research and, in particular when”
BackgroundAlley, Z. M., Chapman, J. E., Schaper, H., & Saldana, L. (2023) · Implementation Science · doi:10.1186/s13012-023-01285-0 · Cited by 86
“More specifically, intervention fidelity is defined as adherence to key treatment components, where those components are delivered with competence [7, 8].”
BackgroundThe case for prioritizing implementation strategy fidelity measurement: benefits and challenges
Akiba, C. F., Powell, B. J., Pence, B. W., Nguyen, M. X. B., Golin, C., & Go, V. (2022) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab138 · Cited by 59
What is the Status of Multi-Informant Treatment Fidelity Research?
McLeod, B. D., Porter, N., Hogue, A., Becker‐Haimes, E. M., & Jensen‐Doss, A. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2022.2151713 · Cited by 67
Self-citationDorsey, S., Kerns, S. E. U., Lucid, L., Pullmann, M. D., Harrison, J. P., Berliner, L., Thompson, K., & Deblinger, E. (2018) · Implementation Science · doi:10.1186/s13012-017-0708-3 · Cited by 67
Self-citation
Metadata
- Authors
- Beidas, R. S., Maclean, J. C., Fishman, J., Dorsey, S., Schoenwald, S. K., Mandell, D. S., Shea, J. A., McLeod, B. D., French, M. T., Hogue, A., Adams, D. R., Lieberman, A., Becker-Haimes, E. M., & Marcus, S. C.
- Affiliations
- University of Pennsylvania (US)
- National Bureau of Economic Research (US)
- University of Washington (US)
- Medical University of South Carolina (US)
- Virginia Commonwealth University (US)
- University of Miami (US)
- National Center on Addiction and Substance Abuse at Columbia University (US)
- Corresponding author
- Beidas, Rinad S.
- ORCID
- Venue
- BMC Psychiatry
- Published
- 2016-09-15
- Volume
- 16
- Issue
- 1
- Pages
- 323-323
- ISSN
- 1471-244X (ISSN-L)
- PMC
- PMC5025620
- OpenAlex
- W2518941648
- Cited by
- 50
- References
- 50
- Citations by year
- 2025: 8 · 2024: 4 · 2023: 7 · 2022: 7 · 2021: 9 · 2020: 4 · 2019: 3 · 2018: 5 · 2017: 3
- FWCI
- 4.91
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- BMC Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ScholarlyCommons (University of Pennsylvania) (submittedVersion, cc-by)
- TUScholarShare (Temple University) (submittedVersion, cc-by)
- Funders
- National Institute of Mental Health (R01 MH108551)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- intervention fidelity, cognitive behavioral therapy, adolescent psychotherapy, behavioral rehearsal, role play, direct observation, cost-effectiveness, therapist supervision, stakeholder perspectives, child psychotherapy
- MeSH terms
- Adolescent, Adult, Mental Disorders, Child, Cost-Benefit Analysis, Female, Humans, Male, Research Design, Philadelphia, Reproducibility of Results, Cognitive Behavioral Therapy, Young Adult, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol. https://app.cochat.ai/papers/10.1186/s12888-016-1034-z
- The paper
- Beidas, R. S., Maclean, J. C., Fishman, J., Dorsey, S., Schoenwald, S. K., Mandell, D. S., Shea, J. A., McLeod, B. D., French, M. T., Hogue, A., Adams, D. R., Lieberman, A., Becker-Haimes, E. M., & Marcus, S. C. (2016). A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol. BMC Psychiatry. https://doi.org/10.1186/s12888-016-1034-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
