The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy
Open accessAbstract
BACKGROUND: Clinicians often modify evidence-based psychotherapies (EBPs) when delivering them in routine care settings. There has been little study of factors associated with or implications of modifications to EBP protocols. This paper differentiates between fidelity-consistent and fidelity-inconsistent modifications and it examines the potential influence of two clinician characteristics, training outcomes, and attitudes toward EBPs on fidelity-consistent and fidelity-inconsistent modifications of cognitive behavioral therapy in a sample of clinicians who had been trained to deliver these treatments for children or adults. METHODS: Survey and coded interview data collected 2 years after completion of training programs in cognitive behavioral therapy were used to examine associations between successful or unsuccessful completion of training, clinician attitudes, and modifications. Modifications endorsed by clinicians were categorized as fidelity-consistent or fidelity-inconsistent and entered as outcomes into separate regression models, with training success and attitudes entered as independent variables. RESULTS: Successful completion of a training program was associated with subsequent fidelity-inconsistent modifications but not fidelity-consistent modifications. Therapists who reported greater openness to using EBPs prior to training reported more fidelity-consistent modifications at follow-up, and those who reported greater willingness to adopt EBPs if they found them appealing were more likely to make fidelity-inconsistent modifications. CONCLUSIONS: Implications of these findings for training, implementation, EBP sustainment, and future studies are discussed. Research on contextual and protocol-related factors that may impact decisions to modify EBPs will be an important future direction of study to complement to this research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The frameworks also did not specify whether modifications were planned (i.e., adaptations) or unplanned (e.g., [2, 4, 27]), or allow investigators to consider modifications in conjunction with fidelity, a related but distinct implementation outcome [1].”
From The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions (2019) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Other practical constraints play a role in decisions to adapt or modify interventions [2, 15, 19, 23].”
From The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions (2019) · cites this paper as [2]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Without understanding forms of modification that occur, the systematic evaluation of processes and strategies that lead to more and less successful implementation may be hindered [2, 17–19].”
From The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions (2019) · cites this paper as [2]
The cited source says what the claim attributes to it.
In the citing paper
“This framework characterized different forms of modifications to interventions, and later work differentiated fidelity-consistent from fidelity-inconsistent modification [1, 2, 16].”
From The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions (2019) · cites this paper as [2]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 3×
“Implementation frameworks suggest an important difference between modification of core elements of the intervention and changes made to less essential, peripheral components [7].”
BackgroundMethodValente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 13,723
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 1×
“Considerable attention has been devoted to factors that influence the implementation and sustainability of EBPs [2–4].”
BackgroundThe dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724 · cited 6×
“considerable debate in the literature [6, 35].”
BackgroundInfluentialWiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355
Aarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272 · cited 2×
“Evidence-Based Practice Attitude Scale [27]”
A Randomized Trial of Methods to Help Clinicians Learn Motivational Interviewing.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1050 · Cited by 1,075 · cited 1×
“Little is known about the long-term use of EBPs after implementation, but the few studies that have examined the issue have found that fewer than 50 % of clinicians deliver them with fidelity following training [5, 6].”
BackgroundMcHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · cited 1×
“The past decade has seen an increase in efforts to implement evidence-based psychotherapies (EBPs) and psychosocial interventions in public sector mental health settings [1].”
Background
Research works printed but not linked: 2
- Gamarra JM, Gutner CA, Calloway A, Joseph N, Stirman SW. Examining the impacts of modifications and adaptations of evidence-based psychotherapies. Conference on the Science of Dissemination and Implementation; Bethesda, MD2014.
- Creed TA, Stirman SW, Evans AC, Beck AT. A model for implementation of cognitive therapy in community mental health: The Beck Initiative. The Behavior Therapist. 2014;37(3):56–64.
Cited by
Wiltsey Stirman, S., Baumann, A. A., & Miller, C. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0898-y · Cited by 1,329
“, [2, 4, 27]), or allow investigators to consider modifications in conjunction with fidelity, a re-”
BackgroundResultInfluentialThe Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806
Self-citationDiffusion Of Innovations Theory, Principles, And Practice
Dearing, J. W., & Cox, J. G. (2018) · Health Affairs · doi:10.1377/hlthaff.2017.1104 · Cited by 757
The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare
Miller, C. J., Barnett, M. L., Baumann, A. A., Gutner, C. A., & Wiltsey-Stirman, S. (2021) · Implementation Science · doi:10.1186/s13012-021-01105-3 · Cited by 490
“Adaptation of an EBP has been defined as the deliberate alteration of its design or delivery to improve its fit in a given context [1, 2].”
BackgroundReframing implementation science to address inequities in healthcare delivery
Baumann, A. A., & Cabassa, L. J. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-4975-3 · Cited by 461
Metadata
- Authors
- Wiltsey Stirman, S., A Gutner, C., Crits-Christoph, P., Edmunds, J., Evans, A. C., & Beidas, R. S.
- Affiliations
- University of Pennsylvania (US)
- Harvard University (US)
- Department of Behavioral Health and Intellectual Disability Services (US)
- Venue
- Implementation Science
- Published
- 2015-08-13
- Volume
- 10
- Issue
- 1
- Pages
- 115-115
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC4534152
- OpenAlex
- W2153708733
- Cited by
- 188
- References
- 43
- Citations by year
- 2026: 11 · 2025: 17 · 2024: 26 · 2023: 15 · 2022: 17 · 2021: 31 · 2020: 22 · 2019: 16 · 2018: 17 · 2017: 6 · 2016: 7 · 2015: 2
- FWCI
- 19.50
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ScholarlyCommons (University of Pennsylvania) (submittedVersion)
- Funders
- National Institutes of Health (1f31mh010800-01)
- National Institute of Mental Health (MH010800, MH080916, MH083333, F31MH083333, MH099179, K23MH099179, R25MH080916)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- evidence-based psychotherapy, intervention fidelity, cognitive behavioral therapy, treatment modification, evidence-based practice implementation
- MeSH terms
- Adult, Child, Clinical Competence, Clinical Protocols, Humans, Psychotherapy, Cognitive Behavioral Therapy, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. https://app.cochat.ai/papers/10.1186/s13012-015-0308-z
- The paper
- Wiltsey Stirman, S., A Gutner, C., Crits-Christoph, P., Edmunds, J., Evans, A. C., & Beidas, R. S. (2015). Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implementation Science. https://doi.org/10.1186/s13012-015-0308-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.