CoChat

Development of a framework and coding system for modifications and adaptations of evidence-based interventions

Open access

The DOI matches its Crossref record; 59 of the 60 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Evidence-based interventions are frequently modified or adapted during the implementation process. Changes may be made to protocols to meet the needs of the target population or address differences between the context in which the intervention was originally designed and the one into which it is implemented [Addict Behav 2011, 36(6):630-635]. However, whether modification compromises or enhances the desired benefits of the intervention is not well understood. A challenge to understanding the impact of specific types of modifications is a lack of attention to characterizing the different types of changes that may occur. A system for classifying the types of modifications that are made when interventions and programs are implemented can facilitate efforts to understand the nature of modifications that are made in particular contexts as well as the impact of these modifications on outcomes of interest. METHODS: We developed a system for classifying modifications made to interventions and programs across a variety of fields and settings. We then coded 258 modifications identified in 32 published articles that described interventions implemented in routine care or community settings. RESULTS: We identified modifications made to the content of interventions, as well as to the context in which interventions are delivered. We identified 12 different types of content modifications, and our coding scheme also included ratings for the level at which these modifications were made (ranging from the individual patient level up to a hospital network or community). We identified five types of contextual modifications (changes to the format, setting, or patient population that do not in and of themselves alter the actual content of the intervention). We also developed codes to indicate who made the modifications and identified a smaller subset of modifications made to the ways that training or evaluations occur when evidence-based interventions are implemented. Rater agreement analyses indicated that the coding scheme can be used to reliably classify modifications described in research articles without overly burdensome training. CONCLUSIONS: This coding system can complement research on fidelity and may advance research with the goal of understanding the impact of modifications made when evidence-based interventions are implemented. Such findings can further inform efforts to implement such interventions while preserving desired levels of program or intervention effectiveness.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1748-5908-8-65

Cites

59 of 60 references verified1 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Article selection procedure and results.
Figure 1 Article selection procedure and results.CC BY · PubMed Central
Figure 2 System of classifying modifications to evidence-based programs or interventions.
Figure 2 System of classifying modifications to evidence-based programs or interventions.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

4 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 60 references

Research works printed but not linked: 1

  1. Schoenwald SK GA, Chapman JE, Frazier SL, Sheidow AJ, Southam-Gerow MA: Toward the effective and efficient measurement of implementation fidelity. Administration Policy Mental Health and Mental Health Serv Res. 2011, 38 (1): 32-43. 10.1007/s10488-010-0321-0. · DOI · Paper page

Cited by

See all 743

Metadata

Authors
Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A.
Affiliations
  • National Center for PTSD (US)
  • VA Boston Healthcare System (US)
  • University of Pennsylvania (US)
  • University of Massachusetts Boston (US)
Corresponding author
Stirman, Shannon Wiltsey
Venue
Implementation Science
Published
2013-06-10
Volume
8
Issue
1
Pages
65-65
ISSN
1748-5908 (ISSN-L)
OpenAlex
W2109880945
Cited by
691
References
59
Citations by year
2026: 49 · 2025: 50 · 2024: 61 · 2023: 79 · 2022: 76 · 2021: 97 · 2020: 72 · 2019: 69 · 2018: 40 · 2017: 40 · 2016: 19 · 2015: 22 · 2014: 12 · 2013: 3
FWCI
33.81
Type
journal article
Language
en
Open access
Locations
  • Implementation Science (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • U.S. Department of Veterans Affairs (R25 MH080916-01A2)
  • Washington University in St. Louis (R25 MH080916-01A2)
  • National Institutes of Health
  • Quality Enhancement Research Initiative (R25 MH080916-01A2)
  • National Institute of Mental Health (MH080916, R00 MH 01800, R00MH080100, R25MH080916)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
Keywords
evidence-based interventions, intervention adaptation, coding scheme, implementation fidelity, community settings, rater agreement, intervention effectiveness
MeSH terms
Mental Disorders, Behavioral Medicine, Community Mental Health Services, Decision Making, Delivery of Health Care, Humans, Evidence-Based Medicine, Clinical Coding

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Development of a framework and coding system for modifications and adaptations of evidence-based interventions. https://app.cochat.ai/papers/10.1186/1748-5908-8-65
The paper
Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science. https://doi.org/10.1186/1748-5908-8-65

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.