CoChat
Sign Up
Cited by 77Health Policy Implementation ScienceMeta-analysis and systematic reviewsPsychotherapy Techniques and Applications

Intervention fidelity: A necessary aspect of intervention effectiveness studies

Murphy, Susan L., Gutman, Sharon A.·2012·American Journal of Occupational Therapy
DOI 10.5014/ajot.2010.005405
Open this paper in CoChat — free account

Abstract

In a recent editorial, we highlighted information commonly absent from manuscripts that report intervention effectiveness (Gutman & Murphy, 2012). One critical element often missing from manuscripts is a discussion of intervention fidelity, which is the extent to which the intervention is delivered as it was intended (Gearing et al., 2011). To assess fidelity, researchers need to determine at the study design stage the methods they will use to assess and monitor the reliability and validity of the intervention (Bellg et al., 2004; Borrelli, 2011). Reporting of fidelity methods in the published product is crucial to allow readers to judge the quality of the study and replicate it and to assist the intervention developers in understanding how various factors may have influenced the outcome of their study.The Consolidated Standards of Reporting Trials (CONSORT) guidelines (Altman et al., 2001), the criteria now required by most medical journals for reporting clinical trials, have been expanded to include reporting of intervention fidelity in nonpharmacological trials (Boutron, Moher, Altman, Schulz, & Ravaud, 2008). The expanded criteria for reporting offer detailed guidance on how to report this additional information. Because fidelity methods are infrequently and inconsistently reported in journals, our intent in this editorial is to discuss the five basic components of intervention fidelity (Bellg et al., 2004; Borrelli, 2011; Gearing et al., 2011):Aspects of trial design pertaining to intervention fidelity include the content and dose of the intervention and the use of any comparison groups (Bellg et al., 2004). Researchers should describe in detail the number, length, and frequency of intervention sessions. The researchers should articulate the underlying theoretical framework or clinical guidelines that provided the foundation for the intervention and specify the intervention’s “active ingredients” (Borrelli, 2011). In designing a trial, researchers should try to plan for potential setbacks and consider alternative strategies before the setbacks occur. One potential setback, for example, is provider dropout (Bellg et al., 2004; Gearing et al., 2011); a potential solution is to train extra providers at the outset of the study so that backup providers with the requisite skills are available.To ensure fidelity, it is necessary to be certain that multiple providers administer the same intervention in the same manner; for this reason, many researchers develop and standardize training procedures. This training may be done initially and throughout the study implementation to allow for turnover in providers and to keep providers from deviating from the standardized procedures over time (a phenomenon known as therapist drift; Bellg et al., 2004; Borrelli, 2011; Gearing et al., 2011). Before beginning intervention delivery, researchers should assess providers’ acquisition of skills by written test, direction observation, or a combination (Bellg et al., 2004). Often, providers who have particular credentials or experience are selected for a study; training plans may need to be adapted if providers have different levels of experience or education (Borrelli, 2011).Researchers should report any methods used to standardize the interventions; this information is especially important so that others may replicate the study (Boutron et al., 2008). Researchers may use written intervention manuals, which assist in ensuring fidelity by helping to control for provider differences, ensuring adherence to the intervention protocol, and maintaining the distinct features of the intervention and comparison treatments (Bellg et al., 2004). Written manuals also provide a concrete means to articulate the active ingredients of the intervention, ensuring consistency in how and when these ingredients are delivered.The first three components of fidelity focus primarily on providers and how treatment is delivered. Fidelity methods also involve a fourth component: how participants received an intervention (e.g., whether they understood the intervention content and how relevant they thought the intervention was to daily life). Researchers can assess this component of fidelity by tracking attendance at sessions and administering measures such as pre- and postintervention assessments of knowledge gained. It also may be important to assess participant self-efficacy in implementing newly taught behaviors or strategies. Borrelli (2011) described several ways to enhance fidelity of intervention receipt.The fifth basic component of fidelity pertains to how people apply the intervention content in daily life. Measuring enactment differs from assessing study outcomes because measurement of enactment occurs throughout the study and not just at an endpoint (Borrelli, 2011). An outside observer can assess enactment using a checklist or other objective measurement. For instance, if a goal of an intervention was medication management and treatment involved

Integrity signals

Registry

Crossref · 10.5014/ajot.2010.005405

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Related

Authors
Murphy, S. L., & Gutman, S. A.
Affiliations
  • University of Michigan (US)
  • Columbia University (US)
ORCID
Venue
American Journal of Occupational Therapy
Publisher
SAGE Publications
Published
2012-07
Volume
66
Issue
4
Pages
387-388
ISSN
  • 0272-9490 (ISSN-L)
  • 1943-7676
DOI
10.5014/ajot.2010.005405
OpenAlex
W2081338251
Cited by
77
References
6
Citations by year
2026: 3 · 2025: 7 · 2024: 8 · 2023: 6 · 2022: 10 · 2021: 7 · 2020: 10 · 2019: 6 · 2018: 3 · 2017: 2 · 2016: 2 · 2015: 6 · 2014: 2 · 2013: 3 · 2012: 1
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • American Journal of Occupational Therapy (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
Keywords
intervention fidelity, intervention effectiveness, reporting quality, CONSORT guidelines, trial design, provider training, replication, non-pharmacological treatment, active ingredients, theoretical framework, training protocols
MeSH terms
Humans, Occupational Therapy, Professional Competence, Research Design, Reproducibility of Results, Treatment Outcome, Guideline Adherence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review