Measuring Treatment Fidelity in a Rehabilitation Intervention Study
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Attaining and demonstrating treatment fidelity is critical in the development and testing of evidence-based interventions. Treatment fidelity refers to the extent to which an intervention was implemented in clinical testing as it was conceptualized and is clearly differentiable from control or standard-of-care interventions. In clinical research, treatment fidelity is typically attained through intensive training and supervision techniques and demonstrated by measuring therapist adherence and competence to the protocol using external raters. However, in occupational and physical therapy outcomes research, treatment fidelity methods have not been used, which, in our view, is a serious gap that impedes novel treatment development and testing in these rehabilitation fields. In this article, we describe the development of methods to train and supervise therapists to attain adequate treatment fidelity in a treatment development project involving a novel occupational and physical therapy-based intervention. We also present a data-driven model for demonstrating therapist adherence and competence in the new treatment and its differentiation from standard of care. In doing so, we provide an approach that rehabilitation researchers can use to address treatment fidelity in occupational and physical therapy-based interventions. We recommend that all treatment researchers in rehabilitation disciplines use these or similar methods as a vital step in the development and testing of evidence-based rehabilitation interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Intervention to Decrease Catheter-Related Bloodstream Infections in the ICU
Pronovost, P., Needham, D., Berenholtz, S., Sinopoli, D., Chu, H., Cosgrove, S., Sexton, B., Hyzy, R., Welsh, R., Roth, G., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa061115 · Cited by 4,387
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
The role and interpretation of pilot studies in clinical research
Leon, A. C., Davis, L. L., & Kraemer, H. C. (2011) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2010.10.008 · Cited by 1,917
McHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909
A stage model of behavioral therapies research: getting started and moving on from stage I.
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.2.133 · Cited by 846
A Stage Model of Behavioral Therapies Research: Getting Started and Moving on From Stage I
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy/8.2.133 · Cited by 846
Borrelli, B., Sepinwall, D., Ernst, D., Bellg, A. J., Czajkowski, S., Breger, R., DeFrancesco, C., Levesque, C., Sharp, D. L., Ogedegbe, G., et al. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.852 · Cited by 803
Treatment fidelity in outcome studies
Moncher, F. J., & Prinz, R. J. (1991) · Clinical Psychology Review · doi:10.1016/0272-7358(91)90103-2 · Cited by 797 · cited 5×
“efficacy, contrast it with a control or standard treatment, and replicate findings.(1,2) This is chal-”
BackgroundMethodInfluentialEfficacy of the third wave of behavioral therapies: A systematic review and meta- analysis
Öst, L.-G. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.12.005 · Cited by 727
Treatment integrity and therapeutic change: issues and research recommendations
Perepletchikova, F., & Kazdin, A. E. (2005) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpi045 · Cited by 638
Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.829 · Cited by 533
Horn, S. D., DeJong, G., Smout, R. J., Gassaway, J., James, R., & Conroy, B. (2005) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2005.09.016 · Cited by 293
Rakovshik, S. G., & McManus, F. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.03.004 · Cited by 281 · cited 1×
“Much of this success is owed to methods to attain and demonstrate treatment fidelity, which result in a more consistent application of skills and knowledge.(5,6) These methods include the development of treatment manuals and corresponding scales of fidelity and therapist training and supervision techniques.”
MethodMonitoring treatment fidelity in a randomized controlled trial of a complex intervention
Spillane, V., Byrne, M. C., Byrne, M., Leathem, C. S., O’Malley, M., & Cupples, M. E. (2007) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04386.x · Cited by 111
Leeuw, M., Goossens, M. E. J. B., de Vet, H. C. W., & Vlaeyen, J. W. S. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.03.008 · Cited by 65 · cited 2×
“Leeuw et al.20 reported designing and using successful methods for assessing treatment delivery and treatment differentiation in a study of interventions for chronic low back pain.”
Method
Cited by
Mobile Health Applications in Weight Management: A Systematic Literature Review
Dounavi, K., & Tsoumani, O. (2019) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2018.12.005 · Cited by 154
“Treatment fidelity refers to the extent to which the mHealth app intervention was reliably administered as planned and whether it differed substantially from control interventions.(25,26) Social validity is inherent to treatment evaluation and can be defined as the significance of the target behavior, acceptability of…”
BackgroundOrkibi, H., & Feniger-Schaal, R. (2019) · PLOS ONE · doi:10.1371/journal.pone.0212575 · Cited by 151
Gawande, R., To, M. N., Pine, E., Griswold, T., Creedon, T. B., Brunel, A., Lozada, A., Loucks, E. B., & Schuman-Olivier, Z. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4739-5 · Cited by 75
Lenze, E. J., Host, H. H., Hildebrand, M. W., Morrow-Howell, N., Carpenter, B., Freedland, K. E., Baum, C. A., Dixon, D., Doré, P., Wendleton, L., et al. (2012) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2012.06.014 · Cited by 55
Self-citation
Metadata
- Authors
- Hildebrand, M. W., Host, H. H., Binder, E. F., Carpenter, B., Freedland, K. E., Morrow-Howell, N., Baum, C. M., Doré, P., & Lenze, E. J.
- Venue
- American Journal of Physical Medicine & Rehabilitation
- Published
- 2012-08
- Volume
- 91
- Issue
- 8
- Pages
- 715-724
- ISSN
- 0894-9115 (ISSN-L)
- OpenAlex
- W1998537090
- Cited by
- 107
- References
- 16
- FWCI
- 7.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.