Evaluating Intervention Fidelity: An Example from a High-Intensity Interval Training Study
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
AIM: Intervention fidelity refers to the degree to which an experimental manipulation has been implemented as intended, but simple, robust methods for quantifying fidelity have not been well documented. Therefore, we aim to illustrate a rigorous quantitative evaluation of intervention fidelity, using data collected during a high-intensity interval training intervention. DESIGN: Single-group measurement study. METHODS: Seventeen adolescents (mean age ± standard deviation [SD] 14.0 ± 0.3 years) attended a 10-week high-intensity interval training intervention, comprising two exercise sessions per week. Sessions consisted of 4-7 45-s maximal effort repetitions, interspersed with 90-s rest. We collected heart rate data at 5-s intervals and recorded the peak heart rate for each repetition. The high-intensity exercise criterion was ≥ 90% of individual maximal heart rate. For each participant, we calculated the proportion of total exercise repetitions exceeding this threshold. A linear mixed model was applied to properly separate the variability in peak heart rate between- and within-subjects. Results are presented both as intention to treat (including missed sessions) and per protocol (only participants with 100% attendance; n=8). RESULTS: For intention to treat, the median (interquartile range) proportion of repetitions meeting the high-intensity criterion was 58% (42% to 68%). The mean peak heart rate was 85% of maximal, with a between-subject SD of 7.8 (95% confidence interval 5.4 to 11.3) percentage points and a within-subject SD of 15.1 (14.6 to 15.6) percentage points. For the per protocol analysis, the median proportion of high-intensity repetitions was 68% (47% to 86%). The mean peak heart rate was 91% of maximal, with between- and within-subject SDs of 3.1 (-1.3 to 4.6) and 3.4 (3.2 to 3.6) percentage points, respectively. CONCLUSIONS: Synthesising information on exercise session attendance and compliance (exercise intensity) quantifies the intervention dose and informs evaluations of treatment fidelity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · cited 1×
“Intervention fidelity—the extent to which an experimental manipulation has been implemented as intended, in a comparable manner to all participants [1], is integral to the internal validity of intervention-based trials [2,3].”
BackgroundPhysiological adaptations to low-volume, high-intensity interval training in health and disease
Gibala, M. J., Little, J. P., MacDonald, M. J., & Hawley, J. A. (2012) · The Journal of Physiology · doi:10.1113/jphysiol.2011.224725 · Cited by 1,744
Buchheit, M., & Laursen, P. B. (2013) · Sports Medicine · doi:10.1007/s40279-013-0029-x · Cited by 1,490
Little, J. P., Gillen, J. B., Percival, M. E., Safdar, A., Tarnopolsky, M. A., Punthakee, Z., Jung, M. E., & Gibala, M. J. (2011) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00921.2011 · Cited by 787 · cited 1×
“Determination of compliance is difficult [16]; therefore, a cut-point of 90% of maximal heart rate was used as our criterion for satisfactory compliance to high-intensity exercise, reflecting that used in previous work on high-intensity interval training [17].”
MethodDiscordance between reported intention-to-treat and per protocol analyses
Porta, N., Bonet, C., & Cobo, E. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.09.013 · Cited by 189 · cited 2×
“The contrasting findings of the intention to treat and per protocol analysis are consistent with the observation that estimated effects of an intervention are often lower when derived from an intention to treat analysis, due to the inclusion of participants that were non-adherent to, or deviated from the protocol [12].”
BackgroundResultEnhancing Intervention Fidelity: A Means of Strengthening Study Impact
Horner, S., Rew, L., & Torres, R. (2006) · Journal for Specialists in Pediatric Nursing · doi:10.1111/j.1744-6155.2006.00050.x · Cited by 141 · cited 2×
“Intervention fidelity—the extent to which an experimental manipulation has been implemented as intended, in a comparable manner to all participants [1], is integral to the internal validity of intervention-based trials [2,3].”
Background
Cited by
McLaren, S. J., Macpherson, T. W., Coutts, A. J., Hurst, C., Spears, I. R., & Weston, M. (2018) · Sports Medicine · doi:10.1007/s40279-017-0830-z · Cited by 419
Self-citationBiddle, S. J. H., & Batterham, A. M. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0254-9 · Cited by 355
Self-citationCosta, E. C., Hay, J. L., Kehler, D. S., Boreskie, K. F., Arora, R. C., Umpierre, D., Szwajcer, A., & Duhamel, T. A. (2018) · Sports Medicine · doi:10.1007/s40279-018-0944-y · Cited by 281
Santos, A., Braaten, K., MacPherson, M., Vasconcellos, D., Vis-Dunbar, M., Lonsdale, C., Lubans, D., & Jung, M. E. (2023) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-023-01535-w · Cited by 59
“In congruence with recommendations by Taylor and colleagues [253], future research on exercise implementation should consider both attendance and intensity achievement to determine implementation success.”
BackgroundMuggeridge, D. J., Sculthorpe, N., James, P. E., & Easton, C. (2017) · Journal of Science and Medicine in Sport · doi:10.1016/j.jsams.2016.04.014 · Cited by 32
Li, Y., Coster, S., Norman, I., Chien, W. T., Qin, J., Ling Tse, M., & Bressington, D. (2021) · Early Intervention in Psychiatry · doi:10.1111/eip.12929 · Cited by 17
Guio de Prada, V., Ortega, J. F., Morales-Palomo, F., Ramirez-Jimenez, M., Moreno-Cabañas, A., & Mora-Rodriguez, R. (2019) · PLOS ONE · doi:10.1371/journal.pone.0225893 · Cited by 16
Metadata
- Authors
- Taylor, K. L., Weston, M., & Batterham, A. M.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-04-22
- Volume
- 10
- Issue
- 4
- Pages
- e0125166
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2023864022
- Cited by
- 81
- References
- 7
- FWCI
- 17.14
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.