Cited by 37Health Policy Implementation ScienceEvaluation and Performance AssessmentDelphi Technique in Research

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Firm, yet flexible: a fidelity debate paper with two case examples

Open access
Albers, Bianca, Verweij, Lotte, Blum, Kathrin, Oesch, Saskia, Schultes, Marie-Therese, Clack, Lauren, Naef, Rahel·2024·Implementation Science

Abstract

Background: In healthcare research and practice, intervention and implementation fidelity represent the steadfast adherence to core components of research-supported interventions and the strategies employed for their implementation. Evaluating fidelity involves determining whether these core components were delivered as intended. Without fidelity data, the results of complex interventions cannot be meaningfully interpreted. Increasingly, the necessity for firmness and strict adherence by implementers and their organizations has been questioned, with calls for flexibility to accommodate contextual conditions. This shift makes contemporary fidelity a balancing act, requiring researchers to navigate various tensions. This debate paper explores these tensions, drawing on experiences from developing fidelity assessments in two ongoing effectiveness-implementation hybrid trials. Main body: First, given often scarce knowledge about the core components of complex interventions and implementation strategies, decisions about fidelity requirements involve a degree of subjective reasoning. Researchers should make these decisions transparent using theory or logic models. Second, because fidelity is context-dependent and applies to both interventions and implementation strategies, researchers must rethink fidelity concepts with every study while balancing firmness and flexibility. This is particularly crucial for hybrid studies, with their differing emphasis on intervention and implementation fidelity. Third, fidelity concepts typically focus on individual behaviors. However, since organizational and system factors also influence fidelity, there is a growing need to define fidelity criteria at these levels. Finally, as contemporary fidelity concepts prioritize flexible over firm adherence, building, evaluating, and maintaining fidelity in healthcare research has become more complex. This complexity calls for intensified efforts to expand the knowledge base for pragmatic and adaptive fidelity measurement in trial and routine healthcare settings. Conclusion: Contemporary conceptualizations of fidelity place greater demands on how fidelity is examined, necessitating the expansion of fidelity frameworks to include organizational and system levels, the service- and study-specific conceptualizations of intervention and implementation fidelity, and the development of pragmatic approaches for assessing fidelity in research and practice. Continuing to build knowledge on how to balance requirements for firmness and flexibility remains a crucial task within the field of implementation science.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13012-024-01406-3

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 The FICUS family care pathway. This figure is unadapted from its original version and licensed under a Creative Commons Generic License (CC BY 4.0 OA). It is attributed to Naef et al. [40]
Fig. 1 The FICUS family care pathway. This figure is unadapted from its original version and licensed under a Creative Commons Generic License (CC BY 4.0 OA). It is attributed to Naef et al. [40]CC BY · PubMed Central
Fig. 2 Adapted Conceptual Framework for Implementation Fidelity in the FICUS trial. This framework was adapted from the original framework by Carroll et al. 2007 [5, 30]
Fig. 2 Adapted Conceptual Framework for Implementation Fidelity in the FICUS trial. This framework was adapted from the original framework by Carroll et al. 2007 [5, 30]CC BY · PubMed Central
Fig. 3 The REVERSE Improvement Cycle (RIC)
Fig. 3 The REVERSE Improvement Cycle (RIC)CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 54

  1. Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–56. https://doi.org/10.1093/her/18.2.237. · DOI · Paper page
  2. Sanetti L, Collier-Meek MA, Fallon L. Fidelity with flexibility: treatment acceptability and individualized adaptations of evidence-supported treatments. In: Maltzman S, editor. The Oxford Handbook of Treatment Processes and outcomes in psychology. New York: Oxford University Press; 2016. p. 289–308. https://doi.org/10.1093/oxfordhb/9780199739134.001.0001. · DOI
  3. Tolmatcheff C, Veenstra R, Roskam I, Galand B. Examining the link between implementation fidelity, quality, and effectiveness of teacher-delivered anti-bullying interventions in a randomized controlled trial. Prev Sci. 2024;25:407–20. https://doi.org/10.1007/s11121-023-01580-8. · DOI
  4. Schultes M-T, Aijaz M, Klug J, Fixsen DL. Competences for implementation science: what trainees need to learn and where they learn it. Adv Health Sci Educ. 2020:1–17. https://doi.org/10.1007/s10459-020-09969-8. · DOI
  5. Demers C, Higgins ZE, Bahrain S, Pelchat R, Gifford W, Lefebvre P. Interdisciplinary studies and implementation science: clarifying the concept of fidelity. Issues Interdisciplinary Stud. 2021;39:91–131.
  6. Lemire C, Rousseau M, Dionne C. A comparison of fidelity implementation frameworks used in the field of early intervention. Am J Eval. 2022:109821402110089. https://doi.org/10.1177/10982140211008978. · DOI
  7. Kendall PC, Beidas RS. Smoothing the trail for dissemination of evidence-based practices for youth: flexibility within fidelity. Prof Psychol Res Pract. 2007;38:13–20. https://doi.org/10.1037/0735-7028.38.1.13. · DOI
  8. Aarons GA, Green AE, Palinkas LA, Self-Brown SR, Whitaker DJ, Lutzker JR, et al. Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci. 2012;7:7. https://doi.org/10.1186/1748-5908-7-32. · DOI · Paper page
  9. Georgiadis C, Peris TS, Comer JS. Implementing strategic flexibility in the delivery of youth mental health care: a tailoring framework for thoughtful clinical practice. Évid-Based Pr Child Adolesc Ment Heal. 2020;5:215–32. https://doi.org/10.1080/23794925.2020.1796550. · DOI
  10. Miller CJ, Barnett ML, Baumann AA, Gutner CA, Wiltsey-Stirman S. The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare. Implement Sci. 2021;16:36. https://doi.org/10.1186/s13012-021-01105-3. · DOI · Paper page
  11. Kilbourne A, Chinman M, Rogal S, Almirall D. Adaptive designs in implementation science and practice: their promise and the need for greater understanding and improved communication. Annu Rev Public Health. 2024;45:69–88. https://doi.org/10.1146/annurev-publhealth060222-014438. · DOI
  12. Sundell K, Beelmann A, Hasson H, von Schwarz U. Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. J Clin Child Adolesc Psychol. 2015;45:784–96. https://doi.org/10.1080/15374416.2015.1020540. · DOI · Paper page
  13. Schwarz U, von Giannotta T, Neher F, Zetterlund M, Hasson J. Professionals’ management of the fidelity–adaptation dilemma in the use of evidence-based interventions—an intervention study. Implement Sci Commun. 2021;2:31. https://doi.org/10.1186/s43058-021-00131-y. · DOI
  14. Hasson H, Rundgren EH, Strehlenert H, Gärdegård A, Uvhagen H, Klinga C, et al. The adaptation and fidelity tool to support social service practitioners in balancing fidelity and adaptations: longitudinal, mixed-method evaluation study. Implement Res Pr. 2023;4:26334895231189200. https://doi.org/10.1177/26334895231189198. · DOI
  15. Ginsburg LR, Hoben M, Easterbrook A, Anderson RA, Estabrooks CA, Norton PG. Fidelity is not easy! Challenges and guidelines for assessing fidelity in complex interventions. Trials. 2021;22:372. https://doi.org/10.1186/s13063-021-05322-5. · DOI
  16. Toomey E, Hardeman W, Hankonen N, Byrne M, McSharry J, Matvienko-Sikar K, et al. Focusing on fidelity: narrative review and recommendations for improving intervention fidelity within trials of health behaviour change interventions. Health Psychol Behav Med. 2020;8:132–51. https://doi.org/10.1080/21642850.2020.1738935. · DOI
  17. Slaughter SE, Hill JN, Snelgrove-Clarke E. What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review. Implement Sci. 2015;10:1–12. https://doi.org/10.1186/s13012-015-0320-3. · DOI
  18. Chen JI, Roth B, Dobscha SK, Lowery JC. Implementation strategies in suicide prevention: a scoping review. Implement Sci. 2024;19:20. https://doi.org/10.1186/s13012-024-01350-2. · DOI
  19. Livorsi DJ, Drainoni M-L, Reisinger HS, Nanda N, McGregor JC, Barlam TF, et al. Leveraging implementation science to advance antibiotic stewardship practice and research. Infect Control Hosp Epidemiol. 2022;43:139–46. https://doi.org/10.1017/ice.2021.480. · DOI
  20. Anderson DM, Gupta AK, Birken SA, Sakas Z, Freeman MC. Adaptation in rural water, sanitation, and hygiene programs: a qualitative study in Nepal. Int J Hyg Environ Heal. 2022;240: 113919. https://doi.org/10.1016/j.ijheh.2022.113919. · DOI
  21. Haley AD, Powell BJ, Walsh-Bailey C, Krancari M, Gruß I, Shea CM, et al. Strengthening methods for tracking adaptations and modifications to implementation strategies. BMC Med Res Methodol. 2021;21:133. https://doi.org/10.1186/s12874-021-01326-6. · DOI
  22. Akiba CF, Powell BJ, Pence BW, Nguyen MXB, Golin C, Go V. The case for prioritizing implementation strategy fidelity measurement: benefits and challenges. Transl Behav Med. 2021. https://doi.org/10.1093/tbm/ibab138. · DOI
  23. Berry CA, Nguyen AM, Cuthel AM, Cleland CM, Siman N, Pham-Singer H, et al. Measuring implementation strategy fidelity in HealthyHearts NYC: a complex intervention using practice facilitation in primary care. Am J Med Qual. 2021;36:270–6. https://doi.org/10.1177/1062860620959450. · DOI
  24. Stein LAR, Bassett SS, Welsh WN, Clair-Michaud M, Abdel-Salam S, Monico L, et al. Implementation strategy fidelity and organizational outcomes in a randomized trial: implications for reentry from corrections to community treatment. Subst Use Misuse. 2022;ahead-of-print:1–11. https://doi.org/10.1080/10826084.2022.2161311. · DOI
  25. Tschida JE, Drahota A. Fidelity to the ACT SMART toolkit: an instrumental case study of implementation strategy fidelity. Implement Sci Commun. 2023;4:52. https://doi.org/10.1186/s43058-023-00434-2. · DOI
  26. He S, Shepherd H, Butow P, Shaw J, Harris M, Faris M, et al. Fidelity and acceptability of implementation strategies developed for adherence to a clinical pathway for screening, assessment and management of anxiety and depression in adults with cancer. Arch Public Heal. 2024;82:65. https://doi.org/10.1186/s13690-024-01293-6. · DOI
  27. Stockdale SE, Hamilton AB, Bergman AA, Rose DE, Giannitrapani KF, Dresselhaus TR, et al. Assessing fidelity to evidence-based quality improvement as an implementation strategy for patient-centered medical home transformation in the Veterans Health Administration. Implement Sci. 2020;15:18. https://doi.org/10.1186/s13012-020-0979-y. · DOI
  28. Naef R, Filipovic M, Jeitziner M-M, von Felten S, Safford J, Riguzzi M, et al. A multicomponent family support intervention in intensive care units: study protocol for a multicenter cluster-randomized trial (FICUS trial). Trials. 2022;23:533. https://doi.org/10.1186/s13063-022-06454-y. · DOI
  29. Oesch S, Verweij L, Clack L, Finch T, Riguzzi M, Naef R. Implementation of a multicomponent family support intervention in adult intensive care units: study protocol for an embedded mixed-methods multiple case study (FICUS implementation study). BMJ Open. 2023;13: e074142. https://doi.org/10.1136/bmjopen-2023-074142. · DOI
  30. Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23: 443. https://doi.org/10.1037/0278-6133.23.5.443. · DOI · Paper page
  31. Borrelli B. The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. J Public Heal Dent. 2011;71:S52-63. https://doi.org/10.1111/j.1752-7325.2011.00233.x. · DOI · Paper page
  32. Verweij L, Oesch S, Naef R. Tailored implementation of the FICUS multicomponent family support intervention in adult intensive care units: findings from a mixed methods contextual analysis. BMC Heal Serv Res. 2023;23:1339. https://doi.org/10.1186/s12913-023-10285-1. · DOI
  33. Simpson P, Tarrant M. Development of the family nursing practice scale. J Fam Nurs. 2006;12:413–25. https://doi.org/10.1177/1074840706290806. · DOI
  34. Naef R, Ernst J, Müeller M, Schmid-Mohler G. Translation and psychometric validation of the German version of the family nursing practice scale (FNPS). J Fam Nurs. 2021;27:34–42. https://doi.org/10.1177/1074840720969387. · DOI
  35. Bührmann L, Schuurmans J, Ruwaard J, Fleuren M, Etzelmüller A, Piera-Jiménez J, et al. Tailored implementation of internet-based cognitive behavioural therapy in the multinational context of the ImpleMentAll project: a study protocol for a stepped wedge cluster randomized trial. Trials. 2020;21:893. https://doi.org/10.1186/s13063-020-04686-4. · DOI
  36. Albers B, Rapley T, Nilsen P, Clack L, Editorial. Tailoring in implementation science. Front Heal Serv. 2023;3:1233597. https://doi.org/10.3389/frhs.2023.1233597. · DOI
  37. McHugh SM, Riordan F, Curran GM, Lewis CC, Wolfenden L, Presseau J, et al. Conceptual tensions and practical trade-offs in tailoring implementation interventions. Front Heal Serv. 2022;2:974095. https://doi.org/10.3389/frhs.2022.974095. · DOI
  38. Bührmann L, Driessen P, Metz A, Burke K, Bartley L, Varsi C, et al. Knowledge and attitudes of implementation support practitioners—findings from a systematic integrative review. PLoS One. 2022;17:e0267533. https://doi.org/10.1371/journal.pone.0267533. · DOI
  39. Taylor MJ, McNicholas C, Nicolay C, Darzi A, Bell D, Reed JE. Systematic review of the application of the plan–do–study–act method to improve quality in healthcare. BMJ Qual Saf. 2014;23:290–8. https://doi.org/10.1136/bmjqs-2013-001862. · DOI · Paper page
  40. Knudsen SV, Laursen HVB, Johnsen SP, Bartels PD, Ehlers LH, Mainz J. Can quality improvement improve the quality of care? A systematic review of reported effects and methodological rigor in plan-do-study-act projects. BMC Heal Serv Res. 2019;19:683. https://doi.org/10.1186/s12913-019-4482-6. · DOI
  41. Hill JE, Stephani A-M, Sapple P, Clegg AJ. The effectiveness of continuous quality improvement for developing professional practice and improving health care outcomes: a systematic review. Implement Sci. 2020;15:15. https://doi.org/10.1186/s13012-020-0975-2. · DOI
  42. Albers B, Metz A, Burke K. Implementation support practitioners – a proposal for consolidating a diverse evidence base. BMC Health Serv Res. 2020;20. https://doi.org/10.1186/s12913-020-05145-1. · DOI
  43. von Lengerke T, Tomsic I, Krosta KME, Ebadi E, Keil V, Buchta F, et al. Tailoring implementation interventions of different order in infection prevention and control: a cascadic logic model (IPC-CASCADE). Front Heal Serv. 2023;2: 960854. https://doi.org/10.3389/frhs.2022.960854. · DOI
  44. Easterling DV, Jacob RR, Brownson RC, Haire-Joshu D, Gundersen DA, Angier H, et al. Participatory logic modeling in a multi-site initiative to advance implementation science. Implement Sci Commun. 2023;4:106. https://doi.org/10.1186/s43058-023-00468-6. · DOI
  45. Smith JD, Li DH, Rafferty MR. The implementation research logic model: a method for planning, executing, reporting, and synthesizing implementation projects. Implement Sci. 2020;15:15. https://doi.org/10.1186/s13012-020-01041-8. · DOI
  46. Rezze BD, Law M, Gorter JW, Eva K, Pollock N. A narrative review of generic intervention fidelity measures. Phys Occup Ther Pediatr. 2012;32:430–46. https://doi.org/10.3109/01942638.2012.713454. · DOI
  47. Rezze BD, Law M, Eva K, Pollock N, Gorter JW. Development of a generic fidelity measure for rehabilitation intervention research for children with physical disabilities. Dev Med Child Neurol. 2013;55:737–44. https://doi.org/10.1111/dmcn.12114. · DOI
  48. Oesch S, Verweij L, Riguzzi M, Finch T, Naef R. Exploring Implementation Processes of a Multicomponent Family Support Intervention in Intensive Care Units (FICUS) Study: A Mixed-Methods Process Evaluation. J Adv Nurs. 2024. https://doi.org/10.1111/jan.16544. · DOI
  49. Terrana A, Viglione C, Rhee K, Rabin B, Godino J, Aarons GA, et al. The core functions and forms paradigm throughout EPIS: designing and implementing an evidence-based practice with function fidelity. Front Heal Serv. 2024;3: 1281690. https://doi.org/10.3389/frhs.2023.1281690. · DOI · Paper page
  50. Williams NJ, Marcus SC, Ehrhart MG, Sklar M, Esp SM, Carandang K, et al. Randomized trial of an organizational implementation strategy to improve measurement-based care fidelity and youth outcomes in community mental health. J Am Acad Child Adolesc Psychiatry. 2023. https://doi.org/10.1016/j.jaac.2023.11.010. · DOI
  51. Williams NJ, Glisson C, Hemmelgarn A, Green P. Mechanisms of change in the ARC organizational strategy: increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Adm Policy Mental Health Mental Health Serv Res. 2017;44:269–83. https://doi.org/10.1007/s10488-016-0742-5. · DOI
  52. Dolcini MM, Davey-Rothwell MA, Singh RR, Catania JA, Gandelman AA, Narayanan V, et al. Use of effective training and quality assurance strategies is associated with high-fidelity EBI implementation in practice settings: a case analysis. Transl Behav Med. 2019. https://doi.org/10.1093/tbm/ibz158. · DOI
  53. Morrow A, Chan P, Tiernan G, Steinberg J, Debono D, Wolfenden L, et al. Building capacity from within: qualitative evaluation of a training program aimed at upskilling healthcare workers in delivering an evidence-based implementation approach. Transl Behav Med. 2021;12: ibab094. https://doi.org/10.1093/tbm/ibab094. · DOI
  54. Bond L, Simmons E, Sabbath EL. Measurement and assessment of fidelity and competence in nonspecialist-delivered, evidence-based behavioral and mental health interventions: a systematic review. SSM - Popul Heal. 2022;19: 101249. https://doi.org/10.1016/j.ssmph.2022.101249. · DOI

Metadata

Authors
Albers, B., Verweij, L., Blum, K., Oesch, S., Schultes, M.-T., Clack, L., & Naef, R.
Affiliations
University of Zurich (CH)
Corresponding author
Albers, Bianca
Venue
Implementation Science
Published
2024-12-05
Volume
19
Issue
1
Pages
79-79
ISSN
1748-5908 (ISSN-L)
OpenAlex
W4405080217
Cited by
37
References
15
Citations by year
2026: 22 · 2025: 14 · 2024: 1
FWCI
17.60
Type
journal article
Language
en
Open access
Locations
  • Implementation Science (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by)
  • Zurich Open Repository and Archive (University of Zurich)
Funders
  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (198778)
  • HORIZON EUROPE Framework Programme (965265)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords
implementation fidelity, intervention fidelity, complex interventions, hybrid effectiveness-implementation trial, fidelity assessment, logic model, contextual flexibility
MeSH terms
Implementation Science, Health Services Research, Humans, Research Design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review