CoChat

Exploring the content and delivery of feedback facilitation co-interventions: a systematic review

Sykes, Michael, Rosenberg-Yunger, Zahava R. S., Quigley, Matthew, Gupta, Lavanya, Thomas, Owen, Robinson, Lisa, Caulfield, Karen, Ivers, Noah, Alderson, Sarah · 2024 · Implementation Science
Cited by 7

The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.

Abstract

Background: Policymakers and researchers recommend supporting the capabilities of feedback recipients to increase the quality of care. There are different ways to support capabilities. We aimed to describe the content and delivery of feedback facilitation interventions delivered alongside audit and feedback within randomised controlled trials. Methods: We included papers describing feedback facilitation identified by the latest Cochrane review of audit and feedback. The piloted extraction proforma was based upon a framework to describe intervention content, with additional prompts relating to the identification of influences, selection of improvement actions and consideration of priorities and implications. We describe the content and delivery graphically, statistically and narratively. Results: We reviewed 146 papers describing 104 feedback facilitation interventions. Across included studies, feedback facilitation contained 26 different implementation strategies. There was a median of three implementation strategies per intervention and evidence that the number of strategies per intervention is increasing. Theory was used in 35 trials, although the precise role of theory was poorly described. Ten studies provided a logic model and six of these described their mechanisms of action. Both the exploration of influences and the selection of improvement actions were described in 46 of the feedback facilitation interventions; we describe who undertook this tailoring work. Exploring dose, there was large variation in duration (15–1800 min), frequency (1 to 42 times) and number of recipients per site (1 to 135). There were important gaps in reporting, but some evidence that reporting is improving over time. Conclusions: Heterogeneity in the design of feedback facilitation needs to be considered when assessing the intervention’s effectiveness. We describe explicit feedback facilitation choices for future intervention developers based upon choices made to date. We found the Expert Recommendations for Implementing Change to be valuable when describing intervention components, with the potential for some minor clarifications in terms and for greater specificity by intervention providers. Reporting demonstrated extensive gaps which hinder both replication and learning. Feedback facilitation providers are recommended to close reporting gaps that hinder replication. Future work should seek to address the ‘opportunity’ for improvement activity, defined as factors that lie outside the individual that make care or improvement behaviour possible. Review registration: The study protocol was published at: https://www.protocols.io/private/4DA5DE33B68E11ED9EF70A58A9FEAC02.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13012-024-01365-9

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 35 references

Research works printed but not linked: 142

  1. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259.
  2. Brown B, Gude WT, Blakeman T, van der Veer SN, Ivers N, Francis JJ, Lorencatto F, Presseau J, Peek N, Daker-White G. Clinical performance feedback intervention theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research. Implement Sci. 2019;14(1):40. · DOI · Paper page
  3. Colquhoun HL, Carroll K, Eva KW, Grimshaw JM, Ivers N, Michie S, Brehaut JC. Informing the research agenda for optimizing audit and feedback interventions: results of a prioritization exercise. BMC Med Res Methodol. 2021;21(1):1–8. · DOI
  4. Health Service Executive. National Review of Clinical Audit. Health Service Executive: Dublin, Ireland. 2019. Available from: national-review-of-clinical-audit-report-2019.pdf. Accessed 26 Sept 2023.
  5. Cooke LJ, Duncan D, Rivera L, Dowling SK, Symonds C, Armson H. How do physicians behave when they participate in audit and feedback activities in a group with their peers? Implement Sci. 2018;13(1):104. · DOI
  6. McHugh SM, Riordan F, Curran GM, Lewis CC, Wolfenden L, Presseau J, Lengnick-Hall R, Powell BJ. Conceptual tensions and practical trade-offs in tailoring implementation interventions. Front Health Serv. 2022;17(2):974095. · DOI
  7. Sykes M, O’Halloran E, Mahon L, McSharry J, Allan L, Thomson R, Finch T, Kolehmainen N. Enhancing national audit through addressing the quality improvement capabilities of feedback recipients: a multi-phase intervention development study. Pilot Feasibility Stud. 2022;8(1):1–8. · DOI
  8. Ivers N. Audit and Feedback Systematic Review: Data Abstraction Guide. 2019. Unpublished.
  9. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21. · DOI · Paper page
  10. Rychetnik L, Hawe P, Waters E, Barratt A, Frommer M. A glossary for evidence based public health. J Epidemiol Comm Health. 2004;58:538–45. · DOI · Paper page
  11. Smith JD, Li DH, Rafferty MR. The implementation research logic model: a method for planning, executing, reporting, and synthesizing implementation projects. Implement Sci. 2020;15:1–2. · DOI · Paper page
  12. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. https://doi.org/10.1136/bmj.a1655. · DOI · Paper page
  13. Mills T, Lawton R, Sheard L. Advancing complexity science in healthcare research: the logic of logic models. BMC Med Res Methodol. 2019;19(1):1–1. · DOI · Paper page
  14. Cooke LJ, Duncan D, Rivera L, Dowling SK, Symonds C, Armson H. The Calgary Audit and Feedback Framework: a practical, evidence-informed approach for the design and implementation of socially constructed learning interventions using audit and group feedback. Implement Sci. 2018;13(1):1–8. · DOI
  15. Sykes M, Alderson S, Thomas O, Caulfield K, Robinson L, Quigley M, Gupta L, Rosenberg-Yunger Z. Exploring the components of feedback facilitation: a systematic review. Available from: https://www.protocols.io/view/exploring-the-components-of-feedback-facilitation-8epv5jm8dl1b/v1. Accessed 26 Sept 2023.
  16. Althabe F, Chomba E, Tshefu AK, Banda E, Belizán M, Bergel E, Berrueta M, Bertrand J, Bose C, Cafferata ML, Carlo WA. A multifaceted intervention to improve syphilis screening and treatment in pregnant women in Kinshasa, Democratic Republic of the Congo and in Lusaka, Zambia: a cluster randomised controlled trial. Lancet Glob Health. 2019;7(5):e655–63. · DOI
  17. Nkamba D, Mwenechanya M, Kilonga AM, et al. Barriers and facilitators to the implementation of antenatal syphilis screening and treatment for the prevention of congenital syphilis in the Democratic Republic of Congo and Zambia: results of qualitative formative research. BMC Health Serv Res. 2017;17:556. · DOI
  18. Ayieko P, Ntoburi S, Wagai J, Opondo C, Opiyo N, Migiro S, Wamae A, Mogoa W, Were F, Wasunna A, Fegan G. A multifaceted intervention to implement guidelines and improve admission paediatric care in Kenyan district hospitals: a cluster randomised trial. PLoS Med. 2011;8(4):e1001018. · DOI · Paper page
  19. Wagai J, Mbindyo P, Mbaabu L, et al. Implementation experience during an eighteen month intervention to improve paediatric and newborn care in Kenyan district hospitals. Implement Sci. 2009;4:45. · DOI
  20. Ayieko P, Irimu G, Ogero M, Mwaniki P, Malla L, Julius T, Chepkirui M, Mbevi G, Oliwa J, Agweyu A, Akech S. Effect of enhancing audit and feedback on uptake of childhood pneumonia treatment policy in hospitals that are part of a clinical network: a cluster randomized trial. Implement Sci. 2019;14(1):1–4. · DOI
  21. English M, Ayieko P, Nyamai R, Were F, Githanga D, Irimu G. What do we think we are doing? How might a clinical information network be promoting implementation of recommended paediatric care practices in Kenyan hospitals? Heal Res Policy Syst. 2017;15:4. https://doi.org/10.1186/s12961-017-0172-1. · DOI · Paper page
  22. Baldwin NS, Gilpin DF, Tunney MM, Kearney MP, Crymble L, Cardwell C, Hughes CM. Cluster randomised controlled trial of an infection control education and training intervention programme focusing on meticillin-resistant Staphylococcus aureus in nursing homes for older people. J Hosp Infect. 2010;76(1):36–41. · DOI
  23. Barkun AN, Bhat M, Armstrong D, Dawes M, Donner A, Enns R, Martin J, Moayyedi P, Romagnuolo J, Stitt L. Effectiveness of disseminating consensus management recommendations for ulcer bleeding: a cluster randomized trial. CMAJ. 2013;185(3):E156–66. · DOI
  24. Bertoni AG, Bonds DE, Chen H, Hogan P, Crago L, Rosenberger E, Barham AH, Clinch CR, Goff DC. Impact of a multifaceted intervention on cholesterol management in primary care practices: guideline adherence for heart health randomized trial. Arch Intern Med. 2009;169(7):678–86. · DOI · Paper page
  25. Bond TC, Patel PR, Krisher J, Sauls L, Deane J, Strott K, McClellan W. A group-randomized evaluation of a quality improvement intervention to improve influenza vaccination rates in dialysis centers. Am J Kidney Dis. 2011;57(2):283–90. · DOI
  26. Bonevski B, Sanson-Fisher RW, Campbell E, Carruthers A, Reid AL, Ireland M. Randomized controlled trial of a computer strategy to increase general practitioner preventive care. Prev Med. 1999;29(6):478–86. · DOI
  27. Borgiel AE, Williams JI, Davis DA, Dunn EV, Hobbs N, Hutchison B, Wilson CR, Jensen J, O’Neil JJ, Bass MJ. Evaluating the effectiveness of 2 educational interventions in family practice. CMAJ. 1999;161(8):965–70.
  28. Bregnhøj L, Thirstrup S, Kristensen MB, Bjerrum L, Sonne J. Combined intervention programme reduces inappropriate prescribing in elderly patients exposed to polypharmacy in primary care. Eur J Clin Pharmacol. 2009;65:199–207. · DOI
  29. Brown LF, Keily PA, Spencer AJ. Evaluation of a continuing education intervention “Periodontics in General Practice.” Commun Dent Oral Epidemiol. 1994;22(6):441–7. · DOI
  30. Chaillet N, Dumont A, Abrahamowicz M, Pasquier JC, Audibert F, Monnier P, Abenhaim HA, Dubé E, Dugas M, Burne R, Fraser WD. A cluster-randomized trial to reduce cesarean delivery rates in Quebec. N Engl J Med. 2015;372(18):1710–21. · DOI · Paper page
  31. Charrier L, Allochis MC, Cavallo MR, Gregori D, Cavallo F, Zotti CM. Integrated audit as a means to implement unit protocols: a randomized and controlled study. J Eval Clin Pract. 2008;14(5):847–53. · DOI
  32. Clarke M, Devane D, Gross MM, Morano S, Lundgren I, Sinclair M, Putman K, Beech B, Vehviläinen-Julkunen K, Nieuwenhuijze M, Wiseman H. OptiBIRTH: a cluster randomised trial of a complex intervention to increase vaginal birth after caesarean section. BMC Pregnancy Childbirth. 2020;20:1–7. · DOI
  33. Grylka-Baeschlin S, Nicoletti J, Sinclair M, Maguire R, Carroll M, Begley C. Process evaluation for OptiBIRTH, a randomised controlled trial of a complex intervention designed to increase rates of vaginal birth after caesarean section. Trials. 2018;19(1):9. https://doi.org/10.1186/s13063-017-2401-x. · DOI
  34. Cundill B, Mbakilwa H, Chandler CI, Mtove G, Mtei F, Willetts A, Foster E, Muro F, Mwinyishehe R, Mandike R, Olomi R. Prescriber and patient-oriented behavioural interventions to improve use of malaria rapid diagnostic tests in Tanzania: facility-based cluster randomised trial. BMC Med. 2015;13:1–6. · DOI
  35. Curtis JR, Treece PD, Nielsen EL, Downey L, Shannon SE, Braungardt T, Owens D, Steinberg KP, Engelberg RA. Integrating palliative and critical care: evaluation of a quality-improvement intervention. Am J Respir Crit Care Med. 2008;178:269–75. · DOI · Paper page
  36. Treece PD, Engelberg RA, Shannon SE, Nielsen EL, Braungardt T, Rubenfeld GD, Steinberg KP, Curtis JR. Integrating palliative and critical care: description of an intervention. Crit Care Med. 2006;34:S380–7. · DOI
  37. DeVore AD, Cox M, Heidenreich PA, Fonarow GC, Yancy CW, Eapen ZJ, Peterson ED, Hernandez AF. Cluster-randomized trial of personalized site performance feedback in get with the guidelines-heart failure. Circ Cardiovasc Qual Outcomes. 2015;8(4):421–7. · DOI
  38. Everett GD, deBlois CS, Chang PF. Effect of cost education, cost audits, and faculty chart review on the use of laboratory services. Arch Intern Med. 1983;143(5):942–4. · DOI · Paper page
  39. Fabbri C, Dutt V, Shukla V, Singh K, Shah N, Powell-Jackson T. The effect of report cards on the coverage of maternal and neonatal health care: a factorial, cluster-randomised controlled trial in Uttar Pradesh, India. Lancet Glob Health. 2019;7(8):e1097–108. · DOI
  40. Filardo G, Nicewander D, Herrin J, et al. A hospital-randomized controlled trial of an educational quality improvement intervention in rural and small community hospitals in texas following implementation of information technology. Am J Med Qual. 2007;22:418–27. · DOI
  41. Filardo G, Nicewander D, Herrin J, et al. Challenges in conducting a hospital-randomized trial of an educational quality improvement intervention in rural and small community hospitals. Am J Med Qual. 2008;23:440–7. · DOI
  42. Foster JM, Hoskins G, Smith B, Lee AJ, Price D, Pinnock H. Practice development plans to improve the primary care management of acute asthma: randomised controlled trial. BMC Fam Pract. 2007;8(1):1–3. · DOI · Paper page
  43. Frijling BD, Lobo CM, Hulscher ME, Akkermans RP, Braspenning JC, Prins A, Van Der Wouden JC, Grol RP. Multifaceted support to improve clinical decision making in diabetes care: a randomized controlled trial in general practice. Diabet Med. 2002;19(10):836–42. · DOI · Paper page
  44. Frijling BD, Lobo CM, Hulscher ME, Akkermans RP, van Drenth BB, Prins A, van der Wouden JC, Grol RP. Intensive support to improve clinical decision making in cardiovascular care: a randomised controlled trial in general practice. BMJ Qual Saf. 2003;12(3):181–7. · DOI · Paper page
  45. Lobo CM, Frijling BD, Hulscher ME, Bernsen RM, Braspenning JC, Grol RP, Prins A, van der Wouden JC. Organisational determinants of cardiovascular prevention in general practice. Scand J Prim Health Care. 2003;21(2):99–105. · doi:10.1080/02813430310001707
  46. Frijling BD, Lobo CM, Hulscher ME, van Drenth BB, Braspenning JC, Prins A, van der Wouden JC, Grol RP. Provision of information and advice in cardiovascular care: clinical performance of general practitioners. Patient Educ Couns. 2002;48(2):131–7. · DOI
  47. Frijling BD, Spies TH, Lobo CM, Hulscher ME, van Drenth BB, Braspenning JC, Prins A, van der Wouden JC, Grol RP. Blood pressure control in treated hypertensive patients: clinical performance of general practitioners. Br J Gen Pract. 2001;51(462):9–14.
  48. Frijling BD, Lobo CM, Keus IM, Jenks KM, Akkermans RP, Hulscher ME, Prins A, van der Wouden JC, Grol RP. Perceptions of cardiovascular risk among patients with hypertension or diabetes. Patient Educ Couns. 2004;52(1):47–53. · DOI
  49. Lobo CM, Frijling BD, Hulscher ME, Bernsen RM, Braspenning JC, Grol RP, Prins A, van der Wouden JC. Improving quality of organizing cardiovascular preventive care in general practice by outreach visitors: a randomized controlled trial. Prev Med. 2002;35(5):422–9. · DOI
  50. Lobo CM, Frijling BD, Hulscher ME, Braspenning JC, Grol RP, Prins A, van der Wouden JC. Organizing cardiovascular preventive care in general practice: determinants of a successful intervention. Prev Med. 2002;35(5):430–6. · DOI
  51. Gilkey MB, Dayton AM, Moss JL, Sparks AC, Grimshaw AH, Bowling JM, Brewer NT. Increasing provision of adolescent vaccines in primary care: a randomized controlled trial. Pediatrics. 2014;134(2):e346–53. · doi:10.1542/peds.2013-4257
  52. Gilkey MB, Moss JL, Roberts AJ, Dayton AM, Grimshaw AH, Brewer NT. Comparing in-person and webinar delivery of an immunization quality improvement program: a process evaluation of the adolescent AFIX trial. Implement Sci. 2014;9(1):21. · DOI
  53. Gilkey MB, Parks MJ, Margolis MA, McRee AL, Terk JV. Implementing evidence-based strategies to improve HPV vaccine delivery. Pediatrics. 2019;144(1):e20182500. · DOI
  54. Gjelstad S, Høye S, Straand J, Brekke M, Dalen I, Lindbæk M. Improving antibiotic prescribing in acute respiratory tract infections: cluster randomised trial from Norwegian general practice (prescription peer academic detailing (Rx-PAD) study). BMJ. 2013;26:347.
  55. Gjelstad S, Fetveit A, Straand J, Dalen I, Rognstad S, Lindbaek M. Can antibiotic prescriptions in respiratory tract infections be improved? A cluster-randomized educational intervention in general practice–the Prescription Peer Academic Detailing (Rx-PAD) Study [NCT00272155]. BMC Health Serv Res. 2006;6:1–2. · DOI · Paper page
  56. Gude WT, van Engen-Verheul MM, van der Veer SN, Kemps HM, Jaspers MW, de Keizer NF, Peek N. Effect of a web-based audit and feedback intervention with outreach visits on the clinical performance of multidisciplinary teams: a cluster-randomized trial in cardiac rehabilitation. Implement Sci. 2016;11:1–6. · DOI
  57. van Engen-Verheul MM, de Keizer NF, van der Veer SN, Kemps H, Reimer WJ, Jaspers MW, Peek N. Evaluating the effect of a web-based quality improvement system with feedback and outreach visits on guideline concordance in the field of cardiac rehabilitation: rationale and study protocol. Implement Sci. 2014;9(1):1–5. · DOI
  58. Gulliford MC, Juszczyk D, Prevost AT, Soames J, McDermott L, Sultana K, Wright M, Fox R, Hay AD, Little P, Moore M. Electronically delivered interventions to reduce antibiotic prescribing for respiratory infections in primary care: cluster RCT using electronic health records and cohort study. Health Technol Assess. 2019;23(11):1. · DOI
  59. Harris MF, Parker SM, Litt J, Van Driel M, Russell G, Mazza D, Jayasinghe UW, Del Mar C, Lloyd J, Smith J, Zwar N. Implementing guidelines to routinely prevent chronic vascular disease in primary care: the Preventive Evidence into Practice cluster randomised controlled trial. BMJ Open. 2015;5(12):e009397. · DOI
  60. Hayes R, Armour B, Bratzler D, Moore L, Murray C, Stevens BR, Radford M, Fitzgerald D, Elward K, Ballard DJ. Comparison of an enhanced versus a written feedback model on the management of Medicare inpatients with venous thrombosis. Jt Comm J Qual Improv. 2001;27(3):155–68.
  61. Hayes RP, Ballard DJ. Feedbck about practice patterns for measurable iprovements in quality of care: a challenge for PROs under the Health Care Quality Improvement Initiative. Clin Perform Qual Health Care. 1995;3:15–22.
  62. Hendryx MS, Fieselmann JF, Jeanne Bock M, Wakefield DS, Helms CM, Bentler SE. Outreach education to improve quality of rural ICU care: results of a randomized trial. Am J Respir Crit Care Med. 1998;158(2):418–23. · DOI · Paper page
  63. Hogg W, Lemelin J, Graham ID, Grimshaw J, Martin C, Moore L, Soto E, O’Rourke K. Improving prevention in primary care: evaluating the effectiveness of outreach facilitation. Fam Pract. 2008;25(1):40–8. · DOI · Paper page
  64. Lemelin J, Hogg W, Baskerville N. Evidence to action: a tailored multifaceted approach to changing family physician practice patterns and improving preventive care. CMAJ. 2001;164(757–763):11.
  65. Houston TK, Sadasivam RS, Allison JJ, Ash AS, Ray MN, English TM, Hogan TP, Ford DE. Evaluating the QUIT-PRIMO clinical practice ePortal to increase smoker engagement with online cessation interventions: a national hybrid type 2 implementation study. Implement Sci. 2015;10(1):1–6. · DOI
  66. Houston TK, Sadasivam RS, Ford DE, Richman J, Ray MN, Allison JJ. The QUIT-PRIMO provider-patient Internet-delivered smoking cessation referral intervention: a cluster-randomized comparative effectiveness trial: study protocol. Implement Sci. 2010;5(1):1–9. · DOI
  67. Huffman MD, Mohanan PP, Devarajan R, Baldridge AS, Kondal D, Zhao L, Ali M, Krishnan MN, Natesan S, Gopinath R, Viswanathan S. Effect of a quality improvement intervention on clinical outcomes in patients in India with acute myocardial infarction: the ACS QUIK randomized clinical trial. JAMA. 2018;319(6):567–78. · DOI
  68. Huis A, Schoonhoven L, Grol R, Donders R, Hulscher M, van Achterberg T. Impact of a team and leaders-directed strategy to improve nurses’ adherence to hand hygiene guidelines: a cluster randomised trial. Int J Nurs Stud. 2013;50(4):464–74. · DOI
  69. Ivers NM, Tu K, Young J, Francis JJ, Barnsley J, Shah BR, Upshur RE, Moineddin R, Grimshaw JM, Zwarenstein M. Feedback GAP: pragmatic, cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care. Implement Sci. 2013;8:1–1. · DOI · Paper page
  70. Ivers NM, Tu K, Francis J, Bransley J, Shah B, Upshur R, Kiss A, Grimshaw JM, Zwarenstein M. Trial of Goal-setting and Action-Plans to increase the effectiveness of audit and feedback interventions in primary care. Study protocol. Implement Sci. 2010;5. · DOI · Paper page
  71. Kaufmann-Kolle P, Szecsenyi J, Broge B, Haefeli WE, Schneider A. Führt die Implementierung von offenem Benchmarking in datengestützten Qualitätszirkeln zur Verbesserung der hausärztlichen Versorgung bei Arzneimittelinteraktion und Asthma bronchiale? Z Evid Fortbild Qual Gesundhwes. 2011;105(5):389–95. · DOI
  72. Kennedy CC, Ioannidis G, Thabane L, Adachi JD, Marr S, Giangregorio LM, Morin SN, Crilly RG, Josse RG, Lohfeld L, Pickard LE. Successful knowledge translation intervention in long-term care: final results from the vitamin D and osteoporosis study (ViDOS) pilot cluster randomized controlled trial. Trials. 2015;16(1):1–1. · DOI
  73. Kennedy CC, Ioannidis G, Giangregorio LM, Adachi JD, Thabane L, Morin SN, Crilly RG, Marr S, Josse RG, Lohfeld L, Pickard LE. An interdisciplinary knowledge translation intervention in long-term care: study protocol for the vitamin D and osteoporosis study (ViDOS) pilot cluster randomized controlled trial. Implement Sci. 2012;7(1):1–2. · DOI
  74. Kennedy CC, Thabane L, Ioannidis G, Adachi JD, Papaioannou A. Implementing a knowledge translation intervention in long-term care: feasibility results from the Vitamin D and Osteoporosis Study (ViDOS). J Am Med Dir Assoc. 2014;15:943–5. · DOI
  75. Kritchevsky SB, Simmons BP, Braun BI. The project to monitor indicators: a collaborative effort between the Joint Commission on Accreditation of Healthcare Organizations and the Society for Healthcare Epidemiology of America. Infect Control Hosp Epidemiol. 1995;16:33–5. · doi:10.2307/30140999
  76. Lemelin J, Hogg W, Baskerville N. Evidence to action: a tailored multifaceted approach to changing family physician practice patterns and improving preventive care. CMAJ. 2001;164(6):757–63.
  77. Baskerville NB, Hogg W, Lemelin J. Process evaluation of a tailored multifaceted approach to changing family physician practice patterns improving preventive care. J Fam Pract. 2001;50(3):W242–9.
  78. Lesuis N, van Vollenhoven RF, Akkermans RP, Verhoef LM, Hulscher ME, den Broeder AA. Rheumatologists’ guideline adherence in rheumatoid arthritis: a randomised controlled study on electronic decision support, education and feedback. Clin Exp Rheumatol. 2018;36(1):21–8.
  79. Levi CR, Attia JA, D’Este C, Ryan AE, Henskens F, Kerr E, Parsons MW, Sanson-Fisher RW, Bladin CF, Lindley RI, Middleton S. Cluster-Randomized trial of thrombolysis implementation support in metropolitan and regional Australian stroke centers: lessons for individual and systems behavior change. J Am Heart Assoc. 2020;9(3):e012732. · DOI
  80. Paul CL, Levi CR, D’Este CA, Parsons MW, Bladin CF, Lindley RI, Attia JR, Henskens F, Lalor E, Longworth M, Middleton S. Thrombolysis ImPlementation in Stroke (TIPS): evaluating the effectiveness of a strategy to increase the adoption of best evidence practice–protocol for a cluster randomised controlled trial in acute stroke care. Implement Sci. 2014;9(1):1–3. · DOI
  81. Lopez-Picazo JJ, Ruiz JC, Sanchez JF, Ariza A, Aguilera B. A randomized trial of the effectiveness and efficiency of interventions to reduce potential drug interactions in primary care. Am J Med Qual. 2011;26(2):145–53. · DOI
  82. Lynch EA, Cadilhac DA, Luker JA, Hillier SL. Education-only versus a multifaceted intervention for improving assessment of rehabilitation needs after stroke; a cluster randomised trial. Implement Sci. 2015;11(1):1–3. · DOI
  83. Lynch EA, Luker JA, Cadilhac DA, Hillier SL. Rehabilitation assessments for patients with stroke in Australian hospitals do not always reflect the patients’ rehabilitation requirements. Arch Phys Med Rehabil. 2015;96:782–9. · DOI
  84. Lynch EA, Luker JA, Cadilhac DA, Fryer CE, Hillier S. A qualitative study using the Theoretical Domains Framework to investigate why patients were or were not assessed for rehabilitation after stroke. Clin Rehabil. 2017;31(7):966–77. · DOI
  85. McCartney P, Macdowall W, Thorogood M. A randomised controlled trial of feedback to general practitioners of their prophylactic aspirin prescribing. BMJ. 1997;315(7099):35–6. · DOI · Paper page
  86. McCluskey A, Ada L, Kelly PJ, Middleton S, Goodall S, Grimshaw JM, Logan P, Longworth M, Karageorge A. A behavior change program to increase outings delivered during therapy to stroke survivors by community rehabilitation teams: the Out-and-About trial. Int J Stroke. 2016;11(4):425–37. · DOI
  87. Mold JW, Fox C, Wisniewski A, Lipman PD, Krauss MR, Harris DR, Aspy C, Cohen RA, Elward K, Frame P, Yawn BP. Implementing asthma guidelines using practice facilitation and local learning collaboratives: a randomized controlled trial. Ann Fam Med. 2014;12(3):233–40. · DOI
  88. Myers RE, Turner B, Weinberg D, Hyslop T, Hauck WW, Brigham T, Rothermel T, Grana J, Schlackman N. Impact of a physician-oriented intervention on follow-up in colorectal cancer screening. Prev Med. 2004;38(4):375–81. · DOI
  89. Myers RE, Turner B, Weinberg D, Hauck WW, Hyslop T, Brigham T, Rothermel T, Grana J, Schlackman N. Complete diagnostic evaluation in colorectal cancer screening: research design and baseline findings. Prev Med. 2001;33(4):249–60. · DOI
  90. Nilsson G, Hjemdahl P, Hässler A, Vitols S, Wallen NH, Krakau I. Feedback on prescribing rate combined with problem-oriented pharmacotherapy education as a model to improve prescribing behaviour among general practitioners. Eur J Clin Pharmacol. 2001;56:843–8. · DOI
  91. Palmer RH, Louis TA, Hsu LN, Peterson HF, Rothrock JK, Strain R, Thompson MS, Wright EA. A randomized controlled trial of quality assurance in sixteen ambulatory care practices. Med Care. 1985;1:751–70. · DOI · Paper page
  92. Palmer RH, Strain R, Maurer JV, Thompson MS. A method for evaluating performance of ambulatory pediatric tasks. Pediatrics. 1984;73(3):269–77. · doi:10.1542/peds.73.3.269
  93. Papadakis S, Cole AG, Reid RD, Assi R, Gharib M, Tulloch HE, Mullen KA, Wells G, Pipe AL. From good to great: the role of performance coaching in enhancing tobacco-dependence treatment rates. Ann Fam Med. 2018;16(6):498–506. · DOI
  94. Papadakis S, Pipe AL, Reid RD, Tulloch H, Mullen KA, Assi R, Cole AG, Wells G. Effectiveness of performance coaching for enhancing rates of smoking cessation treatment delivery by primary care providers: study protocol for a cluster randomized controlled trial. Contemp Clin Trials. 2015;1(45):184–90. · DOI
  95. Patel MS, Kurtzman GW, Kannan S, Small DS, Morris A, Honeywell S, Leri D, Rareshide CA, Day SC, Mahoney KB, Volpp KG. Effect of an automated patient dashboard using active choice and peer comparison performance feedback to physicians on statin prescribing: the PRESCRIBE cluster randomized clinical trial. JAMA Netw Open. 2018;1(3):e180818. · DOI
  96. Peiris D, Usherwood T, Panaretto K, Harris M, Hunt J, Redfern J, Zwar N, Colagiuri S, Hayman N, Lo S, Patel B. Effect of a computer-guided, quality improvement program for cardiovascular disease risk management in primary health care: the treatment of cardiovascular risk using electronic decision support cluster-randomized trial. Circ Cardiovasc Qual Outcomes. 2015;8(1):87–95. · DOI · Paper page
  97. Peiris D, Usherwood T, Panaretto K, Harris M, Hunt J, Patel B, Zwar N, Redfern J, MacMahon S, Colagiuri S, Hayman N. The Treatment of cardiovascular Risk in Primary care using Electronic Decision suppOrt (TORPEDO) study: intervention development and protocol for a cluster randomised, controlled trial of an electronic decision support and quality improvement intervention in Australian primary healthcare. BMJ Open. 2012;2(6):e002177. · DOI
  98. Pettersson E, Vernby Å, Mölstad S, Lundborg CS. Can a multifaceted educational intervention targeting both nurses and physicians change the prescribing of antibiotics to nursing home residents? A cluster randomized controlled trial. J Antimicrob Chemother. 2011;66(11):2659–66. · DOI
  99. Price-Haywood EG, Harden-Barrios J, Cooper LA. Comparative effectiveness of audit-feedback versus additional physician communication training to improve cancer screening for patients with limited health literacy. J Gen Intern Med. 2014;29:1113–21. · DOI
  100. Price-Haywood EG, Roth KG, Shelby K, Cooper LA. Cancer risk communication with low health literacy patients: a continuing medical education program. J Gen Intern Med. 2010;25:126–9. · DOI
  101. Quanbeck A, Brown RT, Zgierska AE, Jacobson N, Robinson JM, Johnson RA, Deyo BM, Madden L, Tuan WJ, Alagoz E. A randomized matched-pairs study of feasibility, acceptability, and effectiveness of systems consultation: a novel implementation strategy for adopting clinical guidelines for opioid prescribing in primary care. Implement Sci. 2018;13:1–3. · DOI
  102. Quanbeck A, Almirall D, Jacobson N, Brown RT, Landeck JK, Madden L, Cohen A, Deyo BM, Robinson J, Johnson RA, Schumacher N. The Balanced Opioid Initiative: protocol for a clustered, sequential, multiple-assignment randomized trial to construct an adaptive implementation strategy to improve guideline-concordant opioid prescribing in primary care. Implement Sci. 2020;15:1–3. · DOI
  103. Quinley JC, Shih A. Improving physician coverage of pneumococcal vaccine: a randomized trial of a telephone intervention. J Community Health. 2004;29:103–15. · DOI
  104. Raasch BA, Hays R, Buettner PG. An educational intervention to improve diagnosis and management of suspicious skin lesions. J Contin Educ Heal Prof. 2000;20(1):39–51. · DOI · Paper page
  105. Raasch B. The epidemiology, diagnosis and management of nonmelanoma skin cancer in general practice in Townsville. PhD thesis, James Cook University, Australia. 1999.
  106. Raja AS, Ip IK, Dunne RM, Schuur JD, Mills AM, Khorasani R. Effects of performance feedback reports on adherence to evidence-based guidelines in use of CT for evaluation of pulmonary embolism in the emergency department: a randomized trial. Am J Roentgenol. 2015;205(5):936–40. · DOI
  107. Rask K, Kohler SA, Wells KI, Williams JA, Diamond CC. Performance improvement interventions to improve delivery of screening services in diabetes care. JCOM-WAYNE PA-. 2001;8(11):23–30.
  108. Ruangkanchanasetr S. Laboratory investigation utilization in pediatric out-patient department Ramathibodi Hospital. J Med Assoc Thai. 1993;1(76):194–208.
  109. Sauaia A, Ralston D, Schluter WW, Marciniak TA, Havranek EP, Dunn TR. Influencing care in acute myocardial infarction: a randomized trial comparing 2 types of intervention. Am J Med Qual. 2000;15(5):197–206. · DOI · Paper page
  110. Schectman JM, Schroth WS, Verme D, Voss JD. Randomized controlled trial of education and feedback for implementation of guidelines for acute low back pain. J Gen Intern Med. 2003;18(10):773–80. · DOI
  111. Scholes D, Grothaus L, McClure J, Reid R, Fishman P, Sisk C, Lindenbaum JE, Green B, Grafton J, Thompson RS. A randomized trial of strategies to increase chlamydia screening in young women. Prev Med. 2006;43(4):343–50. · DOI
  112. Sinclair C, Frankel M. The effect of quality assurance activities on the quality of mental health services. QRB Qual Rev Bull. 1982;8(7):7–15.
  113. Siriwardena AN, Rashid A, Johnson MR, Dewey ME. Cluster randomised controlled trial of an educational outreach visit to improve influenza and pneumococcal immunisation rates in primary care. Br J Gen Pract. 2002;52(482):735–40.
  114. Solomon DH, Katz JN, La Tourette AM, Coblyn JS. Multifaceted intervention to improve rheumatologists’ management of glucocorticoid-induced osteoporosis: a randomized controlled trial. Arthritis Care Res. 2004;51(3):383–7. · DOI · Paper page
  115. Søndergaard J, Hansen DG, Aarslev P, Munck AP. A multifaceted intervention according to the Audit Project Odense method improved secondary prevention of ischemic heart disease: a randomised controlled trial. Fam Pract. 2006;23(2):198–202. · DOI
  116. Stewardson AJ, Sax H, Gayet-Ageron A, Touveneau S, Longtin Y, Zingg W, Pittet D. Enhanced performance feedback and patient participation to improve hand hygiene compliance of health-care workers in the setting of established multimodal promotion: a single-centre, cluster randomised controlled trial. Lancet Infect Dis. 2016;16(12):1345–55. · DOI
  117. Trietsch J, van Steenkiste B, Grol R, Winkens B, Ulenkate H, Metsemakers J, van der Weijden T. Effect of audit and feedback with peer review on general practitioners’ prescribing and test ordering performance: a cluster-randomized controlled trial. BMC Fam Pract. 2017;18(1):1–3. · DOI
  118. Trietsch J, van der Weijden T, Verstappen W, Janknegt R, Muijrers P, Winkens R, van Steenkiste B, Grol R, Metsemakers J. A cluster randomized controlled trial aimed at implementation of local quality improvement collaboratives to improve prescribing and test ordering performance of general practitioners: study Protocol. Implement Sci. 2009;4(1):1–4. · DOI
  119. van der Velden AW, Kuyvenhoven MM, Verheij TJ. Improving antibiotic prescribing quality by an intervention embedded in the primary care practice accreditation: the ARTI4 randomized trial. J Antimicrob Chemother. 2016;71(1):257–63. · DOI
  120. van der Weijden TR, Grol RP, Knottnerus JA. Feasibility of a national cholesterol guideline in daily practice. A randomized controlled trial in 20 general practices. Int J Qual Health Care. 1999;11(2):131–7. · DOI · Paper page
  121. Veninga CC, Øv PL, Wahlstrom RO, Muskova M, DenigG P, Berkhof J, Kochen MM, Haaijer-Ruskamp FM, Drug Education Project Group. Evaluating an educational intervention to improve the treatment of asthma in four European countries. Am J Respir Crit Care Med. 1999;160(4):1254–62. · DOI · Paper page
  122. Verstappen WH, van der Weijden T, Sijbrandij J, Smeele I, Hermsen J, Grimshaw J, Grol RP. Effect of a practice-based strategy on test ordering performance of primary care physicians: a randomized trial. JAMA. 2003;289(18):2407–12. · DOI · Paper page
  123. Verstappen WH, van der Weijden T, Dubois WI, Smeele I, Hermsen J, Tan FE, Grol RP. Improving test ordering in primary care: the added value of a small-group quality improvement strategy compared with classic feedback only. Ann Fam Med. 2004;2(6):569–75. · DOI
  124. Vingerhoets E, Wensing M, Grol RP. Feedback of patients’ evaluations of general practice care: a randomised trial. BMJ Qual Saf. 2001;10(4):224–8. · DOI
  125. Wahlström R, Kounnavong S, Sisounthone B, Phanyanouvong A, Southammavong T, Eriksson B, Tomson G. Effectiveness of feedback for improving case management of malaria, diarrhoea and pneumonia–a randomized controlled trial at provincial hospitals in Lao PDR. Tropical Med Int Health. 2003;8(10):901–9. · DOI · Paper page
  126. Walsh M, Laptook A, Kazzi SN, Engle WA, Yao Q, Rasmussen M, Buchter S, Heldt G, Rhine W, Higgins R, Poole K. A cluster-randomized trial of benchmarking and multimodal quality improvement to improve rates of survival free of bronchopulmonary dysplasia for infants with birth weights of less than 1250 grams. Pediatrics. 2007;119(5):876–90. · DOI
  127. Wang Y, Li Z, Zhao X, Wang C, Wang X, Wang D, Liang L, Liu L, Wang C, Li H, Shen H. Effect of a multifaceted quality improvement intervention on hospital personnel adherence to performance measures in patients with acute ischemic stroke in China: a randomized clinical trial. JAMA. 2018;320(3):245–54. · DOI
  128. Wang Y, Li Z, Xian Y, Zhao X, Li H, Shen H, Wang C, Liu L, Wang C, Pan Y, Wang D. Rationale and design of a cluster-randomized multifaceted intervention trial to improve stroke care quality in China: the GOLDEN BRIDGE–Acute Ischemic Stroke. Am Heart J. 2015;169(6):767–74. · DOI
  129. Wathne JS, Kleppe LK, Harthug S, Blix HS, Nilsen RM, Charani E, Smith I. The effect of antibiotic stewardship interventions with stakeholder involvement in hospital settings: a multicentre, cluster randomized controlled intervention study. Antimicrob Resist Infect Control. 2018;7(1):1–2. · DOI
  130. Willis TA, Collinson M, Glidewell L, Farrin AJ, Holland M, Meads D, Hulme C, Petty D, Alderson S, Hartley S, Vargas-Palacios A. An adaptable implementation package targeting evidence-based indicators in primary care: a pragmatic cluster-randomised evaluation. PLoS Med. 2020;17(2):e1003045. · DOI
  131. Willis TA, Hartley S, Glidewell L, Farrin AJ, Lawton R, McEachan RRC, et al. Action to Support Practices Implement Research Evidence (ASPIRE): protocol for a cluster-randomised evaluation of adaptable implementation packages targeting ‘high impact’ clinical practice recommendations in general practice. Implement Sci. 2016;11(1):1–11.
  132. Glidewell L, Willis TA, Petty D, Lawton R, McEachan RRC, Ingleson E, et al. To what extent can behaviour change techniques be identified within an adaptable implementation package for primary care? A prospective directed content analysis. Implement Sci. 2018;13(32):32. · DOI
  133. Wu Y, Li S, Patel A, Li X, Du X, Wu T, Zhao Y, Feng L, Billot L, Peterson ED, Woodward M. Effect of a quality of care improvement initiative in patients with acute coronary syndrome in resource-constrained hospitals in China: a randomized clinical trial. JAMA cardiology. 2019;4(5):418–27. · DOI
  134. Li S, Wu Y, Du X, Li X, Patel A, Peterson ED, Turnbull F, Lo S, Billot L, Laba T, Gao R. Rational and design of a stepped-wedge cluster randomized trial evaluating quality improvement initiative for reducing cardiovascular events among patients with acute coronary syndromes in resource-constrained hospitals in China. Am Heart J. 2015;169(3):349–55. · DOI
  135. Fox RD, Mazmanian PE, Putnam RW. Changing and learning in the lives of physicians. New York: Praeger; 1989.
  136. Rogers EM. Diffusion of innovations. 3rd ed. New York: Free Press; 1983.
  137. Bandura A. Self-efficacy: toward a unifying theory of behavior change. Psychol Rev. 1977;84:191–215. · DOI · Paper page
  138. Bandura A. Social foundation and thought of action: a social cognitive theory. New York: Prentice Hall; 1986.
  139. Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, Chinman MJ, Smith JL, Proctor EK, Kirchner JE. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implement Sci. 2015;10:1–8. · DOI · Paper page
  140. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38:65–76. · DOI · Paper page
  141. McHugh S, Presseau J, Luecking CT, Powell BJ. Examining the complementarity between the ERIC compilation of implementation strategies and the behaviour change technique taxonomy: a qualitative analysis. Implement Sci. 2022;17(1):1–23. · DOI
  142. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95. · DOI · Paper page

Cited by

Metadata

Authors
Sykes, M., Rosenberg-Yunger, Z. R. S., Quigley, M., Gupta, L., Thomas, O., Robinson, L., Caulfield, K., Ivers, N., & Alderson, S.
Venue
Implementation Science
Published
2024-05-28
Volume
19
Issue
1
ISSN
1748-5908
Cited by
7
References
35
Language
en
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Exploring the content and delivery of feedback facilitation co-interventions: a systematic review. https://app.cochat.ai/papers/10.1186/s13012-024-01365-9
The paper
Sykes, M., Rosenberg-Yunger, Z. R. S., Quigley, M., Gupta, L., Thomas, O., Robinson, L., Caulfield, K., Ivers, N., & Alderson, S. (2024). Exploring the content and delivery of feedback facilitation co-interventions: a systematic review. Implementation Science. https://doi.org/10.1186/s13012-024-01365-9

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.