Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index; 4 of the 58 sources its claims cite were checked for support.

No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention

Open access

Abstract

BACKGROUND: Audit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key 'active ingredients.' DISCUSSION: Given the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the 'business as usual' approach to evaluating two-arm trials of audit and feedback interventions against usual care for common problems and settings is unlikely to contribute new generalizable findings. Future audit and feedback trials should incorporate evidence- and theory-based best practices, and address known gaps in the literature. SUMMARY: We offer an agenda for high-priority research topics for implementation researchers that focuses on reviewing best practices for designing audit and feedback interventions to optimize effectiveness.

Overview

CoChat Summary

TL;DR

This paper argues that continuing “business as usual” two-arm trials of audit and feedback (A&F) versus usual care is unlikely to produce new generalizable findings, and instead proposes an agenda for optimizing A&F design. It summarizes consensus best practices and high-priority research topics from a 2012 international expert meeting, grounded in Cochrane review evidence of a median 4.3% absolute improvement.

Key findings

  • The Cochrane review of 140 randomized A&F trials found a median 4.3% absolute improvement (interquartile range 0.5% to 16%) in provider compliance; one-quarter of interventions had relatively large positive effects, while another quarter had negative or null effects.
  • Tentative best practices include valid and recent audit data about the individual/team’s own behavior, repeated audit cycles, multi-modal feedback, delivery from a trusted source, comparison data with relevant others, targets/goals, and a clear action plan when discrepancies are evident.
  • A&F appears more effective when feedback is presented both verbally and in writing, comes from a supervisor or senior colleague, is repeated, and uses achievable benchmarks of care (top 10% of peers) rather than highlighting median peer performance; it is less effective when from a regulatory body.
  • The authors recommend shifting future research from A&F versus usual care toward head-to-head comparisons of different A&F designs, fractional factorial trials, embedded process evaluations, and studies of contextual/recipient, intervention-design, and targeted-behavior factors.

Methods

  • Design: a discussion/agenda paper summarizing outcomes from a two-day international expert meeting held in December 2012; participants were purposively sought based on contributions to A&F or related literature or as potential knowledge users, with a maximum of 30 attendees.
  • Data: the most recent Cochrane review of A&F (140 randomized trials) and the collective experiences and research programs of meeting participants.
  • Analysis: narrative synthesis and consensus discussion, producing Table 1 of tentative best practices and Table 2 of example high-priority research topics.

Limitations

  • Stated in the paper: the recommendations reflect the limitations of the studies reviewed; the considerations only reflect opinions expressed at the meeting; with a maximum of 30 attendees, important perspectives may have been omitted; and there is no present universally accepted, comprehensive list of A&F intervention components.
  • Evident from the text: the best practices are labeled “tentative,” and the paper does not conduct a formal systematic review, quantitative synthesis, or empirical validation of the proposed agenda.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/1748-5908-9-14

Cites

52 of 52 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

4 Valid · 0 Not valid · 37 Not checked · 13 Own results and interpretations

27 more claims

Create a free account to see all 54 claims and to verify the 54 references still open.

See all claims — free account
  • It may state two separate claims as one. 10
  • Probably not a substantial claim. 14

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 52 references

Research works printed but not linked: 2

  1. Doran GT: There’s a S.M.A.R.T. way to write management’s goals and objectives. AMA Forum. Management review. 1981, 70 (11): 35-36.
  2. Ivers N, Barnsley J, Upshur R, Shah B, Tu K, Grimshaw J, Zwarenstein M: My job is one patient at a time’: perceived discordance between population-level quality targets and patient-centered care inhibits quality improvement. Canadian Family Physician. 2013, in press

Cited by

See all 400

Metadata

Authors
Ivers, N. M., Sales, A., Colquhoun, H., Michie, S., Foy, R., Francis, J. J., & Grimshaw, J. M.
Affiliations
  • University of Toronto (CA)
  • University of Michigan (US)
  • Ottawa Hospital (CA)
  • University College London (GB)
  • University of Leeds (GB)
  • City, University of London (GB)
  • University of Ottawa (CA)
Corresponding author
Ivers, Noah M
Venue
Implementation Science
Published
2014-01-17
Volume
9
Issue
1
Pages
14-14
ISSN
1748-5908 (ISSN-L)
OpenAlex
W2097831015
Cited by
400
References
52
Citations by year
2026: 14 · 2025: 19 · 2024: 39 · 2023: 36 · 2022: 54 · 2021: 54 · 2020: 35 · 2019: 32 · 2018: 33 · 2017: 33 · 2016: 21 · 2015: 19 · 2014: 10
FWCI
49.93
Type
journal article
Language
en
Open access
Locations
  • Implementation Science (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
  • City Research Online (City University London) (acceptedVersion)
  • Deep Blue (University of Michigan) (submittedVersion)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by)
  • uO Research (University of Ottawa) (submittedVersion, public-domain)
  • TSpace (University of Toronto) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
Funders
  • University of Toronto
  • Canadian Institutes of Health Research
  • Department of Family and Community Medicine, University of Toronto
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
Keywords
audit and feedback, intervention design, mechanism of action, healthcare quality improvement, two-arm trials, usual care comparison, research agenda, implementation research
MeSH terms
Attitude of Health Personnel, Behavior, Feedback, Health Services Research, Humans, Medical Audit, Quality of Health Care, Evidence-Based Medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. https://app.cochat.ai/papers/10.1186/1748-5908-9-14
The paper
Ivers, N. M., Sales, A., Colquhoun, H., Michie, S., Foy, R., Francis, J. J., & Grimshaw, J. M. (2014). No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implementation Science. https://doi.org/10.1186/1748-5908-9-14

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.