The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory
Open accessAbstract
BACKGROUND: Audit and feedback is a common intervention for supporting clinical behaviour change. Increasingly, health data are available in electronic format. Yet, little is known regarding if and how electronic audit and feedback (e-A&F) improves quality of care in practice. OBJECTIVE: The study aimed to assess the effectiveness of e-A&F interventions in a primary care and hospital context and to identify theoretical mechanisms of behaviour change underlying these interventions. METHODS: In August 2016, we searched five electronic databases, including MEDLINE and EMBASE via Ovid, and the Cochrane Central Register of Controlled Trials for published randomised controlled trials. We included studies that evaluated e-A&F interventions, defined as a summary of clinical performance delivered through an interactive computer interface to healthcare providers. Data on feedback characteristics, underlying theoretical domains, effect size and risk of bias were extracted by two independent review authors, who determined the domains within the Theoretical Domains Framework (TDF). We performed a meta-analysis of e-A&F effectiveness, and a narrative analysis of the nature and patterns of TDF domains and potential links with the intervention effect. RESULTS: We included seven studies comprising of 81,700 patients being cared for by 329 healthcare professionals/primary care facilities. Given the extremely high heterogeneity of the e-A&F interventions and five studies having a medium or high risk of bias, the average effect was deemed unreliable. Only two studies explicitly used theory to guide intervention design. The most frequent theoretical domains targeted by the e-A&F interventions included 'knowledge', 'social influences', 'goals' and 'behaviour regulation', with each intervention targeting a combination of at least three. None of the interventions addressed the domains 'social/professional role and identity' or 'emotion'. Analyses identified the number of different domains coded in control arm to have the biggest role in heterogeneity in e-A&F effect size. CONCLUSIONS: Given the high heterogeneity of identified studies, the effects of e-A&F were found to be highly variable. Additionally, e-A&F interventions tend to implicitly target only a fraction of known theoretical domains, even after omitting domains presumed not to be linked to e-A&F. Also, little evaluation of comparative effectiveness across trial arms was conducted. Future research should seek to further unpack the theoretical domains essential for effective e-A&F in order to better support strategic individual and team goals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485 · cited 8×
“Further exploration of possible sources of heterogeneity as detailed in previous reviews [2] showed the number of theoretical domains targeted in the control arm, feedback characteristics (graphical feedback, A&F headto-head comparison and real-time feedback frequency) and intervention duration to be the biggest expli…”
BackgroundMethodInfluentialMaking psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440
Carver, C. S., & Scheier, M. F. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.1.111 · Cited by 2,650
Murray, E., Treweek, S., Pope, C., MacFarlane, A., Ballini, L., Dowrick, C., Finch, T., Kennedy, A., Mair, F., O'Donnell, C., et al. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-63 · Cited by 1,478
Flottorp, S. A., Oxman, A. D., Krause, J., Musila, N. R., Wensing, M., Godycki-Cwirko, M., Baker, R., & Eccles, M. P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-35 · Cited by 1,138
Specifying and reporting complex behaviour change interventions: the need for a scientific method
Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-40 · Cited by 976
Individual determinants of research utilization by nurses: a systematic review update
Squires, J. E., Estabrooks, C. A., Gustavsson, P., & Wallin, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-1 · Cited by 798
Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices
Prasad, V., & Ioannidis, J. P. (2014) · Implementation Science · doi:10.1186/1748-5908-9-1 · Cited by 723
Improving Patient Care: The Implementation of Change in Health Care
(2013) · doi:10.1002/9781118525975 · Cited by 506 · cited 1×
“These barriers are complex and dynamic (they are influenced by ongoing changes in the healthcare organization which in turn influence clinicians’ behaviours) [20].”
Background
Cited by
Melloul, E., Lassen, K., Roulin, D., Grass, F., Perinel, J., Adham, M., Wellge, E. B., Kunzler, F., Besselink, M. G., Asbun, H., et al. (2020) · World Journal of Surgery · doi:10.1007/s00268-020-05462-w · Cited by 536
Brown, B., Gude, W. T., Blakeman, T., van der Veer, S. N., Ivers, N., Francis, J. J., Lorencatto, F., Presseau, J., Peek, N., & Daker-White, G. (2019) · Implementation Science · doi:10.1186/s13012-019-0883-5 · Cited by 387
Self-citationNathan, N., Elton, B., Babic, M., McCarthy, N., Sutherland, R., Presseau, J., Seward, K., Hodder, R., Booth, D., Yoong, S. L., et al. (2018) · Preventive Medicine · doi:10.1016/j.ypmed.2017.11.012 · Cited by 291
Redfern, J., Coorey, G., Mulley, J., Scaria, A., Neubeck, L., Hafiz, N., Pitt, C., Weir, K., Forbes, J., Parker, S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00325-z · Cited by 95
Engell, T., Stadnick, N. A., Aarons, G. A., & Barnett, M. L. (2023) · Global Implementation Research and Applications · doi:10.1007/s43477-023-00077-4 · Cited by 37
“As noted in Table 1, in terms of evidence for implementation strategies, audit and feedback is an empirically supported and relatively more “unpacked” implementation strategy to date (Brown et al., 2019; Ivers et al., 2012; Tuti et al., 2017).”
Background
Metadata
- Authors
- Tuti, T., Nzinga, J., Njoroge, M., Brown, B., Peek, N., English, M., Paton, C., & van der Veer, S. N.
- Venue
- Implementation Science
- Published
- 2017-05-12
- Volume
- 12
- Issue
- 1
- Pages
- 61-61
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2611998760
- Cited by
- 159
- References
- 20
- FWCI
- 2.77
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory. https://app.cochat.ai/papers/10.1186/s13012-017-0590-z
- The paper
- Tuti, T., Nzinga, J., Njoroge, M., Brown, B., Peek, N., English, M., Paton, C., & van der Veer, S. N. (2017). A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory. Implementation Science. https://doi.org/10.1186/s13012-017-0590-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.