The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback
Open accessAbstract
BACKGROUND: Many people advocate audit and feedback as a strategy for improving professional practice. The main results of an update of a Cochrane review on the effects of audit and feedback are reported. DATA SOURCES: The Cochrane Effective Practice and Organisation of Care Group's register up to January 2004 was searched. Randomised trials of audit and feedback that reported objectively measured professional practice in a healthcare setting or healthcare outcomes were included. REVIEW METHODS: Data were independently extracted and the quality of studies were assessed by two reviewers. Quantitative, visual and qualitative analyses were undertaken. MAIN RESULTS: 118 trials are included in the review. In the primary analysis, 88 comparisons from 72 studies were included that compared any intervention in which audit and feedback was a component to no intervention. For dichotomous outcomes, the median-adjusted risk difference of compliance with desired practice was 5% (interquartile range 3-11). For continuous outcomes, the median-adjusted percentage change relative to control was 16% (interquartile range 5-37). Low baseline compliance with recommended practice and higher intensity of audit and feedback appeared to predict the effectiveness of audit and feedback. CONCLUSIONS: Audit and feedback can be effective in improving professional practice. The effects are generally small to moderate. The absolute effects of audit and feedback are likely to be larger when baseline adherence to recommended practice is low and intensity of audit and feedback is high.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Printed educational materials: effects on professional practice and health care outcomes
Freemantle, N., Harvey, E., Wolf, F., Grimshaw, J., Grilli, R., & Bero, L. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000172 · Cited by 326
RetractedAudit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Charbonneau, D. H. (2005) · Europe PMC (PubMed Central) · Cited by 2,041
Forsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
Self-citation(2001) · PubMed · Cited by 1,709
Printed educational materials: effects on professional practice and healthcare outcomes
Giguère, A., Légaré, F., Grimshaw, J., Turcotte, S., Fiander, M., Grudniewicz, A., Makosso-Kallyth, S., Wolf, F. M., Farmer, A. P., & Gagnon, M.-P. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004398.pub3 · Cited by 878
Lomas, J. (1991) · JAMA · doi:10.1001/jama.265.17.2202 · Cited by 575
Kiefe, C. I., Allison, J. J., Williams, O. D., Person, S. D., Weaver, M. T., & Weissman, N. W. (2001) · JAMA · doi:10.1001/jama.285.22.2871 · Cited by 503
Soumerai, S. B., McLaughlin, T. J., Gurwitz, J. H., Guadagnoli, E., Hauptman, P. J., Borbas, C., Morris, N., McLaughlin, B., Gao, X., Willison, D. J., et al. (1998) · JAMA · doi:10.1001/jama.279.17.1358 · Cited by 479
Tierney, W. M., Hui, S. L., & McDonald, C. J. (1986) · Medical Care · doi:10.1097/00005650-198608000-00001 · Cited by 337
O'Brien, M. A., Freemantle, N., Oxman, A. D., Wolfe, F., Davis, D., & Herrin, J. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030 · Cited by 336
Self-citationEffects of feedback of information on clinical practice: a review.
Mugford, M., Banfield, P., & O'Hanlon, M. (1991) · BMJ · doi:10.1136/bmj.303.6799.398 · Cited by 330
A Trial of Two Strategies to Modify the Test-Ordering Behavior of Medical Residents
Martin, A. R., Wolf, M. A., Thibodeau, L. A., Dzau, V., & Braunwald, E. (1980) · New England Journal of Medicine · doi:10.1056/nejm198012043032304 · Cited by 287
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J., Kristoffersen, D., Thomson O'Brien, M., & Oxman, A. (2003) · The Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259 · Cited by 284
Self-citationFairbrother, G., Hanson, K. L., Friedman, S., & Butts, G. C. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.2.171 · Cited by 238
Lomas, J., Enkin, M., Anderson, G., Hannah, W. J., Vayda, E., & Singer, J. (1991) · PubMed · Cited by 223
Eccles, M., Steen, N., Grimshaw, J., Thomas, L., McNamee, P., Soutter, J., Wilsdon, J., Matowe, L., Needham, G., Gilbert, F., et al. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04564-5 · Cited by 222
Influencing Behavior of Physicians Ordering Laboratory Tests: A Literature Study
Axt-Adam, P., van der Wouden, J. C., & van der Does, E. (1993) · Medical Care · doi:10.1097/00005650-199309000-00003 · Cited by 198
Moher, M., Yudkin, P., Wright, L., Turner, R., Fuller, A., Schofield, T., & Mant, D. (2001) · BMJ · doi:10.1136/bmj.322.7298.1338 · Cited by 184
Hillman, A. L., Ripley, K., Goldfarb, N., Weiner, J., Nuamah, I., & Lusk, E. (1999) · Pediatrics · doi:10.1542/peds.104.4.931 · Cited by 159
Anderson, F. A. (1994) · Archives of Internal Medicine · doi:10.1001/archinte.1994.00420060103011 · Cited by 156
Effect of physician profiling on utilization: Meta-analysis of randomized clinical trials
Balas, E. A., Boren, S. A., Brown, G. D., Ewigman, B., Mitchell, J. A., & Perkoff, G. T. (1996) · Journal of General Internal Medicine · doi:10.1007/bf02599025 · Cited by 130
Buntinx, F., Winkens, R. A. G., Grol, R. P. T. M., & Knottnerus, J. A. (1993) · Family Practice · doi:10.1093/fampra/10.2.219 · Cited by 102
A target-based model for increasing influenza immunizations in private practice
Buffington, J., Bell, K., & LaForce, F. M. (1991) · Journal of General Internal Medicine · doi:10.1007/bf02598961 · Cited by 100
An evaluation of statewide strategies to reduce antibiotic overuse.
Mainous, A. G., Hueston, W. J., Love, M. M., Evans, M. E., & Finger, R. (2000) · PubMed · Cited by 91
Improving Hypertension Control: Impact of Computer Feedback and Physician Education
Dickinson, J. C., Warshaw, G. A., Gehlbach, S. H., Bobula, J. A., Muhlbaier, L. H., & Parkerson, G. R. (1981) · Medical Care · doi:10.1097/00005650-198108000-00004 · Cited by 72
Using an office system intervention to increase breast cancer screening
Kinsinger, L. S., Harris, R., Qaqish, B., Strecher, V., & Kaluzny, A. (1998) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1998.00160.x · Cited by 59
Siriwardena, A. N., Rashid, A., Johnson, M., & Dewey, M. E. (2002) · Europe PMC (PubMed Central) · Cited by 53
Evaluating the effectiveness of 2 educational interventions in family practice.
Borgiel, A. E., Williams, J. I., Davis, D. A., Dunn, E. V., Hobbs, N., Hutchison, B. G., Wilson, C. R., Jensen, J., O'Neil, J., & Bass, M. J. (1999) · Europe PMC (PubMed Central) · Cited by 49
Does feedback improve the quality of cervical smears? A randomized controlled trial.
Buntinx, F., Knottnerus, J. A., Crebolder, H. F. J. M., Seegers, T., Essed, G. G. M., & Schouten, H. J. A. (1993) · Europe PMC (PubMed Central) · Cited by 47
Soumerai, S. B., McLaughlin, T., Gurwitz, J. H., Guadagnoli, E., Hauptman, P. J., Borbas, C., Morris, N., McLaughlin, B., Gao, X., Willison, D. J., et al. (1999) · Survey of Anesthesiology · doi:10.1097/00132586-199910000-00010 · Cited by 47
Guadagnoli, E., Soumerai, S. B., Gurwitz, J. H., Borbas, C., Shapiro, C. L., Weeks, J. C., & Morris, N. (2000) · Breast Cancer Research and Treatment · doi:10.1023/a:1006475012861 · Cited by 45
van den Hombergh, P., Grol, R., van den Hoogen, H. J., & van den Bosch, W. J. (1999) · Quality in Health Care · doi:10.1136/qshc.8.3.161 · Cited by 45
Søndergaard, J., Andersen, M., Vach, K., Kragstrup, J., Maclure, M., & Gram, L. F. (2002) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-002-0454-5 · Cited by 44
Failure of low-cost audits with feedback to reduce laboratory test utilization
Wones, R. G. (1987) · Medical Care · doi:10.1097/00005650-198701000-00009 · Cited by 44
Kiefe, C. I., Allison, J. J., Williams, O. D., Person, S. D., Weaver, M. T., & Weissman, N. W. (2001) · American Journal of Ophthalmology · doi:10.1016/s0002-9394(01)01225-9 · Cited by 42
(2001) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340210310 · Cited by 40
Robling, M. R., Houston, H. L. A., Kinnersley, P., Hourihan, M. D., Cohen, D. R., Hale, J., & Hood, K. (2002) · Clinical Radiology · doi:10.1053/crad.2001.0864 · Cited by 39
Gullion, D. S., Tschann, J. M., Adamson, E. T., & Coates, T. J. (1988) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.4750080402 · Cited by 31
Baker, R., Farooqi, A., Tait, C., & Walsh, S. (1997) · Quality and Safety in Health Care · doi:10.1136/qshc.6.1.14 · Cited by 28
Sauaia, A., Ralston, D., Schluter, W. W., Marciniak, T. A., Havranek, E. P., & Dunn, T. R. (2000) · American Journal of Medical Quality · doi:10.1177/106286060001500503 · Cited by 24
Hayes, R. P., Armour, B. S., Bratzler, D. W., Moore, L., Murray, C. K., Stevens, B. R., Radford, M. J., Fitzgerald, D., Elward, K. S., & Ballard, D. J. (2001) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(01)27014-x · Cited by 15
Cited by
Clinical Practice Guidelines We Can Trust
Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, & Institute of Medicine (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,081
Overconfidence as a Cause of Diagnostic Error in Medicine
Berner, E. S., & Graber, M. L. (2008) · The American Journal of Medicine · doi:10.1016/j.amjmed.2008.01.001 · Cited by 1,034
Prior, M., Guerin, M., & Grimmer‐Somers, K. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01014.x · Cited by 507
The effects of on-screen, point of care computer reminders on processes and outcomes of care
Shojania, K. G., Jennings, A., Ramsay, C. R., Grimshaw, J. M., Kwan, J. L., & Lo, L. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001096.pub2 · Cited by 466
Cognitive interventions to reduce diagnostic error: a narrative review
Graber, M. L., Kissam, S., Payne, V. L., Meyer, A. N. D., Sorensen, A., Lenfestey, N., Tant, E., Henriksen, K., LaBresh, K., & Singh, H. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000149 · Cited by 449
Metadata
- Authors
- Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D.
- Venue
- Quality and Safety in Health Care
- Publisher
- BMJ
- Published
- 2006-12-01
- Volume
- 15
- Issue
- 6
- Pages
- 433-436
- ISSN
- 1475-3898 (ISSN-L)
- 1475-3901
- OpenAlex
- W2129159506
- Cited by
- 368
- References
- 43
- FWCI
- 4.20
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.