Audit and feedback and clinical practice guideline adherence: Making feedback actionable
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
BACKGROUND: As a strategy for improving clinical practice guideline (CPG) adherence, audit and feedback (A&F) has been found to be variably effective, yet A&F research has not investigated the impact of feedback characteristics on its effectiveness. This paper explores how high performing facilities (HPF) and low performing facilities (LPF) differ in the way they use clinical audit data for feedback purposes. METHOD: Descriptive, qualitative, cross-sectional study of a purposeful sample of six Veterans Affairs Medical Centers (VAMCs) with high and low adherence to six CPGs, as measured by external chart review audits. One-hundred and two employees involved with outpatient CPG implementation across the six facilities participated in one-hour semi-structured interviews where they discussed strategies, facilitators and barriers to implementing CPGs. Interviews were analyzed using techniques from the grounded theory method. RESULTS: High performers provided timely, individualized, non-punitive feedback to providers, whereas low performers were more variable in their timeliness and non-punitiveness and relied on more standardized, facility-level reports. The concept of actionable feedback emerged as the core category from the data, around which timeliness, individualization, non-punitiveness, and customizability can be hierarchically ordered. CONCLUSION: Facilities with a successful record of guideline adherence tend to deliver more timely, individualized and non-punitive feedback to providers about their adherence than facilities with a poor record of guideline adherence. Consistent with findings from organizational research, feedback intervention characteristics may influence the feedback's effectiveness at changing desired behaviors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This fits well with previous qualitative work comparing high and low performing hospitals finding that feedback with a punitive tone seems to be less effective (Hysong 2006).”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Hysong 2006
In the citing paper
“The effectiveness of A&F may be influenced by the characteristics of the targeted behavior, the recipients, their context, and the components of the A&F intervention itself [9,15,16].”
From No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention (2014) · cites this paper as [15]
In the citing paper
“Conversely, feedback is less effective when it comes from a regulatory body, agreeing with qualitative work suggesting that feedback perceived to be potentially punitive appeared less effective than a supportive approach [15,20].”
From No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention (2014) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
O'Brien, M. A., Oxman, A. D., Davis, D., Haynes, R. B., Freemantle, N., & Harvey, E. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000260 · Cited by 123
Retracted(1998) · Sage eBooks · Cited by 38,631
The Discovery of Grounded Theory: Strategies for Qualitative Research
Glaser, B. G., & Strauss, A. L. (2017) · Aldine (Routledge reprint) · doi:10.4324/9780203793206 · Cited by 25,789
The Discovery of Grounded Theory
Glaser, B. G., & Strauss, A. L. (2017) · The Discovery of Grounded Theory · doi:10.4324/9780203793206-1 · Cited by 8,344
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882 · cited 5×
“Third is non-punitiveness – feedback delivered in a non-punitive way is less likely to be resisted by the recipient regardless of content [15,23,24], thus”
BackgroundInfluentialAudit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044 · cited 2×
“Grimshaw and colleagues[5] reported a median effect size of A&F of +7% compared to no intervention using dichotomous process measures, with effect sizes ranging from 1.”
BackgroundMethodAudit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912 · cited 3×
“Along similar lines, Jamtvedt and colleagues [6] reported a median adjusted relative risk of non-compliance of .”
BackgroundEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J. M., Thomas, R. E., MacLennan, G., Fraser, C., Ramsay, C. R., Vale, L., Whitty, P., Eccles, M. P., Matowe, L., Shirran, L., et al. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305290190 · Cited by 864
DeShon, R. P., Kozlowski, S. W. J., Schmidt, A. M., Milner, K. R., & Wiechmann, D. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.6.1035 · Cited by 606 · cited 2×
“Timely feedback has long been positively associated with feedback effectiveness in the organizational literature,[13] as has the need for individualized feedback[21,22].”
BackgroundAudit and feedback: Effects on professional practice and healthcare outcomes
Jamtvedt, G., Young, J., Kristoffersen, D., Thomson O'Brien, M., & Oxman, A. (2003) · Physiotherapy · doi:10.1016/s0031-9406(05)60176-9 · Cited by 582
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J., Kristoffersen, D., Thomson O'Brien, M., & Oxman, A. (2003) · The Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259 · Cited by 284
Performance appraisal : state of the art in practice
Smither, J. W. (1998) · Jossey-Bass Publishers eBooks · Cited by 254
Foy, R., Eccles, M., Jamtvedt, G., Young, J., Grimshaw, J., & Baker, R. (2005) · BMC Health Services Research · doi:10.1186/1472-6963-5-50 · Cited by 250 · cited 1×
“Such studies attribute much of the variability in effect of the interventions to (often unrecognized) differences in the characteristics of the feedback used in the intervention and/or to the conditions under which A&F is more likely to be effective [6-9].”
BackgroundLeung, K., Su, S., & Morris, M. W. (2001) · Human Relations · doi:10.1177/0018726701549002 · Cited by 234 · cited 1×
“Feedback delivered in a non-punitive way has been empirically linked to increased likelihood of feedback acceptance[25], a critical moderator of the relationship between feedback and performance[26].”
BackgroundEccles, M., Steen, N., Grimshaw, J., Thomas, L., McNamee, P., Soutter, J., Wilsdon, J., Matowe, L., Needham, G., Gilbert, F., et al. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04564-5 · Cited by 222 · cited 1×
“In clinical practice guideline (CPG) implementation, A&F has been used to attempt to increase guideline adherence across a wide variety of settings and conditions, such as inpatient management of chronic obstructive pulmonary disease (COPD)[1], test ordering in primary care[2,3], and angiotensin-converting enzyme (ACE…”
BackgroundA Covariance Structure Analysis of Employees' Response to Performance Feedback.
Kinicki, A. J., Prussia, G. E., Wu, B. (., & McKee-Ryan, F. M. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.6.1057 · Cited by 215 · cited 1×
“Feedback delivered in a non-punitive way has been empirically linked to increased likelihood of feedback acceptance[25], a critical moderator of the relationship between feedback and performance[26].”
BackgroundData feedback efforts in quality improvement: lessons learned from US hospitals
Bradley, E. H. (2004) · Quality and Safety in Health Care · doi:10.1136/qhc.13.1.26 · Cited by 198
Relationships among feedback sign, self-efficacy, and acceptance of performance feedback.
Nease, A. A., Mudgett, B. O., & Quiñones, M. A. (1999) · Journal of Applied Psychology · doi:10.1037//0021-9010.84.5.806 · Cited by 144 · cited 1×
“Third is non-punitiveness – feedback delivered in a non-punitive way is less likely to be resisted by the recipient regardless of content [15,23,24], thus”
BackgroundThe Effect of Feedback Sign on Task Performance Depends on Self-Concept Discrepancies.
Vancouver, J. B., & Tischner, E. C. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.6.1092 · Cited by 106 · cited 1×
“, whether it is positive or negative)[14], and its content (e.”
BackgroundIndividual versus Group Feedback in Cooperative Groups
Archer-Kath, J., Johnson, D. W., & Johnson, R. T. (1994) · The Journal of Social Psychology · doi:10.1080/00224545.1994.9922999 · Cited by 92 · cited 2×
“Timely feedback has long been positively associated with feedback effectiveness in the organizational literature,[13] as has the need for individualized feedback[21,22].”
BackgroundExworthy, M., Wilkinson, E. K., McColl, A., Moore, M., Roderick, P., Smith, H., & Gabbay, J. (2003) · Social Science & Medicine · doi:10.1016/s0277-9536(02)00151-x · Cited by 90 · cited 1×
“Earlier A&F research has suggested that the timing of feedback delivery can influence the resulting behavior change[10], as can the credibility of the feedback source [11-13].”
BackgroundThe effect of audit and feedback on immunization delivery
Bordley, W. C., Chelminski, A., Margolis, P. A., Kraus, R., Szilagyi, P. G., & Vann, J. J. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(00)00126-4 · Cited by 69 · cited 1×
“Such studies attribute much of the variability in effect of the interventions to (often unrecognized) differences in the characteristics of the feedback used in the intervention and/or to the conditions under which A&F is more likely to be effective [6-9].”
BackgroundLyons, S. S. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1495 · Cited by 66
Not of One Mind: Mental Models of Clinical Practice Guidelines in the Veterans Health Administration
Hysong, S. J., Best, R. G., Pugh, J. A., & Moore, F. I. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00387.x · Cited by 62
Self-citationRobinson, M. B. (1994) · Journal of Epidemiology and Community Health · doi:10.1136/jech.48.5.435 · Cited by 61 · cited 1×
“Earlier A&F research has suggested that the timing of feedback delivery can influence the resulting behavior change[10], as can the credibility of the feedback source [11-13].”
BackgroundHysong, S. J., Best, R. G., & Pugh, J. A. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2006.00610.x · Cited by 55
Self-citationBaker, R., Falconer Smith, J., & Lambert, P. C. (2003) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813430310002995 · Cited by 40
Harvey, P. A., Murphy, M. C., Dornom, E., Berlowitz, D. J., Lim, W. K., & Jackson, B. (2005) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2004.00754.x · Cited by 26 · cited 2×
“If one looks at some of the other guidelines, such as our COPD guideline, there we really don't have a formal system set up for monitoring that.”
BackgroundGoff, D. C., Massing, M. W., Bertoni, A. G., Davis, J., Ambrosius, W. T., McArdle, J. A., Duren‐Winfield, V., Sueta, C. A., & Croft, J. B. (2005) · American Heart Journal · doi:10.1016/j.ahj.2004.12.025 · Cited by 19 · cited 1×
“In clinical practice guideline (CPG) implementation, A&F has been used to attempt to increase guideline adherence across a wide variety of settings and conditions, such as inpatient management of chronic obstructive pulmonary disease (COPD)[1], test ordering in primary care[2,3], and angiotensin-converting enzyme (ACE…”
BackgroundVeterans Health Administration
National Cancer Institute (2020) · Definitions · doi:10.32388/hreccp · Cited by 13
(2006) · Age and Ageing · doi:10.1093/ageing/afj107 · Cited by 8
Staff Nurse Performance: Effects of Goal-Setting and Performance Feedback
Stull, M. K. (1986) · JONA The Journal of Nursing Administration · doi:10.1097/00005110-198607000-00005 · Cited by 7
Performance feedback: a question of source credibility.
Stull, M. K. (1986) · PubMed · Cited by 5
Research works printed but not linked: 2
- Pugh JA Knowledge management and clinical practice guideline implementation [Final Report] CPI 99129-1 2001 San Antonio, TX, Veterans Evidence-Based Implementation Dissemination Center
- Muhr T Atlas ti – Short User's Manual [42 Build 061] 2001 Berlin, Germany, Scientific Software Development
Cited by
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Barriers and Strategies in Guideline Implementation—A Scoping Review
Fischer, F., Lange, K., Klose, K., Greiner, W., & Kraemer, A. (2016) · Healthcare · doi:10.3390/healthcare4030036 · Cited by 900
“[49] Review n/a Disease-specific: Hypertension [50] Study Australia Disease-specific: Vascular diseases [51] Study USA Generic [52] Study USA Generic [53] Study USA Disease-specific: Angina [54] Review Germany Generic [55] Study Spain Disease-specific: Hypertension [20] Study Netherlands Generic [56] Study Netherlands…”
BackgroundWinstone, N. E., Nash, R. A., Parker, M., & Rowntree, J. (2017) · Educational Psychologist · doi:10.1080/00461520.2016.1207538 · Cited by 884
Boyce, M. B., Browne, J. P., & Greenhalgh, J. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-002524 · Cited by 505
The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare
Miller, C. J., Barnett, M. L., Baumann, A. A., Gutner, C. A., & Wiltsey-Stirman, S. (2021) · Implementation Science · doi:10.1186/s13012-021-01105-3 · Cited by 490
“, audit and feedback [12]) to more intensive strategies that include multiple components and may act on more than one level of a health system (e.”
Background
Metadata
- Authors
- Hysong, S. J., Best, R. G., & Pugh, J. A.
- Affiliations
- Michael E. DeBakey VA Medical Center (US)
- Lockheed Martin (United States) (US)
- The University of Texas at San Antonio Health Science Center (US)
- Corresponding author
- Hysong, Sylvia J
- Venue
- Implementation Science
- Published
- 2006-04-28
- Volume
- 1
- Issue
- 1
- Pages
- 9-9
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC1479835
- OpenAlex
- W2139258049
- Cited by
- 371
- References
- 34
- Citations by year
- 2026: 8 · 2025: 10 · 2024: 27 · 2023: 20 · 2022: 26 · 2021: 31 · 2020: 22 · 2019: 24 · 2018: 24 · 2017: 26 · 2016: 26 · 2015: 20 · 2014: 27 · 2013: 17 · 2012: 16
- FWCI
- 8.36
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- U.S. Department of Veterans Affairs
- Health Services Research and Development
- University of Texas Health Science Center at San Antonio
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- audit and feedback, clinical practice guideline adherence, actionable feedback, feedback characteristics, personalized feedback, guideline implementation, Veterans Affairs hospitals, provider behavior change
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.