The effect of external feedback on the management of medicare inpatients with congestive heart failure
Abstract
The purpose of this study was to compare the effect of 2 feedback strategies on the adherence to congestive heart failure (CHF) guidelines. Thirty-two hospitals in 4 states were randomized to receive either a written feedback intervention (low-intensity intervention [LII]) or an intervention involving feedback, a physician liaison, and quality improvement tools (high-intensity intervention [HII]). CHF quality indicators were assessed, and quality managers were interviewed at baseline and remeasurement. No significant changes in quality indicators were found as a result of either intervention. Seventy-eight percent of quality managers indicated that hospital project implementation had not begun until shortly before remeasurement. HII quality managers perceived the CHF project as significantly more successful compared with LII quality managers (63% versus 13%, P < .01). Evaluation of the effects of external feedback on practice behavior requires sufficient time for organizational and individual clinician change to occur. Physician liaisons may play a role in facilitating this change.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Hayes 2002 found no statistically significant effect on heart failure (median adjusted RD = -1%; no P values reported).
“Hayes 2002 conducted a very similar trial targeting heart failure, again finding no statistically significant effect (median adjusted RD = ‐1%; no P values reported).”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Hayes 2002
Cites
1 retracted
O’Brien, M. A., Oxman, A. D., Davis, D., Haynes, R. B., Freemantle, N., & Harvey, E. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000260 · Cited by 123 · see citing works
RetractedRogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Why Don't Physicians Follow Clinical Practice Guidelines?: A Framework for Improvement
Cabana, M. D., Rand, C. S., Powe, N. R., Wu, A. W., Wilson, M. H., Abboud, P.-A. C., & Rubin, H. R. (1999) · JAMA · doi:10.1001/jama.282.15.1458 · Cited by 6,677 · see citing works
Transtheoretical therapy: Toward a more integrative model of change.
Prochaska, J. O., & DiClemente, C. C. (1982) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0088437 · Cited by 3,922 · see citing works
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763 · see citing works
Evidence for the effectiveness of CME. A review of 50 randomized controlled trials
Davis, D. A. (1992) · JAMA · doi:10.1001/jama.268.9.1111 · Cited by 1,065 · see citing works
Changing Physicians' Practices
Greco, P. J., & Eisenberg, J. M. (1993) · New England Journal of Medicine · doi:10.1056/nejm199310213291714 · Cited by 976 · see citing works
Shortell, S. M., O'Brien, J. L., Carman, J. M., FOSTER, R. W. G., Hughes, E. F., Boerstler, H., & O’Connor, E. J. (1995) · Europe PMC (PubMed Central) · Cited by 678 · see citing works
Quality of Medical Care Delivered to Medicare Beneficiaries
Jencks, S. F., Cuerdon, T. T., Burwen, D. R., Fleming, B. B., Houck, P. M., Kussmaul, A. E., Nilasena, D. S., Ordin, D. L., & Arday, D. R. (2000) · JAMA · doi:10.1001/jama.284.13.1670 · Cited by 647 · see citing works
Lockyer, J. (1997) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.4750170109 · Cited by 620 · see citing works
Heart failure: Evaluation and care of patients with left ventricular systolic dysfunction
Konstam, M. A., Dracup, K., Baker, D. W., Bottorff, M. B., Brooks, N. H., Dacey, R. A., Dunbar, S. B., Jackson, A. B., Jessup, M. L., Johnson, J. C., et al. (1995) · Journal of Cardiac Failure · doi:10.1016/1071-9164(95)90021-7 · Cited by 474 · see citing works
Prochaska, J. O., & Norcross, J. C. (1983) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0088487 · Cited by 260 · see citing works
The health care quality improvement initiative. A new approach to quality assurance in Medicare
Jencks, S. F. (1992) · JAMA · doi:10.1001/jama.268.7.900 · Cited by 256 · see citing works
Guidelines for the Evaluation and Management of Heart Failure
(1995) · Journal of the American College of Cardiology · doi:10.1016/0735-1097(95)00469-6 · Cited by 222 · see citing works
Changing Physician Behavior to Improve Disease Prevention
Cohen, S. J., Halvorson, H. W., & Gosselink, C. A. (1994) · Preventive Medicine · doi:10.1006/pmed.1994.1040 · Cited by 179 · see citing works
The Health Care Quality Improvement Initiative
Jencks, S. F. (1992) · JAMA · doi:10.1001/jama.1992.03490070082047 · Cited by 167 · see citing works
Hospital Leaders' Opinions of the HCFA Mortality Data
Berwick, D. M. (1990) · JAMA · doi:10.1001/jama.1990.03440020081037 · Cited by 136 · see citing works
Keys for successful implementation of total quality management in hospitals
Carman, J. M., Shortell, S. M., Foster, R. W. G., Hughes, E. F. X., Boerstler, H., OʼBrien, J. L., & Ej, O. (1996) · Health Care Management Review · doi:10.1097/00004010-199624000-00005 · Cited by 122 · see citing works
(1997) · Archives of Internal Medicine · doi:10.1001/archinte.1997.00440310067007 · Cited by 100 · see citing works
Meehan, T. P., Hennen, J., Radford, M. J., Petrillo, M. K., Elstein, P., & Ballard, D. J. (1995) · Annals of Internal Medicine · doi:10.7326/0003-4819-122-12-199506150-00007 · Cited by 65 · see citing works
Improving Health Care, Part 3: Clinical Benchmarking for Best Patient Care
Mohr, J. J., Mahoney, C. C., Nelson, E. C., Batalden, P. B., & Plume, S. K. (1996) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30268-1 · Cited by 33 · see citing works
Rp, H., & Dj, B. (1995) · PubMed · Cited by 25 · see citing works
Hayes, R. P., Armour, B. S., Bratzler, D. W., Moore, L., Murray, C. K., Stevens, B. R., Radford, M. J., Fitzgerald, D., Elward, K. S., & Ballard, D. J. (2001) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(01)27014-x · Cited by 15 · see citing works
Bratzler, D. W., Bumpus, L. J., Shook, C., McCargar, P. A., Ruane, T. J., Stalhandske, E. J., Albrich, M. J., Medak, R. E., Pathak, J., Shine, M. E., et al. (1998) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30397-2 · Cited by 14 · see citing works
Penland, T. (1997) · International Journal for Quality in Health Care · doi:10.1093/intqhc/9.1.69 · Cited by 12 · see citing works
Using Clinical Guidelines: Impact on Public Policy, Clinical Policy, and Individual Care Decisions
Eisenberg, J. M., & Foster, N. E. (1993) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(93)19094-9 · Cited by 10 · see citing works
Hayes, R. P., Lundberg, M. T., & Ballard, D. (1994) · Medical Care Review · doi:10.1177/107755879405100103 · Cited by 7 · see citing works
Flagged first, then by citations
1 of the 28 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485 · see citing works
Using quality indicators to improve hospital care: a review of the literature
Vos, M. D., Graafmans, W. C., Kooistra, M., Meijboom, B. R., van der Voort, P., & Westert, G. P. (2009) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzn059 · Cited by 208 · see citing works
Does the Collaborative Model Improve Care for Chronic Heart Failure?
Asch, S. M., Baker, D. W., KEESEY, J. W., Broder, M. S., Schonlau, M., Rosen, M., Wallace, P., & Keeler, E. B. (2005) · Medical Care · doi:10.1097/01.mlr.0000167182.72251.a1 · Cited by 95 · see citing works
Review: What Can We Learn From Quality Improvement Research?
Alexander, J. A., & Hearld, L. R. (2009) · Medical Care Research and Review · doi:10.1177/1077558708330424 · Cited by 91 · see citing works
Audit and feedback: effects on professional practice
Ivers, N. M., Yogasingam, S., Lacroix, M., Brown, K. A., Antony, J., Soobiah, C., Simeoni, M., Willis, T. A., Crawshaw, J., Antonopoulou, V., et al. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub4 · Cited by 103 · see citing works
Interventions to improve adherence to cardiovascular disease guidelines: a systematic review
Jeffery, R. A., To, M. J., Hayduk-Costa, G., Cameron, A., Taylor, C., Zoost, C. V., & Hayden, J. A. (2015) · BMC Family Practice · doi:10.1186/s12875-015-0341-7 · Cited by 55 · see citing works
Improving Communication in Heart Failure Patient Care
Goldstein, N. E., Mather, H. L., McKendrick, K., Gelfman, L. P., Hutchinson, M. D., Lampert, R. J., Lipman, H. I., Matlock, D. D., Strand, J. J., Swetz, K. M., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.07.058 · Cited by 42 · see citing works
Hovlid, E., Braut, G. S., Hannisdal, E., Walshe, K., Bukve, O., Flottorp, S. A., Stensland, P., & Frich, J. C. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038850 · Cited by 27 · see citing works
Thoonsen, A. C., Schoten, S. M. V., Merten, H., van Beusekom, I., Schoonmade, L. J., Delnoij, D. M. J., & de Bruijne, M. C. (2024) · Health Policy · doi:10.1016/j.healthpol.2024.105135 · Cited by 31 · see citing works
Agarwal, A., Bahiru, E. M., Yoo, S. G. K., Berendsen, M. A., Harikrishnan, S., Hernandez, A. F., Prabhakaran, D., & Huffman, M. D. (2019) · Heart · doi:10.1136/heartjnl-2018-314129 · Cited by 17 · see citing works
Cotterill, S., Tang, M. Y., Powell, R., Howarth, E., McGowan, L. J., Roberts, J., Brown, B. C., & Rhodes, S. (2020) · Health Services and Delivery Research · doi:10.3310/hsdr08410 · Cited by 15 · see citing works
Exploring the content and delivery of feedback facilitation co-interventions: a systematic review
Sykes, M. J., Rosenberg-Yunger, Z. R. S., Quigley, M., Gupta, L., Thomas, O., Robinson, L. J., Caulfield, K., Ivers, N. M., & Alderson, S. L. (2024) · Implementation Science · doi:10.1186/s13012-024-01365-9 · Cited by 7 · see citing works
Hauptman, P. J., & Burroughs, T. E. (2004) · The American Journal of Medicine · doi:10.1016/j.amjmed.2004.07.027 · Cited by 1 · see citing works
Hempel, S., Ganz, D. A., Clifford, M., Newberry, S. J., Lim, Y.-W., Larkin, J., Shanman, R., Wertheimer, S. R., Wenger, N. S., Roth, C. P., et al. (2011)
(2013) · doi:10.1201/b15807-1
- Authors
- Hayes, R. P., Baker, D. W., Luthi, J.-C., Baggett, R. L., McClellan, W., Fitzgerald, D., Abrams, F. R., Bratzler, D., & Ballard, D. J.
- Affiliations
- Eli Lilly (United States) (US)
- Georgia Medical Care Foundation, Atlanta
- CFMC, Aurora, Colo
- Oklahoma Foundation for Medical Quality (US)
- Baylor Scott & White Health (US)
- Corresponding author
- Hayes, Risa P.
- Venue
- American Journal of Medical Quality
- Published
- 2002-11
- Volume
- 17
- Issue
- 6
- Pages
- 225-235
- ISSN
- 1062-8606 (ISSN-L)
- 1555-824X
- OpenAlex
- W2009805586
- Cited by
- 15
- References
- 28
- Citations by year
- 2025: 1 · 2024: 2 · 2020: 2 · 2019: 2 · 2015: 1 · 2013: 1 · 2012: 1
- FWCI
- 1.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Medical Quality (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Healthcare Quality and Management
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- congestive heart failure, external feedback, guideline adherence, Medicare inpatients, hospital quality improvement, quality managers, quality indicators, organizational change, clinician behavior change
- MeSH terms
- Aged, Feedback, Medicare, Heart Failure, Humans, Medical Staff, Hospital, Practice Patterns, Physicians', Quality Assurance, Health Care, United States, Multivariate Analysis, Practice Guidelines as Topic, Guideline Adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
