The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Practice Feedback Interventions: 15 Suggestions for Optimizing Effectiveness
Open accessAbstract
Electronic practice data are increasingly being used to provide feedback to encourage practice improvement. However, evidence suggests that despite decades of experience, the effects of such interventions vary greatly and are not improving over time. Guidance on providing more effective feedback does exist, but it is distributed across a wide range of disciplines and theoretical perspectives. Through expert interviews; systematic reviews; and experience with providing, evaluating, and receiving practice feedback, 15 suggestions that are believed to be associated with effective feedback interventions have been identified. These suggestions are intended to provide practical guidance to quality improvement professionals, information technology developers, educators, administrators, and practitioners who receive such interventions. Designing interventions with these suggestions in mind should improve their effect, and studying the mechanisms underlying these suggestions will advance a stagnant literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697
Self-citationDeveloping and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Self-citationMayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Building a practically useful theory of goal setting and task motivation: A 35-year odyssey.
Locke, E. A., & Latham, G. P. (2002) · American Psychologist · doi:10.1037/0003-066x.57.9.705 · Cited by 7,766
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Self-citationCognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationThe visual display of quantitative information
(1985) · General Pharmacology: The Vascular System · doi:10.1016/0306-3623(85)90230-7 · Cited by 5,070
Cane, J., O’Connor, D., & Michie, S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-37 · Cited by 4,888
Self-citationShute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Tosi, H. L. (1991) · Academy of Management Review · doi:10.5465/amr.1991.4278976 · Cited by 4,145
Action control : from cognition to behavior
Kühl, J., & Beckmann, J. (1985) · Cited by 3,573
Making psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440
Self-citationA taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525
Self-citationElwyn, G. (2006) · BMJ · doi:10.1136/bmj.38926.629329.ae · Cited by 1,824
Consequences of individual feedback on behavior in organizations.
Ilgen, D. R., Fisher, C. D., & Taylor, M. S. (1979) · Journal of Applied Psychology · doi:10.1037/0021-9010.64.4.349 · Cited by 1,822
Michie, S., Johnston, M., Francis, J., Hardeman, W., & Eccles, M. (2008) · Applied Psychology · doi:10.1111/j.1464-0597.2008.00341.x · Cited by 1,789
Self-citationDesigning Web Usability: The Practice of Simplicity
Nielsen, J. (1999) · Cited by 1,778
Rethinking models of feedback for learning: the challenge of design
Boud, D., & Molloy, E. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2012.691462 · Cited by 1,636
Cleveland, W. S. (1985) · Medical Entomology and Zoology · Cited by 1,425
Overriding of Drug Safety Alerts in Computerized Physician Order Entry
van der Sijs, H., Aarts, J., Vulto, A., & Berg, M. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1809 · Cited by 1,117
Godin, G., Bélanger-Gravel, A., Eccles, M., & Grimshaw, J. (2008) · Implementation Science · doi:10.1186/1748-5908-3-36 · Cited by 1,096
Self-citationEccles, M., Grimshaw, J., Walker, A., Johnston, M., & Pitts, N. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.002 · Cited by 917
Self-citationDeveloping sustainable feedback practices
Carless, D., Salter, D., Yang, M., & Lam, J. (2011) · Studies in Higher Education · doi:10.1080/03075071003642449 · Cited by 869
Veloski, J., Boex, J. R., Grasberger, M. J., Evans, A., & Wolfson, D. B. (2006) · Medical Teacher · doi:10.1080/01421590600622665 · Cited by 500
Elwyn, G., O'Connor, A. M., Bennett, C., Newcombe, R. G., Politi, M., Durand, M.-A., Drake, E., Joseph-Williams, N., Khangura, S., Saarimaki, A., et al. (2009) · PLoS ONE · doi:10.1371/journal.pone.0004705 · Cited by 466
Giving feedback in clinical settings
Cantillon, P., & Sargeant, J. (2008) · BMJ · doi:10.1136/bmj.a1961 · Cited by 460
Eva, K. W., Armson, H., Holmboe, E., Lockyer, J., Loney, E., Mann, K., & Sargeant, J. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9290-7 · Cited by 402
Self-citationIvers, N. M., Sales, A., Colquhoun, H., Michie, S., Foy, R., Francis, J. J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/1748-5908-9-14 · Cited by 400
Self-citationIvers, N. M., Grimshaw, J. M., Jamtvedt, G., Flottorp, S., O’Brien, M. A., French, S. D., Young, J., & Odgaard-Jensen, J. (2014) · Journal of General Internal Medicine · doi:10.1007/s11606-014-2913-y · Cited by 382
Self-citationToward a Comprehensive Interdisciplinary Model of Health Care Research Use
LOGAN, J., & GRAHAM, I. D. (1998) · Science Communication · doi:10.1177/1075547098020002004 · Cited by 347
Tierney, W. M., Hui, S. L., & McDonald, C. J. (1986) · Medical Care · doi:10.1097/00005650-198608000-00001 · Cited by 337
Meta-Analysis: Audit and Feedback Features Impact Effectiveness on Care Quality
Hysong, S. J. (2009) · Medical Care · doi:10.1097/mlr.0b013e3181893f6b · Cited by 306
Sargeant, J., Lockyer, J., Mann, K., Holmboe, E., Silver, I., Armson, H., Driessen, E., MacLeod, T., Yen, W., Ross, K., et al. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000809 · Cited by 306
Reflection as a strategy to enhance task performance after feedback
Anseel, F., Lievens, F., & Schollaert, E. (2009) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2009.05.003 · Cited by 276
Is timely information always better? The effect of feedback frequency on decision making
Lurie, N. H., & Swaminathan, J. M. (2009) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2008.05.005 · Cited by 264
User Centered Design: An Integrated Approach
Vredenburg, K., Isensee, S., & Righi, C. (2001) · Medical Entomology and Zoology · Cited by 256
Foy, R., Eccles, M., Jamtvedt, G., Young, J., Grimshaw, J., & Baker, R. (2005) · BMC Health Services Research · doi:10.1186/1472-6963-5-50 · Cited by 250
Self-citationA systematic review of the use of theory in randomized controlled trials of audit and feedback
Colquhoun, H. L., Brehaut, J. C., Sales, A., Ivers, N., Grimshaw, J., Michie, S., Carroll, K., Chalifoux, M., & Eva, K. W. (2013) · Implementation Science · doi:10.1186/1748-5908-8-66 · Cited by 231
Self-citationGardner, B., Whittington, C., McAteer, J., Eccles, M. P., & Michie, S. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.01.039 · Cited by 225
Self-citationEccles, M., Steen, N., Grimshaw, J., Thomas, L., McNamee, P., Soutter, J., Wilsdon, J., Matowe, L., Needham, G., Gilbert, F., et al. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04564-5 · Cited by 222
Self-citationGoal theory vs. control theory: Contrasting approaches to understanding work motivation
Locke, E. A. (1991) · Motivation and Emotion · doi:10.1007/bf00991473 · Cited by 184
Lam, C. F., DeRue, D. S., Karam, E. P., & Hollenbeck, J. R. (2011) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2011.05.002 · Cited by 172
Feedback, the various tasks of the doctor, and the feedforward alternative
Kluger, A. N., & Van Dijk, D. (2010) · Medical Education · doi:10.1111/j.1365-2923.2010.03849.x · Cited by 134
Self-generated persuasion: Effects of the target and direction of arguments.
Briñol, P., McCaslin, M. J., & Petty, R. E. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0027231 · Cited by 132
Changing physiciansʼ practices
Fidler, H., Lockyer, J., Toews, J., & Violato, C. (1999) · Academic Medicine · doi:10.1097/00001888-199906000-00019 · Cited by 125
Building theories of knowledge translation interventions: Use the entire menu of constructs
Brehaut, J. C., & Eva, K. W. (2012) · Implementation Science · doi:10.1186/1748-5908-7-114 · Cited by 120
Self-citationIndividual versus Group Feedback in Cooperative Groups
Archer-Kath, J., Johnson, D. W., & Johnson, R. T. (1994) · The Journal of Social Psychology · doi:10.1080/00224545.1994.9922999 · Cited by 104
Thomas, R. E., Croal, B. L., Ramsay, C. R., Eccles, M., & Grimshaw, J. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68888-0 · Cited by 99
Self-citationExworthy, M., Wilkinson, E. K., McColl, A., Moore, M. V., Roderick, P., Smith, H. E., & Gabbay, J. (2003) · Social Science & Medicine · doi:10.1016/s0277-9536(02)00151-x · Cited by 91
A cognitive-science based programme to enhance study efficacy in a high and low risk setting
Metcalfe, J., Kornell, N., & Son, L. K. (2007) · The European Journal of Cognitive Psychology · doi:10.1080/09541440701326063 · Cited by 79
Ivers, N. M., Tu, K., Young, J., Francis, J., Barnsley, J. M., Shah, B. R., Upshur, R. E. G., Moineddin, R., Grimshaw, J., & Zwarenstein, M. (2013) · Implementation Science · doi:10.1186/1748-5908-8-142 · Cited by 50
Self-citationPeer mentoring in doctor performance assessment: strategies, obstacles and benefits
Overeem, K., Driessen, E. W., Arah, O. A., Lombarts, K. M. J. M. H., Wollersheim, H. C. H., & Grol, R. P. T. M. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03580.x · Cited by 48
Opiyo, N., Shepperd, S., Musila, N., Allen, E., Nyamai, R., Fretheim, A., & English, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0055067 · Cited by 44
Reiter, H., Rosenfeld, J. M., Nandagopal, K., & Eva, K. W. (2004) · Advances in Health Sciences Education · doi:10.1023/b:ahse.0000038172.97337.d5 · Cited by 38
Self-citationMitchell, E., Sullivan, F., Grimshaw, J., Donnan, P. T., & Watt, G. C. M. (2005) · PubMed · Cited by 36
Self-citationUsing Surgeon-Specific Outcome Reports and Positive Deviance for Continuous Quality Improvement
Ivanovic, J., Anstee, C., Ramsay, T., Gilbert, S., Maziak, D. E., Shamji, F. M., Sundaresan, R. S., Villeneuve, P. J., & SEELY, A. J. E. (2015) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2015.04.012 · Cited by 34
Supporting the use of health technology assessments in policy making about health systems
Lavis, J. N., Wilson, M. G., Grimshaw, J., Haynes, R. B., Ouimet, M., Raina, P. S., Gruen, R. L., & Graham, I. D. (2010) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646231000108x · Cited by 29
Self-citationSales, A. E., Fraser, K. D., Baylon, M. A. B., O’Rourke, H. M., Gao, G., Bucknall, T. K., & Maisey, S. (2015) · Implementation Science · doi:10.1186/s13012-015-0208-2 · Cited by 29
Self-citationBrown, J. D., Farnham, S. D., & Cook, K. E. (2002) · Journal of Personality · doi:10.1111/1467-6494.00181 · Cited by 10
Performance feedback: a question of source credibility.
Stull, M. K. (1986) · PubMed · Cited by 5
Cited by
Brown, B., Gude, W. T., Blakeman, T., van der Veer, S. N., Ivers, N., Francis, J. J., Lorencatto, F., Presseau, J., Peek, N., & Daker-White, G. (2019) · Implementation Science · doi:10.1186/s13012-019-0883-5 · Cited by 387
Self-citationPerry, C. K., Damschroder, L. J., Hemler, J. R., Woodson, T. T., Ono, S. S., & Cohen, D. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0876-4 · Cited by 288
Joliat, G., Kobayashi, K., Hasegawa, K., Thomson, J., Padbury, R., Scott, M., Brustia, R., Scatton, O., Tran Cao, H. S., Vauthey, J., et al. (2023) · World Journal of Surgery · doi:10.1007/s00268-022-06732-5 · Cited by 330
Feedback for learners in medical education: What is known? A scoping review.
Bing-You, R., Hayes, V., Varaklis, K., Trowbridge, R., Kemp, H., & McKelvy, D. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001578 · Cited by 256
R2C2 in action: Testing an evidence-based model to facilitate feedback and coaching in residency.
Sargeant, J., Mann, K., Manos, S., Epstein, I., Warren, A., Shearer, C., & Boudreau, M. (2017) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-16-00398.1 · Cited by 98
Metadata
- Authors
- Brehaut, J. C., Colquhoun, H. L., Eva, K. W., Carroll, K., Sales, A., Michie, S., Ivers, N., & Grimshaw, J. M.
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2016-02-23
- Volume
- 164
- Issue
- 6
- Pages
- 435
- ISSN
- 0003-4819 (ISSN-L)
- OpenAlex
- W2305807559
- Cited by
- 491
- References
- 63
- FWCI
- 30.53
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.