The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7
Abstract
BACKGROUND AND CONTEXT: There is a basis for the assumption that feedback can be used to enhance physicians' performance. Nevertheless, the findings of empirical studies of the impact of feedback on clinical performance have been equivocal. OBJECTIVES: To summarize evidence related to the impact of assessment and feedback on physicians' clinical performance. SEARCH STRATEGY: The authors searched the literature from 1966 to 2003 using MEDLINE, HealthSTAR, the Science Citation Index and eight other electronic databases. A total of 3702 citations were identified. INCLUSION AND EXCLUSION CRITERIA: Empirical studies were selected involving the baseline measurement of physicians' performance and follow-up measurement after they received summaries of their performance. DATA EXTRACTION: Data were extracted on research design, sample, dependent and independent variables using a written protocol. DATA SYNTHESIS: A group of 220 studies involving primary data collection was identified. However, only 41 met all selection criteria and evaluated the independent effect of feedback on physician performance. Of these, 32 (74%) demonstrated a positive impact. Feedback was more likely to be effective when provided by an authoritative source over an extended period of time. Another subset of 132 studies examined the effect of feedback combined with other interventions such as educational programmes, practice guidelines and reminders. Of these, 106 studies (77%) demonstrated a positive impact. Two additional subsets of 29 feedback studies involving resident physicians in training and 18 studies examining proxy measures of physician performance across clinical sites or groups of patients were reviewed. The majority of these two subsets also reported that feedback had positive effects on performance. HEADLINE RESULTS: Feedback can change physicians' clinical performance when provided systematically over multiple years by an authoritative, credible source. CONCLUSIONS: The effects of formal assessment and feedback on physician performance are influenced by the source and duration of feedback. Other factors, such as physicians' active involvement in the process, the amount of information reported, the timing and amount of feedback, and other concurrent interventions, such as education, guidelines, reminder systems and incentives, also appear to be important. However, the independent contributions of these interventions have not been well documented in controlled studies. It is recommended that the designers of future theoretical as well as practical studies of feedback separate the effects of feedback from other concurrent interventions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For instance, Veloski et al. [109] demonstrated that multisource feedback, which often integrates written and verbal elements, improved medical students' interpersonal skills and clinical reasoning, highlighting the value of a multimodal approach to feedback delivery.”
From Formative assessment and feedback in medical education: A practical guide: AMEE Guide No. 189 (2026) · cites this paper as [109]
In the citing paper
“Institutions can create opportunities for longitudinal teacher-learner relationships to flourish, such as extended placements [68–70].”
From Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education. (2015) · cites this paper as [68]
Citations
Cites
Pharmacological interventions for somatoform disorders in adults
Kleinstäuber, M., Witthöft, M., Steffanowski, A., van Marwijk, H., Hiller, W., & Lambert, M. J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010628.pub2 · Cited by 11,369
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
(2020) · Journal of Medical Education · doi:10.5812/jme · Cited by 3,505
Davis, D., O'Brien, M. A. T., Freemantle, N., Wolf, F. M., Mazmanian, P., & Taylor-Vaisey, A. (1999) · JAMA · doi:10.1001/jama.282.9.867 · Cited by 2,364
Oxman, A. D., Thomson, M., Davis, D. A., & Haynes, R. B. (1995) · PubMed Central · Cited by 1,847
Grimshaw, J., Shirran, L., Thomas, R. E., Mowatt, G., Fraser, C. M., Bero, L. A., Grilli, R. G., Harvey, E., Oxman, A., & O’Brien, M. A. (2001) · Medical Care · doi:10.1097/00005650-200108002-00002 · Cited by 1,794
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
(2001) · PubMed · Cited by 1,709
The Cochrane Database of Systematic Reviews
Handoll, H. H., Howe, T. E., & Madhok, R. (2002) · Physiotherapy · doi:10.1016/s0031-9406(05)60709-2 · Cited by 1,497
Peabody, J. W., Luck, J., Glassman, P., Dresselhaus, T., & Lee, M. (2000) · Journal of the American Medical Association (JAMA) · doi:10.1001/jama.283.13.1715 · Cited by 1,311
Simulation Technology for Health Care Professional Skills Training and Assessment
Issenberg, S. B. (1999) · JAMA · doi:10.1001/jama.282.9.861 · Cited by 920
Is More Information Better? The Effects of “Report Cards” on Health Care Providers
Dranove, D., Kessler, D. P., McClellan, M., & Satterthwaite, M. A. (2003) · Journal of Political Economy · doi:10.1086/374180 · Cited by 666
Methods For Measuring Patient Satisfaction With Specific Medical Encounters
Ware, J., & Hays, R. (1988) · Medical Care · doi:10.1097/00005650-198804000-00008 · Cited by 638
Rubin, H. R. (1993) · JAMA · doi:10.1001/jama.270.7.835 · Cited by 531
Continuing Medical Education and the Physician as a Learner
Mazmanian, P. E., & Davis, D. A. (2002) · JAMA · doi:10.1001/jama.288.9.1057 · Cited by 476
BEME Guide No. 1: Best Evidence Medical Education
Harden, R. M. (1999) · Medical Teacher · doi:10.1080/01421599978960 · Cited by 353
Use of Peer Ratings to Evaluate Physician Performance
Ramsey, P. G. (1993) · JAMA · doi:10.1001/jama.1993.03500130069034 · Cited by 352
Patients' Ratings of Outpatient Visits in Different Practice Settings
Rubin, H. R. (1993) · JAMA · doi:10.1001/jama.1993.03510070057036 · Cited by 336
Improving Health Care, Part 1: The Clinical Value Compass
Nelson, E. C., Mohr, J. J., Batalden, P. B., & Plume, S. K. (1996) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30228-0 · Cited by 173
Changes in Tonsillectomy Rates Associated With Feedback and Review
Wennberg, J. E., Blowers, L., Parker, R., & Gittelsohn, A. M. (1977) · PEDIATRICS · doi:10.1542/peds.59.6.821 · Cited by 165
Global rating scales in residency education
Gray, J. D. (1996) · Academic Medicine · doi:10.1097/00001888-199601000-00043 · Cited by 151
Is More Information Better? The Effects of 'Report Cards' on Health Care Providers
Dranove, D., Kessler, D. P., McClellan, M., & Satterthwaite, M. A. (2002) · National Bureau of Economic Research · doi:10.3386/w8697 · Cited by 143
Measuring physiciansʼ performances by using simulated patients
Norman, G. R., Neufeld, V. R., Walsh, A., Woodward, C., & Gliva‐McConvey, G. A. (1985) · Academic Medicine · doi:10.1097/00001888-198512000-00004 · Cited by 135
James, B. C. (2001) · New England Journal of Medicine · doi:10.1056/nejm200109273451311 · Cited by 78
Do Cardiologists Do It Better?
Nash, I. S., Nash, D. B., & Fuster, V. (1997) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(96)00528-1 · Cited by 63
Evaluation of patient care. An approach
Gonnella, J. S. (1970) · JAMA · doi:10.1001/jama.214.11.2040 · Cited by 58
Selection and Exclusion of Primary Care Physicians by Managed Care Organizations
Bindman, A. B. (1998) · JAMA · doi:10.1001/jama.279.9.675 · Cited by 53
Assessment measures in medical school, residency, and practice : the connections
Gonnella, J. S. (1993) · Medical Entomology and Zoology · Cited by 44
The Measurement of Physician Performance
Hanchak, N. A., & Schlackman, N. (1995) · Quality Management in Health Care · doi:10.1097/00019514-199504010-00001 · Cited by 43
Gonnella, J. S. (1970) · JAMA · doi:10.1001/jama.1970.03180110050012 · Cited by 39
Tu, H. T., & Reschovsky, J. D. (2002) · New England Journal of Medicine · doi:10.1056/nejmsa011250 · Cited by 38
McGuire, C. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00022 · Cited by 30
Evaluating the competence of physicians in practice
Nash, D. B., Markson, L. E., Howell, S., & Hildreth, E. A. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00024 · Cited by 29
U.S. Healthcare's quality-based compensation model.
Hanchak, N. A., Schlackman, N., & Harmon-Weiss (1996) · PubMed · Cited by 27
Woodward, C. A., Cohen, M., FERRIER, B. M., Goldsmith, C. H., & Keane, D. M. (1989) · Europe PMC (PubMed Central) · Cited by 23
Woodward, C. A., FERRIER, B. M., Cohen, M., & Goldsmith, C. H. (1990) · Teaching and Learning in Medicine · doi:10.1080/10401339009539434 · Cited by 19
The diluting effect of medical work groups on feedback efficacy in changing physician's practice
Sicotte, C., Pineault, R., Tilquin, C., & Contandriopoulos, A. (1996) · Journal of Behavioral Medicine · doi:10.1007/bf01904763 · Cited by 7
A Cost-Effective Method to Characterize Variation in Clinical Practice
Chang, K. J., Sauereisen, S., Dlutowski, M. J., Veloski, J. J., & Nash, D. B. (1999) · Evaluation & the Health Professions · doi:10.1177/01632789922034257 · Cited by 7
Self-citation
Research works printed but not linked: 5
- Hanchak NA, 1996, Health Care Finance Review, 17, 143
- O’Brien MA, 2003, The Cochrane Library, 1
- Oxman AD, 1995, Canadian Medical Association Journal, 153, 1423
- Stewart AL, 1992, Measuring Functioning and Well-being2nd edn
- Woodward CA, 1989, Canadian Medical Association Journal, 141, 897
Cited by
Sorted by citations
Workplace-based assessment as an educational tool: AMEE Guide No. 31
Norcini, J., & Burch, V. (2007) · Medical Teacher · doi:10.1080/01421590701775453 · Cited by 984
State of the science in health professional education: effective feedback
Archer, J. C. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03546.x · Cited by 783
What is feedback in clinical education?
Van De Ridder, J. M. M., Stokking, K. M., McGaghie, W. C., & Ten Cate, O. T. J. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02973.x · Cited by 686
Practice Feedback Interventions: 15 Suggestions for Optimizing Effectiveness
Brehaut, J., Colquhoun, H. L., Eva, K. W., Carroll, K. A., Sales, A. E., Michie, S., Ivers, N. M., & Grimshaw, J. (2016) · Annals of Internal Medicine · doi:10.7326/m15-2248 · Cited by 502
Impact of workplace based assessment on doctors' education and performance: a systematic review
Miller, A. P., & Archer, J. C. (2010) · BMJ · doi:10.1136/bmj.c5064 · Cited by 462
Metadata
- Authors
- Veloski, J., Boex, J. R., Grasberger, M. J., Evans, A., & Wolfson, D. B.
- Affiliations
- Thomas Jefferson University (US)
- Northeast Ohio Medical University (US)
- ABIM Foundation (US)
- Corresponding author
- Veloski, Jon
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2006-01
- Volume
- 28
- Issue
- 2
- Pages
- 117-128
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W1985455827
- Cited by
- 500
- References
- 39
- Citations by year
- 2026: 21 · 2025: 20 · 2024: 20 · 2023: 15 · 2022: 13 · 2021: 35 · 2020: 28 · 2019: 27 · 2018: 35 · 2017: 38 · 2016: 33 · 2015: 35 · 2014: 42 · 2013: 29 · 2012: 31
- FWCI
- 1.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Teacher (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- physician performance feedback, clinical performance assessment, feedback effectiveness, medical residents, educational intervention, clinical guidelines, reminder systems, incentives
- MeSH terms
- Clinical Competence, Feedback, Humans, Physicians
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review