The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Assessment, feedback and the alchemy of learning
Abstract
Context: Models of sound assessment practices increasingly emphasise assessment's formative role. As a result, assessment must not only support sound judgements about learner competence, but also generate meaningful feedback to guide learning. Reconciling the tension between assessment's focus on judgement and decision making and feedback's focus on growth and development represents a critical challenge for researchers and educators. Methods: We synthesise the literature related to this tension, framed around four trends in education research: (i) shifting perspectives on assessment; (ii) shifting perspectives on feedback; (iii) increasing attention on learners’ perceptions of assessment and feedback, and (iv) increasing attention on the influence of culture on assessment and feedback. We describe factors that produce and sustain this tension. Results: The lines between assessment and feedback frequently blur in medical education. Models of programmatic assessment deliberately use the same data for both purposes: low‐stakes individual data points are used formatively, but then are added together to support summative judgements. However, the translation of theory to practice is not straightforward. Efforts to embed meaningful feedback in programmes of learning face a multitude of threats. Learners may perceive assessment with formative intent as summative, restricting their engagement with it as feedback, and thus diminishing its learning value. A learning culture focused on assessment may limit learners’ sense of safety to explore, to experiment, and sometimes to fail. Conclusions: Successfully blending assessment and feedback demands clarity of purpose, support for learners, and a system and organisational commitment to a culture of improvement rather than a culture of performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Learning: Legitimate Peripheral Participation.
Bloch, M., Lave, J., & Wenger, E. (1994) · Man · doi:10.2307/2804509 · Cited by 39,454
Situated Learning: Legitimate Peripheral Participation
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 35,324
Politeness : Some Universals in Language Usage
Brown, P. (1987) · Cited by 12,106
Politeness: Some Universals in Language Usage
Brown, P., Levinson, S. C., & Gumperz, J. J. (1987) · Cambridge University Press eBooks · doi:10.1017/cbo9780511813085 · Cited by 10,438
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Formative assessment and the design of instructional systems
Sadler, D. R. (1989) · Instructional Science · doi:10.1007/bf00117714 · Cited by 4,285
Medical error—the third leading cause of death in the US
Makary, M. A., & Daniel, M. (2016) · BMJ · doi:10.1136/bmj.i2139 · Cited by 3,264
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
(1966) · Social Science Education Consortium eBooks · Cited by 2,483
Signature pedagogies in the professions
Shulman, L. S. (2005) · Daedalus · doi:10.1162/0011526054622015 · Cited by 2,032
Feedback in Clinical Medical Education
Ende, J. (1983) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1983.03340060055026 · Cited by 1,329
The instructional effect of feedback in test-like events.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991) · Review of Educational Research · doi:10.3102/00346543061002213 · Cited by 1,313
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
Eppich, W., & Cheng, A. (2015) · Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000072 · Cited by 1,106
Rudolph, J. W., Simon, R., Dufresne, R. L., & Raemer, D. B. (2006) · Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare · doi:10.1097/01266021-200600110-00006 · Cited by 1,094
A model for programmatic assessment fit for purpose.
van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652239 · Cited by 892
ALDERSON, J. C., & WALL, D. (1993) · Applied Linguistics · doi:10.1093/applin/14.2.115 · Cited by 847
Test-enhanced learning in medical education
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03124.x · Cited by 610
Norcini, J., Anderson, B., Bollela, V., Burch, V., Costa, M. J., Duvivier, R., Galbraith, R., Hays, R., Kent, A., Perrott, V., et al. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.551559 · Cited by 574
The “educational alliance” as a framework for reconceptualizing feedback in medical education.
Telio, S., Ajjawi, R., & Regehr, G. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000560 · Cited by 572
Core principles of assessment in competency-based medical education.
Lockyer, J., Carraccio, C., Chan, M.-K., Hart, D., Smee, S., Touchie, C., Holmboe, E. S., Frank, J. R., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315082 · Cited by 493
Repeated testing produces superior transfer of learning relative to repeated studying.
Butler, A. C. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0019902 · Cited by 492
Impact of workplace based assessment on doctors' education and performance: a systematic review
Miller, A., & Archer, J. (2010) · BMJ · doi:10.1136/bmj.c5064 · Cited by 461
Giving feedback in clinical settings
Cantillon, P., & Sargeant, J. (2008) · BMJ · doi:10.1136/bmj.a1961 · Cited by 460
Eva, K. W., Armson, H., Holmboe, E., Lockyer, J., Loney, E., Mann, K., & Sargeant, J. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9290-7 · Cited by 402
Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education.
Lefroy, J., Watling, C., Teunissen, P. W., & Brand, P. (2015) · Perspectives on Medical Education · doi:10.1007/s40037-015-0231-7 · Cited by 347
Self-citationSargeant, J., Lockyer, J., Mann, K., Holmboe, E., Silver, I., Armson, H., Driessen, E., MacLeod, T., Yen, W., Ross, K., et al. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000809 · Cited by 306
Programmatic assessment of competency-based workplace learning: when theory meets practice
Bok, H. G., Teunissen, P. W., Favier, R. P., Rietbroek, N. J., Theyse, L. F., Brommer, H., Haarhuis, J. C., van Beukelen, P., van der Vleuten, C. P., & Jaarsma, D. A. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-123 · Cited by 303
Assessment in the post-psychometric era: Learning to love the subjective and collective
Hodges, B. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.789134 · Cited by 283
Understanding the influence of emotions and reflection upon multi-source feedback acceptance and use
Sargeant, J., Mann, K., Sinclair, D., Van der Vleuten, C., & Metsemakers, J. (2008) · Advances in Health Sciences Education · doi:10.1007/s10459-006-9039-x · Cited by 274
A call to action: The controversy of and rationale for competency-based medical education
Holmboe, E. S., Sherbino, J., Englander, R., Snell, L., Frank, J. R., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315067 · Cited by 272
Learning from clinical work: the roles of learning cues and credibility judgements
Watling, C., Driessen, E., van der Vleuten, C. P. M., & Lingard, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04126.x · Cited by 261
Self-citationValidity in work‐based assessment: expanding our horizons
Govaerts, M., & van der Vleuten, C. P. (2013) · Medical Education · doi:10.1111/medu.12289 · Cited by 249
Entrustability Scales: Outlining Their Usefulness for Competency-Based Clinical Assessment
Rekman, J., Gofton, W., Dudek, N., Gofton, T., & Hamstra, S. J. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001045 · Cited by 237
Medical Education: Theory and Practice
Dornan, T., Mann, K. V., Scherpbier, A. J. J. A., & Spencer, J. (2010) · Newcastle University ePrints (Newcastle Univesity) · doi:10.25405/ncl.34176165 · Cited by 225
The impact of programmatic assessment on student learning: theory versus practice
Heeneman, S., Oudkerk Pool, A., Schuwirth, L. W. T., van der Vleuten, C. P. M., & Driessen, E. W. (2015) · Medical Education · doi:10.1111/medu.12645 · Cited by 211
The wheel of competency assessment: Presenting quality criteria for competency assessment programs
Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2006) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2006.04.006 · Cited by 190
Towards a program of assessment for health professionals: from training into practice
Eva, K. W., Bordage, G., Campbell, C., Galbraith, R., Ginsburg, S., Holmboe, E., & Regehr, G. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9653-6 · Cited by 180
Self-citationSargeant, J., Mann, K., & Ferrier, S. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02124.x · Cited by 174
Beyond individualism: professional culture and its influence on feedback
Watling, C., Driessen, E., van der Vleuten, C. P. M., Vanstone, M., & Lingard, L. (2013) · Medical Education · doi:10.1111/medu.12150 · Cited by 174
Self-citationLearning culture and feedback: an international study of medical athletes and musicians
Watling, C., Driessen, E., van der Vleuten, C. P. M., & Lingard, L. (2014) · Medical Education · doi:10.1111/medu.12407 · Cited by 162
Self-citationFeedback falling on deaf ears: residents' receptivity to feedback tempered by sender credibility
Bing-You, R. G., Paterson, J., & Levine, M. A. (1997) · Medical Teacher · doi:10.3109/01421599709019346 · Cited by 161
Focusing on the Formative: Building an Assessment System Aimed at Student Growth and Development
Konopasek, L., Norcini, J. J., & Krupat, E. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001171 · Cited by 157
Staging a performance: learners’ perceptions about direct observation during residency
LaDonna, K. A., Hatala, R. A., Lingard, L., Voyer, S., & Watling, C. (2017) · Medical Education · doi:10.1111/medu.13232 · Cited by 153
Self-citationTeunissen, P. W., Stapel, D. A., van der Vleuten, C., Scherpbier, A., Boor, K., & Scheele, F. (2009) · Academic Medicine · doi:10.1097/acm.0b013e3181a858ad · Cited by 151
Hedging to save face: a linguistic analysis of written comments on in-training evaluation reports
Ginsburg, S., van der Vleuten, C. P. M., Eva, K. W., & Lingard, L. (2015) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9622-0 · Cited by 149
Self-citationStudent perceptions of assessment and feedback in longitudinal integrated clerkships
Bates, J., Konkin, J., Suddards, C., Dobson, S., & Pratt, D. (2013) · Medical Education · doi:10.1111/medu.12087 · Cited by 145
A new framework for designing programmes of assessment
Dijkstra, J., van der Vleuten, C. P. M., & Schuwirth, L. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9205-z · Cited by 142
Ramani, S., Post, S. E., Könings, K., Mann, K., Katz, J. T., & van der Vleuten, C. (2017) · Teaching and Learning in Medicine · doi:10.1080/10401334.2016.1244014 · Cited by 138
How clinical supervisors develop trust in their trainees: a qualitative study
Hauer, K. E., Oza, S. K., Kogan, J. R., Stankiewicz, C. A., Stenfors, T., ten Cate, O., Batt, J., & O’Sullivan, P. (2015) · Medical Education · doi:10.1111/medu.12745 · Cited by 137
Larsen, D. P., Butler, A. C., Lawson, A. L., & Roediger, H. L., III (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9379-7 · Cited by 129
Watling, C., LaDonna, K. A., Lingard, L., Voyer, S., & Hatala, R. A. (2016) · Medical Education · doi:10.1111/medu.13062 · Cited by 122
Self-citationSchuwirth, L., & Ash, J. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.787140 · Cited by 118
Driessen, E., & Scheele, F. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.798403 · Cited by 110
Changing the culture of assessment: the dominance of the summative assessment paradigm
Harrison, C., Könings, K. D., Schuwirth, L., Wass, V., & van der Vleuten, C. P. M. (2017) · BMC Medical Education · doi:10.1186/s12909-017-0912-5 · Cited by 104
Understanding responses to feedback: the potential and limitations of regulatory focus theory
Watling, C., Driessen, E., van der Vleuten, C. P. M., Vanstone, M., & Lingard, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04209.x · Cited by 99
Self-citationBowen, L., Marshall, M., & Murdoch-Eaton, D. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001632 · Cited by 99
Unfulfilled promise, untapped potential: Feedback at the crossroads
Watling, C. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.889812 · Cited by 98
Self-citationVoyer, S., Cuncic, C., Butler, D. L., MacNeil, K. A., Watling, C., & Hatala, R. A. (2016) · Medical Education · doi:10.1111/medu.13067 · Cited by 85
Self-citationStudent perspectives on assessment: Experience in a competency-based portfolio system
Altahawi, F. F., Sisk, B. A., Poloskey, S. L., Hicks, C. W., & Dannefer, E. F. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652243 · Cited by 80
Test‐enhanced learning and its effect on comprehension and diagnostic accuracy
Baghdady, M. T., Carnahan, H., Lam, E. W. N., & Woods, N. N. (2014) · Medical Education · doi:10.1111/medu.12302 · Cited by 79
Test‐enhanced learning of clinical reasoning: a crossover randomised trial
Raupach, T., Andresen, J. C., Meyer, K., Strobel, L., Koziolek, M. J., Jung, W. E., Brown, J., & Anders, S. (2016) · Medical Education · doi:10.1111/medu.13069 · Cited by 74
Beyond assessment of learning toward assessment for learning: Educating tomorrow's physicians
Dannefer, E. F. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.787141 · Cited by 72
Report card from McMaster: student evaluation at a problem-based medical school
Blake, J. M., Norman, G. R., & Smith, E. K. (1995) · The Lancet · doi:10.1016/s0140-6736(95)90014-4 · Cited by 62
Bierer, S. B., Dannefer, E. F., Taylor, C. A., Hall, P. M., & Hull, A. L. (2008) · Medical Teacher · doi:10.1080/01421590802139740 · Cited by 56
The Education and Training of Future Physicians
Cavalcanti, R. B., & Detsky, A. S. (2011) · JAMA · doi:10.1001/jama.2011.1232 · Cited by 44
Work-based Assessment and Co-production in Postgraduate Medical Training
Holmboe, E. S. (2017) · GMS journal for medical education · doi:10.3205/zma001135 · Cited by 42
Madan, R., Conn, D. K., Dubo, E., Voore, P. M., & Wiesenfeld, L. (2012) · The Canadian Journal of Psychiatry · doi:10.1177/070674371205700411 · Cited by 37
The challenge of changing to an assessment for learning culture
Harrison, C., & Wass, V. (2016) · Medical Education · doi:10.1111/medu.13058 · Cited by 32
McGuire, C. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00022 · Cited by 30
Interdisciplinary direct observation: impact on precepting, residents, and faculty.
Ross, V., Mauksch, L. B., Huntington, J., & Beard, J. (2012) · PubMed · Cited by 20
An application of programmatic assessment for learning (PAL) system for general practice training
Schuwirth, L., Valentine, N. A., & Dilena, P. (2017) · Europe PMC (PubMed Central) · doi:10.3205/zma001133 · Cited by 11
Assessment est mort, vive assessment
Roberts, T. E. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.798404 · Cited by 4
Cited by
Branfield Day, L., Miles, A., Ginsburg, S., & Melvin, L. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003315 · Cited by 120
Self-citationNg, F. Y. C., Thirunavukarasu, A. J., Cheng, H., Tan, T. F., Gutierrez, L., Lan, Y., Ong, J. C. L., Chong, Y. S., Ngiam, K. Y., Ho, D., et al. (2023) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101230 · Cited by 113
Where philosophy meets culture: exploring how coaches conceptualise their roles
Watling, C. J., & LaDonna, K. A. (2019) · Medical Education · doi:10.1111/medu.13799 · Cited by 91
Self-citationSurgical Artificial Intelligence in Urology
Goldenberg, M. G. (2024) · Urologic Clinics of North America · doi:10.1016/j.ucl.2023.06.003 · Cited by 12
Predictors of faculty narrative evaluation quality in medical school clerkships
Mooney, C. J., Pascoe, J. M., Blatt, A. E., Lang, V. J., Kelly, M. S., Braun, M. K., Burch, J. E., & Stone, R. T. (2022) · Medical Education · doi:10.1111/medu.14911 · Cited by 10
Metadata
- Authors
- Watling, C. J., & Ginsburg, S.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2018-08-02
- Volume
- 53
- Issue
- 1
- Pages
- 76-85
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2885480655
- Cited by
- 427
- References
- 73
- FWCI
- 105.47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.