Quality of written narrative feedback and reflection in a modified mini-clinical evaluation exercise: an observational study
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Research has shown that narrative feedback, (self) reflections and a plan to undertake and evaluate improvements are key factors for effective feedback on clinical performance. We investigated the quantity of narrative comments comprising feedback (by trainers), self-reflections (by trainees) and action plans (by trainer and trainee) entered on a mini-CEX form that was modified for use in general practice training and to encourage trainers and trainees to provide narrative comments. In view of the importance of specificity as an indicator of feedback quality, we additionally examined the specificity of the comments. METHOD: We collected and analysed modified mini-CEX forms completed by GP trainers and trainees. Since each trainee has the same trainer for the duration of one year, we used trainer-trainee pairs as the unit of analysis. We determined for all forms the frequency of the different types of narrative comments and rated their specificity on a three-point scale: specific, moderately specific, not specific. Specificity was compared between trainee-trainer pairs. RESULTS: We collected 485 completed modified mini-CEX forms from 54 trainees (mean of 8.8 forms per trainee; range 1-23; SD 5.6). Trainer feedback was more frequently provided than trainee self-reflections, and action plans were very rare. The comments were generally specific, but showed large differences between trainee-trainer pairs. CONCLUSION: The frequency of self-reflection and action plans varied, all comments were generally specific and there were substantial and consistent differences between trainee-trainer pairs in the specificity of comments. We therefore conclude that feedback is not so much determined by the instrument as by the users. Interventions to improve the educational effects of the feedback procedure should therefore focus more on the users than on the instruments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 5×
“Based on the importance of specific comments as indicator of quality [1,7,8,11,12], we can conclude that, if comments were made, the modified assessment form elicited useful qualitative comments.”
BackgroundInfluentialShute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Inside the Black Box: Raising Standards through Classroom Assessment
Black, P., & Wiliam, D. (2010) · Phi Delta Kappan · doi:10.1177/003172171009200119 · Cited by 4,231
Workplace-based assessment as an educational tool: AMEE Guide No. 31
Norcini, J., & Burch, V. (2007) · Medical Teacher · doi:10.1080/01421590701775453 · Cited by 984
Yorke, M. (2003) · Higher Education · doi:10.1023/a:1023967026413 · Cited by 973 · cited 1×
“Research on formative assessment and feedback suggests that these are powerful tools to change trainees’ behaviour [1-4].”
BackgroundState of the science in health professional education: effective feedback
Archer, J. C. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03546.x · Cited by 783 · cited 9×
“Based on the importance of specific comments as indicator of quality [1,7,8,11,12], we can conclude that, if comments were made, the modified assessment form elicited useful qualitative comments.”
BackgroundResultInfluential“Directed” self-assessment: Practice and feedback within a social context
Sargeant, J., Mann, K., van der Vleuten, C., & Metsemakers, J. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.155 · Cited by 158 · cited 3×
“Based on the importance of specific comments as indicator of quality [1,7,8,11,12], we can conclude that, if comments were made, the modified assessment form elicited useful qualitative comments.”
BackgroundWatling, C. J., & Lingard, L. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9223-x · Cited by 139
Cited by
Believing is seeing: how people's beliefs influence goals, emotions and behaviour
Teunissen, P. W., & Bok, H. G. J. (2013) · Medical Education · doi:10.1111/medu.12228 · Cited by 99
Generative Artificial Intelligence and Large Language Models in Primary Care Medical Education
Parente, D. J. (2024) · Family Medicine · doi:10.22454/fammed.2024.775525 · Cited by 40
Van Ostaeyen, S., Embo, M., Rotsaert, T., De Clercq, O., Schellens, T., & Valcke, M. (2023) · Perspectives on Medical Education · doi:10.5334/pme.1050 · Cited by 6
Metadata
- Authors
- Pelgrim, E. A., Kramer, A. W., Mokkink, H. G., & Van der Vleuten, C. P.
- Venue
- BMC Medical Education
- Published
- 2012-10-18
- Volume
- 12
- Issue
- 1
- Pages
- 97-97
- ISSN
- 1472-6920 (ISSN-L)
- OpenAlex
- W2140058971
- Cited by
- 56
- References
- 8
- FWCI
- 3.47
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quality of written narrative feedback and reflection in a modified mini-clinical evaluation exercise: an observational study. https://app.cochat.ai/papers/10.1186/1472-6920-12-97
- The paper
- Pelgrim, E. A., Kramer, A. W., Mokkink, H. G., & Van der Vleuten, C. P. (2012). Quality of written narrative feedback and reflection in a modified mini-clinical evaluation exercise: an observational study. BMC Medical Education. https://doi.org/10.1186/1472-6920-12-97
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.