A qualitative textual analysis of feedback comments in ePortfolios: quality and alignment with the CanMEDS roles
Open accessAbstract
Introduction: Competency-based education requires high-quality feedback to guide students’ acquisition of competencies. Sound assessment and feedback systems, such as ePortfolios, are needed to facilitate seeking and giving feedback during clinical placements. However, it is unclear whether the written feedback comments in ePortfolios are of high quality and aligned with the current competency focus. Therefore, this study investigates the quality of written feedback comments in ePortfolios of healthcare students, as well as how these feedback comments align with the CanMEDS roles. Methods: A qualitative textual analysis was conducted. 2,349 written feedback comments retrieved from the ePortfolios of 149 healthcare students (specialist medicine, general practice, occupational therapy, speech therapy and midwifery) were analysed retrospectively using deductive content analysis. Two structured categorisation matrices, one based on four literature-derived feedback quality criteria (performance, judgment, elaboration and improvement) and another one on the seven CanMEDS roles (Medical Expert, Communicator, Collaborator, Leader, Health Advocate, Scholar and Professional), guided the analysis. Results: The minority of the feedback comments (n = 352; 14.9%) could be considered of high quality because they met all four quality criteria. Most feedback comments were of moderate quality and met only two to three quality criteria. Regarding the CanMEDS roles, the Medical Expert role was most frequently represented in the feedback comments, as opposed to the roles Leader and Health Advocate. Discussion: The results highlighted that providing high-quality feedback is challenging. To respond to these challenges, it is recommended to set up individual and continuous feedback training.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Many studies report that the quality of human feedback varies widely depending on the provider and the situation.
“many studies report that the quality of human feedback varies widely depending on the provider and the situation [29-31]”
From AI-Generated Versus Human Supervisor Feedback on Medical Students’ Clinical Clerkship Logs: Cross-Sectional Convergent Mixed Methods Study (2026) · cites this paper as [31]
The Results (Quality of written feedback comments; page unavailable) classify comments as low, moderate, or high quality, showing variation in this study. The Discussion (page unavailable) cites one study associating quality with provider gender, but says variation by feedback phase is only possible and was not assessed. It does not establish that many studies found wide variation depending on both provider and situation. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · see citing works
The qualitative content analysis process
Elo, S., & Kyngäs, H. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04569.x · Cited by 22,617 · see citing works
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · see citing works
Understanding and Applying Research Paradigms in Educational Contexts
Kivunja, C., & Kuyini, A. B. (2017) · International Journal of Higher Education · doi:10.5430/ijhe.v6n5p26 · Cited by 1,216 · see citing works
The role of assessment in competency-based medical education
Holmboe, E. S., Sherbino, J., Long, D. M., Swing, S. R., Frank, J. R., & Collaborators, F. T. I. C. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.500704 · Cited by 956 · see citing works
What is feedback in clinical education?
Van De Ridder, J. M. M., Stokking, K. M., McGaghie, W. C., & Ten Cate, O. T. J. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02973.x · Cited by 686 · see citing works
A contemporary approach to validity arguments: a practical guide to K ane's framework
Cook, D. A., Brydges, R., Ginsburg, S., & Hatala, R. A. (2015) · Medical Education · doi:10.1111/medu.12678 · Cited by 644 · see citing works
Cole, F. L. (1988) · Clinical Nurse Specialist · doi:10.1097/00002800-198800210-00025 · Cited by 419 · see citing works
A call to action: The controversy of and rationale for competency-based medical education
Holmboe, E. S., Sherbino, J., Englander, R., Snell, L. S., Frank, J. R., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315067 · Cited by 276 · see citing works
Rodger, S., Webb, G., Devitt, L., GILBERT, J. H. V., Wrightson, P. A., & McMeeken, J. M. (2008) · PubMed · Cited by 231 · see citing works
The INCEpTION Platform: Machine-Assisted and Knowledge-Oriented Interactive Annotation
Klie, J.-C., Bugert, M., Boullosa, B., de Castilho, R. E., & Gurevych, I. (2018) · TUbilio (Technical University of Darmstadt) · Cited by 200 · see citing works
Reading between the lines: faculty interpretations of narrative evaluation comments
Ginsburg, S., Regehr, G., Lingard, L., & Eva, K. W. (2015) · Medical Education · doi:10.1111/medu.12637 · Cited by 138 · see citing works
Ginsburg, S., van der Vleuten, C. P. M., & Eva, K. W. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001669 · Cited by 125 · see citing works
Bing‐You, R. G., Varaklis, K., Hayes, V., Trowbridge, R. L., Kemp, H., & McKelvy, D. J. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001927 · Cited by 122 · see citing works
How Clerkship Students Learn From Real Patients in Practice Settings
Steven, K., Wenger, É., Boshuizen, H. P. A., Scherpbier, A. J. J. A., & Dornan, T. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000129 · Cited by 94 · see citing works
Ginsburg, S., Watling, C., Schumacher, D. J., Gingerich, A., & Hatala, R. A. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004089 · Cited by 64 · see citing works
Canavan, C., Holtman, M. C., Richmond, M., & Katsufrakis, P. J. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ed4cdb · Cited by 62 · see citing works
Pelgrim, E. A. M., Kramer, A. W. M., Mokkink, H. G. A., & van der Vleuten, C. P. M. (2012) · BMC Medical Education · doi:10.1186/1472-6920-12-97 · Cited by 56 · see citing works
Tomiak, A. T., Braund, H., Egan, R. G., Dalgarno, N., Emack, J., Reid, M.-A., & Hammad, N. (2019) · Journal of Cancer Education · doi:10.1007/s13187-018-1456-z · Cited by 53 · see citing works
Ötleş, E., Kendrick, D. E., Solano, Q. P., Schuller, M. C., Ahle, S. L., Eskender, M. H., Carnes, E., & George, B. C. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004153 · Cited by 48 · see citing works
Quality of feedback following performance assessments: does assessor expertise matter?
Govaerts, M., van de Wiel, M. W. J., & van der Vleuten, C. P. M. (2013) · European journal of training and development · doi:10.1108/03090591311293310 · Cited by 45 · see citing works
Quality evaluation reports: Can a faculty development program make a difference?
Dudek, N. L., Marks, M. B., Wood, T. J., Dojeiji, S., Bandiera, G. W., Hatala, R. A., Cooke, L., & Sadownik, L. A. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.689444 · Cited by 42 · see citing works
Christiansen, B., Averlid, G., Baluyot, C., Blomberg, K., Eikeland, A., Strand, I. R., Larsen, M. H., & Lindeflaten, K. (2020) · Nursing Open · doi:10.1002/nop2.717 · Cited by 41 · see citing works
The role of ePortfolios in supporting learning in eight healthcare disciplines: A scoping review
Janssens, O., Haerens, L. L., Valcke, M., Beeckman, D., Pype, P. F., & Embo, M. P. C. (2022) · Nurse Education in Practice · doi:10.1016/j.nepr.2022.103418 · Cited by 33 · see citing works
Puddester, D. G., Macdonald, C. J., Clements, D., Gaffney, J., & Wiesenfeld, L. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0375-5 · Cited by 32 · see citing works
Renting, N., Gans, R. O. B., Borleffs, J. C. C., van der Wal, M. A., Jaarsma, D. A. D. C., & Cohen‐Schotanus, J. (2015) · Medical Teacher · doi:10.3109/0142159x.2015.1075649 · Cited by 32 · see citing works
Integrated and implicit: how residents learn Can MEDS roles by participating in practice
Renting, N., Raat, A. N. J., Dornan, T., Wenger, É., van der Wal, M. A., Borleffs, J. C. C., Gans, R. O. B., & Jaarsma, D. A. D. C. (2017) · Medical Education · doi:10.1111/medu.13335 · Cited by 32 · see citing works
What supervisors say in their feedback: construction of CanMEDS roles in workplace settings
Renting, N., Dornan, T., Gans, R. O. B., Borleffs, J. C. C., Cohen‐Schotanus, J., & Jaarsma, D. A. D. C. (2015) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9634-9 · Cited by 31 · see citing works
Working with words: exploring textual analysis in medical education research
Park, S. E., Griffin, A., & Gill, D. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04184.x · Cited by 29 · see citing works
de Jong, L. H., Bok, H. G. J., Schellekens, L. H., Kremer, W. D. J., Jonker, F. H., & van der Vleuten, C. P. M. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03257-2 · Cited by 24 · see citing works
Lefebvre, C., Hiestand, B. C., Glass, C., Masneri, D. A., Hosmer, K., Hunt, M. R., & Hartman, N. D. (2018) · Evaluation & the Health Professions · doi:10.1177/0163278718820415 · Cited by 22 · see citing works
Raaum, S. E., Lappé, K., Colbert‐Getz, J. M., & Milne, C. K. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-04946-3 · Cited by 22 · see citing works
Feedback using an ePortfolio for medicine long cases: quality not quantity
Bleasel, J. F., Burgess, A. W., Weeks, R., & Haq, I. (2016) · BMC Medical Education · doi:10.1186/s12909-016-0801-3 · Cited by 21 · see citing works
Bugaj, T. J., Schmid, C., Koechel, A., Stiepak, J., Groener, J. B., Herzog, W., & Nikendei, C. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1309377 · Cited by 21 · see citing works
Janssens, O., Embo, M. P. C., Valcke, M., & Haerens, L. L. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03308-8 · Cited by 21 · see citing works
Nugraheny, E., Claramita, M., Rahayu, G. R., & Kumara, A. (2016) · Iranian Journal of Nursing and Midwifery Research · doi:10.4103/1735-9066.197671 · Cited by 20 · see citing works
Evaluation of feedback given to trainees in medical specialties
Tham, T., Burr, B., & Boohan, M. (2017) · Clinical Medicine · doi:10.7861/clinmedicine.17-4-303 · Cited by 16 · see citing works
Not wanted on the voyage: highlighting intrinsic CanMEDS gaps in Competence by Design curricula
Binnendyk, J., Pack, R., Field, E., & Watling, C. (2021) · Canadian Medical Education Journal · doi:10.36834/cmej.70950 · Cited by 15 · see citing works
Fu, R.-H., Cho, Y.-H., Quattri, F., & Monrouxe, L. V. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024425 · Cited by 13 · see citing works
Training to Support ePortfolio Users During Clinical Placements: a Scoping Review
Ostaeyen, S. V., Embo, M. P. C., Schellens, T., & Valcke, M. (2022) · Medical Science Educator · doi:10.1007/s40670-022-01583-0 · Cited by 11 · see citing works
Predictors of faculty narrative evaluation quality in medical school clerkships
Mooney, C. J., Pascoe, J. M., Blatt, A. E., Lang, V. J., Kelly, M. S., Braun, M. K., Burch, J. E., & Stone, R. T. (2022) · Medical Education · doi:10.1111/medu.14911 · Cited by 10 · see citing works
Barrett, A., Galvin, R., Steinert, Y., Scherpbier, A. J. J. A., O’Shaughnessy, A., Walsh, G., & Horgan, M. M. (2016) · SpringerPlus · doi:10.1186/s40064-016-1748-x · Cited by 9 · see citing works
Experiences of Faculty Members Giving Corrective Feedback to Medical Trainees in a Clinical Setting
Dávila-Cervantes, A., Foulds, J. L., Gomaa, N. A., & Rashid, M. (2020) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000322 · Cited by 9 · see citing works
Sharing perspectives on feedback: a combined resident-faculty workshop
Kim, B., Rajagopalan, A. K., Tabasky, E., Reddy, S. S., & Topor, D. R. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03253-6 · Cited by 9 · see citing works
Comparing the Quality of Narrative Comments by Rotation Setting
Roshan, A., Wagner, N., Acai, A., Emmerton-Coughlin, H. M. A., Sonnadara, R., Scott, T. M., & Karimuddin, A. A. (2021) · Journal of surgical education · doi:10.1016/j.jsurg.2021.06.012 · Cited by 7 · see citing works
Using natural language processing to determine factors associated with high-quality feedback
Marcotte, K. M., Ötleş, E., Thelen, A. E., Gates, R. S., George, B. C., & Krumm, A. E. (2022) · Global Surgical Education - Journal of the Association for Surgical Education · doi:10.1007/s44186-022-00051-y · Cited by 7 · see citing works
Li, P., Jiang, F., Yin, L., Chen, Y. Q., Shao, L., Li, Y., Gao, Y., & Lu, M. H. (2022) · Advances in Medical Education and Practice · doi:10.2147/amep.s367129 · Cited by 4 · see citing works
The ePortfolio in UK cardiology training: time for a new digital platform?
Elamin, A., Obeidat, M., & Davis, G. K. (2021) · British Journal of Cardiology · doi:10.5837/bjc.2021.031 · Cited by 1 · see citing works
Ginsburg, S. R. (2016) · doi:10.26481/dis.20160901sg
Flagged first, then by citations
Research works printed but not linked: 1
- [3]Frank JR. CanMEDS: a framework for teaching and assessing competencies. In: Sherbino J, Frank JR (Eds.) Educational design a CanMEDS guide for the health professions. Ottawa: Royal College of Physicians and Surgeons; 2011. pp. 17– 22.
Cited by
Sorted by citations
Cook, D. A., Overgaard, J., Pankratz, V. S., Del Fiol, G., & Aakre, C. A. (2025) · Journal of Medical Internet Research · doi:10.2196/68486 · Cited by 96 · see citing works
Ostaeyen, S. V., Langhe, L. D., Clercq, O. D., Embo, M. P. C., Schellens, T., & Valcke, M. (2023) · Perspectives on Medical Education · doi:10.5334/pme.1056 · Cited by 14 · see citing works
Kondo, T., Donkers, J., Nishigori, H., Rovers, S., & Heeneman, S. (2026) · JMIR Medical Education · doi:10.2196/90064 · Cited by 1 · see citing works
The Perceived Effectiveness of Feedback Scale: Validity and Reliability Study
Esen, E., Adıgüzel, O. C., & Kara, D. A. (2025) · Anadolu Journal Of Educational Sciences International · doi:10.18039/ajesi.1633718
Kondo, T., Donkers, J. H. H. L. M., Nishigori, H., Rovers, S. F. E., & Heeneman, S. (2025) · doi:10.2196/preprints.90064
Esen, E., Adıgüzel, O. C., & Kara, D. A. (2026) · International Journal of Assessment Tools in Education · doi:10.21449/ijate.1610075
- Authors
- Van Ostaeyen, S., Embo, M., Rotsaert, T., De Clercq, O., Schellens, T., & Valcke, M.
- Affiliations
- University of Antwerp (BE)
- Ghent University (BE)
- Venue
- Perspectives on Medical Education
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2023-12-22
- Volume
- 12
- Issue
- 1
- Pages
- 584-593
- ISSN
- 2212-2761 (ISSN-L)
- 2212-277X
- PMC
- PMC10742175
- OpenAlex
- W4390105133
- Cited by
- 6
- References
- 49
- Citations by year
- 2026: 2 · 2025: 3 · 2023: 1
- FWCI
- 1.54
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Perspectives on Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Research Foundation Flanders (FWO, Strategic Basic Research (SBO)) (S003219N)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Social Sciences › Education › Student Assessment and Feedback
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- e-portfolio, written feedback, feedback quality, CanMEDS roles, competency-based education, clinical practicum, health professions students, medical expertise, feedback training, medical education assessment
- MeSH terms
- Clinical Competence, Competency-Based Education, Feedback, Humans, Medicine, Retrospective Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
