The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Core principles of assessment in competency-based medical education.
Abstract
The meaningful assessment of competence is critical for the implementation of effective competency-based medical education (CBME). Timely ongoing assessments are needed along with comprehensive periodic reviews to ensure that trainees continue to progress. New approaches are needed to optimize the use of multiple assessors and assessments; to synthesize the data collected from multiple assessors and multiple types of assessments; to develop faculty competence in assessment; and to ensure that relationships between the givers and receivers of feedback are appropriate. This paper describes the core principles of assessment for learning and assessment of learning. It addresses several ways to ensure the effectiveness of assessment programs, including using the right combination of assessment methods and conducting careful assessor selection and training. It provides a reconceptualization of the role of psychometrics and articulates the importance of a group process in determining trainees' progress. In addition, it notes that, to reach its potential as a driver in trainee development, quality care, and patient safety, CBME requires effective information management and documentation as well as ongoing consideration of ways to improve the assessment system.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Two recently implemented initiatives in medical education, competencybased medical education (CBME) [9][10][11] and programmatic assessment of learners, 12 have the potential to improve the practice of feedback by promoting frequent observation of learners, feedback conversations, and coaching for improvement.”
From The R2C2 Model in Residency Education: How Does It Foster Coaching and Promote Feedback Use? (2018) · cites this paper as [11]
In the citing paper
“Finally, they promote the longitudinal compilation of performance data to coach the learner's continuing development (assessment for learning) and to make evidence-based decisions about the learner's progress (assessment of learning).[11][12][13][14][15]”
From The R2C2 Model in Residency Education: How Does It Foster Coaching and Promote Feedback Use? (2018) · cites this paper as [11]
Citations
Cites
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883
(1975) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 2,461
Self-Directed Learning, A Guide for Learners and Teachers
McNally, J. M. (1976) · The Journal of Continuing Education in Nursing · doi:10.3928/0022-0124-19760501-17 · Cited by 2,248
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
The Next GME Accreditation System — Rationale and Benefits
Nasca, T. J., Philibert, I., Brigham, T. P., & Flynn, T. C. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1200117 · Cited by 1,621
The Science of Evaluation: A Realist Manifesto
Pawson, R. (2013) · doi:10.4135/9781473913820 · Cited by 1,271
Assessing professional competence: from methods to programmes
Van Der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02094.x · Cited by 1,268
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
ten Cate, O., & Scheele, F. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31805559c7 · Cited by 1,162
Nuts and Bolts of Entrustable Professional Activities
ten Cate, O. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-12-00380.1 · Cited by 1,018
The CanMEDS initiative: implementing an outcomes-based framework of physician competencies
Frank, J. R., & Danoff, D. S. (2007) · Medical Teacher · doi:10.1080/01421590701746983 · Cited by 1,005
Self-Assessment in the Health Professions: A Reformulation and Research Agenda
Eva, K. W., & Regehr, G. (2005) · Academic Medicine · doi:10.1097/00001888-200510001-00015 · Cited by 992
Carraccio, C. L., Wolfsthal, S. D., Englander, R., Ferentz, K. S., & Martin, C. (2002) · Academic Medicine · doi:10.1097/00001888-200205000-00003 · Cited by 979
The ACGME outcome project: retrospective and prospective
Swing, S. R. (2007) · Medical Teacher · doi:10.1080/01421590701392903 · Cited by 964
What every teacher needs to know about clinical reasoning
Eva, K. W. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01972.x · Cited by 939
A model for programmatic assessment fit for purpose.
van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652239 · Cited by 892
State of the science in health professional education: effective feedback
Archer, J. C. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03546.x · Cited by 783
Regehr, G., MacRae, H., Reznick, R. K., & Szalay, D. (1998) · Academic Medicine · doi:10.1097/00001888-199809000-00020 · Cited by 712
Norcini, J. J., Anderson, M. B., Bóllela, V. R., Burch, V. C., Costa, M. J., Duvivier, R. J., Galbraith, R. M., Hays, R., Kent, A., Perrott, V., et al. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.551559 · Cited by 607
John Dewey on Education Selected Writings
Dewey, J., & Archambault, R. D. (1974) · University of Chicago Press eBooks · Cited by 527
Rater training for performance appraisal: A quantitative review
Woehr, D. J., & Huffcutt, A. I. (1994) · Journal of Occupational and Organizational Psychology · doi:10.1111/j.2044-8325.1994.tb00562.x · Cited by 455
“I'll never play professional football” and other fallacies of self-assessment
Eva, K. W., & Regehr, G. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.150 · Cited by 452
The assessment of professional competence: building blocks for theory development
van der Vleuten, C. P. M., Schuwirth, L., Scheele, F., Driessen, E. W., & Hodges, B. D. (2010) · Best Practice & Research Clinical Obstetrics & Gynaecology · doi:10.1016/j.bpobgyn.2010.04.001 · Cited by 356
The processes and dimensions of informed self-assessment: A conceptual model.
Sargeant, J., Armson, H., Chesluk, B., Dornan, T., Eva, K., Holmboe, E., Lockyer, J., Loney, E., Mann, K., & van der Vleuten, C. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181d85a4e · Cited by 318
Self-citationAssessment in the post-psychometric era: Learning to love the subjective and collective
Hodges, B. D. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.789134 · Cited by 301
Effects of Training in Direct Observation of Medical Residents' Clinical Competence
Holmboe, E. S., Hawkins, R. E., & Huot, S. J. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-11-200406010-00008 · Cited by 290
Learning from clinical work: the roles of learning cues and credibility judgements
Watling, C., Driessen, E., van der Vleuten, C. P. M., & Lingard, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04126.x · Cited by 261
Performance appraisal : state of the art in practice
Smither, J. W. (1998) · Jossey-Bass Publishers eBooks · Cited by 252
Validity in work‐based assessment: expanding our horizons
Govaerts, M., & van der Vleuten, C. P. M. (2013) · Medical Education · doi:10.1111/medu.12289 · Cited by 250
Portfolios for assessment and learning: AMEE Guide no. 45
van Tartwijk, J., & Driessen, E. W. (2009) · Medical Teacher · doi:10.1080/01421590903139201 · Cited by 233
AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment
Ben‐David, M. F., Davis, M. H., Harden, R. M., Howie, P., Ker, J., & Pippard, M. J. (2001) · Medical Teacher · doi:10.1080/01421590120090952 · Cited by 226
Workplace-based assessment: effects of rater expertise
Govaerts, M., Schuwirth, L., van der Vleuten, C. P. M., & Muijtjens, A. M. M. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9250-7 · Cited by 206
Rater-Based Assessments as Social Judgments: Rethinking the Etiology of Rater Errors
Gingerich, A., Regehr, G., & Eva, K. W. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31822a6cf8 · Cited by 196
Workplace-based assessment: raters’ performance theories and constructs
Govaerts, M., van de Wiel, M. W. J., Schuwirth, L., van der Vleuten, C. P. M., & Muijtjens, A. M. M. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9376-x · Cited by 181
Practical Guide to the Evaluation of Clinical Competence
Huh, S. Y. (2022) · Korean Medical Education Review · doi:10.17496/kmer.2022.24.2.176 · Cited by 162
Knowing When to Look It Up: A New Conception of Self-Assessment Ability
Eva, K. W., & Regehr, G. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31813e6755 · Cited by 160
A plea for new psychometric models in educational assessment
Schuwirth, L., & van der Vleuten, C. P. M. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02405.x · Cited by 158
Evolving concepts of assessment in a competency-based world
Harris, P., Bhanji, F., Topps, M. H., Ross, S., Lieberman, S. A., Frank, J. R., Snell, L. S., Sherbino, J., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315071 · Cited by 155
Features of assessment learners use to make informed self-assessments of clinical performance.
Sargeant, J., Eva, K. W., Armson, H., Chesluk, B., Dornan, T., Holmboe, E., Lockyer, J. M., Loney, E., Mann, K. V., & van der Vleuten, C. P. M. (2011) · Medical Education · doi:10.1111/j.1365-2923.2010.03888.x · Cited by 154
Reconceptualizing Variable Rater Assessments as Both an Educational and Clinical Care Problem
Kogan, J. R., Conforti, L. N., Iobst, W. F., & Holmboe, E. S. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000221 · Cited by 148
Lievens, F. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.2.255 · Cited by 139
A new framework for designing programmes of assessment
Dijkstra, J., van der Vleuten, C. P. M., & Schuwirth, L. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9205-z · Cited by 133
Expertise in performance assessment: assessors’ perspectives
Berendonk, C., Stalmeijer, R. E., & Schuwirth, L. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9392-x · Cited by 119
Schuwirth, L., & Ash, J. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.787140 · Cited by 118
Portfolios as a method of student assessment
Davis, M. H., & Harden, R. M. (2001) · Cited by 113
What every teacher needs to know about clinical reasoning
Eva Kevin, W. (2005) · Educación Médica · Cited by 113
Hemmer, P. A., Hawkins, R. E., Jackson, J. L., & Pangaro, L. N. (2000) · Academic Medicine · doi:10.1097/00001888-200002000-00016 · Cited by 108
Using Technology To Create A Dynamic Classroom Experience
Courts, B., & Tucker, J. P. (2012) · Journal of College Teaching & Learning (TLC) · doi:10.19030/tlc.v9i2.6907 · Cited by 105
Understanding responses to feedback: the potential and limitations of regulatory focus theory
Watling, C., Driessen, E., van der Vleuten, C. P. M., Vanstone, M., & Lingard, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04209.x · Cited by 99
Schwind, C. J., Williams, R. G., Boehler, M. L., & Dunnington, G. L. (2004) · Academic Medicine · doi:10.1097/00001888-200405000-00016 · Cited by 73
Scylla or Charybdis? Can we navigate between objectification and judgement in assessment?
Eva, K. W., & Hodges, B. D. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04310.x · Cited by 69
Realizing the Promise and Importance of Performance-Based Assessment
Kogan, J. R., & Holmboe, E. S. (2013) · Teaching and Learning in Medicine · doi:10.1080/10401334.2013.842912 · Cited by 55
Pelgrim, E. A. M., Kramer, A. W. M., Mokkink, H. G. A., & van der Vleuten, C. P. M. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.801939 · Cited by 53
Yeates, P., O'Neill, P. A., Mann, K. V., & Eva, K. W. (2012) · JAMA · doi:10.1001/jama.2012.36515 · Cited by 51
Portfolios for Assessment and Learning
Kenney, J. (2017) · Institutional Repositories DataBase (IRDB) · Cited by 36
Putting the Pediatrics Milestones Into Practice: A Consensus Roadmap and Resource Analysis
Schumacher, D. J., Spector, N. D., Calaman, S., West, D. C., Cruz, M., Frohna, J. G., del Rey, J. A. G., Gustafson, K., Poynter, S. E., Rosenbluth, G., et al. (2014) · PEDIATRICS · doi:10.1542/peds.2013-2917 · Cited by 29
Health Care Informatics: A Skills-Based Resource
Felkey, B. G., Fox, B. I., & Thrower, M. R. (2005) · Cited by 8
Hicks, P. J., Schwartz, A., Clyman, S. G., & Nichols, D. G. (2014) · Academic Pediatrics · doi:10.1016/j.acap.2013.12.007 · Cited by 7
Ponnamperuma, G. G. (2013) · Oxford University Press eBooks · doi:10.1093/med/9780199652679.003.0046 · Cited by 5
Research works printed but not linked: 4
- Holmboe ES, 2008, Practical guide to the evaluation of clinical competence
- Nyquist JG., 2014, Techniques for assessment of learner performance in teaching and assessing the competencies
- Pawson R, 1997, Realistic evaluation
- Surowiecki J., 2005, The wisdom of crowds
Cited by
Sorted by citations
Assessment, feedback and the alchemy of learning
Watling, C., & Ginsburg, S. (2018) · Medical Education · doi:10.1111/medu.13645 · Cited by 461
National survey on anatomical sciences in medical education
McBride, J. M., & Drake, R. L. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1760 · Cited by 321
Current practice of assessing students’ sustainability competencies: a review of tools
Redman, A., Wiek, A., & Barth, M. (2020) · Sustainability Science · doi:10.1007/s11625-020-00855-1 · Cited by 295
Implementing competency-based medical education: Moving forward
Frank, J. R., Snell, L. S., Englander, R., Holmboe, E. S., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315069 · Cited by 220
Growth mindset in competency-based medical education
Richardson, D. L., Kinnear, B., Hauer, K. E., Turner, T. L., Warm, E. J., Hall, A. K., Ross, S., Thoma, B., Melle, E. V., & Collaborators, O. B. O. T. I. (2021) · Medical Teacher · doi:10.1080/0142159x.2021.1928036 · Cited by 185
“…of competency-based medical education (CBME) across health professions training (Carraccio et al. 2002), much has been written about assessment practices that support competency development (Frank et al. 2010; Holmboe et al. 2010; Harris et al. 2017; Lockyer et al. 2017; Iobst and Holmboe 2020).”
Background
Metadata
- Authors
- Lockyer, J., Carraccio, C., Chan, M.-K., Hart, D., Smee, S., Touchie, C., Holmboe, E. S., Frank, J. R., & Collaborators, O. B. O. T. I.
- Affiliations
- University of Calgary (CA)
- American Board of Pediatrics, Chapel Hill, NC, USA;
- University of Manitoba (CA)
- University of Minnesota (US)
- Medical Council of Canada (CA)
- Accreditation Council for Graduate Medical Education (US)
- University of Ottawa (CA)
- Corresponding author
- Lockyer, Jocelyn
- ORCID
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2017-06-03
- Volume
- 39
- Issue
- 6
- Pages
- 609-616
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2623879525
- Cited by
- 493
- References
- 59
- Citations by year
- 2026: 36 · 2025: 40 · 2024: 69 · 2023: 78 · 2022: 66 · 2021: 75 · 2020: 57 · 2019: 36 · 2018: 29 · 2017: 6
- FWCI
- 32.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Teacher (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Competency Development and Evaluation
- Keywords
- competency-based medical education, learning assessment, assessment for learning, assessor training, psychometrics, feedback, assessment system improvement
- MeSH terms
- Clinical Competence, Competency-Based Education, Education, Medical, Educational Measurement, Feedback, Humans, Learning, Psychometrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review