Core principles of assessment in competency-based medical education.
Abstract
The meaningful assessment of competence is critical for the implementation of effective competency-based medical education (CBME). Timely ongoing assessments are needed along with comprehensive periodic reviews to ensure that trainees continue to progress. New approaches are needed to optimize the use of multiple assessors and assessments; to synthesize the data collected from multiple assessors and multiple types of assessments; to develop faculty competence in assessment; and to ensure that relationships between the givers and receivers of feedback are appropriate. This paper describes the core principles of assessment for learning and assessment of learning. It addresses several ways to ensure the effectiveness of assessment programs, including using the right combination of assessment methods and conducting careful assessor selection and training. It provides a reconceptualization of the role of psychometrics and articulates the importance of a group process in determining trainees' progress. In addition, it notes that, to reach its potential as a driver in trainee development, quality care, and patient safety, CBME requires effective information management and documentation as well as ongoing consideration of ways to improve the assessment system.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
CBME and programmatic assessment have the potential to improve the practice of feedback by promoting frequent observation of learners, feedback conversations, and coaching for improvement.
“Two recently implemented initiatives in medical education, competencybased medical education (CBME) [9][10][11] and programmatic assessment of learners, 12 have the potential to improve the practice of feedback by promoting frequent observation of learners, feedback conversations, and coaching for improvement.”
From The R2C2 Model in Residency Education: How Does It Foster Coaching and Promote Feedback Use? (2018) · cites this paper as [11]
CBME and programmatic assessment promote the longitudinal compilation of performance data to coach the learner's continuing development and to make evidence-based decisions about the learner's progress.
“Finally, they promote the longitudinal compilation of performance data to coach the learner's continuing development (assessment for learning) and to make evidence-based decisions about the learner's progress (assessment of learning).[11][12][13][14][15]”
From The R2C2 Model in Residency Education: How Does It Foster Coaching and Promote Feedback Use? (2018) · cites this paper as [11]
Cites
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883 · see citing works
(1975) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 2,461 · see citing works
Self-Directed Learning, A Guide for Learners and Teachers
McNally, J. M. (1976) · The Journal of Continuing Education in Nursing · doi:10.3928/0022-0124-19760501-17 · Cited by 2,248 · see citing works
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110 · see citing works
The next GME accreditation system--rationale and benefits.
Nasca, T., Philibert, I., Brigham, T., & Flynn, T. C. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1200117 · Cited by 1,565 · see citing works
The Science of Evaluation: A Realist Manifesto
Pawson, R. (2013) · doi:10.4135/9781473913820 · Cited by 1,271 · see citing works
Assessing professional competence: from methods to programmes
Van Der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02094.x · Cited by 1,268 · see citing works
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247 · see citing works
ten Cate, O., & Scheele, F. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31805559c7 · Cited by 1,162 · see citing works
Nuts and Bolts of Entrustable Professional Activities
ten Cate, O. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-12-00380.1 · Cited by 1,018 · see citing works
The CanMEDS initiative: implementing an outcomes-based framework of physician competencies
Frank, J. R., & Danoff, D. S. (2007) · Medical Teacher · doi:10.1080/01421590701746983 · Cited by 1,005 · see citing works
Self-Assessment in the Health Professions: A Reformulation and Research Agenda
Eva, K. W., & Regehr, G. (2005) · Academic Medicine · doi:10.1097/00001888-200510001-00015 · Cited by 992 · see citing works
Carraccio, C. L., Wolfsthal, S. D., Englander, R., Ferentz, K. S., & Martin, C. (2002) · Academic Medicine · doi:10.1097/00001888-200205000-00003 · Cited by 979 · see citing works
The ACGME outcome project: retrospective and prospective
Swing, S. R. (2007) · Medical Teacher · doi:10.1080/01421590701392903 · Cited by 964 · see citing works
What every teacher needs to know about clinical reasoning
Eva, K. W. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01972.x · Cited by 939 · see citing works
A model for programmatic assessment fit for purpose.
van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652239 · Cited by 892 · see citing works
State of the science in health professional education: effective feedback
Archer, J. C. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03546.x · Cited by 783 · see citing works
Regehr, G., MacRae, H., Reznick, R. K., & Szalay, D. (1998) · Academic Medicine · doi:10.1097/00001888-199809000-00020 · Cited by 712 · see citing works
Norcini, J. J., Anderson, M. B., Bóllela, V. R., Burch, V. C., Costa, M. J., Duvivier, R. J., Galbraith, R. M., Hays, R., Kent, A., Perrott, V., et al. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.551559 · Cited by 587 · see citing works
John Dewey on Education Selected Writings
Dewey, J., & Archambault, R. D. (1974) · University of Chicago Press eBooks · Cited by 527 · see citing works
Rater training for performance appraisal: A quantitative review
Woehr, D. J., & Huffcutt, A. I. (1994) · Journal of Occupational and Organizational Psychology · doi:10.1111/j.2044-8325.1994.tb00562.x · Cited by 455 · see citing works
“I'll never play professional football” and other fallacies of self-assessment
Eva, K. W., & Regehr, G. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.150 · Cited by 452 · see citing works
The assessment of professional competence: building blocks for theory development
van der Vleuten, C. P. M., Schuwirth, L., Scheele, F., Driessen, E. W., & Hodges, B. D. (2010) · Best Practice & Research Clinical Obstetrics & Gynaecology · doi:10.1016/j.bpobgyn.2010.04.001 · Cited by 341 · see citing works
The processes and dimensions of informed self-assessment: A conceptual model.
Sargeant, J., Armson, H., Chesluk, B., Dornan, T., Eva, K., Holmboe, E., Lockyer, J., Loney, E., Mann, K., & van der Vleuten, C. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181d85a4e · Cited by 318 · see citing works
Effects of Training in Direct Observation of Medical Residents' Clinical Competence
Holmboe, E. S., Hawkins, R. E., & Huot, S. J. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-11-200406010-00008 · Cited by 290 · see citing works
Assessment in the post-psychometric era: Learning to love the subjective and collective
Hodges, B. D. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.789134 · Cited by 283 · see citing works
Learning from clinical work: the roles of learning cues and credibility judgements
Watling, C., Driessen, E., van der Vleuten, C. P. M., & Lingard, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04126.x · Cited by 261 · see citing works
Performance appraisal : state of the art in practice
Smither, J. W. (1998) · Jossey-Bass Publishers eBooks · Cited by 252 · see citing works
Validity in work‐based assessment: expanding our horizons
Govaerts, M., & van der Vleuten, C. P. M. (2013) · Medical Education · doi:10.1111/medu.12289 · Cited by 250 · see citing works
AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment
Ben‐David, M. F., Davis, M. H., Harden, R. M., Howie, P., Ker, J., & Pippard, M. J. (2001) · Medical Teacher · doi:10.1080/01421590120090952 · Cited by 226 · see citing works
Portfolios for assessment and learning: AMEE Guide no. 45
van Tartwijk, J., & Driessen, E. W. (2009) · Medical Teacher · doi:10.1080/01421590903139201 · Cited by 217 · see citing works
Workplace-based assessment: effects of rater expertise
Govaerts, M., Schuwirth, L., van der Vleuten, C. P. M., & Muijtjens, A. M. M. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9250-7 · Cited by 198 · see citing works
Rater-Based Assessments as Social Judgments: Rethinking the Etiology of Rater Errors
Gingerich, A., Regehr, G., & Eva, K. W. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31822a6cf8 · Cited by 196 · see citing works
Workplace-based assessment: raters’ performance theories and constructs
Govaerts, M., van de Wiel, M. W. J., Schuwirth, L., van der Vleuten, C. P. M., & Muijtjens, A. M. M. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9376-x · Cited by 181 · see citing works
Practical Guide to the Evaluation of Clinical Competence
Huh, S. Y. (2022) · Korean Medical Education Review · doi:10.17496/kmer.2022.24.2.176 · Cited by 162 · see citing works
Knowing When to Look It Up: A New Conception of Self-Assessment Ability
Eva, K. W., & Regehr, G. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31813e6755 · Cited by 160 · see citing works
A plea for new psychometric models in educational assessment
Schuwirth, L., & van der Vleuten, C. P. M. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02405.x · Cited by 158 · see citing works
Evolving concepts of assessment in a competency-based world
Harris, P., Bhanji, F., Topps, M. H., Ross, S., Lieberman, S. A., Frank, J. R., Snell, L. S., Sherbino, J., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315071 · Cited by 155 · see citing works
Features of assessment learners use to make informed self-assessments of clinical performance.
Sargeant, J., Eva, K. W., Armson, H., Chesluk, B., Dornan, T., Holmboe, E., Lockyer, J. M., Loney, E., Mann, K. V., & van der Vleuten, C. P. M. (2011) · Medical Education · doi:10.1111/j.1365-2923.2010.03888.x · Cited by 154 · see citing works
Reconceptualizing Variable Rater Assessments as Both an Educational and Clinical Care Problem
Kogan, J. R., Conforti, L. N., Iobst, W. F., & Holmboe, E. S. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000221 · Cited by 148 · see citing works
Lievens, F. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.2.255 · Cited by 139 · see citing works
A new framework for designing programmes of assessment
Dijkstra, J., van der Vleuten, C. P. M., & Schuwirth, L. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9205-z · Cited by 133 · see citing works
Schuwirth, L., & Ash, J. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.787140 · Cited by 118 · see citing works
Expertise in performance assessment: assessors’ perspectives
Berendonk, C., Stalmeijer, R. E., & Schuwirth, L. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9392-x · Cited by 116 · see citing works
Portfolios as a method of student assessment
Davis, M. H., & Harden, R. M. (2001) · Cited by 113 · see citing works
What every teacher needs to know about clinical reasoning
Eva Kevin, W. (2005) · Educación Médica · Cited by 113 · see citing works
Hemmer, P. A., Hawkins, R. E., Jackson, J. L., & Pangaro, L. N. (2000) · Academic Medicine · doi:10.1097/00001888-200002000-00016 · Cited by 108 · see citing works
Using Technology To Create A Dynamic Classroom Experience
Courts, B., & Tucker, J. P. (2012) · Journal of College Teaching & Learning (TLC) · doi:10.19030/tlc.v9i2.6907 · Cited by 105 · see citing works
Understanding responses to feedback: the potential and limitations of regulatory focus theory
Watling, C., Driessen, E., van der Vleuten, C. P. M., Vanstone, M., & Lingard, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04209.x · Cited by 99 · see citing works
Schwind, C. J., Williams, R. G., Boehler, M. L., & Dunnington, G. L. (2004) · Academic Medicine · doi:10.1097/00001888-200405000-00016 · Cited by 73 · see citing works
Scylla or Charybdis? Can we navigate between objectification and judgement in assessment?
Eva, K. W., & Hodges, B. D. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04310.x · Cited by 69 · see citing works
Realizing the Promise and Importance of Performance-Based Assessment
Kogan, J. R., & Holmboe, E. S. (2013) · Teaching and Learning in Medicine · doi:10.1080/10401334.2013.842912 · Cited by 51 · see citing works
Pelgrim, E. A. M., Kramer, A. W. M., Mokkink, H. G. A., & van der Vleuten, C. P. M. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.801939 · Cited by 51 · see citing works
Yeates, P., O'Neill, P. A., Mann, K. V., & Eva, K. W. (2012) · JAMA · doi:10.1001/jama.2012.36515 · Cited by 51 · see citing works
Portfolios for Assessment and Learning
Kenney, J. (2017) · Institutional Repositories DataBase (IRDB) · Cited by 36 · see citing works
Putting the Pediatrics Milestones Into Practice: A Consensus Roadmap and Resource Analysis
Schumacher, D. J., Spector, N. D., Calaman, S., West, D. C., Cruz, M., Frohna, J. G., del Rey, J. A. G., Gustafson, K., Poynter, S. E., Rosenbluth, G., et al. (2014) · PEDIATRICS · doi:10.1542/peds.2013-2917 · Cited by 29 · see citing works
Health Care Informatics: A Skills-Based Resource
Felkey, B. G., Fox, B. I., & Thrower, M. R. (2005) · Cited by 8 · see citing works
Hicks, P. J., Schwartz, A., Clyman, S. G., & Nichols, D. G. (2014) · Academic Pediatrics · doi:10.1016/j.acap.2013.12.007 · Cited by 7 · see citing works
Ponnamperuma, G. G. (2013) · Oxford University Press eBooks · doi:10.1093/med/9780199652679.003.0046 · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Assessment, feedback and the alchemy of learning
Watling, C., & Ginsburg, S. (2018) · Medical Education · doi:10.1111/medu.13645 · Cited by 434 · see citing works
National survey on anatomical sciences in medical education
McBride, J. M., & Drake, R. L. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1760 · Cited by 321 · see citing works
Current practice of assessing students’ sustainability competencies: a review of tools
Redman, A., Wiek, A., & Barth, M. (2020) · Sustainability Science · doi:10.1007/s11625-020-00855-1 · Cited by 295 · see citing works
Implementing competency-based medical education: Moving forward
Frank, J. R., Snell, L. S., Englander, R., Holmboe, E. S., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315069 · Cited by 220 · see citing works
Growth mindset in competency-based medical education
Richardson, D. L., Kinnear, B., Hauer, K. E., Turner, T. L., Warm, E. J., Hall, A. K., Ross, S., Thoma, B., Melle, E. V., & Collaborators, O. B. O. T. I. (2021) · Medical Teacher · doi:10.1080/0142159x.2021.1928036 · Cited by 185 · see citing works
“…of competency-based medical education (CBME) across health professions training (Carraccio et al. 2002), much has been written about assessment practices that support competency development (Frank et al. 2010; Holmboe et al. 2010; Harris et al. 2017; Lockyer et al. 2017; Iobst and Holmboe 2020).”
BackgroundMcNamara, P. J., Jain, A., EL-Khuffash, A. F., Giesinger, R. E., Weisz, D. E., Freud, L., Levy, P. T., Bhombal, S., de Boode, W. P., Leone, T. A., et al. (2024) · Journal of the American Society of Echocardiography · doi:10.1016/j.echo.2023.11.016 · Cited by 166 · see citing works
Evolving concepts of assessment in a competency-based world
Harris, P., Bhanji, F., Topps, M. H., Ross, S., Lieberman, S. A., Frank, J. R., Snell, L. S., Sherbino, J., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315071 · Cited by 155 · see citing works
Entrustment decision making: extending miller’s pyramid.
ten Cate, O., Carraccio, C., Damodaran, A., Gofton, W., Hamstra, S. J., Hart, D. E., Richardson, D., Ross, S., Schultz, K., Warm, E. J., et al. (2021) · Academic Medicine · doi:10.1097/acm.0000000000003800 · Cited by 160 · see citing works
The R2C2 Model in Residency Education: How Does It Foster Coaching and Promote Feedback Use?
Sargeant, J., Lockyer, J. M., Mann, K., Armson, H., Warren, A., Zetkulic, M., Soklaridis, S., Könings, K. D., Ross, K., Silver, I., et al. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002131 · Cited by 148 · see citing works
Conducting a high-stakes OSCE in a COVID-19 environment
Boursicot, K. A. M., Kemp, S., Ong, T. H., Wijaya, L., Goh, S. H., Freeman, K., & Curran, I. (2020) · MedEdPublish · doi:10.15694/mep.2020.000054.1 · Cited by 132 · see citing works
Scoping Review of Entrustable Professional Activities in Undergraduate Medical Education
Meyer, E. G., Chen, H. C., Uijtdehaage, S. H. J., Durning, S. J., & Maggio, L. A. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002735 · Cited by 130 · see citing works
Hall, A. K., Rich, J., Dagnone, J. D., Weersink, K., Caudle, J., Sherbino, J., Frank, J. R., Bandiera, G., & Van Melle, E. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003040 · Cited by 104 · see citing works
Professional identity formation: linking meaning to well-being
Toubassi, D., Schenker, C., Roberts, M., & Forte, M. (2022) · Advances in Health Sciences Education · doi:10.1007/s10459-022-10146-2 · Cited by 119 · see citing works
“The move to competency-based medical education has encouraged the “dual purposing of assessment”(Richardson et al., 2021)—“assessment of learning” as well as “assessment for learning” (Lockyer et al., 2017; Watling & Ginsburg, 2019).”
BackgroundEntrustable professional activities in entry‐level health professional education: A scoping review
Bramley, A. L., & McKenna, L. (2021) · Medical Education · doi:10.1111/medu.14539 · Cited by 96 · see citing works
Clinical Cadavers as a Simulation Resource for Procedural Learning
Kovacs, G. J., Levitan, R. M., & Sandeski, R. (2018) · AEM Education and Training · doi:10.1002/aet2.10103 · Cited by 94 · see citing works
Performance assessment: Consensus statement and recommendations from the 2020 Ottawa Conference
Boursicot, K. A. M., Kemp, S., WILKINSON, T. J., Findyartini, A., Canning, C., Cilliers, F. J., & Fuller, R. (2020) · Medical Teacher · doi:10.1080/0142159x.2020.1830052 · Cited by 96 · see citing works
Lockyer, J., Bursey, F. R., Richardson, D. L., Frank, J. R., Snell, L. S., Campbell, C. B., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315064 · Cited by 91 · see citing works
Enhanced Requirements for Assessment in a Competency-Based, Time-Variable Medical Education System
Gruppen, L. D., ten Cate, O., Lingard, L., Teunissen, P. W., & Kogan, J. R. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002066 · Cited by 88 · see citing works
Managing tensions in assessment: moving beyond either–or thinking
Govaerts, M., van der Vleuten, C. P. M., & Holmboe, E. S. (2018) · Medical Education · doi:10.1111/medu.13656 · Cited by 88 · see citing works
Damewood, S. C., Leo, M. M., Bailitz, J. M., Gottlieb, M. A., Liu, R., Hoffmann, B., & Gaspari, R. (2019) · AEM Education and Training · doi:10.1002/aet2.10368 · Cited by 87 · see citing works
The impact of entrustment assessments on feedback and learning: Trainee perspectives
Martin, L. J., Sibbald, M., Vegas, D. B., Russell, D., & Govaerts, M. (2019) · Medical Education · doi:10.1111/medu.14047 · Cited by 87 · see citing works
Competency-Based Medical Education at the Front Lines of Patient Care
Cooper, D., & Holmboe, E. S. (2025) · New England Journal of Medicine · doi:10.1056/nejmra2411880 · Cited by 76 · see citing works
Competency-Based Medical Education: Considering Its Past, Present, and a Post–COVID-19 Era
Ryan, M. S., Holmboe, E. S., & Chandra, S. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004535 · Cited by 79 · see citing works
“The Most Crushing Thing”: Understanding Resident Assessment Burden in a Competency-Based Curriculum
Ott, M. C., Pack, R., Cristancho, S., Chin, M., Koughnett, J. A. V., & Ott, M. C. (2022) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-22-00050.1 · Cited by 77 · see citing works
Rockarts, J., Brewer‐Deluce, D., Shali, A., Mohialdin, V., & Wainman, B. C. (2020) · Anatomical Sciences Education · doi:10.1002/ase.1960 · Cited by 77 · see citing works
“…an important consideration in several contexts specifically in assessing curricular reform in light of competency-based medical education (CBME) changes in Canada, as well as appraising factors influencing post-graduate knowledge retention and performance (Frank et al., 2010; Lockyer et al., 2017).”
BackgroundThe Assessment Burden in Competency-Based Medical Education: How Programs Are Adapting
Szulewski, A., Braund, H., Dagnone, D., McEwen, L., Dalgarno, N., Schultz, K., & Hall, A. K. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005305 · Cited by 75 · see citing works
Kinnear, B., Warm, E. J., & Hauer, K. E. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1474191 · Cited by 71 · see citing works
“Since group process is thought to lead to better judgments (Lockyer et al. 2017), many programs worldwide have established groups of educators that review and discuss such data.”
BackgroundDemystifying AI: Current State and Future Role in Medical Education Assessment
Turner, L., Hashimoto, D. A., Vasisht, S., & Schaye, V. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005598 · Cited by 70 · see citing works
“20 AI can address these challenges by o ff ering consistent, objective assessments that are less resource intensive, enabling e ffi cient collection of high-volume assessments and providing immediate feedback.”
BackgroundYou can have both: Coaching to promote clinical competency and professional identity formation
Parsons, A. S., Kon, R. H., Plews-Ogan, M., & Gusic, M. E. (2020) · Perspectives on Medical Education · doi:10.1007/s40037-020-00612-1 · Cited by 69 · see citing works
Anderson, H. L. K., Kurtz, J. B., & West, D. C. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004366 · Cited by 69 · see citing works
Rich, J. V., Young, S. F., Donnelly, C. A., Hall, A. K., Dagnone, D., Weersink, K., Caudle, J. M., Melle, E. V., & Klinger, D. A. (2019) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13328 · Cited by 67 · see citing works
Chan, T. M., Sebok‐Syer, S. S., Sampson, C. S., & Monteiro, S. (2020) · Teaching and Learning in Medicine · doi:10.1080/10401334.2019.1708365 · Cited by 65 · see citing works
Training and education of healthcare workers during viral epidemics: a systematic review
Nayahangan, L., Konge, L., Russell, L., & Andersen, S. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-044111 · Cited by 51 · see citing works
Meyer, E. G., Taylor, D. R., Uijtdehaage, S. H. J., & Durning, S. J. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003504 · Cited by 64 · see citing works
Autonomy and developing physicians: Reimagining supervision using self‐determination theory
Sawatsky, A. P., OʼBrien, B. C., & Hafferty, F. W. (2021) · Medical Education · doi:10.1111/medu.14580 · Cited by 66 · see citing works
Better Decision-Making: Shared Mental Models and the Clinical Competency Committee
Edgar, L., Jones, M. D., Harsy, B., Passiment, M., & Hauer, K. E. (2021) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-20-00850.1 · Cited by 60 · see citing works
“This requirement places a great deal of accountability on the CCC to ensure that a graduate is ready for unsupervised practice.(16,17) CCCs may struggle to define the purpose of their work and the best way of assessing resident performance.”
BackgroundOrr, C., & Sonnadara, R. (2019) · Advances in Medical Education and Practice · doi:10.2147/amep.s191470 · Cited by 59 · see citing works
Communication, learning and assessment: Exploring the dimensions of the digital learning environment
Thoma, B., Turnquist, A., Zaver, F., Hall, A. K., & Chan, T. M. (2019) · Medical Teacher · doi:10.1080/0142159x.2019.1567911 · Cited by 58 · see citing works
“Technologically enhanced programs of assessment will harness digital management platforms and electronic portfolios, with these comprehensive data repositories becoming the new standard (Gruppen et al. 2018; Lockyer et al. 2017).”
BackgroundSystematic review and narrative synthesis of competency-based medical education in anaesthesia
Weller, J. M., Naik, V. N., & Diego, R. J. S. (2020) · British Journal of Anaesthesia · doi:10.1016/j.bja.2019.10.025 · Cited by 61 · see citing works
Hart, D. E., Franzen, D., Beeson, M. S., Bhat, R. G., Kulkarni, M. L., Thibodeau, L. G., Weizberg, M., & Promes, S. B. (2018) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2018.11.38912 · Cited by 56 · see citing works
Frank, J. R., Karpinski, J., Sherbino, J., Snell, L. S., Atkinson, A. R., Oswald, A., Hall, A. K., Cooke, L., Dojeiji, S., Richardson, D. L., et al. (2024) · Perspectives on Medical Education · doi:10.5334/pme.1096 · Cited by 57 · see citing works
Molgaard, L. K., Chaney, K. P., Bok, H. G. J., Read, E. K., Hodgson, J., Salisbury, S. K., Rush, B. R., Ilkiw, J. E., May, S. A., Danielson, J. A., et al. (2019) · Medical Teacher · doi:10.1080/0142159x.2019.1643834 · Cited by 50 · see citing works
“Competency frameworks must be linked to a meaningful evaluation of achievement if they are to be effective in guiding learner progress towards desired outcomes (Lockyer et al. 2017).”
BackgroundRoss, S., Hauer, K. E., Wycliffe-Jones, K., Hall, A. K., Molgaard, L. K., Richardson, D. L., Oswald, A., Bhanji, F., & Collaborators, O. B. O. T. I. (2021) · Medical Teacher · doi:10.1080/0142159x.2021.1925099 · Cited by 49 · see citing works
“Rather, programmatic assessment, or the intentional combining of multiple observations and tools fit for purpose, within a clear framework with processes to link assessments to desired outcomes, is probably the way forward (Iobst and Holmboe 2020; Lockyer et al. 2017).”
BackgroundThoma, B., Caretta‐Weyer, H. A., Schumacher, D. J., Warm, E. J., Hall, A. K., Hamstra, S. J., Cavalcanti, R. B., Chan, T. M., & Collaborators, O. B. O. T. I. (2021) · Medical Teacher · doi:10.1080/0142159x.2021.1925100 · Cited by 43 · see citing works
“Frequent, low-stakes assessments provide targeted feedback (assessment for learning) and, following aggregation of all assessment results, the data are used to make high-stakes decisions regarding promotion through the training program (assessment of learning) (Lockyer et al. 2017).”
BackgroundValidity as a social imperative for assessment in health professions education: a concept analysis
Marceau, M., Gallagher, F., Young, M., & St-Onge, C. (2018) · Medical Education · doi:10.1111/medu.13574 · Cited by 45 · see citing works
Danilovich, N., Kitto, S. C., Price, D. W., Campbell, C. B., Hodgson, A., & HENDRY, P. J. (2021) · Family Medicine · doi:10.22454/fammed.2021.453158 · Cited by 46 · see citing works
Bell, C. R., Hall, A. K., Wagner, N., Rang, L. C. F., Newbigging, J., & McKaigney, C. J. (2020) · AEM Education and Training · doi:10.1002/aet2.10520 · Cited by 43 · see citing works
Asif, H., McInnis, C. L., Dang, F., Ajzenberg, H., Wang, P. L., Mosa, A., Ko, G., Zevin, B., Mann, S. M., & WINTHROP, A. L. (2021) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2021.03.064 · Cited by 42 · see citing works
Lupi, C. S., Ownby, A. R., Jokela, J. A., Cutrer, W. B., Thompson-Busch, A. K., Catallozzi, M., Noble, J. M., & Amiel, J. M. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002297 · Cited by 44 · see citing works
Pugh, D., Champlain, A. D., Gierl, M. J., Lai, H., & Touchie, C. (2020) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-020-00134-8 · Cited by 42 · see citing works
“For example, the introduction of competency-based education models, which require multiple data points to make meaningful decisions about competence, has increased the need for test items to support more frequent and tailored assessments (Lockyer et al., 2017).”
BackgroundSpadafore, M., Yılmaz, Y., Rally, V., Chan, T. M., Russell, M., Thoma, B., Singh, S., Monteiro, S., Pardhan, A., Martin, L. J., et al. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005634 · Cited by 41 · see citing works
Hoang, N. S., & Lau, J. N. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002205 · Cited by 41 · see citing works
Implementation of Programmatic Assessment: Challenges and Lessons Learned
Govaerts, M., van der Vleuten, C. P. M., & Schut, S. (2022) · Education Sciences · doi:10.3390/educsci12100717 · Cited by 41 · see citing works
The power of subjectivity in competency-based assessment
Virk, A., Joshi, A., Mahajan, R., & Singh, T. (2020) · Journal of Postgraduate Medicine · doi:10.4103/jpgm.jpgm_591_20 · Cited by 40 · see citing works
“[29] The same has been emphasized in literature.[4,12,30] The big challenge that lies ahead is to understand how subjectivity in assessment can be reintroduced while retaining ‘rigour’ in assessment.”
BackgroundLomis, K. D., Mejicano, G. C., Caverzagie, K. J., Monrad, S. U., Pusic, M. V., & Hauer, K. E. (2021) · Medical Teacher · doi:10.1080/0142159x.2021.1924364 · Cited by 40 · see citing works
Richardson, D. L., Landreville, J. M., Trier, J., Cheung, W. J., Bhanji, F., Hall, A. K., Frank, J. R., & Oswald, A. (2024) · Perspectives on Medical Education · doi:10.5334/pme.959 · Cited by 41 · see citing works
Beyond summative decision making: Illuminating the broader roles of competence committees
Pack, R., Lingard, L. A., Watling, C., & Cristancho, S. (2020) · Medical Education · doi:10.1111/medu.14072 · Cited by 37 · see citing works
Shaw, T., Wood, T. J., Touchie, C., Pugh, D., & Humphrey-Murto, S. M. (2020) · Advances in Health Sciences Education · doi:10.1007/s10459-020-09979-6 · Cited by 36 · see citing works
“This is particularly true in the realm of competency-based medical education (CBME) where learners depend on frequent assessments to build upon and guide their progress towards competence (Holmboe et al.”
BackgroundInfluentialColonoscopy competence assessment tools: a systematic review of validity evidence
Khan, R., Zheng, E., Wani, S. B., Scaffidi, M. A., Jeyalingam, T., Gimpaya, N., Anderson, J. T., Grover, S. C., McCreath, G. A., & Walsh, C. M. (2021) · Endoscopy · doi:10.1055/a-1352-7293 · Cited by 36 · see citing works
“Ideally, they should support both assessment “for learning” and assessment “of learning” [5].”
BackgroundBray, M. J., Bradley, E. B., Martindale, J. R., & Gusic, M. E. (2020) · Teaching and Learning in Medicine · doi:10.1080/10401334.2020.1857256 · Cited by 38 · see citing works
Analyzing the Administrative Burden of Competency Based Medical Education
Cheung, K., Rogoza, C., Chung, A. D., & Kwan, B. Y. M. (2021) · Canadian Association of Radiologists Journal · doi:10.1177/08465371211038963 · Cited by 35 · see citing works
“Musculoskeletal radiology (3) 89 1:19 Cardiothoracic radiology (2) 62 2:19 Abdominal radiology (3) 199 3:04 Interventional radiology (4) 115 3:16 Neuroradiology (5) 165 3:27 Women’s imaging specialists (4) 86 3:47 Pediatric radiology (2) 25 3:49 Nuclear medicine (1) 14 5:38”
Sternszus, R., Slattery, N., Cruess, R. L., ten Cate, O., Hamstra, S. J., & Steinert, Y. (2023) · Perspectives on Medical Education · doi:10.5334/pme.1027 · Cited by 38 · see citing works
Ross, S., Binczyk, N. M., Hamza, D. M., Schipper, S., Humphries, P., Nichols, D. N., & Donoff, M. G. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.4581 · Cited by 33 · see citing works
Resident perceptions of Competency-Based Medical Education
Mann, S. M., Hastings‐Truelove, A., Beesley, T., Howden, S., & Egan, R. G. (2020) · Canadian Medical Education Journal · doi:10.36834/cmej.67958 · Cited by 33 · see citing works
Delivering on the promise of competency based medical education – an institutional approach
Dagnone, D., Stockley, D. B., Flynn, L., Egan, R. G., van Wylick, R., McEwen, L. A., Walker, R., & Reznick, R. K. (2019) · Canadian Medical Education Journal · doi:10.36834/cmej.43303 · Cited by 32 · see citing works
Sebok‐Syer, S. S., Pack, R., Shepherd, L. G., McConnell, A., Dukelow, A. M., Sedran, R. J., & Lingard, L. (2020) · Medical Education · doi:10.1111/medu.14147 · Cited by 32 · see citing works
“1 In response to this transformation, calls abound for assessment innovations to facilitate the frequent low-stakes assessment and feedback opportunities required by CBME 2,3 that ameliorate the potential for assessment burden.”
BackgroundTaken Out of Context: Hazards in the Interpretation of Written Assessment Comments
Ginsburg, S., Kogan, J. R., Gingerich, A., Lynch, M., & Watling, C. (2019) · Academic Medicine · doi:10.1097/acm.0000000000003047 · Cited by 30 · see citing works
Entrustment Unpacked: Aligning Purposes, Stakes, and Processes to Enhance Learner Assessment
Kinnear, B., Warm, E. J., Caretta‐Weyer, H. A., Holmboe, E. S., Turner, D. A., van der Vleuten, C. P. M., & Schumacher, D. J. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004108 · Cited by 29 · see citing works
What Behaviors Define a Good Physician? Assessing and Communicating About Noncognitive Skills
Warm, E. J., Kinnear, B., Lance, S. H., Schauer, D. P., & Brenner, J. M. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004215 · Cited by 29 · see citing works
Feedback Credibility in Healthcare Education: a Systematic Review and Synthesis
Dai, C., Bertram, K., & Chahine, S. (2021) · Medical Science Educator · doi:10.1007/s40670-020-01167-w · Cited by 32 · see citing works
Marty, A., Linsenmeyer, M., George, B. C., Young, J. Q., Breckwoldt, J., & ten Cate, O. (2023) · Medical Teacher · doi:10.1080/0142159x.2023.2168527 · Cited by 28 · see citing works
“Summative decisions are made by teams (clinical competency committees or similar entities), based on multiple observations and information bits (Lockyer et al. 2017).”
BackgroundStorrar, N., Hope, D., & Cameron, H. S. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1450496 · Cited by 27 · see citing works
“This can aid fair assessment of competence, (Lockyer et al. 2017), but practical experience will also add salience to what can be abstract outcomes.”
BackgroundStefan, A., Hall, J. N., Sherbino, J., & Chan, T. M. (2019) · Canadian Journal of Emergency Medicine · doi:10.1017/cem.2019.343 · Cited by 27 · see citing works
Hsiao, C., Chou, F. C., Hsieh, C.-C., Chang, L., & Hsu, C.-M. (2020) · Journal of Medical Internet Research · doi:10.2196/15655 · Cited by 27 · see citing works
“Further, effective assessment needs effective information management and documentation, as well as continuous improvements to the assessment system [22].”
BackgroundConstructing a Validity Map for a Workplace-Based Assessment System: Cross-Walking Messick and Kane
Kinnear, B., Kelleher, M., May, B., Sall, D. R., Schauer, D. P., Schumacher, D. J., & Warm, E. J. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004112 · Cited by 27 · see citing works
Development of and Preliminary Validity Evidence for the EFeCT Feedback Scoring Tool
Ross, S., Hamza, D. M., Zulla, R. T., Stasiuk, S., & Nichols, D. N. (2022) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-21-00602.1 · Cited by 27 · see citing works
Castellanos-Ortega, Á., Broch, M. J., Palacios-Castañeda, D., Gómez-Tello, V., Valdivia, M., Vicent, C., Madrid, I., Martinez, N., Párraga, M. J., Sancho, E., et al. (2022) · Medicina Intensiva · doi:10.1016/j.medin.2022.01.011 · Cited by 27 · see citing works
How workplace‐based assessments guide learning in postgraduate education: A scoping review
Martin, L. J., Blissett, S., Johnston, B. K., Tsang, M., Gauthier, S. R., Ahmed, Z., & Sibbald, M. (2022) · Medical Education · doi:10.1111/medu.14960 · Cited by 29 · see citing works
Competency-based pharmacy education definition: What components need to be defined to implement it?
Daugherty, K. K., Chen, A. M. H., Churchwell, M. D., Jarrett, J. B., Kleppinger, E. L., Meyer, S. M., Nawarskas, J. J., Sibicky, S. L., Stowe, C. D., & Rhoney, D. H. (2023) · American Journal of Pharmaceutical Education · doi:10.1016/j.ajpe.2023.100624 · Cited by 27 · see citing works
Enk, A. V., & ten Cate, O. (2020) · Perspectives on Medical Education · doi:10.1007/s40037-020-00616-x · Cited by 26 · see citing works
Ahn, E., LaDonna, K. A., Landreville, J. M., Mcheimech, R., & Cheung, W. J. (2023) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-23-00204.1 · Cited by 25 · see citing works
Carraccio, C. L., Martini, A., Melle, E. V., & Schumacher, D. J. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004075 · Cited by 25 · see citing works
Felthun, J. Z., Taylor, S., Shulruf, B., & Allen, D. W. (2021) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2021.18.11 · Cited by 25 · see citing works
Point-of-Care-ultrasound in undergraduate medical education: a scoping review of assessment methods
DeBiasio, C., Pageau, P., Shefrin, A. E., Woo, M. Y., & Cheung, W. J. (2023) · The Ultrasound Journal · doi:10.1186/s13089-023-00325-6 · Cited by 25 · see citing works
“While methods of assessment, including multiple-choice questions (MCQs) and technical skill evaluation such as objective structural clinical evaluations (OSCEs) have traditionally been used, an emerging approach of targeting multiple assessment methods to better measure POCUS skills and thereby competency has been sug…”
MethodEvaluating the Strengths and Barriers of Competency-Based Education in the Health Professions
Jarrett, J. B., Elmes, A. T., Keller, E., Stowe, C. D., & Daugherty, K. K. (2024) · American Journal of Pharmaceutical Education · doi:10.1016/j.ajpe.2024.100709 · Cited by 25 · see citing works
Ryan, M. S., Gielissen, K. A., Shin, D., Perera, R. A., Gusic, M. E., Ferenchick, G. S., Ownby, A. R., Cutrer, W. B., Obeso, V. T., & Santen, S. A. (2024) · Medical Education · doi:10.1111/medu.15291 · Cited by 24 · see citing works
“14 Due to growing interest around competency-based assessment across the continuum of training 15 – 17 and increasing uptake of the Core EPA framework for assessment across medical schools, 18 it is imperative to determine the validity and reliability of WBAs, particularly if they are used as a…”
BackgroundClement, E., Oswald, A., Ghosh, S., & Hamza, D. M. (2024) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-23-00210.1 · Cited by 24 · see citing works
Assessment Practices for Dietetics Trainees: A Systematic Review
Jamieson, J., Palermo, C. E., Hay, M., & Gibson, S. (2019) · Journal of the Academy of Nutrition and Dietetics · doi:10.1016/j.jand.2018.09.010 · Cited by 24 · see citing works
Bolster, M. B., Chandra, S., Demaerschalk, B. M., Esper, C. D., Genkins, J. Z., Hayden, E. M., Tan‐McGrory, A., & Schwamm, L. H. (2022) · Academic Medicine · doi:10.1097/acm.0000000000004660 · Cited by 24 · see citing works
GPT-4: the future of artificial intelligence in medical school assessments
Haruna‐Cooper, L., & Rashid, A. (2023) · Journal of the Royal Society of Medicine · doi:10.1177/01410768231181251 · Cited by 24 · see citing works
Shrivastava, S. R., & Shrivastava, P. S. (2019) · Family Medicine and Community Health · doi:10.1136/fmch-2018-000043 · Cited by 23 · see citing works
“Significant emphasis has been given to assessment and its principles in order to ensure that competent healthcare professionals are produced.(15) 16 In the current study, respondents gave due emphasis to the issues that CBME is student-friendly, allows gradation of students on a yearly basis and that it helps in the i…”
BackgroundMa, I. W. Y., Desy, J. R., Woo, M. Y., Kirkpatrick, A. W., & Noble, V. E. (2020) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-19-00531.1 · Cited by 22 · see citing works
“Recurrent workplace-based observations are essential to help trainees achieve competence and to support decision-making and judgments regarding their competence.(13,14) To date, multiple assessment tools for POCUS skills have been published, with varying amounts of validity evidence to support the interpretation of sc…”
BackgroundThe pharmacology course for preclinical students using team-based learning
Kim, D.-H., Lee, J. H., & Kim, S. A. (2020) · Korean journal of medical education · doi:10.3946/kjme.2020.151 · Cited by 22 · see citing works
“The primary aim of a standardized, high-stake assessment such as KMLE lies in the assessment of learning rather than individualized, formative assessment for learning [26].”
BackgroundCollaborative Development of Core Entrustable Professional Activities for Veterinary Education
Salisbury, S. K., Rush, B. R., Ilkiw, J. E., Matthew, S. M., Chaney, K. P., Molgaard, L. K., May, S. A., Bok, H. G. J., Hodgson, J., Frost, J. S., et al. (2020) · Journal of Veterinary Medical Education · doi:10.3138/jvme.2019-0090 · Cited by 22 · see citing works
King, E., Turpin, M. J., Green, W., & Schull, D. N. (2019) · Advances in Health Sciences Education · doi:10.1007/s10459-019-09891-8 · Cited by 21 · see citing works
Optimizing assessors’ mental workload in rater-based assessment: a critical narrative review
Paravattil, B., & Wilby, K. J. (2019) · Perspectives on Medical Education · doi:10.1007/s40037-019-00535-6 · Cited by 21 · see citing works
Ryan, M. S., Khan, A. R., Park, Y. S., Chastain, C. A., Phillipi, C. A., Santen, S. A., Barron, B., Obeso, V. T., Yingling, S. L., & Program, F. T. C. E. P. A. F. E. R. P. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004222 · Cited by 21 · see citing works
Learner handover: Perspectives and recommendations from the front-line
Gumuchian, S. T., Pal, N. E., Young, M. E., Danoff, D. S., Plotnick, L. H., Cummings, B., Gomez-Garibello, C. A., & Dory, V. (2020) · Perspectives on Medical Education · doi:10.1007/s40037-020-00601-4 · Cited by 21 · see citing works
“The developmental lens of CBME models and the accompanying assessment approaches have led to an increased focus on learner handover, or ‘forward-feeding’, where information about learners is shared across educational phases, supervisors, and/or clinical placements [4, 5].”
BackgroundInfluentialLeroy, P. L. J. M., KRAUSS, B. S., Costa, L. R., Barbi, E., Irwin, M. G., Carlson, D. W., Absalom, A. R., Andolfatto, G., Roback, M. G., Babl, F. E., et al. (2024) · British Journal of Anaesthesia · doi:10.1016/j.bja.2024.07.036 · Cited by 20 · see citing works
Singh, T., & Shah, N. (2022) · Journal of Postgraduate Medicine · doi:10.4103/jpgm.jpgm_337_22 · Cited by 20 · see citing works
“[34,37] This is especially important when qualitative assessments are done to make high-stakes decisions.”
- Authors
- Lockyer, J., Carraccio, C., Chan, M.-K., Hart, D., Smee, S., Touchie, C., Holmboe, E. S., Frank, J. R., & Collaborators, O. B. O. T. I.
- Affiliations
- University of Calgary (CA)
- American Board of Pediatrics, Chapel Hill, NC, USA;
- University of Manitoba (CA)
- University of Minnesota (US)
- Medical Council of Canada (CA)
- Accreditation Council for Graduate Medical Education (US)
- University of Ottawa (CA)
- Corresponding author
- Lockyer, Jocelyn
- ORCID
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2017-06-03
- Volume
- 39
- Issue
- 6
- Pages
- 609-616
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2623879525
- Cited by
- 493
- References
- 59
- Citations by year
- 2026: 36 · 2025: 40 · 2024: 69 · 2023: 78 · 2022: 66 · 2021: 75 · 2020: 57 · 2019: 36 · 2018: 29 · 2017: 6
- FWCI
- 32.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Teacher (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Psychology › Social Psychology › Competency Development and Evaluation
- Keywords
- competency-based medical education, learning assessment, assessment for learning, assessor training, psychometrics, feedback, assessment system improvement
- MeSH terms
- Clinical Competence, Competency-Based Education, Education, Medical, Educational Measurement, Feedback, Humans, Learning, Psychometrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review