Self-Assessment in the Health Professions: A Reformulation and Research Agenda
Abstract
Many researchers and educators have identified self-assessment as a vital aspect of professional self-regulation.1,2,3 This rationale has been the expressed motivation for a large number of studies of self-assessment ability in medical education, health professional education, and professions education generally. Unfortunately, the outcome of most studies would seem to cast doubt on the capacity for self-assessment, with the majority of authors concluding that self-assessment is, in fact, quite poor.4 In a recent article, Ward and colleagues suggested that this conclusion must be questioned because the methodologies used to evaluate self-assessment are fraught with methodological weaknesses.4 However, even studies that have attempted to address the weaknesses within the methodological paradigm have produced little evidence for effective self-assessment.5 Thus, the health professional education community is left with a conundrum that can only be resolved by deciding either that the conclusions of the studies are wrong, or that a critical premise underlying the concept of “self-regulation” in the professions is unsupportable. The current paper addresses this conundrum by arguing that there is a problem with the literature on self-assessment, and that this problem is more fundamental than a list of easily correctable methodological flaws. Rather, the roots of the problem in the self-assessment literature involve a failure to effectively conceptualize the nature of self-assessment in the daily practice of health care professionals, and a failure to properly explicate the role of self-assessment in a self-regulating profession. Until such an articulation of self-assessment is elaborated, it is difficult to know even which literatures might be informative in addressing this issue, and impossible to develop programs of research that operationalize the concept of self-assessment ability in a form that can be effectively studied. Thus, we will begin with a brief reflection on the various functions of self-assessment for a practicing health care professional and the manner in which these functions operate. The Purposes of Self-Assessment in Practice Self-assessment has been defined broadly as the involvement of learners in judging whether or not learner-identified standards have been met.6 While attractive due to their concise and encompassing nature, we fear that such simple definitions risk being misleading as they can cause underappreciation of the complexities of the construct. Self-assessment functions both as a mechanism for identifying one’s weaknesses and as a mechanism for identifying one’s strengths. Each of these mechanisms can be considered to have distinct, albeit complementary, functions. As a mechanism for identifying weaknesses or gaps in one’s skills and abilities, self-assessment serves several potential functions. First, in daily practice, the identification of one’s weaknesses allows the professional to self-limit in areas of limited competence. For example, in many circumstances the professional can quickly reject certain plans of action because she recognizes that she is unlikely to be able to complete the component tasks necessary to enact the plan. In other circumstances, a professional might recognize that he is “over his head” in a particular case and decide that it is time to recruit additional resources: to “look this up,” to obtain a consultation, to recruit additional support, or to refer the problem to another individual who is more competent in this domain. Second, in reflecting on one’s practice in general, the ability to identify weaknesses can serve the function of helping the professional set appropriate learning goals. That is, the traditional model of self-regulated continuing professional development presumes that an individual will select ongoing learning activities that fill professional gaps, but this presumes that the professional can effectively self-assess. Thus, in this role, the identification of weakness can help a professional to decide what must be learned. As a corollary to this, effective self-assessment is vital for setting realistic expectations of oneself, to avoid setting oneself up for failure. Thus, the identification of weakness also helps the self-regulating professional to decide what not to try learning, what should be accepted as forever outside one’s scope of competent practice. There is a complementary set of functions served by the ability to accurately self-assess one’s strengths. First, in daily practice, having a clear and accurate sense of one’s strengths allows the professional to act with appropriate confidence. For example, knowing one’s strengths provides the professional with the confidence to move forward on a fitting plan of action without inappropriate hesitation or trepidation. Similarly, it ensures that the individual will choose to persist on an appropriate plan of action in the face of initially negative feedback. The right path is not
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Enabling support of learners to self-monitor in relation to competency requirements is an important goal.
“Enabling support of learners to self-monitor in relation to competency requirements is an important goal [63, 64]”
From Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education. (2015) · cites this paper as [64]
Cites
Self-efficacy: The exercise of control
Bandura, A., Freeman, W. H., & Lightsey, R. (1999) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.13.2.158 · Cited by 46,835 · see citing works
The Reflective Practitioner: How Professionals Think in Action
Checkoway, B. N., & Schön, D. A. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3324262 · Cited by 21,311 · see citing works
(1985) · Medical Entomology and Zoology · Cited by 19,180 · see citing works
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317 · see citing works
The role of deliberate practice in the acquisition of expert performance
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993) · Psychological Review · doi:10.1037/0033-295x.100.3.363 · Cited by 9,564 · see citing works
(2014) · Palgrave Macmillan eBooks · doi:10.1057/9781137399595.0007 · Cited by 8,328 · see citing works
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731 · see citing works
The Emotional Brain: The Mysterious Underpinnings of Emotional Life
LeDoux, J. E. (2004) · Medical Entomology and Zoology · Cited by 4,212 · see citing works
The unbearable automaticity of being
Bargh, J. A., & Chartrand, T. L. (1999) · American Psychologist · doi:10.1037/0003-066x.54.7.462 · Cited by 3,699 · see citing works
The Reflective Practitioner: How Professionals Think in Action
Schön, D. A., & DeSanctis, V. (1986) · The Journal of Continuing Higher Education · doi:10.1080/07377366.1986.10401080 · Cited by 3,234 · see citing works
Ericsson, K. A. (2004) · Academic Medicine · doi:10.1097/00001888-200410001-00022 · Cited by 2,988 · see citing works
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · see citing works
The person and the situation: perspectives of social psychology
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3604 · Cited by 2,205 · see citing works
The automated will: nonconscious activation and pursuit of behavioral goals.
Bargh, J. A., Gollwitzer, P. M., Lee-Chai, A., Barndollar, K., & Trötschel, R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.6.1014 · Cited by 1,865 · see citing works
(1994) · The MIT Press eBooks · doi:10.7551/mitpress/4561.001.0001 · Cited by 1,741 · see citing works
Strangers to ourselves: discovering the adaptive unconscious
(2003) · Choice Reviews Online · doi:10.5860/choice.40-3712 · Cited by 1,641 · see citing works
Feeling and thinking: the role of affect in social cognition
(2000) · Choice Reviews Online · doi:10.5860/choice.37-5959 · Cited by 1,387 · see citing works
Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning
Koriat, A. (1997) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.126.4.349 · Cited by 1,363 · see citing works
How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life
Gilovich, T. D. (1991) · Medical Entomology and Zoology · Cited by 1,005 · see citing works
What every teacher needs to know about clinical reasoning
Eva, K. W. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01972.x · Cited by 939 · see citing works
Self-citationEnhancing Learning Through Self-assessment
Boud, D. J. (2013) · Routledge eBooks · doi:10.4324/9781315041520 · Cited by 914 · see citing works
Personal contact, individuation, and the better-than-average effect.
Alicke, M. D., Klotz, M. L., Breitenbecher, D. L., Yurak, T. J., & Vredenburg, D. S. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.68.5.804 · Cited by 914 · see citing works
Whittlesea, B. W. A. (1993) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.19.6.1235 · Cited by 865 · see citing works
If we are so rich, why aren't we happy?
Csíkszentmihályi, M. (1999) · American Psychologist · doi:10.1037/0003-066x.54.10.821 · Cited by 727 · see citing works
A review of the validity and accuracy of self-assessments in health professions training
Gordon, M. J. (1991) · Academic Medicine · doi:10.1097/00001888-199112000-00012 · Cited by 537 · see citing works
Cervone, D., & Peake, P. K. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.50.3.492 · Cited by 504 · see citing works
Situated Optimism: Specific Outcome Expectancies and Self-Regulation
Armor, D. A., & Taylor, S. E. (1998) · Advances in experimental social psychology · doi:10.1016/s0065-2601(08)60386-x · Cited by 453 · see citing works
Measuring Self-assessment: Current State of the Art
Ward, M., Gruppen, L. D., & Regehr, G. (2002) · Advances in Health Sciences Education · doi:10.1023/a:1014585522084 · Cited by 413 · see citing works
Self-citationA Randomized Trial of Continuing Medical Education
Sibley, J. C., Sackett, D. L., Neufeld, V. R., Gerrard, B. A., Rudnick, K. V., & Fraser, W. D. (1982) · New England Journal of Medicine · doi:10.1056/nejm198203043060904 · Cited by 342 · see citing works
Jr. Shapiro Deane, H., Schwartz, C. E., & Astin, J. A. (1996) · American Psychologist · doi:10.1037//0003-066x.51.12.1213 · Cited by 328 · see citing works
Expectations and Performance: An Empirical Test of Bandura's Self-efficacy Theory
Weinberg, R., Gould, D., & Jackson, A. (1979) · Journal of Sport Psychology · doi:10.1123/jsp.1.4.320 · Cited by 315 · see citing works
Boud, D. J. (1999) · Social Work Education · doi:10.1080/02615479911220131 · Cited by 305 · see citing works
How Can I Know What I Don't Know? Poor Self Assessment in a Well-Defined Domain
Eva, K. W., Cunnington, J. P. W., Reiter, H., Keane, D. R., & Norman, G. R. (2004) · Advances in Health Sciences Education · doi:10.1023/b:ahse.0000038209.65714.d4 · Cited by 302 · see citing works
Self-citationComparing the Accuracy of Personality Judgments by the Self and Knowledgeable Others
Kolar, D. W., Funder, D. C., & Colvin, C. R. (1996) · Journal of Personality · doi:10.1111/j.1467-6494.1996.tb00513.x · Cited by 289 · see citing works
Dolmans, D. H. J. M., Gijselaers, W., Moust, J. H. C., de Grave, W. S., Wolfhagen, I. H. A. P., & van der Vleuten, C. P. M. (2002) · Medical Teacher · doi:10.1080/01421590220125277 · Cited by 262 · see citing works
Is study time allocated selectively to a region of proximal learning?
Metcalfe, J. (2002) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.131.3.349 · Cited by 259 · see citing works
Reliability and validity of the Memory Self-Efficacy Questionnaire.
Berry, J. M., West, R. L., & Dennehey, D. M. (1989) · Developmental Psychology · doi:10.1037/0012-1649.25.5.701 · Cited by 250 · see citing works
Shapiro, D. H., Schwartz, C. E., & Astin, J. A. (1996) · American Psychologist · doi:10.1037/0003-066x.51.12.1213 · Cited by 223 · see citing works
Exploring the Etiology of Content Specificity
Eva, K. W., Neville, A. J., & Norman, G. R. (1998) · Academic Medicine · doi:10.1097/00001888-199810000-00028 · Cited by 220 · see citing works
Self-citationUtilization of Metacognitive Judgments in the Allocation of Study During Multitrial Learning
Nelson, T. O., Dunlosky, J. T., Graf, A., & Narens, L. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00502.x · Cited by 216 · see citing works
The Development of Expertise in Dermatology
Norman, G. R. (1989) · Archives of Dermatology · doi:10.1001/archderm.1989.01670200039005 · Cited by 180 · see citing works
Cervone, D. (2000) · Behavior Modification · doi:10.1177/0145445500241002 · Cited by 168 · see citing works
Mental representations of medical diagnostic knowledge
Custers, E. J. F. M., Regehr, G., & Norman, G. R. (1996) · Academic Medicine · doi:10.1097/00001888-199610000-00044 · Cited by 134 · see citing works
Self-citationThe adult learner: a mythical species
Norman, G. R. (1999) · Academic Medicine · doi:10.1097/00001888-199908000-00011 · Cited by 134 · see citing works
Self-evaluation in undergraduate medical education
Arnold, L., Willoughby, T. L., & Calkins, E. V. (1985) · Academic Medicine · doi:10.1097/00001888-198501000-00004 · Cited by 123 · see citing works
Causes and constraints of the shift-to-easier-materials effect in the control of study
Dunlosky, J. T., & Thiede, K. W. (2004) · Memory & Cognition · doi:10.3758/bf03195868 · Cited by 113 · see citing works
Delaying judgments of learning affects memory, not metamemory
Kimball, D. R., & Metcalfe, J. (2003) · Memory & Cognition · doi:10.3758/bf03196445 · Cited by 108 · see citing works
Applications of Heuristics and Biases to Social Issues
Heath, L., Tindale, R. S., Edwards, J., Posavac, E. J., Bryant, F. B., Henderson-King, E. I., Suarez‐Balcazar, Y., & Myers, J. (1994) · Social psychological applications to social issues · doi:10.1007/978-1-4757-9238-6 · Cited by 71 · see citing works
Measuring self-assessment skills
Regehr, G., Hodges, B. D., Tiberius, R. G., & Lofchy, J. (1996) · Academic Medicine · doi:10.1097/00001888-199610000-00043 · Cited by 64 · see citing works
Self-citationSelf and Peer Assessment in Tutorials
Reiter, H., Eva, K. W., Hatala, R. M., & Norman, G. R. (2002) · Academic Medicine · doi:10.1097/00001888-200211000-00016 · Cited by 61 · see citing works
Self-citationAssessing Tutorial-Based Assessment
Eva, K. W. (2001) · Advances in Health Sciences Education · doi:10.1023/a:1012743830638 · Cited by 60 · see citing works
Self-citationGruppen, L. D., Garcia, J., Grum, C. M., Fitzgerald, J. T., White, C. A., Dicken, L. L., Sisson, J. C., & Zweifler, A. J. (1997) · Academic Medicine · doi:10.1097/00001888-199710001-00020 · Cited by 60 · see citing works
The Influence of Task Formats on the Accuracy of Medical Studentsʼ Self-assessments
Fitzgerald, J. T., Gruppen, L. D., & White, C. B. (2000) · Academic Medicine · doi:10.1097/00001888-200007000-00019 · Cited by 56 · see citing works
Colliver, J. A., Verhulst, S. J., & Barrows, H. S. (2005) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1703_1 · Cited by 33 · see citing works
Applying a Relative Ranking Model to the Self-Assessment of Extended Performances
Harrington, J. P., Murnaghan, J. J., & Regehr, G. (1997) · Advances in Health Sciences Education · doi:10.1023/a:1009782022956 · Cited by 25 · see citing works
Self-citationCervone, D. (1985) · Cognitive Therapy and Research · doi:10.1007/bf01173085 · Cited by 25 · see citing works
Gruppen, L. D., Garcia, J. D. N., Grum, C. M., Fitzgerald, J. T., White, C. A., Dicken, L. L., Sisson, J. C., & Zweifler, A. J. (1997) · Academic Medicine · doi:10.1097/00001888-199710000-00043 · Cited by 16 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Davis, D. A., Mazmanian, P. E., Fordis, M., Van Harrison, R., Thorpe, K. E., & Perrier, L. (2006) · JAMA · doi:10.1001/jama.296.9.1094 · Cited by 2,375 · see citing works
Reflection and reflective practice in health professions education: a systematic review
Mann, K., Gordon, J., & MacLeod, A. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-007-9090-2 · Cited by 2,175 · see citing works
Assessment in medical education
Epstein, R. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmra054784 · Cited by 1,872 · see citing works
Eppich, W., & Cheng, A. (2015) · Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000072 · Cited by 1,106 · see citing works
A model for programmatic assessment fit for purpose.
van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652239 · Cited by 892 · see citing works
State of the science in health professional education: effective feedback
Archer, J. C. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03546.x · Cited by 783 · see citing works
Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses
Panadero, E., Jonsson, A., & Botella, J. (2017) · Educational Research Review · doi:10.1016/j.edurev.2017.08.004 · Cited by 712 · see citing works
Diagnostic error and clinical reasoning
Norman, G. R., & Eva, K. W. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03507.x · Cited by 500 · see citing works
Self-citationCore principles of assessment in competency-based medical education.
Lockyer, J., Carraccio, C., Chan, M.-K., Hart, D., Smee, S., Touchie, C., Holmboe, E. S., Frank, J. R., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315082 · Cited by 493 · see citing works
“I'll never play professional football” and other fallacies of self-assessment
Eva, K. W., & Regehr, G. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.150 · Cited by 452 · see citing works
Self-citationEva, K. W., Armson, H., Holmboe, E., Lockyer, J., Loney, E., Mann, K., & Sargeant, J. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9290-7 · Cited by 402 · see citing works
Self-citationColthart, I., Bagnall, G., Evans, A., Allbutt, H., Haig, A., Illing, J. C., & McKinstry, B. (2008) · Medical Teacher · doi:10.1080/01421590701881699 · Cited by 385 · see citing works
Teaching the Social Determinants of Health: A Path to Equity or a Road to Nowhere?
Sharma, M., Pinto, A. D., & Kumagai, A. K. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001689 · Cited by 348 · see citing works
Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education.
Lefroy, J., Watling, C., Teunissen, P. W., & Brand, P. (2015) · Perspectives on Medical Education · doi:10.1007/s40037-015-0231-7 · Cited by 347 · see citing works
The assessment of professional competence: building blocks for theory development
van der Vleuten, C. P. M., Schuwirth, L., Scheele, F., Driessen, E. W., & Hodges, B. D. (2010) · Best Practice & Research Clinical Obstetrics & Gynaecology · doi:10.1016/j.bpobgyn.2010.04.001 · Cited by 341 · see citing works
Portfolios in medical education: why do they meet with mixed success? A systematic review
Driessen, E. W., van Tartwijk, J., van der Vleuten, C. P. M., & Wass, V. (2007) · Medical Education · doi:10.1111/j.1365-2923.2007.02944.x · Cited by 337 · see citing works
Medical students’ self-assessment of performance: Results from three meta-analyses
Blanch‐Hartigan, D. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2010.06.037 · Cited by 333 · see citing works
Self-monitoring in clinical practice: A challenge for medical educators
Epstein, R. M., Siegel, D. J., & Silberman, J. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.149 · Cited by 333 · see citing works
The processes and dimensions of informed self-assessment: A conceptual model.
Sargeant, J., Armson, H., Chesluk, B., Dornan, T., Eva, K., Holmboe, E., Lockyer, J., Loney, E., Mann, K., & van der Vleuten, C. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181d85a4e · Cited by 318 · see citing works
Self-citationUnderstanding trust as an essential element of trainee supervision and learning in the workplace
Hauer, K. E., ten Cate, O., Boscardin, C., Irby, D. M., Iobst, W. F., & O’Sullivan, P. (2013) · Advances in Health Sciences Education · doi:10.1007/s10459-013-9474-4 · Cited by 303 · see citing works
Reflection: a link between receiving and using assessment feedback
Sargeant, J. M., Mann, K. V., van der Vleuten, C. P., & Metsemakers, J. F. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-008-9124-4 · Cited by 296 · see citing works
Teaching and Learning in Medical Education: How Theory can Inform Practice
Kaufman, D. M., & Mann, K. V. (2010) · Wiley eBooks · doi:10.1002/9781444320282.ch2 · Cited by 284 · see citing works
Field Education for Clinical Social Work Practice: Best Practices and Contemporary Challenges
Bogo, M. (2015) · Clinical Social Work Journal · doi:10.1007/s10615-015-0526-5 · Cited by 280 · see citing works
Overconfidence in Clinical Decision Making
Croskerry, P., & Norman, G. R. (2008) · The American Journal of Medicine · doi:10.1016/j.amjmed.2008.02.001 · Cited by 263 · see citing works
Schumacher, D. J., Englander, R., & Carraccio, C. L. (2013) · Academic Medicine · doi:10.1097/acm.0b013e3182a6e8f8 · Cited by 263 · see citing works
Learning from clinical work: the roles of learning cues and credibility judgements
Watling, C., Driessen, E., van der Vleuten, C. P. M., & Lingard, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04126.x · Cited by 261 · see citing works
Dual processing and diagnostic errors
Norman, G. R. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9179-x · Cited by 252 · see citing works
How prepared are UK medical graduates for practice? A rapid review of the literature 2009–2014
Monrouxe, L. V., Grundy, L., Mann, M. K., John, Z., Panagoulas, E., Bullock, A. D., & Mattick, K. L. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013656 · Cited by 241 · see citing works
Colliver, J. A., Conlee, M. J., Verhulst, S. J., & Dorsey, J. K. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181d281dc · Cited by 232 · see citing works
Feedback and the educational alliance: Examining credibility judgements and their consequences.
Telio, S., Regehr, G., & Ajjawi, R. (2016) · Medical Education · doi:10.1111/medu.13063 · Cited by 231 · see citing works
Self-citationCoaching: a new model for academic and career achievement
Deiorio, N. M., Carney, P. A., Kahl, L. E., Bonura, E. M., & Juve, A. M. (2016) · Medical Education Online · doi:10.3402/meo.v21.33480 · Cited by 229 · see citing works
Ng, S., Kinsella, E. A., Friesen, F., & Hodges, B. D. (2015) · Medical Education · doi:10.1111/medu.12680 · Cited by 224 · see citing works
The role of deliberate practice in the acquisition of clinical skills
Duvivier, R. J., van Dalen, J., Muijtjens, A. M., Moulaert, V. R., van der Vleuten, C. P., & Scherpbier, A. J. (2011) · BMC Medical Education · doi:10.1186/1472-6920-11-101 · Cited by 223 · see citing works
Self-assessment in Lifelong Learning and Improving Performance in Practice
Duffy, F. D., & Holmboe, E. S. (2006) · JAMA · doi:10.1001/jama.296.9.1137 · Cited by 217 · see citing works
Fung, L., Boet, S., Bould, M. D., Qosa, H., Perrier, L., Tricco, A. C., Tavares, W., & Reeves, S. (2015) · Journal of Interprofessional Care · doi:10.3109/13561820.2015.1017555 · Cited by 216 · see citing works
Evaluation of competency methods in engineering education: a systematic review
Cruz, M. L., Saunders-Smits, G., & Groen, P. (2019) · European Journal of Engineering Education · doi:10.1080/03043797.2019.1671810 · Cited by 215 · see citing works
Guiding principles and recommendations for the assessment of competence.
Kaslow, N. J., Rubin, N. J., Bebeau, M. J., Leigh, I. W., Lichtenberg, J. W., Nelson, P. D., Portnoy, S. M., & Smith, I. L. (2007) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.38.5.441 · Cited by 208 · see citing works
Context and clinical reasoning: understanding the perspective of the expert’s voice
Durning, S. J., Artino, A. R., Pangaro, L. N., van der Vleuten, C. P. M., & Schuwirth, L. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04053.x · Cited by 206 · see citing works
Looking in the mirror: Self-debriefing versus instructor debriefing for simulated crises*
Boet, S., Bould, M. D., Bruppacher, H. R., Desjardins, F., Chandra, D. B., & Naik, V. N. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31820eb8be · Cited by 206 · see citing works
Rijdt, C. D., Stes, A., van der Vleuten, C. P. M., & Dochy, F. J. R. C. (2012) · Educational Research Review · doi:10.1016/j.edurev.2012.05.007 · Cited by 205 · see citing works
Exploring deliberate practice in medicine: how do physicians learn in the workplace?
van de Wiel, M. W. J., den Bossche, P. V., Janßen, S., & Jossberger, H. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9246-3 · Cited by 202 · see citing works
Vasan, N. S., DeFouw, D. O., & Compton, S. A. (2009) · Anatomical Sciences Education · doi:10.1002/ase.91 · Cited by 199 · see citing works
Mann, K. V., van der Vleuten, C. P. M., Eva, K. W., Armson, H., Chesluk, B., Dornan, T., Holmboe, E. S., Lockyer, J., Loney, E., & Sargeant, J. M. (2011) · Academic Medicine · doi:10.1097/acm.0b013e318226abdd · Cited by 198 · see citing works
Self-citationExploring the divergence between self-assessment and self-monitoring
Eva, K. W., & Regehr, G. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9263-2 · Cited by 194 · see citing works
Self-citationA tool for self-assessment of communication skills and professionalism in residents
Symons, A. B., Swanson, A., McGuigan, D., Orrange, S. M., & Akl, E. A. (2009) · BMC Medical Education · doi:10.1186/1472-6920-9-1 · Cited by 192 · see citing works
OʼBrien, B. C., Cooke, M., & Irby, D. M. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31814a4fd5 · Cited by 186 · see citing works
Helping medical learners recognise and manage unconscious bias toward certain patient groups
Teal, C. R., Gill, A. C., Green, A. R., & Crandall, S. J. S. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04101.x · Cited by 184 · see citing works
Dannefer, E. F., & Henson, L. C. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31803ead30 · Cited by 181 · see citing works
Within-Team Debriefing Versus Instructor-Led Debriefing for Simulation-Based Education
Boet, S., Bould, M. D., Sharma, B., Revees, S., Naik, V. N., Triby, E., & Grantcharov, T. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e31829659e4 · Cited by 180 · see citing works
An analysis of peer, self, and tutor assessment in problem-based learning tutorials
Papinczak, T., Young, L., Groves, M., & Haynes, M. A. (2007) · Medical Teacher · doi:10.1080/01421590701294323 · Cited by 176 · see citing works
Axboe, M. K., Christensen, K. S., Kofoed, P., & Ammentorp, J. (2016) · BMC Medical Education · doi:10.1186/s12909-016-0798-7 · Cited by 171 · see citing works
Factors confounding the assessment of reflection: a critical review
Koole, S., Dornan, T., Aper, L., Scherpbier, A. J. J. A., Valcke, M., Cohen‐Schotanus, J., & Derese, A. (2011) · BMC Medical Education · doi:10.1186/1472-6920-11-104 · Cited by 167 · see citing works
Knowing When to Look It Up: A New Conception of Self-Assessment Ability
Eva, K. W., & Regehr, G. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31813e6755 · Cited by 160 · see citing works
Self-citationBaxter, P. E., & Norman, G. R. (2011) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2011.05658.x · Cited by 159 · see citing works
“Directed” self-assessment: Practice and feedback within a social context
Sargeant, J., Mann, K., van der Vleuten, C., & Metsemakers, J. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.155 · Cited by 158 · see citing works
Evolving concepts of assessment in a competency-based world
Harris, P., Bhanji, F., Topps, M. H., Ross, S., Lieberman, S. A., Frank, J. R., Snell, L. S., Sherbino, J., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315071 · Cited by 155 · see citing works
Cognitive metaphors of expertise and knowledge: prospects and limitations for medical education
Mylopoulos, M., & Regehr, G. (2007) · Medical Education · doi:10.1111/j.1365-2923.2007.02912.x · Cited by 154 · see citing works
Self-citationThe competency movement within psychology: An historical perspective.
Rubin, N. J., Bebeau, M. J., Leigh, I. W., Lichtenberg, J. W., Nelson, P. D., Portnoy, S. M., Smith, I. L., & Kaslow, N. J. (2007) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.38.5.452 · Cited by 154 · see citing works
The self critical doctor: helping students become more reflective
Driessen, E. W., van Tartwijk, J., & Dornan, T. (2008) · BMJ · doi:10.1136/bmj.39503.608032.ad · Cited by 153 · see citing works
Understanding the behaviour of newly qualified doctors in acute care contexts
Tallentire, V. R., Smith, S. E., Skinner, J., & Cameron, H. S. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04024.x · Cited by 149 · see citing works
Curiosity and medical education
Dyche, L., & Epstein, R. M. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.03944.x · Cited by 146 · see citing works
A New Concept of Unsupervised Learning: Directed Self-Guided Learning in the Health Professions
Brydges, R., Dubrowski, A., & Regehr, G. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ed4c96 · Cited by 143 · see citing works
Self-citationIlgen, J. S., Eva, K. W., de Bruin, A. B. H., Cook, D. A., & Regehr, G. (2018) · Advances in Health Sciences Education · doi:10.1007/s10459-018-9859-5 · Cited by 142 · see citing works
Self-citationSlowing Down to Stay Out of Trouble in the Operating Room: Remaining Attentive in Automaticity
Moulton, C.-A., Regehr, G., Lingard, L., Merritt, C., & MacRae, H. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181f073dd · Cited by 140 · see citing works
Self-citationWatling, C. J., & Lingard, L. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9223-x · Cited by 139 · see citing works
Learning to Reason: A Journey of Professional Socialisation
Ajjawi, R., & Higgs, J. (2008) · Advances in Health Sciences Education · doi:10.1007/s10459-006-9032-4 · Cited by 137 · see citing works
Theory and Practice in the Design and Conduct of Graduate Medical Education
Hodges, B. D., & Kuper, A. (2011) · Academic Medicine · doi:10.1097/acm.0b013e318238e069 · Cited by 136 · see citing works
New graduate doctors’ preparedness for practice: a multistakeholder, multicentre narrative study
Monrouxe, L. V., Bullock, A. D., Gormley, G., Kaufhold, K., Kelly, N. A. A., Roberts, C. E., Mattick, K. L., & Rees, C. E. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-023146 · Cited by 135 · see citing works
The self-regulated learning of medical students in the clinical environment – a scoping review
Cho, K. K., Marjadi, B., Langendyk, V., & Hu, W. (2017) · BMC Medical Education · doi:10.1186/s12909-017-0956-6 · Cited by 133 · see citing works
Riddell, J., Robins, L., Brown, A., Sherbino, J., Lin, M., & Ilgen, J. S. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002984 · Cited by 129 · see citing works
French, J. C., Colbert, C. Y., Pien, L. C., Dannefer, E. F., & Taylor, C. A. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.05.016 · Cited by 128 · see citing works
CPD of the future: a partnership between quality improvement and competency‐based education
Sargeant, J. M., Wong, B. M., & Campbell, C. M. (2017) · Medical Education · doi:10.1111/medu.13407 · Cited by 124 · see citing works
Reliability and validity of student peer assessment in medical education: A systematic review
Speyer, R., Pilz, W., Van Der Kruis, J., & Brunings, J. W. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.610835 · Cited by 123 · see citing works
Durning, S. J., Cleary, T. J., Sandars, J. E., Hemmer, P. A., Kokotailo, P. K., & Artino, A. R. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31820dc384 · Cited by 119 · see citing works
Tai, J. H.-M., Canny, B. J., Haines, T. P., & Molloy, E. K. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9659-0 · Cited by 117 · see citing works
Solution-Focused Coaching in Pediatric Rehabilitation: An Integrated Model for Practice
Baldwin, P. J., King, G. A., Evans, J., McDougall, S., Tucker, M. A., & Servais, M. (2013) · Physical & Occupational Therapy In Pediatrics · doi:10.3109/01942638.2013.784718 · Cited by 117 · see citing works
Recognizing, assessing, and intervening with problems of professional competence.
Kaslow, N. J., Rubin, N. J., Forrest, L. M., Elman, N. S., Horne, B. A. V., Jacobs, S. C., Huprich, S. K., Benton, S. A., Pantesco, V. F., Dollinger, S. J., et al. (2007) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.38.5.479 · Cited by 117 · see citing works
Norman, G. R., Neville, A. J., Blake, J. M., & Mueller, B. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.486063 · Cited by 114 · see citing works
Achievement Goal Structures and Self-Regulated Learning
Artino, A. R., Dong, T., DeZee, K. J., Gilliland, W. R., Waechter, D. M., Cruess, D. F., & Durning, S. J. (2012) · Academic Medicine · doi:10.1097/acm.0b013e3182676b55 · Cited by 113 · see citing works
Monitoring and regulation of learning in medical education: The need for predictive cues
de Bruin, A. B. H., Dunlosky, J., & Cavalcanti, R. B. (2017) · Medical Education · doi:10.1111/medu.13267 · Cited by 112 · see citing works
Norman, G. R. (2014) · Advances in Health Sciences Education · doi:10.1007/s10459-014-9494-8 · Cited by 112 · see citing works
Heuristics and biases − a biased perspective on clinical reasoning
Eva, K. W., & Norman, G. R. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02258.x · Cited by 109 · see citing works
Self-citationThe Importance of Feedback in Preparing Social Work Students for Field Education
Kourgiantakis, T., Sewell, K. M., & Bogo, M. (2018) · Clinical Social Work Journal · doi:10.1007/s10615-018-0671-8 · Cited by 107 · see citing works
Coproducing Health Professions Education: A Prerequisite to Coproducing Health Care Services?
Englander, R., Holmboe, E. S., Batalden, P. B., Caron, R. M., Durham, C. F., Foster, T. C., Ogrinc, G. S., Ercan-Fang, N. G., & Batalden, M. (2019) · Academic Medicine · doi:10.1097/acm.0000000000003137 · Cited by 106 · see citing works
Ferguson, P. C., Caverzagie, K. J., Nousiainen, M. T., Snell, L. S., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315079 · Cited by 105 · see citing works
Course evaluation in medical education
Kogan, J. R., & Shea, J. A. (2007) · Teaching and Teacher Education · doi:10.1016/j.tate.2006.12.020 · Cited by 105 · see citing works
Excellence in clinical teaching: knowledge transformation and development required
Irby, D. M. (2014) · Medical Education · doi:10.1111/medu.12507 · Cited by 103 · see citing works
Finn, B., & Tauber, S. K. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9313-7 · Cited by 102 · see citing works
Hulsman, R. L., Harmsen, A. B., & Fabriek, M. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2008.10.009 · Cited by 102 · see citing works
Clinical decision making: how surgeons do it
Crebbin, W., Beasley, S. W., & Watters, D. A. (2013) · ANZ Journal of Surgery · doi:10.1111/ans.12180 · Cited by 101 · see citing works
Khoiriyah, U., Roberts, C., Jorm, C. M., & van der Vleuten, C. P. M. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0422-2 · Cited by 101 · see citing works
Tavares, W., Eppich, W., Cheng, A., Miller, S. G., Teunissen, P. W., Watling, C., & Sargeant, J. M. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002932 · Cited by 100 · see citing works
Rater cognition: review and integration of research findings
Gauthier, G., St‐Onge, C., & Tavares, W. (2016) · Medical Education · doi:10.1111/medu.12973 · Cited by 100 · see citing works
Believing is seeing: how people's beliefs influence goals, emotions and behaviour
Teunissen, P. W., & Bok, H. G. J. (2013) · Medical Education · doi:10.1111/medu.12228 · Cited by 99 · see citing works
Gulbrandsen, P., Jensen, B. F., Finset, A., & Blanch‐Hartigan, D. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2012.11.015 · Cited by 99 · see citing works
Comparing students’ perceived and actual competence in higher vocational education
Baartman, L. K. J., & Ruijs, L. (2011) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2011.553274 · Cited by 99 · see citing works
Artino, A. R., Driessen, E. W., & Maggio, L. A. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002412 · Cited by 96 · see citing works
Huang, G. C., Newman, L. R., Schwartzstein, R. M., Clardy, P. F., Feller-Kopman, D. J., Irish, J. T., & Smith, C. (2009) · Academic Medicine · doi:10.1097/acm.0b013e3181acf491 · Cited by 96 · see citing works
How Accurate Are Our Students? A Meta-analytic Systematic Review on Self-assessment Scoring Accuracy
León, S. P., Panadero, E., & García‐Martínez, I. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09819-0 · Cited by 94 · see citing works
The preparedness of UK graduates in acute care: a systematic literature review
Tallentire, V. R., Smith, S. E., Skinner, J., & Cameron, H. S. (2011) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2011-130232 · Cited by 93 · see citing works
- Authors
- Eva, K. W., & Regehr, G.
- Affiliations
- McMaster University (CA)
- Corresponding author
- Eva, Kevin W.
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-10
- Volume
- 80
- Issue
- Supplement
- Pages
- S46-S54
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W2120386903
- Semantic Scholar
- 3157ebc5ee38639f73962821385248f935e082e0
- Cited by
- 992
- References
- 56
- Citations by year
- 2026: 68 · 2025: 38 · 2024: 34 · 2023: 47 · 2022: 49 · 2021: 51 · 2020: 37 · 2019: 56 · 2018: 60 · 2017: 60 · 2016: 63 · 2015: 56 · 2014: 43 · 2013: 64 · 2012: 56
- FWCI
- 4.36
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Academic Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- self-assessment, self-regulation, health professions education, professional self-regulation, self-assessment ability, research agenda
- MeSH terms
- Health Personnel, Humans, Models, Psychological, Research Design, Self-Assessment, Self Concept, Self-Evaluation Programs, Knowledge, Self Efficacy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review