The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Assessing professional competence: from methods to programmes
Abstract
Introduction We use a utility model to illustrate that, firstly, selecting an assessment method involves context‐dependent compromises, and secondly, that assessment is not a measurement problem but an instructional design problem, comprising educational, implementation and resource aspects. In the model, assessment characteristics are differently weighted depending on the purpose and context of the assessment. Empirical and theoretical developments Of the characteristics in the model, we focus on reliability, validity and educational impact and argue that they are not inherent qualities of any instrument. Reliability depends not on structuring or standardisation but on sampling. Key issues concerning validity are authenticity and integration of competencies. Assessment in medical education addresses complex competencies and thus requires quantitative and qualitative information from different sources as well as professional judgement. Adequate sampling across judges, instruments and contexts can ensure both validity and reliability. Despite recognition that assessment drives learning, this relationship has been little researched, possibly because of its strong context dependence. Assessment as instructional design When assessment should stimulate learning and requires adequate sampling, in authentic contexts, of the performance of complex competencies that cannot be broken down into simple parts, we need to make a shift from individual methods to an integral programme, intertwined with the education programme. Therefore, we need an instructional design perspective. Implications for development and research Programmatic instructional design hinges on a careful description and motivation of choices, whose effectiveness should be measured against the intended outcomes. We should not evaluate individual methods, but provide evidence of the utility of the assessment programme as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In the new movement towards programmatic assessment, progress and learning from feedback is emphasized and built into the system [74, 75].”
From Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education. (2015) · cites this paper as [74]
Citations
Cites
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883
Defining and Assessing Professional Competence
Epstein, R. M. (2002) · JAMA · doi:10.1001/jama.287.2.226 · Cited by 3,114
Standards for educational and psychological testing
(1985) · PsycEXTRA Dataset · doi:10.1037/e500832009-001 · Cited by 1,493
Validity: on the meaningful interpretation of assessment data
Downing, S. M. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01594.x · Cited by 1,434
The interplay of evidence and consequences in the validation of performance assessments
Messick, S. (1994) · Educational Researcher · doi:10.3102/0013189x023002013 · Cited by 1,315
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
The use of self-, peer and co-assessment in higher education: A review
Dochy, F., Segers, M., & Sluijsmans, D. (1999) · Studies in Higher Education · doi:10.1080/03075079912331379935 · Cited by 1,206
Complex, Performance-Based Assessment: Expectations and Validation Criteria
Linn, R. L., Baker, E., & Dunbar, S. (1991) · Educational Researcher · doi:10.3102/0013189x020008015 · Cited by 1,043
The Mini-CEX: A Method for Assessing Clinical Skills
Norcini, J. J., Blank, L. L., Duffy, F. D., & Fortna, G. S. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-6-200303180-00012 · Cited by 730
Regehr, G., MacRae, H., Reznick, R. K., & Szalay, D. (1998) · Academic Medicine · doi:10.1097/00001888-199809000-00020 · Cited by 712
Research works printed but not linked: 5
- Van Merriënboer JJG, 1997, Training Complex Cognitive Skills.
- Gibbs G, 2002, How Assessment Influences Student Learning – a Conceptual Overview:
- Epstein RM, 2001, Comprehensive Assessment Manual
- Swanson DB, 1987, Further Developments in Assessing Clinical Competence, 13
- Van Der Vleuten CPM, 1988, Reliability (Generalisability) of the Maastricht Skills Test.
Cited by
Sorted by citations
Items 301–400 of 1,000
Developing a “Frequent Look and Rapid Remediation” Assessment System for a New Medical School
Ricketts, C., & Bligh, J. G. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ff9ca3 · Cited by 27
Ramamurthy, S., Er, H. M., Nadarajah, V. D., & Pook, P. C. K. (2016) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2016.02.017 · Cited by 27
Development and Validation of a Ureteral Anastomosis Simulation Model for Surgical Training
Tunitsky, E., Murphy, A. M., Barber, M. D., Simmons, M. N., & Jelovsek, J. E. (2013) · Urogynecology · doi:10.1097/spv.0b013e3182a331bf · Cited by 27
Direct Observation Assessment of Milestones: Problems with Reliability
Schott, M., Kedia, R., Promes, S. B., Swoboda, T. K., O'Rourke, K., Green, W., Liu, R., Stansfield, R. B., & Santen, S. A. (2015) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2015.9.27270 · Cited by 26
Assessing family medicine trainees – what can we learn from the European neighbours?
Flum, E., Maagaard, R., Godycki-Ćwirko, M., Scarborough, N., Scherpbier, N. D., Ledig, T., Roos, M., & Steinhäuser, J. (2015) · Europe PMC (PubMed Central) · doi:10.3205/zma000963 · Cited by 26
A mobile application to facilitate implementation of programmatic assessment in anaesthesia training
Marty, A., Braun, J., Schick, C., Zalunardo, M. P., Spahn, D. R., & Breckwoldt, J. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2022.02.038 · Cited by 27
Gettman, M. T., Le, C. Q., Rangel, L. J., Slezak, J. M., Bergstralh, E. J., & Krambeck, A. E. (2009) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0b013e3181871c3e · Cited by 26
Workplace Learning in Veterinary Education: A Sociocultural Perspective
Scholz, E. C., Trede, F., & Raidal, S. L. (2013) · Journal of Veterinary Medical Education · doi:10.3138/jvme.0113-015r · Cited by 33
Workplace-based assessment: measuring and shaping clinical learning.
Singh, T., & Sood, R. (2013) · PubMed · Cited by 26
Structured feedback to undergraduate medical students: 3 years’ experience of an assessment tool
Haffling, A.-C., Beckman, A., & Edgren, G. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.577466 · Cited by 27
Suhoyo, Y., Schönrock-Adema, J., Rahayu, G. R., Kuks, J. B. M., & Cohen‐Schotanus, J. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.917160 · Cited by 26
Durning, S. J., Ratcliffe, T. A., Artino, A. R., van der Vleuten, C. P. M., Beckman, T. J., Holmboe, E. S., Lipner, R. S., & Schuwirth, L. (2013) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.21188 · Cited by 30
Self-citationHow Do Thresholds of Principle and Preference Influence Surgeon Assessments of Learner Performance?
Apramian, T., Cristancho, S., Şener, A., & Lingard, L. (2017) · Annals of Surgery · doi:10.1097/sla.0000000000002284 · Cited by 25
Implementation of Portfolios as a Programmatic Global Assessment Measure in Dental Education
Gadbury‐Amyot, C. C., & Overman, P. R. (2018) · Journal of Dental Education · doi:10.21815/jde.018.062 · Cited by 25
Rocha, S. R., Romão, G. S., Setúbal, M. S. V., Collares, C. F., & do Amaral, E. M. S. (2019) · Revista Brasileira de Educação Médica · doi:10.1590/1981-5271v43suplemento1-20190154 · Cited by 33
How argumentation theory can inform assessment validity: A critical review
Kinnear, B., Schumacher, D. J., Driessen, E. W., & Varpio, L. (2022) · Medical Education · doi:10.1111/medu.14882 · Cited by 25
Rotthoff, T., Baehring, T., Dicken, H.-D., Fahron, U., Richter, B., Fischer, M. R., & Scherbaum, W. A. (2006) · BMC Medical Education · doi:10.1186/1472-6920-6-50 · Cited by 25
Dalrymple, K. R., Wong, S., Rosenblum, A., Wuenschell, C. W., Paine, M. L., & Shuler, C. F. (2007) · Journal of Dental Education · doi:10.1002/j.0022-0337.2007.71.12.tb04433.x · Cited by 25
Heijne-Penninga, M., Kuks, J. B. M., Hofman, R. H., & Cohen‐Schotanus, J. (2010) · Medical Teacher · doi:10.3109/0142159x.2011.530315 · Cited by 25
Ginsburg, L. R., Tregunno, D., Norton, P., Smee, S. M., de Vries, I., Sebok‐Syer, S. S., VanDenKerkhof, E. G., Luctkar‐Flude, M., & Medves, J. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003277 · Cited by 24
Consensus development of core competencies in intensive and critical care medicine training in China
Hu, X., Xi, X.-M., Ma, P., Qiu, H., Yu, K.-J., Tang, Y.-Q., Qian, C.-Y., Fang, Q., Wang, Y.-S., Yu, X.-Y., et al. (2016) · Critical Care · doi:10.1186/s13054-016-1514-z · Cited by 23
Hernandez, C. A., Daroowalla, F., LaRochelle, J. S., Ismail, N. J., Tartaglia, K. M., Fagan, M. J., Kisielewski, M., & Walsh, K. J. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003815 · Cited by 26
Evaluation Apprehension and Impression Management in Clinical Medical Education
McGaghie, W. C. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002143 · Cited by 25
van Dalen, J. (2015) · Wiley eBooks · doi:10.1002/9781118728130.ch30 · Cited by 27
de Jong, L. H., Bok, H. G. J., Schellekens, L. H., Kremer, W. D. J., Jonker, F. H., & van der Vleuten, C. P. M. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03257-2 · Cited by 24
Ryan, M. S., Gielissen, K. A., Shin, D., Perera, R. A., Gusic, M. E., Ferenchick, G. S., Ownby, A. R., Cutrer, W. B., Obeso, V. T., & Santen, S. A. (2024) · Medical Education · doi:10.1111/medu.15291 · Cited by 24
Assessment Practices for Dietetics Trainees: A Systematic Review
Jamieson, J., Palermo, C. E., Hay, M., & Gibson, S. (2019) · Journal of the Academy of Nutrition and Dietetics · doi:10.1016/j.jand.2018.09.010 · Cited by 24
Blended programmatic assessment for competency based curricula
Mahajan, R., Saiyad, S. N., Virk, A., Joshi, A., & Singh, T. (2021) · Journal of Postgraduate Medicine · doi:10.4103/jpgm.jpgm_1061_20 · Cited by 27
Exploring complexities in the reform of assessment practice: a critical realist perspective
Roberts, C., Khanna, P., Lane, S., Reimann, P., & Schuwirth, L. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-021-10065-8 · Cited by 24
Self-citationAn international review of the use of competency standards in undergraduate pharmacy education
Nash, R., Chalmers, L., Brown, N. R., Jackson, S., & Peterson, G. M. (2015) · eCite Digital Repository (University of Tasmania) · Cited by 24
Challenges in measuring ACGME competencies: considerations for milestones
Natesan, P., Batley, N. J., Bakhti, R., & Doueihi, P. (2018) · International Journal of Emergency Medicine · doi:10.1186/s12245-018-0198-3 · Cited by 24
Assessment of the practicing physician: Challenges and opportunities
Holmboe, E. S. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.200 · Cited by 24
Quality assurance, benchmarking, assessment and mutual international recognition of qualifications
Hobson, R. S., Rolland, S., Rotgans, J. I., Schoonheim‐Klein, M., Best, H. A., Chomyszyn‐Gajewska, M., Dymock, D., Essop, R., Hupp, J. R., Kundzina, R., et al. (2008) · European Journal Of Dental Education · doi:10.1111/j.1600-0579.2007.00484.x · Cited by 24
Workplace-based assessment in radiology—where to now?
Augustine, K., McCoubrie, P., Wilkinson, J., & McKnight, L. (2010) · Clinical Radiology · doi:10.1016/j.crad.2009.12.004 · Cited by 25
Marcotte, L., Egan, R. G., Soleas, E., Dalgarno, N., Norris, M., & Smith, C. (2019) · PubMed Central · Cited by 23
Chaney, K. P., & Hodgson, J. (2021) · Frontiers in Veterinary Science · doi:10.3389/fvets.2021.689356 · Cited by 31
Nunnink, L., Venkatesh, B., Krishnan, A., Vidhani, K., & Udy, A. A. (2010) · Anaesthesia and Intensive Care · doi:10.1177/0310057x1003800511 · Cited by 23
Durning, S. J., Hanson, J. L., Gilliland, W. R., McManigle, J. E., Waechter, D. M., & Pangaro, L. N. (2010) · Military Medicine · doi:10.7205/milmed-d-09-00044 · Cited by 24
Achike, F. I. (2009) · The Journal of Clinical Pharmacology · doi:10.1177/0091270009343697 · Cited by 23
Twelve tips for increasing the defensibility of assessment decisions
Hays, R., Hamlin, G. P., & Crane, L. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.943711 · Cited by 23
Bekkink, M. O., Donders, R. A. R. T., van Muijen, G. N. P., & Ruiter, D. J. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9291-6 · Cited by 22
Assessing postgraduate trainees in Canada: Are we achieving diversity in methods?
Chou, S. H., Lockyer, J., Cole, G., & McLaughlin, K. (2008) · Medical Teacher · doi:10.1080/01421590802512938 · Cited by 23
Jenkins, L. S., Mash, R. J., & Derese, A. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-101 · Cited by 23
Daelmans, H. E. M., der Vossen, M. M., Croiset, G., & Kusurkar, R. A. (2016) · International Journal of Medical Education · doi:10.5116/ijme.5689.3c7f · Cited by 23
Nutritional value of an "anti-regurgitation" formula.
Levtchenko, E. N., Hauser, B., & Vandenplas, Y. (1998) · PubMed · Cited by 23
Howley, L. D. (2013) · Springer eBooks · doi:10.1007/978-1-4614-5993-4_13 · Cited by 23
Programmatic assessment design choices in nine programs in higher education
Baartman, L. K. J., van Schilt-Mol, T., & van der Vleuten, C. P. M. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.931980 · Cited by 27
Rosenthal, G. E., McClain, D. A., High, K. P., Easterling, D. V., Sharkey, A., Wagenknecht, L. E., O’Byrne, C., Woodside, R., & Houston, T. K. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005259 · Cited by 22
Sargeant, J. M., MacLeod, T., Sinclair, D. E., & Power, M. (2011) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.20111 · Cited by 24
What Do We Know About Education in Colorectal Cancer Prevention?—Survey Among 1130 Medical Students
Pietrzyk, Ł., Torres, A., Denisow‐Pietrzyk, M., & Torres, K. (2015) · Journal of Cancer Education · doi:10.1007/s13187-015-0967-0 · Cited by 22
Vorstenbosch, M. A. T. M., Bouter, S., van den Hurk, M. M., Kooloos, J. G. M., Bolhuis, S. M., & Laan, R. (2013) · Anatomical Sciences Education · doi:10.1002/ase.1382 · Cited by 22
Kogan, J. R., Conforti, L. N., Yamazaki, K., Iobst, W. F., & Holmboe, E. S. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001319 · Cited by 22
Selection into medicine: the predictive validity of an outcome-based procedure
Schreurs, S., Cleutjens, K. B. J. M., Muijtjens, A. M. M., Cleland, J., & Egbrink, M. G. A. O. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1316-x · Cited by 22
Kassab, S. E., Du, X., Toft, E. S., Cyprian, F. S., Al-Moslih, A., Schmidt, H. G., Hamdy, H., & Abu-Hijleh, M. F. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1594-y · Cited by 21
Assessment of Professional Competence
Tigelaar, D. E. H., & van der Vleuten, C. P. M. (2014) · Springer international handbooks of education · doi:10.1007/978-94-017-8902-8_45 · Cited by 23
Validity, Reliability, and Defensibility of Assessments in Veterinary Education
Hecker, K. G., & Violato, C. (2009) · Journal of Veterinary Medical Education · doi:10.3138/jvme.36.3.271 · Cited by 27
Miller, P. A., Nayer, M., & Eva, K. W. (2010) · Physical Therapy · doi:10.2522/ptj.20080137 · Cited by 19
Jenkins, L. S., Mash, R. J., & Derese, A. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-149 · Cited by 22
BERGUS, G. R., & Kreiter, C. D. (2007) · Medical Education · doi:10.1111/j.1365-2923.2007.02786.x · Cited by 22
Assessment of non-clinical attributes in paramedicine using multiple mini-interviews
Tavares, W., & Mausz, J. (2015) · Emergency Medicine Journal · doi:10.1136/emermed-2013-202964 · Cited by 20
Workplace based assessment: A review of available tools and their relevance
Prakash, J., Chatterjee, K. D., Srivastava, K., Chauhan, V. S., & Sharma, R. (2020) · Industrial Psychiatry Journal · doi:10.4103/ipj.ipj_225_20 · Cited by 21
Operationalizing Programmatic Assessment: The CBME Programmatic Assessment Practice Guidelines
Rich, J. V., Luhanga, U., Young, S. F., Wagner, N., Dagnone, D., Chamberlain, S., & McEwen, L. A. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004574 · Cited by 21
Understanding fatty acid metabolism through an active learning approach
Fardilha, M., Schrader, M., Silva, O. A. B. D. C. E., & Silva, E. F. D. C. E. (2010) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20330 · Cited by 21
Reliability of consultation skills assessments using standardised versus real patients
Reinders, M. E., Blankenstein, A. H., van Marwijk, H., Knol, D. L., Ram, P., van der Horst, H. E., de Vet, H. C. W., & van der Vleuten, C. P. M. (2011) · Medical Education · doi:10.1111/j.1365-2923.2010.03917.x · Cited by 21
The Next Phase of Pediatric Residency Education: The Partnership of the Milestones Project
Rushton, J. L., Hicks, P. J., & Carraccio, C. L. (2010) · Academic Pediatrics · doi:10.1016/j.acap.2010.01.001 · Cited by 21
Self-evaluation of assessment programs: A cross-case analysis
Baartman, L. K. J., Prins, F. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2011) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2011.03.001 · Cited by 23
Evaluation of Reliability in Structured Viva Voce As a Formative Assessment of Dental Students
Ganji, K. K. (2017) · Journal of Dental Education · doi:10.21815/jde.016.017 · Cited by 22
Tensions in post‐examination feedback: information for learning versus potential for harm
Ryan, A., McColl, G., O’Brien, R. C., Chiavaroli, N. G., Judd, T. S., Finch, S. J., & Swanson, D. B. (2017) · Medical Education · doi:10.1111/medu.13366 · Cited by 22
Programmatic assessment: Can we provide evidence for saturation of information?
de Jong, L. H., Bok, H. G. J., Kremer, W. D. J., & van der Vleuten, C. P. M. (2019) · Medical Teacher · doi:10.1080/0142159x.2018.1555369 · Cited by 21
In Search of Characterizing Surgical Skill
Azari, D. P., Greenberg, C. C., Pugh, C. M., Wiegmann, D. A., & Radwin, R. G. (2019) · Journal of surgical education · doi:10.1016/j.jsurg.2019.02.010 · Cited by 22
A pilot survey of student perceptions on the benefit of the OSCE and MCQ modalities
Müller, S., Settmacher, U., Koch, I., & Dahmen, U. (2018) · Europe PMC (PubMed Central) · doi:10.3205/zma001197 · Cited by 23
Playford, D. E., Kirke, A. B., Maley, M. A. L., & Worthington, R. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.778392 · Cited by 23
Assessment of clinical performance: gathering evidence
WILKINSON, T. J. (2007) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2007.01483.x · Cited by 21
Are specialist certification examinations a reliable measure of physician competence?
Burch, V. C., Norman, G. R., Schmidt, H. G., & van der Vleuten, C. P. M. (2007) · Advances in Health Sciences Education · doi:10.1007/s10459-007-9063-5 · Cited by 21
Schuwirth, L., & van der Vleuten, C. P. M. (2018) · Wiley eBooks · doi:10.1002/9781119373780.ch20 · Cited by 24
Self-citationTop 10 ways to reconcile social media and ‘traditional’ education in emergency care
Roland, D., & Brazil, V. A. (2015) · Emergency Medicine Journal · doi:10.1136/emermed-2015-205024 · Cited by 20
Developing a digital application for quality assurance of assessment programmes in higher education
Schellekens, L. H., van der Schaaf, M. F., van der Vleuten, C. P. M., Prins, F. J., Wools, S., & Bok, H. G. J. (2022) · Quality Assurance in Education · doi:10.1108/qae-03-2022-0066 · Cited by 20
Badaoui, A., de Campos, S. T., Fusaroli, P., Gincul, R., Kahaleh, M., Poley, J., Valencia, L. S., Czakó, L., Ginés, À., Hucl, T., et al. (2023) · Endoscopy · doi:10.1055/a-2224-8704 · Cited by 20
Assessment methods in surgical training in the United Kingdom
Evgeniou, E., Loizou, P., Tsironi, M., & Iyer, S. (2013) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2013.10.2 · Cited by 20
Kalsi, H. K., Kalsi, J. S., & Fisher, N. L. (2013) · BDJ · doi:10.1038/sj.bdj.2013.1098 · Cited by 20
In the minds of OSCE examiners: uncovering hidden assumptions
Chahine, S., Holmes, B., & Kowalewski, Z. (2015) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9655-4 · Cited by 21
A Call for an Integrated Program of Assessment
Fielding, D. W., & Regehr, G. (2017) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe81477 · Cited by 21
Farajpour, A., Amini, M., Pishbin, E., Mostafavian, Z., & Farmad, S. A. (2018) · Europe PMC (PubMed Central) · doi:10.30476/jamp.2018.41025 · Cited by 20
Assessment toolbox for Indian medical graduate competencies
Singh, T., Saiyad, S. N., Virk, A., Kalra, J., & Mahajan, R. (2021) · Journal of Postgraduate Medicine · doi:10.4103/jpgm.jpgm_1260_20 · Cited by 20
Beeching, N. J., Rautelin, H., Stahl, J. ‐., & Leegaard, T. M. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2021.07.009 · Cited by 22
An Examination of Canadian Social Work Program Curriculum and The Addiction Core Competencies
Graves, G., Csiernik, R., Foy, J., & Cesar, J. (2009) · Journal of Social Work Practice in the Addictions · doi:10.1080/15332560903212595 · Cited by 21
Durning, S. J., Cohen, D. L., Cruess, D., McManigle, J. E., & MacDonald, R. (2008) · Teaching and Learning in Medicine · doi:10.1080/10401330802199609 · Cited by 20
Collins, D., & Cruickshank, A. (2015) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2014.08.002 · Cited by 23
Christensen, L., Karle, H., & Nystrup, J. (2007) · Medical Teacher · doi:10.1080/01421590701370537 · Cited by 20
Nash, R., Chalmers, L., Stupans, I., & Brown, N. R. (2016) · International Journal of Pharmacy Practice · doi:10.1111/ijpp.12267 · Cited by 20
Assessment of Junior Doctor performance: a validation study
Carr, S., Celenza, A., & Lake, F. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-129 · Cited by 19
Developing a two-dimensional model of unprofessional behaviour profiles in medical students
der Vossen, M. M., de la Croix, A., Teherani, A., van Mook, W., Croiset, G., & Kusurkar, R. A. (2018) · Advances in Health Sciences Education · doi:10.1007/s10459-018-9861-y · Cited by 21
Learning analytics dashboards: What do students actually ask for?
Divjak, B., Svetec, B., & Horvat, D. (2023) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3576050.3576141 · Cited by 24
Trevitt, C. (2008) · Educational Action Research · doi:10.1080/09650790802445676 · Cited by 19
Morris, M. C., Frodl, T., D’Souza, A., Fagan, A. J., & Ridgway, P. F. (2014) · Journal of surgical education · doi:10.1016/j.jsurg.2014.09.007 · Cited by 19
McGill, D. A., van der Vleuten, C. P. M., & Clarke, M. J. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9410-z · Cited by 19
Utility of an app-based system to improve feedback following workplace-based assessment
Lefroy, J., Roberts, N., Molyneux, A., Bartlett, M., Gay, S. P., & McKinley, R. K. (2017) · International Journal of Medical Education · doi:10.5116/ijme.5910.dc69 · Cited by 20
Developing early career professional auditors at work
Plant, K., Barac, K., & Jager, H. D. (2017) · Meditari Accountancy Research · doi:10.1108/medar-03-2017-0119 · Cited by 19
Peeters, M. J. (2015) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2015.06.015 · Cited by 19
Assessment of competence in anesthesiology
Tetzlaff, J. E. (2009) · Current Opinion in Anaesthesiology · doi:10.1097/aco.0b013e3283326958 · Cited by 17
Metadata
- Authors
- Van Der Vleuten, C. P. M., & Schuwirth, L. W. T.
- Affiliations
- Maastricht University (NL)
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2005-02-23
- Volume
- 39
- Issue
- 3
- Pages
- 309-317
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2163175447
- Cited by
- 1,268
- References
- 44
- Citations by year
- 2026: 87 · 2025: 46 · 2024: 51 · 2023: 66 · 2022: 66 · 2021: 92 · 2020: 63 · 2019: 76 · 2018: 59 · 2017: 66 · 2016: 65 · 2015: 75 · 2014: 72 · 2013: 64 · 2012: 47
- FWCI
- 33.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Education (publishedVersion)
- PubMed (publishedVersion)
- Northumbria Research Link (Northumbria University) (acceptedVersion)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Competency Development and Evaluation
- Keywords
- professional competence assessment, assessment methods, assessment reliability, assessment validity, sampling, authenticity, competency-based education
- MeSH terms
- Clinical Competence, Education, Medical, Undergraduate, Learning, Reproducibility of Results, Program Evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review