Cited by 892Innovations in Medical EducationStudent Assessment and FeedbackEvaluation and Performance Assessment

The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.

A model for programmatic assessment fit for purpose.

van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., van Tartwijk, J.·2012·Medical Teacher

DOI 10.3109/0142159x.2012.652239

Open this paper in CoChat — free account

Abstract

We propose a model for programmatic assessment in action, which simultaneously optimises assessment for learning and assessment for decision making about learner progress. This model is based on a set of assessment principles that are interpreted from empirical research. It specifies cycles of training, assessment and learner support activities that are complemented by intermediate and final moments of evaluation on aggregated assessment data points. A key principle is that individual data points are maximised for learning and feedback value, whereas high-stake decisions are based on the aggregation of many data points. Expert judgement plays an important role in the programme. Fundamental is the notion of sampling and bias reduction to deal with the inevitable subjectivity of this type of judgement. Bias reduction is further sought in procedural assessment strategies derived from criteria for qualitative research. We discuss a number of challenges and opportunities around the proposed model. One of its prime virtues is that it enables assessment to move, beyond the dominant psychometric discourse with its focus on individual instruments, towards a systems approach to assessment design underpinned by empirically grounded theory.

Integrity signals

Registry

Crossref · 10.3109/0142159x.2012.652239

Cites

69 of 69 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Power of Feedback
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory.
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883
Focus on Formative Feedback
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Naturalistic Decision Making
Klein, G. A. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288385 · Cited by 2,434
Defining Quality
Harvey, L., & Green, D. (1993) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293930180102 · Cited by 1,281
Assessing professional competence: from methods to programmes
Van Der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02094.x · Cited by 1,268
Self-citation
Linking Theory and Practice: Changing the Pedagogy of Teacher Education
Korthagen, F. A. J., & Kessels, J. P. A. M. (1999) · Educational Researcher · doi:10.3102/0013189x028004004 · Cited by 1,266
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170

Flagged first, then by citations

Show all 69 references

Research works printed but not linked: 6

Cavalcanti RB, 2011, JAMA, 306, 993
Cilliers FJ, 2011, Adv Health Sci Educ Theory Pract
Dijkstra J, Galbraith R, Hodges B, McAvoy P, McCrorie P, Southgate L, Van der Vleuten C, Wass V, Schuwirth L. under editorial review. Fit-for-purpose guidelines for designing programmes of assessment
Harden RM, 1984, Med Teach, 18, 284
Van Merriënboer JJG, 1997, Training complex cognitive skills
Verhoeven BH, 1999, Educ Health, 12, 49

Sorted by citations

Items 201–300 of 892

Shaping the right conditions in programmatic assessment: how quality of narrative information affects the quality of high-stakes decision-making
de Jong, L. H., Bok, H. G. J., Schellekens, L. H., Kremer, W. D. J., Jonker, F. H., & van der Vleuten, C. P. M. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03257-2 · Cited by 24
Assessment Practices for Dietetics Trainees: A Systematic Review
Jamieson, J., Palermo, C. E., Hay, M., & Gibson, S. (2019) · Journal of the Academy of Nutrition and Dietetics · doi:10.1016/j.jand.2018.09.010 · Cited by 24
Competency Committees in Undergraduate Medical Education: Approaching Tensions Using a Polarity Management Framework
Monrad, S. U., Mangrulkar, R. S., Woolliscroft, J. O., Daniel, M. M., Hartley, S. E., Gay, T. L., Highet, A., Vijayakumar, N., & Santen, S. A. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002816 · Cited by 24
The Value of Programmatic Assessment in Supporting Educators and Students to Succeed: A Qualitative Evaluation
Dart, J., Twohig, C., Anderson, A., Bryce, A., Collins, J., Gibson, S., Kleve, S., Porter, J. A., Volders, E., & Palermo, C. E. (2021) · Journal of the Academy of Nutrition and Dietetics · doi:10.1016/j.jand.2021.01.013 · Cited by 24
Exploring complexities in the reform of assessment practice: a critical realist perspective
Roberts, C., Khanna, P., Lane, S., Reimann, P., & Schuwirth, L. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-021-10065-8 · Cited by 24
Self-citation
Crossing the Virtual Chasm: Practical Considerations for Rethinking Curriculum, Competency, and Culture in the Virtual Care Era
Bolster, M. B., Chandra, S., Demaerschalk, B. M., Esper, C. D., Genkins, J. Z., Hayden, E. M., Tan‐McGrory, A., & Schwamm, L. H. (2022) · Academic Medicine · doi:10.1097/acm.0000000000004660 · Cited by 24
How is self-regulated learning documented in e-portfolios of trainees? A content analysis
van der Gulden, R., Heeneman, S., Kramer, A. W. M., Laan, R., Haan, N. D. S.-D., & Thoonen, B. P. A. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02114-4 · Cited by 24
The influence of students’ prior clinical skills and context characteristics on mini-CEX scores in clerkships – a multilevel analysis
Rogausch, A., Beyeler, C., Montagne, S., Jucker-Kupper, P., Berendonk, C., Huwendiek, S., Gemperli, A., & Himmel, W. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0490-3 · Cited by 23
A Mixed-Methods Analysis in Assessing Students’ Professional Development by Applying an Assessment for Learning Approach
Peeters, M. J., & Vaidya, V. (2016) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe80577 · Cited by 26
Development of e‐portfolio in undergraduate clinical dentistry: How trainees select and reflect on evidence
Greviana, N., Mustika, R., & Soemantri, D. (2020) · European Journal Of Dental Education · doi:10.1111/eje.12502 · Cited by 24
What difficulties do faculty members face when conducting workplace-based assessments in undergraduate clerkships?
Daelmans, H. E. M., der Vossen, M. M., Croiset, G., & Kusurkar, R. A. (2016) · International Journal of Medical Education · doi:10.5116/ijme.5689.3c7f · Cited by 23
Assessing Resident Performance on the Psychiatry Milestones
Swing, S. R., Cowley, D. S., & Bentman, A. L. (2014) · Academic Psychiatry · doi:10.1007/s40596-014-0114-y · Cited by 22
Actor-network theory and the OSCE: formulating a new research agenda for a post-psychometric era
Bearman, M., & Ajjawi, R. (2017) · Advances in Health Sciences Education · doi:10.1007/s10459-017-9797-7 · Cited by 22
Exploring students’ feedback seeking behavior in the context of programmatic assessment
Baartman, L. K. J., Baukema, H., & Prins, F. J. (2022) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2022.2100875 · Cited by 22
Self-citation
Programmatic assessment design choices in nine programs in higher education
Baartman, L. K. J., van Schilt-Mol, T., & van der Vleuten, C. P. M. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.931980 · Cited by 27
Self-citation
The reliability of a portfolio of workplace-based assessments in anesthesia training
Castanelli, D. J., van Loon, J., Jolly, B. C., & Weller, J. M. (2018) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-018-1251-7 · Cited by 22
Assessment of Professional Competence
Tigelaar, D. E. H., & van der Vleuten, C. P. M. (2014) · Springer international handbooks of education · doi:10.1007/978-94-017-8902-8_45 · Cited by 23
Self-citation
Evaluating clerkship competency without exams
Cianciolo, A. T., Hingle, S. T., Hudali, T. H., & Beason, A. M. (2019) · The Clinical Teacher · doi:10.1111/tct.13114 · Cited by 21
Formative Use of Assessment to Foster Self-Regulated Learning: the Alignment of Teachers’ Conceptions and Classroom Assessment Practices
van der Linden, J., van der Vleuten, C. P. M., Nieuwenhuis, L. F. M., & van Schilt-Mol, T. (2023) · Journal of Formative Design in Learning · doi:10.1007/s41686-023-00082-8 · Cited by 37
Exploring Validity Evidence Associated With Questionnaire-Based Tools for Assessing the Professional Performance of Physicians: A Systematic Review
van der Meulen, M. W., Smirnova, A., Heeneman, S., Egbrink, M. G. A. O., van der Vleuten, C. P. M., & Lombarts, K. M. J. M. H. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002767 · Cited by 21
Can We Agree on Expectations and Assessments of Graduating Residents?
Nousiainen, M., Incoll, I. W., Peabody, T. D., & Marsh, J. L. (2017) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.16.01048 · Cited by 22
Programmatic assessment: Can we provide evidence for saturation of information?
de Jong, L. H., Bok, H. G. J., Kremer, W. D. J., & van der Vleuten, C. P. M. (2019) · Medical Teacher · doi:10.1080/0142159x.2018.1555369 · Cited by 21
Learner handover: Perspectives and recommendations from the front-line
Gumuchian, S. T., Pal, N. E., Young, M. E., Danoff, D. S., Plotnick, L. H., Cummings, B., Gomez-Garibello, C. A., & Dory, V. (2020) · Perspectives on Medical Education · doi:10.1007/s40037-020-00601-4 · Cited by 21
How to Design a Useful Test
Schuwirth, L., & van der Vleuten, C. P. M. (2018) · Wiley eBooks · doi:10.1002/9781119373780.ch20 · Cited by 24
Self-citation
Are raters influenced by prior information about a learner? A review of assimilation and contrast effects in assessment
Humphrey-Murto, S. M., Shaw, T., Touchie, C., Pugh, D., Cowley, L., & Wood, T. J. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-021-10032-3 · Cited by 20
Developing a digital application for quality assurance of assessment programmes in higher education
Schellekens, L. H., van der Schaaf, M. F., van der Vleuten, C. P. M., Prins, F. J., Wools, S., & Bok, H. G. J. (2022) · Quality Assurance in Education · doi:10.1108/qae-03-2022-0066 · Cited by 20
Advancing anti-oppression and social justice in healthcare through competency-based medical education (CBME)
Busari, J. O., Diffey, L., Hauer, K. E., Lomis, K. D., Amiel, J. M., Barone, M., Schultz, K., Chen, H. C., Damodaran, A. K., Turner, D. A., et al. (2024) · Medical Teacher · doi:10.1080/0142159x.2023.2298763 · Cited by 24
A Call for an Integrated Program of Assessment
Fielding, D. W., & Regehr, G. (2017) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe81477 · Cited by 21
Designing Entrustable Professional Activities for Training Health Professional Educators: a Review of Current Practices
Iqbal, M. Z., Al-Eraky, M. M., & AlSheikh, M. H. (2018) · Medical Science Educator · doi:10.1007/s40670-018-0623-5 · Cited by 20
Alignment of CanMEDS-Based Undergraduate and Postgraduate Pharmacy Curricula in The Netherlands
Koster, A. S., Mantel-Teeuwisse, A. K., Woerdenbag, H. J., Mulder, W. M. C., Wilffert, B., Schalekamp, T., Buurma, H., Wilting, I., & Westein, M. P. D. (2020) · Pharmacy · doi:10.3390/pharmacy8030117 · Cited by 20
Measuring the Master Adaptive Learner: Development and Internal Structure Validity Evidence for a New Instrument
Stringer, J. K., Gruppen, L. D., Ryan, M. S., Ginzburg, S. B., Cutrer, W. B., Wolff, M., & Santen, S. A. (2022) · Medical Science Educator · doi:10.1007/s40670-021-01491-9 · Cited by 19
Direct Observation of Residents: A Model for an Assessment System
Donato, A. A. (2014) · The American Journal of Medicine · doi:10.1016/j.amjmed.2014.01.016 · Cited by 19
From Theory to Practice: Utilizing Competency-Based Milestones to Assess Professional Growth and Development in the Foundational Science Blocks of a Pre-clerkship Medical School Curriculum
Pettepher, C. C., Lomis, K. D., & Osheroff, N. (2016) · Medical Science Educator · doi:10.1007/s40670-016-0262-7 · Cited by 20
Standardization in the MSPE: Key Tensions for Learners, Schools, and Residency Programs
Hauer, K. E., Giang, D., Kapp, M., & Sterling, R. S. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003290 · Cited by 20
Wresting with Implementation: a Step-By-Step Guide to Implementing Entrustable Professional Activities (EPAs) in Psychiatry Residency Programs
Hung, E. K., Jibson, M. D., Sadhu, J. M., Stewart, C., Walker, A., Wichser, L. M. H., & Young, J. Q. (2020) · Academic Psychiatry · doi:10.1007/s40596-020-01341-7 · Cited by 18
A Program of Assessment Model for Point-of-Care Ultrasound Training for Pediatric Critical Care Providers: A Comprehensive Approach to Enhance Competency-Based Point-of-Care Ultrasound Training
Maxson, I., Su, E. R., Brown, K. A., Tcharmtchi, M. H., Ginsburg, S., Bhargava, V., Wenger, J. L., Centers, G. I., Alade, K. H., Leung, S. K., et al. (2023) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000003288 · Cited by 18
Implementing Competence Committees on a National Scale: Design and Lessons Learned
Oswald, A., Dubois, D. G., Snell, L. S., Anderson, R., Karpinski, J., Hall, A. K., Frank, J. R., & Cheung, W. J. (2024) · Perspectives on Medical Education · doi:10.5334/pme.961 · Cited by 19
Qualitative analysis of MMI raters’ scorings of medical school candidates: A matter of taste?
Christensen, M. K., Lykkegaard, E., Lund, O., & O’Neill, L. D. (2017) · Advances in Health Sciences Education · doi:10.1007/s10459-017-9794-x · Cited by 18
Excellence in medical training: developing talent—not sorting it
Dhaliwal, G., & Hauer, K. E. (2021) · Perspectives on Medical Education · doi:10.1007/s40037-021-00678-5 · Cited by 20
Identifying pedagogy and teaching strategies for achieving nationally prescribed learning outcomes
Delany, C. M., Kosta, L., Ewen, S. C., Nicholson, P., Remedios, L. J., & Harms, L. (2016) · Higher Education Research & Development · doi:10.1080/07294360.2016.1138450 · Cited by 19
Predicting performance of junior doctors: Association of workplace based assessment with demographic characteristics, emotional intelligence, selection scores, and undergraduate academic performance
Carr, S., Celenza, A., Mercer, A., Lake, F., & Puddey, I. B. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1426840 · Cited by 18
Entrustable professional activities (EPAs) for postgraduate competency based intensive care medicine training in the Netherlands: The next step towards excellence in intensive care medicine training
van Bockel, E. A. P., Walstock, P. A., van Mook, W., Arbous, M. S., Tepaske, R., van Hemel, T., Müller, M. C. A., Delwig, H., & Tulleken, J. E. (2019) · Journal of Critical Care · doi:10.1016/j.jcrc.2019.09.012 · Cited by 17
Implementing programmatic assessment transforms supervisor attitudes: An explanatory sequential mixed methods study
Jamieson, J., Hay, M., Gibson, S., & Palermo, C. E. (2021) · Medical Teacher · doi:10.1080/0142159x.2021.1893678 · Cited by 18
Striving to thrive or striving to survive: Professional identity constructions of medical trainees in clinical assessment activities
Liao, K., Ajjawi, R., Peng, C., Jenq, C., & Monrouxe, L. V. (2023) · Medical Education · doi:10.1111/medu.15152 · Cited by 21
Developing questionnaires to measure students’ expectations and perceptions of assessment quality
Leeuwenkamp, K. J. G.-V., Brinke, D. J.-T., & Kester, L. (2018) · Cogent Education · doi:10.1080/2331186x.2018.1464425 · Cited by 21
Core components of Communication Skills Training in oncology: A synthesis of the literature contrasted with consensual recommendations
Stiefel, F., de Vries, M., & Bourquin, C. (2018) · European Journal of Cancer Care · doi:10.1111/ecc.12859 · Cited by 17
Judging residents’ performance: a qualitative study using grounded theory
Duitsman, M. E., Fluit, C. R. M. G., van der Goot, W. E., ten Kate-Booij, M., Graaf, J. D., & Jaarsma, D. A. D. C. (2019) · BMC Medical Education · doi:10.1186/s12909-018-1446-1 · Cited by 17
Assessment of medical students’ integrated clinical communication skills: development of a tailor-made assessment tool
Brouwers, M., Custers, J. A. E., Bazelmans, E., van Weel, C., Laan, R., & van Weel-Baumgarten, E. M. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1557-3 · Cited by 17
Curriculum development in final year dentistry to enhance competency and professionalism for contemporary general dental practice
Friedlander, L. T., Meldrum, A., & Lyons, K. M. (2019) · European Journal Of Dental Education · doi:10.1111/eje.12458 · Cited by 17
Is the number of procedures completed a valid indicator of final year student competency in operative dentistry?
Dawson, L. J., Fox, K., Jellicoe, M., Adderton, E., Bissell, V., & Youngson, C. C. (2021) · BDJ · doi:10.1038/s41415-021-2967-2 · Cited by 17
Development and assessment of an online virtual orthodontic curriculum
Liu, L., Yuan, S., Zhang, W., Wang, Z., Zhao, C., Pan, Y., Yan, B., & Wang, L. (2021) · Journal of Dental Education · doi:10.1002/jdd.12825 · Cited by 17
Design and Implementation of a Competency-Based Transfusion Medicine Training Program in Canada
Zeller, M. P., Sherbino, J., Whitman, L., Skeate, R. C., & Arnold, D. M. (2015) · Transfusion Medicine Reviews · doi:10.1016/j.tmrv.2015.11.001 · Cited by 17
Workplace-Based Assessments Using Pediatric Critical Care Entrustable Professional Activities
Emke, A. R., Park, Y. S., Srinivasan, S., & Tekian, A. S. (2019) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-18-01006.1 · Cited by 19
Ethical Learning Experiences and Engagement in Academic Dishonesty: A Study of Asian and European Pharmacy and Medical Students in New Zealand
Henning, M. A., Malpas, P. J., Manalo, E., Ram, S., Vijayakumar, V., & Hawken, S. J. (2014) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-014-0172-7 · Cited by 17
Editorial: Competency frameworks in health professions education
Palermo, C. E., Aretz, H. T., & Holmboe, E. S. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.1034729 · Cited by 17
Psychometric validation of the reconstructed version of the assessment of reasoning tool
Thammasitboon, S., Sur, M., Rencic, J. J., Dhaliwal, G., Kumar, S., Sundaram, S., & Krishnamurthy, P. (2020) · Medical Teacher · doi:10.1080/0142159x.2020.1830960 · Cited by 16
Workplace-based assessments of entrustable professional activities in a psychiatry core clerkship: an observational study
Pinilla, S., Kyrou, A., Klöppel, S., Strik, W. K., Nissen, C., & Huwendiek, S. (2021) · BMC Medical Education · doi:10.1186/s12909-021-02637-4 · Cited by 18
Realizing One’s Own Subjectivity: Assessors’ Perceptions of the Influence of Training on Their Conduct of Workplace-Based Assessments
Hodwitz, K., Kuper, A., & Brydges, R. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002943 · Cited by 15
The quarter model: A proposed approach for in-training assessment of undergraduate students in Indian Medical Schools
Singh, T., Anshu, & Modi, J. N. (2012) · Indian Pediatrics · doi:10.1007/s13312-012-0215-1 · Cited by 16
Assessment of Competence in Pediatric Gastrointestinal Endoscopy
Walsh, C. M. (2014) · Current Gastroenterology Reports · doi:10.1007/s11894-014-0401-5 · Cited by 17
Can integrating Aboriginal health content in undergraduate nutrition curricula foster student cultural capabilities?
McCartan, J., Dart, J., Adams, K., Davidson, Z. E., & Brimblecombe, J. K. (2020) · Higher Education Research & Development · doi:10.1080/07294360.2020.1740182 · Cited by 16
An evaluation of programmatic assessment across health professions education using contribution analysis
Jamieson, J., Palermo, C. E., Hay, M., Bacon, R., Lutze, J., & Gibson, S. (2025) · Advances in Health Sciences Education · doi:10.1007/s10459-025-10444-5 · Cited by 18
Key dimensions of innovations in workplace-based assessment for postgraduate medical education: a scoping review
Weller, J. M., Coomber, T., Chen, Y., & Castanelli, D. J. (2021) · British Journal of Anaesthesia · doi:10.1016/j.bja.2021.06.038 · Cited by 15
Exploring the Impact of Entrustable Professional Activities on Feedback Culture: A Qualitative Study of Anesthesiology Residents and Attendings
Berger, S., Stalmeijer, R. E., Marty, A., & Berendonk, C. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005188 · Cited by 17
A narrative review of adaptive testing and its application to medical education
Burr, S. A., Gale, T. C. E., Kisielewska, J., Millin, P., Pêgo, J. M., Pinter, G., Robinson, I. M., & Zahra, D. (2023) · MedEdPublish · doi:10.12688/mep.19844.1 · Cited by 16
Implementation and Evaluation of Entrustable Professional Activities for a Pharmacy Intern Training Program in Australia
Abeyaratne, C., & Galbraith, K. J. (2024) · American Journal of Pharmaceutical Education · doi:10.1016/j.ajpe.2024.101308 · Cited by 15
Assessment in Dutch Vocational Education: Overview and Tensions of the Past 15 Years
Baartman, L. K. J., & Gulikers, J. T. M. (2017) · Professional and practice-based learning · doi:10.1007/978-3-319-50734-7_12 · Cited by 16
Self-citation
Predicting patterns of change and stability in student performance across a medical degree
Griffin, B., Bayl‐Smith, P., & Hu, W. C. Y. (2018) · Medical Education · doi:10.1111/medu.13508 · Cited by 15
The role of theory-based outcome frameworks in program evaluation: Considering the case of contribution analysis
Dauphinée, W. D. (2015) · Medical Teacher · doi:10.3109/0142159x.2015.1087484 · Cited by 16
The Construction of Surgical Trust
Salim, S. Y., Govaerts, M., & White, J. S. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000003125 · Cited by 15
Medical Education
Dornan, T., & Teunissen, P. W. (2014) · Springer international handbooks of education · doi:10.1007/978-94-017-8902-8_21 · Cited by 15
A conceptual model for program-level assessment
Charlton, N., & Newsham‐West, R. (2024) · Higher Education Research & Development · doi:10.1080/07294360.2024.2364094 · Cited by 16
Identifying what our students have learned: a framework for practical assessment validation
Fawns, T., Boud, D. J., & Dawson, P. (2026) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2026.2620053 · Cited by 27
“Dismantling Fixed Time, Variable Outcome Education: Abandoning ‘Ready or Not, Here they Come’ is Overdue”
Carraccio, C. L., Lentz, A., & Schumacher, D. J. (2023) · Perspectives on Medical Education · doi:10.5334/pme.10 · Cited by 16
The framework of Systematic Assessment for Resilience (SAR): development and validation
Wadi, M., Yusoff, M. S. B., Taha, M. H., Shorbagi, S., Lah, N. A. Z. N., & Rahim, A. F. A. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04177-5 · Cited by 17
Growing professional competence in nutrition and dietetics
Palermo, C. E. (2015) · Nutrition & Dietetics · doi:10.1111/1747-0080.12202 · Cited by 14
Assessment programs to enhance learning
Cecílio‐Fernandes, D., Cohen‐Schotanus, J., & Tio, R. A. (2017) · Physical Therapy Reviews · doi:10.1080/10833196.2017.1341143 · Cited by 14
Teacher and student perceptions of intermediate assessment in higher education
Day, I. N. Z., van Blankenstein, F. M., Westenberg, P. M., & Admiraal, W. (2017) · Educational Studies · doi:10.1080/03055698.2017.1382324 · Cited by 15
“Princess and the pea” – an assessment tool for palpation skills in postgraduate education
Kamp, R., Möltner, A., & Harendza, S. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1619-6 · Cited by 14
Exploring how educators at the workplace inform their judgement of students’ professional performance
de Vos, M., Baartman, L. K. J., van der Vleuten, C. P. M., & de Bruijn, E. (2019) · Journal of Education and Work · doi:10.1080/13639080.2019.1696953 · Cited by 16
Self-citation
Making it fair: Learners’ and assessors’ perspectives of the attributes of fair judgement
Valentine, N. A., Shanahan, E. M., Durning, S. J., & Schuwirth, L. (2021) · Medical Education · doi:10.1111/medu.14574 · Cited by 15
Self-citation
The threat of the dyscompetent resident: A plea to make the implicit more explicit!
van Mook, W., van Luijk, S. J., Zwietering, P. J., Southgate, L. J., Schuwirth, L., Scherpbier, A. J. J. A., & van der Vleuten, C. P. M. (2014) · Advances in Health Sciences Education · doi:10.1007/s10459-014-9526-4 · Cited by 14
Self-citation
Workplace-Based Assessment in a Primary-Care Setting
Hecker, K. G., Norris, J. M., & Coe, J. B. (2012) · Journal of Veterinary Medical Education · doi:10.3138/jvme.0612.054r · Cited by 14
Workplace learning in midwifery education in Flanders (Belgium)
Embo, M. P. C., & Valcke, M. (2015) · Midwifery · doi:10.1016/j.midw.2015.11.021 · Cited by 14
Assessing professional competence: a critical review of the Annual Review of Competence Progression
Woolf, K., Page, M., & Viney, R. (2019) · Journal of the Royal Society of Medicine · doi:10.1177/0141076819848113 · Cited by 14
Standing up for Subjectivity in the Assessment of Competencies
Rotthoff, T. (2018) · Europe PMC (PubMed Central) · doi:10.3205/zma001175 · Cited by 14
Design Your Clinical Workplace to Facilitate Competency-Based Education
Caretta‐Weyer, H. A., & Gisondi, M. A. (2019) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2019.4.43216 · Cited by 14
The Case for Authentic Student Assessment in Distance Digital Pharmacy Education
Qandil, A. M., Darweesh, R. S., & Al-Ghananeem, A. M. (2021) · MedEdPublish · doi:10.15694/mep.2021.000006.1 · Cited by 13
Inclusive assessment in health professions education: Balancing global goals and local contexts
Finn, G. M., Tai, J., & Nadarajah, V. D. (2024) · Medical Education · doi:10.1111/medu.15535 · Cited by 17
How do trained raters take context factors into account when assessing GP trainee communication performance? An exploratory, qualitative study
Essers, G. T. J. M., Dielissen, P. W., van Weel, C., van der Vleuten, C. P. M., van Dulmen, S., & Kramer, A. W. M. (2014) · Advances in Health Sciences Education · doi:10.1007/s10459-014-9511-y · Cited by 13
Reliability of team-based self-monitoring in critical events: a pilot study
Stocker, M., Menadue, L., Kakat, S., Costa, K. D., Combes, J., BANYA, W. A. S., Lane, M., Desai, A. R., & Burmester, M. (2013) · BMC Emergency Medicine · doi:10.1186/1471-227x-13-22 · Cited by 13
Early predictors of need for remediation in the Australian general practice training program: a retrospective cohort study
Magin, P. J., Stewart, R. A., Turnock, A. C., Tapley, A., Holliday, E. G., & Cooling, N. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-016-9722-5 · Cited by 13
Self-regulated learning lens on trainee perceptions of the mini-CEX: a qualitative study
Kipen, E., Flynn, E. M., & Woodward‐Kron, R. E. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026796 · Cited by 14
Impact of Structured Feedback on Examiner Judgements in Objective Structured Clinical Examinations (OSCEs) Using Generalisability Theory
Wong, W. Y. A., Roberts, C., & Thistlethwaite, J. E. (2020) · Health Professions Education · doi:10.1016/j.hpe.2020.02.005 · Cited by 13
Real-world impact of the COVID-19 pandemic on the assessment of anaesthesiology residents
Kealey, A., Alam, F., McCreath, G. A., Matava, C. T., Bahrey, L. A., & Walsh, C. M. (2020) · British Journal of Anaesthesia · doi:10.1016/j.bja.2020.08.016 · Cited by 13
An overview of and approach to selecting appropriate patient representations in teaching and summative assessment in medical education
Bauer, D., Lahner, F.-M., Huwendiek, S., Schmitz, F., & Guttormsen, S. (2020) · Swiss Medical Weekly · doi:10.4414/smw.2020.20382 · Cited by 17
Clinical empathy in GP-training: Experiences and needs among Dutch GP-trainees. “Empathy as an element of personal growth”
Derksen, F., Hartman, T. O., Lagro‐Janssen, A. L. M., & Kramer, A. W. M. (2021) · Patient Education and Counseling · doi:10.1016/j.pec.2021.03.030 · Cited by 13
Advancing Workplace-Based Assessment in Psychiatric Education
Young, J. Q., Frank, J. R., & Holmboe, E. S. (2021) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2021.03.005 · Cited by 12
Evaluating validity evidence for 2 instruments developed to assess students' surgical skills in a simulated environment
Farrell, R. M., Gilbert, G. E., Betance, L., Huck, J., Hunt, J., Dundas, J. M., & Pope, E. R. (2022) · Veterinary Surgery · doi:10.1111/vsu.13791 · Cited by 16
Validity and Feasibility of the Minicard Direct Observation Tool in 1 Training Program
Donato, A. A., Park, Y. S., George, D. L., Schwartz, A., & Yudkowsky, R. (2015) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-14-00532.1 · Cited by 13

Authors: van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J.
Affiliations: Flinders University (AU)
Maastricht University (NL)
Leiden University (NL)
University of Applied Sciences Utrecht (NL)
ORCID: Schuwirth, L. W. T.
Driessen, E. W.
Tigelaar, D.
Baartman, L. K. J.
Venue: Medical Teacher
Publisher: Informa UK Limited
Published: 2012-02-25
Volume: 34
Issue: 3
Pages: 205-214
ISSN: 0142-159X (ISSN-L)
1466-187X
DOI: 10.3109/0142159x.2012.652239
OpenAlex: W2163467994
Cited by: 892
References: 69
Citations by year: 2026: 140 · 2025: 62 · 2024: 70 · 2023: 74 · 2022: 72 · 2021: 71 · 2020: 59 · 2019: 66 · 2018: 69 · 2017: 56 · 2016: 50 · 2015: 32 · 2014: 40 · 2013: 21 · 2012: 9
FWCI: 31.53
Type: journal article
Language: en
Open access: closed
Locations: Medical Teacher (publishedVersion)
PubMed (publishedVersion)
Research Publications (Maastricht University) (publishedVersion)
Radboud Repository (Radboud University) (submittedVersion)
Research Publications (Maastricht University) (submittedVersion)
Topics: Social Sciences › Education › Innovations in Medical Education
Social Sciences › Education › Student Assessment and Feedback
Social Sciences › Public Administration › Evaluation and Performance Assessment
Keywords: programmatic assessment, assessment for learning, student progress, evaluation principles, expert opinion, bias mitigation, sampling, feedback, medical education
MeSH terms: Decision Making, Educational Measurement, Humans, Program Evaluation, Models, Educational

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A model for programmatic assessment fit for purpose.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks