Cited by 892Innovations in Medical EducationStudent Assessment and FeedbackEvaluation and Performance Assessment

The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.

A model for programmatic assessment fit for purpose.

van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., van Tartwijk, J.·2012·Medical Teacher

DOI 10.3109/0142159x.2012.652239

Open this paper in CoChat — free account

Abstract

We propose a model for programmatic assessment in action, which simultaneously optimises assessment for learning and assessment for decision making about learner progress. This model is based on a set of assessment principles that are interpreted from empirical research. It specifies cycles of training, assessment and learner support activities that are complemented by intermediate and final moments of evaluation on aggregated assessment data points. A key principle is that individual data points are maximised for learning and feedback value, whereas high-stake decisions are based on the aggregation of many data points. Expert judgement plays an important role in the programme. Fundamental is the notion of sampling and bias reduction to deal with the inevitable subjectivity of this type of judgement. Bias reduction is further sought in procedural assessment strategies derived from criteria for qualitative research. We discuss a number of challenges and opportunities around the proposed model. One of its prime virtues is that it enables assessment to move, beyond the dominant psychometric discourse with its focus on individual instruments, towards a systems approach to assessment design underpinned by empirically grounded theory.

Integrity signals

Registry

Crossref · 10.3109/0142159x.2012.652239

Cites

69 of 69 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Power of Feedback
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory.
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883
Focus on Formative Feedback
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Naturalistic Decision Making
Klein, G. A. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288385 · Cited by 2,434
Defining Quality
Harvey, L., & Green, D. (1993) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293930180102 · Cited by 1,281
Assessing professional competence: from methods to programmes
Van Der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02094.x · Cited by 1,268
Self-citation
Linking Theory and Practice: Changing the Pedagogy of Teacher Education
Korthagen, F. A. J., & Kessels, J. P. A. M. (1999) · Educational Researcher · doi:10.3102/0013189x028004004 · Cited by 1,266
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170

Flagged first, then by citations

Show all 69 references

Research works printed but not linked: 6

Cavalcanti RB, 2011, JAMA, 306, 993
Cilliers FJ, 2011, Adv Health Sci Educ Theory Pract
Dijkstra J, Galbraith R, Hodges B, McAvoy P, McCrorie P, Southgate L, Van der Vleuten C, Wass V, Schuwirth L. under editorial review. Fit-for-purpose guidelines for designing programmes of assessment
Harden RM, 1984, Med Teach, 18, 284
Van Merriënboer JJG, 1997, Training complex cognitive skills
Verhoeven BH, 1999, Educ Health, 12, 49

Sorted by citations

Items 101–200 of 892

Perceptions of purpose, value, and process of the mini-Clinical Evaluation Exercise in anesthesia training
Castanelli, D. J., Jowsey, T., Chen, Y., & Weller, J. M. (2016) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-016-0740-9 · Cited by 50
A Qualitative Exploration of the Help-Seeking Behaviors of Students Who Experience Psychological Distress Around Assessment at Medical School
Winter, R., Patel, R. M., & Norman, R. I. (2017) · Academic Psychiatry · doi:10.1007/s40596-017-0701-9 · Cited by 50
The use of a portfolio in postgraduate medical education – reflect, assess and account, one for each or all in one?
Heeneman, S., & Driessen, E. W. (2017) · Europe PMC (PubMed Central) · doi:10.3205/zma001134 · Cited by 50
Self-citation
Contextualised reflective competence: a new learning model promoting reflective practice for clinical training
Lane, S., & Roberts, C. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03112-4 · Cited by 49
Perceived clinical relevance and retention of basic sciences across the medical education continuum
Malau‐Aduli, B. S., Alele, F. O., Heggarty, P., Teague, P.-A., Gupta, T. S., & Hays, R. (2019) · AJP Advances in Physiology Education · doi:10.1152/advan.00012.2019 · Cited by 49
Kompetenzorientiert prüfen im Staatsexamen Medizin
Jünger, J. (2018) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-017-2668-9 · Cited by 47
McMaster Modular Assessment Program (McMAP) Through the Years: Residents' Experience With an Evolving Feedback Culture Over a 3‐year Period
Li, S., Sherbino, J., & Chan, T. M. (2016) · AEM Education and Training · doi:10.1002/aet2.10009 · Cited by 42
Assessment Pearls for Competency-Based Medical Education
Humphrey-Murto, S. M., Wood, T. J., Ross, S., Tavares, W., Kvern, B. L., Sidhu, R. S., Sargeant, J. M., & Touchie, C. (2017) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-17-00365.1 · Cited by 47
Assessment in a global context: An international perspective on dental education
Patel, U. S., Tonni, I., Gadbury‐Amyot, C. C., van der Vleuten, C. P. M., & Escudier, M. P. (2018) · European Journal Of Dental Education · doi:10.1111/eje.12343 · Cited by 49
Key considerations in planning and designing programmatic assessment in competency-based medical education
Ross, S., Hauer, K. E., Wycliffe-Jones, K., Hall, A. K., Molgaard, L. K., Richardson, D. L., Oswald, A., Bhanji, F., & Collaborators, O. B. O. T. I. (2021) · Medical Teacher · doi:10.1080/0142159x.2021.1925099 · Cited by 49
In‐training assessment developments in postgraduate education in E urope
van der Vleuten, C. P. M., & Verhoeven, B. H. (2013) · ANZ Journal of Surgery · doi:10.1111/ans.12190 · Cited by 49
Development of a Postgraduate Community Pharmacist Specialization Program Using CanMEDS Competencies, and Entrustable Professional Activities
Westein, M. P. D., de Vries, H., Floor‐Schreudering, A., Koster, A. S., & Buurma, H. (2018) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe6863 · Cited by 46
Keeping mum in clinical supervision: private thoughts and public judgements
Scarff, C. E., Bearman, M., Chiavaroli, N. G., & Trumble, S. (2018) · Medical Education · doi:10.1111/medu.13728 · Cited by 45
The Urgency of Now: Rethinking and Improving Assessment Practices in Medical Education Programs
Holmboe, E. S., Osman, N. Y., Murphy, C. M., & Kogan, J. R. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005251 · Cited by 45
Validity as a social imperative for assessment in health professions education: a concept analysis
Marceau, M., Gallagher, F., Young, M. E., & St‐Onge, C. (2018) · Medical Education · doi:10.1111/medu.13574 · Cited by 54
Next Steps in the Implementation of Learning Analytics in Medical Education: Consensus From an International Cohort of Medical Educators
Thoma, B., Warm, E. J., Hamstra, S. J., Cavalcanti, R. B., Pusic, M. V., Shaw, T. J., Verma, A., Frank, J. R., & Hauer, K. E. (2020) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-19-00493.1 · Cited by 44
Revisiting ‘Assessing professional competence: from methods to programmes’
van der Vleuten, C. P. M. (2016) · Medical Education · doi:10.1111/medu.12632 · Cited by 42
We Have No Choice but to Transform: The Future of Medical Education After the COVID-19 Pandemic
Lucey, C. R., Davis, J. A., & Green, M. M. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004526 · Cited by 43
Patterns of direct observation and their impact during residency: general practice supervisors’ views
Rietmeijer, C. B. T., Huisman, D., Blankenstein, A. H., de Vries, H., Scheele, F., Kramer, A. W. M., & Teunissen, P. W. (2018) · Medical Education · doi:10.1111/medu.13631 · Cited by 41
Scaffolding reflective learning in clinical practice: A comparison of two types of reflective activities
Embo, M. P. C., Driessen, E. W., Valcke, M., & van der Vleuten, C. P. M. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.899686 · Cited by 43
Self-citation
Implementation of Programmatic Assessment: Challenges and Lessons Learned
Govaerts, M., van der Vleuten, C. P. M., & Schut, S. (2022) · Education Sciences · doi:10.3390/educsci12100717 · Cited by 41
The reliability and validity of a portfolio designed as a programmatic assessment of performance in an integrated clinical placement
Roberts, C., Shadbolt, N. E., Clark, T., & Simpson, P. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-197 · Cited by 48
Content validity of game-based assessment: case study of a serious game for ICT managers in training
Hummel, H. G. K., Brinke, D. J.-T., Nadolski, R. J., & Baartman, L. K. J. (2016) · Technology Pedagogy and Education · doi:10.1080/1475939x.2016.1192060 · Cited by 41
Self-citation
Development and initial validation of a dual-purpose questionnaire capturing mentors’ and mentees’ perceptions and expectations of the mentoring process
Heeneman, S., & de Grave, W. S. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1574-2 · Cited by 40
Understanding the influence of teacher–learner relationships on learners’ assessment perception
Schut, S., van Tartwijk, J., Driessen, E. W., van der Vleuten, C. P. M., & Heeneman, S. (2019) · Advances in Health Sciences Education · doi:10.1007/s10459-019-09935-z · Cited by 40
Self-citation
The critical role of infrastructure and organizational culture in implementing competency-based education and individualized pathways in undergraduate medical education
Lomis, K. D., Mejicano, G. C., Caverzagie, K. J., Monrad, S. U., Pusic, M. V., & Hauer, K. E. (2021) · Medical Teacher · doi:10.1080/0142159x.2021.1924364 · Cited by 50
The uneasy alliance of assessment and feedback
Watling, C. (2016) · Perspectives on Medical Education · doi:10.1007/s40037-016-0300-6 · Cited by 43
Clinical reasoning performance assessment: using situated cognition theory as a conceptual framework
Rencic, J. J., Schuwirth, L., Gruppen, L. D., & Durning, S. J. (2020) · Diagnosis · doi:10.1515/dx-2019-0051 · Cited by 39
Self-citation
Multiple mini‐interview test characteristics: ‘tis better to ask candidates to recall than to imagine
Eva, K. W., & Macala, C. (2014) · Medical Education · doi:10.1111/medu.12402 · Cited by 39
Nuance and Noise: Lessons Learned From Longitudinal Aggregated Assessment Data
Chan, T. M., Sherbino, J., & Mercuri, M. (2017) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-17-00086.1 · Cited by 36
The Development of Entrustable Professional Activities for Competency-Based Veterinary Education in Farm Animal Health
Duijn, C. C. M. A., ten Cate, O., Kremer, W. D. J., & Bok, H. G. J. (2018) · Journal of Veterinary Medical Education · doi:10.3138/jvme.0617-073r · Cited by 37
The Importance of Competency-Based Programmatic Assessment in Graduate Medical Education
Misra, S., Iobst, W. F., Hauer, K. E., & Holmboe, E. S. (2021) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-20-00856.1 · Cited by 37
Assessment and Feedback in Higher Education: A Review of Literature for the Higher Education Academy
Jackel, B., Pearce, J., Radloff, A., & Edwards, D. (2017) · ACEReSearch Repository (Australian Council for Educational Research) · Cited by 37
Tensions in mentoring medical students toward self-directed and reflective learning in a longitudinal portfolio-based mentoring system – An activity theory analysis
Heeneman, S., & de Grave, W. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1286308 · Cited by 36
Programmatic Assessment of Competence in Dietetics: A New Frontier
Palermo, C. E., Gibson, S., Dart, J., Whelan, K., & Hay, M. (2016) · Journal of the Academy of Nutrition and Dietetics · doi:10.1016/j.jand.2016.03.022 · Cited by 36
Shadow systems in assessment: how supervisors make progress decisions in practice
Castanelli, D. J., Weller, J. M., Molloy, E., & Bearman, M. (2019) · Advances in Health Sciences Education · doi:10.1007/s10459-019-09913-5 · Cited by 36
How biased are you? The effect of prior performance information on attending physician ratings and implications for learner handover
Shaw, T., Wood, T. J., Touchie, C., Pugh, D., & Humphrey-Murto, S. M. (2020) · Advances in Health Sciences Education · doi:10.1007/s10459-020-09979-6 · Cited by 37
Programmatic Assessment: The Secret Sauce of Effective CBME Implementation
Iobst, W. F., & Holmboe, E. S. (2020) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-20-00702.1 · Cited by 36
The Accelerating Change in Medical Education Consortium: Key Drivers of Transformative Change
Lomis, K. D., Santen, S. A., Dekhtyar, M., Elliott, V. S., Richardson, J., Hammoud, M. M., Hawkins, R., & Skochelak, S. E. (2021) · Academic Medicine · doi:10.1097/acm.0000000000003897 · Cited by 35
A Methodological Review of the Assessment of Humanism in Medical Students
Buck, E., Holden, M. D., & Szauter, K. M. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000910 · Cited by 37
Use of e-learning in clinical clerkships: effects on acquisition of dermatological knowledge and learning processes
Fransen, F., Martens, H., Nagtzaam, I. F., & Heeneman, S. (2018) · International Journal of Medical Education · doi:10.5116/ijme.5a47.8ab0 · Cited by 35
Competency-Based Medical Education implementation: Are we transforming the culture of assessment?
Griffiths, J., Dalgarno, N., Schultz, K., Han, H., & Melle, E. V. (2019) · Medical Teacher · doi:10.1080/0142159x.2019.1584276 · Cited by 35
The Influence of Prior Performance Information on Ratings of Current Performance and Implications for Learner Handover: A Scoping Review
Humphrey-Murto, S. M., LeBlanc, A., Touchie, C., Pugh, D., Wood, T., Cowley, L., & Shaw, T. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002731 · Cited by 35
Embedding the International Classification of Functioning, Disability and Health in Health Professions Curricula to Enable Interprofessional Education and Collaborative Practice
Moran, M., Bickford, J., Barradell, S., & Scholten, I. (2020) · Journal of Medical Education and Curricular Development · doi:10.1177/2382120520933855 · Cited by 35
Development and Pilot Testing of Entrustable Professional Activities for US Anesthesiology Residency Training
Woodworth, G. E., Marty, A., Tanaka, P. P., Ambardekar, A. P., Chen, F., Duncan, M. J., Fromer, I. R., Hallman, M. R., Klesius, L. L., Ladlie, B. L., et al. (2021) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000005434 · Cited by 35
Feasibility and Outcomes of Implementing a Portfolio Assessment System Alongside a Traditional Grading System
O’Brien, C. L., Sanguino, S. M., Thomas, J. X., & Green, M. M. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001168 · Cited by 36
Reconceptualising Health Professions Education in South Africa
Academy of Science of South Africa (2018) · doi:10.17159/assaf.2018/0021 · Cited by 37
Designing feedback processes in the workplace-based learning of undergraduate health professions education: a scoping review
Fuentes‐Cimma, J., Sluijsmans, D. M. A., Riquelme, A. J., Villagrán, I., Isbej, L., Olivares-Labbe, M. T., & Heeneman, S. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05439-6 · Cited by 53
Programmatic assessment for learning: A programmatically designed assessment for the purpose of learning: AMEE Guide No. 174
Torre, D. M., & Schuwirth, L. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2409936 · Cited by 36
Self-citation
Status of portfolios in undergraduate medical education in the LCME accredited US medical school
Chertoff, J., Wright, A., Novak, M. A., Fantone, J. C., Fleming, A., Ahmed, T., Green, M. M., Kalet, A. L., Linsenmeyer, M., Jacobs, J. L., et al. (2015) · Medical Teacher · doi:10.3109/0142159x.2015.1114595 · Cited by 35
Students’ motivation toward feedback-seeking in the clinical workplace
de Jong, L. H., Favier, R. P., van der Vleuten, C. P. M., & Bok, H. G. J. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1324948 · Cited by 39
Clinical Skills Assessment in the Twenty-First Century
ELDER, A. T. (2018) · Medical Clinics of North America · doi:10.1016/j.mcna.2017.12.014 · Cited by 36
Assessment for distinctiveness: recognising diversity of accomplishments
Jorre, T. J. D. S., Boud, D. J., & Johnson, E. D. (2019) · Studies in Higher Education · doi:10.1080/03075079.2019.1689385 · Cited by 34
Effect of face-to-face verbal feedback compared with no or alternative feedback on the objective workplace task performance of health professionals: a systematic review and meta-analysis
Johnson, C., Weerasuria, M. P., & Keating, J. L. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-030672 · Cited by 34
Driving lesson or driving test?: A metaphor to help faculty separate feedback from assessment
Brand, P. L. P., Jaarsma, D. A. D. C., & van der Vleuten, C. P. M. (2020) · Perspectives on Medical Education · doi:10.1007/s40037-020-00617-w · Cited by 36
Student perspectives on programmatic assessment in a large medical programme: A critical realist analysis
Roberts, C., Khanna, P., Bleasel, J. F., Lane, S., Burgess, A. W., Charles, K. A., Howard, R., O'Mara, D. A., Haq, I., & Rutzou, T. (2022) · Medical Education · doi:10.1111/medu.14807 · Cited by 33
Estruturação de Sistemas para Avaliação Programática do Estudante de Medicina
Troncon, L. E. D. A. (2016) · Revista Brasileira de Educação Médica · doi:10.1590/1981-52712015v40n1e01392015 · Cited by 40
Association of a Competency-Based Assessment System With Identification of and Support for Medical Residents in Difficulty
Ross, S., Binczyk, N. M., Hamza, D. M., Schipper, S., Humphries, P., Nichols, D. N., & Donoff, M. G. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.4581 · Cited by 33
National Internal Medicine Milestone Ratings: Validity Evidence From Longitudinal Three-Year Follow-up
Hauer, K. E., Vandergrift, J. L., Lipner, R. S., Holmboe, E. S., Hood, S., & McDonald, F. S. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002234 · Cited by 33
Designing programmes of assessment: A participatory approach
Jamieson, J., Jenkins, G., BEATTY, S. E., & Palermo, C. E. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1355447 · Cited by 32
Translating Theory Into Practice: Implementing a Program of Assessment
Hauer, K. E., O’Sullivan, P., Fitzhenry, K., & Boscardin, C. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001995 · Cited by 32
On Lampposts, Sneetches, and Stars: A Call to Go Beyond Bibliometrics for Determining Academic Value
Chan, T. M., & Kuehl, D. (2019) · Academic Emergency Medicine · doi:10.1111/acem.13707 · Cited by 32
Educators’ behaviours during feedback in authentic clinical practice settings: an observational study and systematic analysis
Johnson, C., Keating, J. L., Farlie, M. K., Kent, F., Leech, M. T., & Molloy, E. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1524-z · Cited by 32
Harnessing insights from an activity system – OSCEs past and present expanding future assessments
Reid, H., Gormley, G., Dornan, T., & Johnston, J. L. (2020) · Medical Teacher · doi:10.1080/0142159x.2020.1795100 · Cited by 32
How do students offer value to organisations through work integrated learning? A qualitative study using Social Exchange Theory
Kemp, C., van Herwerden, L. A., Molloy, E., Kleve, S., Brimblecombe, J. K., Reidlinger, D. P., & Palermo, C. E. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-021-10038-x · Cited by 42
Programmatic Assessment in Emergency Medicine: Implementation of Best Practices
Perry, M. A., Linn, A. M. J., Munzer, B., Hopson, L. R., Amlong, A., Cole, M., & Santen, S. A. (2017) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-17-00094.1 · Cited by 31
Medical education and training within congenital cardiology: current global status and future directions in a post COVID-19 world
McMahon, C. J., Tretter, J. T., Redington, A. N., Bu'Lock, F. A., Zuhlke, L. J., Heying, R., Mattos, S. D. S., Kumar, R., Jacobs, J. P., & Windram, J. D. (2021) · Cardiology in the Young · doi:10.1017/s1047951121001645 · Cited by 32
Is the learning value of workplace-based assessment being realised? A qualitative study of trainer and trainee perceptions and experiences
Barrett, A., Galvin, R., Scherpbier, A. J. J. A., Teunissen, P. W., O’Shaughnessy, A., & Horgan, M. M. (2016) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2015-133917 · Cited by 31
Design and Implementation of a National Program of Assessment Model – Integrating Entrustable Professional Activity Assessments in Canadian Specialist Postgraduate Medical Education
Cheung, W. J., Bhanji, F., Gofton, W. T., Hall, A. K., Karpinski, J., Richardson, D. L., Frank, J. R., & Dudek, N. L. (2024) · Perspectives on Medical Education · doi:10.5334/pme.956 · Cited by 29
“No One Has Yet Properly Articulated What We Are Trying to Achieve”
Archer, J. C., de Bere, S. R., Nunn, S., Clark, J., & Corrigan, O. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000464 · Cited by 30
Nationwide introduction of a new competency framework for undergraduate medical curricula: a collaborative approach
Sohrmann, M., Berendonk, C., NENDAZ, M. R., Bonvin, R., & Swiss Working Group For Profiles Implementation (2020) · Swiss Medical Weekly · doi:10.57187/smw.2020.20201 · Cited by 30
Rethinking Assessment Concepts in Dental Education
El‐Kishawi, M., Khalaf, K., Al-Najjar, D., Seraj, Z., & Kawas, S. A. (2020) · International Journal of Dentistry · doi:10.1155/2020/8672303 · Cited by 32
A philosophical history of programmatic assessment: tracing shifting configurations
Pearce, J., & Tavares, W. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-021-10050-1 · Cited by 32
Medical education research: a vibrant community of research and education practice
van der Vleuten, C. P. M. (2014) · Medical Education · doi:10.1111/medu.12508 · Cited by 29
The challenge of changing to an assessment for learning culture
Harrison, C., & Wass, V. (2016) · Medical Education · doi:10.1111/medu.13058 · Cited by 30
Competency-based veterinary education: an integrative approach to learning and assessment in the clinical workplace
Bok, H. G. J. (2015) · Perspectives on Medical Education · doi:10.1007/s40037-015-0172-1 · Cited by 29
Entrustment Unpacked: Aligning Purposes, Stakes, and Processes to Enhance Learner Assessment
Kinnear, B., Warm, E. J., Caretta‐Weyer, H. A., Holmboe, E. S., Turner, D. A., van der Vleuten, C. P. M., & Schumacher, D. J. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004108 · Cited by 29
Changing Medical School IT to Support Medical Education Transformation
Spickard, A., Ahmed, T., Lomis, K. D., Johnson, K. B., & Miller, B. M. (2016) · Teaching and Learning in Medicine · doi:10.1080/10401334.2015.1107488 · Cited by 29
A practical approach to programmatic assessment design
Timmerman, A. A., & Dijkstra, J. (2017) · Advances in Health Sciences Education · doi:10.1007/s10459-017-9756-3 · Cited by 28
Self-citation
Identifying low test-taking effort during low-stakes tests with the new Test-taking Effort Short Scale (TESS) – development and psychometrics
Schüttpelz-Brauns, K., Kadmon, M., Kiessling, C., Karay, Y., Gestmann, M., & Kämmer, J. E. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1196-0 · Cited by 20
The Clinical Learning Environment and Workplace-Based Assessment
Henry, D., & West, D. C. (2019) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2019.03.010 · Cited by 30
Can the results of the OSCE predict the results of clinical assessment in dental education?
Näpänkangas, R., Karaharju‐Suvanto, T., Pyörälä, E., Harila, V., Ollila, P., Lähdesmäki, R. E., & Lahti, S. M. (2014) · European Journal Of Dental Education · doi:10.1111/eje.12126 · Cited by 28
A validation study of the psychometric properties of the Groningen Reflection Ability Scale
Andersen, N. B., O’Neill, L. D., Gormsen, L. K., Hvidberg, L., & Mørcke, A. M. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-214 · Cited by 27
Evidence within a portfolio-based assessment program: What do medical students select to document their performance?
Dannefer, E. F., Bierer, S. B., & Gladding, S. P. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652241 · Cited by 27
Evaluation of the Characteristics of a Workplace Assessment Form to Assess Entrustable Professional Activities (EPAs) in an Undergraduate Surgery Core Clerkship
Curran, V. R., Deacon, D. R., Schulz, H., Stringer, K., Stone, C., Duggan, N., & Coombs-Thorne, H. (2018) · Journal of surgical education · doi:10.1016/j.jsurg.2018.02.013 · Cited by 27
How workplace‐based assessments guide learning in postgraduate education: A scoping review
Martin, L. J., Blissett, S., Johnston, B. K., Tsang, M., Gauthier, S. R., Ahmed, Z., & Sibbald, M. (2022) · Medical Education · doi:10.1111/medu.14960 · Cited by 29
Assessment and feedback in higher education reimagined: using programmatic assessment to transform higher education
Baartman, L. K. J., & Quinlan, K. M. (2023) · Perspectives Policy and Practice in Higher Education · doi:10.1080/13603108.2023.2283118 · Cited by 43
Self-citation
Design of a clinical competency committee to maximize formative feedback
Donato, A. A., Alweis, R. L., & Wenderoth, S. (2016) · Journal of Community Hospital Internal Medicine Perspectives · doi:10.3402/jchimp.v6.33533 · Cited by 26
Considerations that will determine if competency-based assessment is a sustainable innovation
Dauphinée, W. D., Boulet, J. R., & Norcini, J. J. (2018) · Advances in Health Sciences Education · doi:10.1007/s10459-018-9833-2 · Cited by 27
Framework for curriculum delivery during COVID-19 pandemic in a health sciences university
Kadri, H. M. F. A., Moamary, M. A., & Knawy, B. A. (2020) · Annals of Thoracic Medicine · doi:10.4103/atm.atm_493_20 · Cited by 27
A mobile application to facilitate implementation of programmatic assessment in anaesthesia training
Marty, A., Braun, J., Schick, C., Zalunardo, M. P., Spahn, D. R., & Breckwoldt, J. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2022.02.038 · Cited by 27
Competency-based simulation assessment of resuscitation skills in emergency medicine postgraduate trainees – a Canadian multi-centred study
Dagnone, D., Hall, A. K., Sebok‐Syer, S. S., Klinger, D. A., Woolfrey, K. G. H., Davison, C., Ross, J., McNeil, G., & Moore, S. W. (2016) · Canadian Medical Education Journal · doi:10.36834/cmej.36682 · Cited by 25
On the issue of costs in programmatic assessment
van der Vleuten, C. P. M., & Heeneman, S. (2016) · Perspectives on Medical Education · doi:10.1007/s40037-016-0295-z · Cited by 25
Variability and dimensionality of students’ and supervisors’ mini-CEX scores in undergraduate medical clerkships – a multilevel factor analysis
Berendonk, C., Rogausch, A., Gemperli, A., & Himmel, W. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1207-1 · Cited by 30
Biochemical visual literacy with constructive alignment: Outcomes, assessment, and activities
Herráez, Á., & Costa, M. J. (2013) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20678 · Cited by 25
Identifying the Impact of Feedback Over Time and at Scale: Opportunities for Learning Analytics
Ryan, T., Gašević, D., & Henderson, M. (2019) · Springer eBooks · doi:10.1007/978-3-030-25112-3_12 · Cited by 25
Identifying Core Components of EPA Implementation: A Path to Knowing if a Complex Intervention Is Being Implemented as Intended
Carraccio, C. L., Martini, A., Melle, E. V., & Schumacher, D. J. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004075 · Cited by 25
Curricular fit perspective on motivation in higher education
Kickert, R., Meeuwisse, M., Stegers‐Jager, K. M., Prinzie, P., & Arends, L. R. (2021) · Higher Education · doi:10.1007/s10734-021-00699-3 · Cited by 35
The Science of Effective Group Process: Lessons for Clinical Competency Committees
Hauer, K. E., Edgar, L., Hogan, S. O., Kinnear, B., & Warm, E. J. (2021) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-20-00827.1 · Cited by 26
How argumentation theory can inform assessment validity: A critical review
Kinnear, B., Schumacher, D. J., Driessen, E. W., & Varpio, L. (2022) · Medical Education · doi:10.1111/medu.14882 · Cited by 25
Self-citation

Authors: van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J.
Affiliations: Flinders University (AU)
Maastricht University (NL)
Leiden University (NL)
University of Applied Sciences Utrecht (NL)
ORCID: Schuwirth, L. W. T.
Driessen, E. W.
Tigelaar, D.
Baartman, L. K. J.
Venue: Medical Teacher
Publisher: Informa UK Limited
Published: 2012-02-25
Volume: 34
Issue: 3
Pages: 205-214
ISSN: 0142-159X (ISSN-L)
1466-187X
DOI: 10.3109/0142159x.2012.652239
OpenAlex: W2163467994
Cited by: 892
References: 69
Citations by year: 2026: 140 · 2025: 62 · 2024: 70 · 2023: 74 · 2022: 72 · 2021: 71 · 2020: 59 · 2019: 66 · 2018: 69 · 2017: 56 · 2016: 50 · 2015: 32 · 2014: 40 · 2013: 21 · 2012: 9
FWCI: 31.53
Type: journal article
Language: en
Open access: closed
Locations: Medical Teacher (publishedVersion)
PubMed (publishedVersion)
Research Publications (Maastricht University) (publishedVersion)
Radboud Repository (Radboud University) (submittedVersion)
Research Publications (Maastricht University) (submittedVersion)
Topics: Social Sciences › Education › Innovations in Medical Education
Social Sciences › Education › Student Assessment and Feedback
Social Sciences › Public Administration › Evaluation and Performance Assessment
Keywords: programmatic assessment, assessment for learning, student progress, evaluation principles, expert opinion, bias mitigation, sampling, feedback, medical education
MeSH terms: Decision Making, Educational Measurement, Humans, Program Evaluation, Models, Educational

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A model for programmatic assessment fit for purpose.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks