The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
A model for programmatic assessment fit for purpose.
Abstract
We propose a model for programmatic assessment in action, which simultaneously optimises assessment for learning and assessment for decision making about learner progress. This model is based on a set of assessment principles that are interpreted from empirical research. It specifies cycles of training, assessment and learner support activities that are complemented by intermediate and final moments of evaluation on aggregated assessment data points. A key principle is that individual data points are maximised for learning and feedback value, whereas high-stake decisions are based on the aggregation of many data points. Expert judgement plays an important role in the programme. Fundamental is the notion of sampling and bias reduction to deal with the inevitable subjectivity of this type of judgement. Bias reduction is further sought in procedural assessment strategies derived from criteria for qualitative research. We discuss a number of challenges and opportunities around the proposed model. One of its prime virtues is that it enables assessment to move, beyond the dominant psychometric discourse with its focus on individual instruments, towards a systems approach to assessment design underpinned by empirically grounded theory.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Finally, they promote the longitudinal compilation of performance data to coach the learner's continuing development (assessment for learning) and to make evidence-based decisions about the learner's progress (assessment of learning).[11][12][13][14][15]”
From The R2C2 Model in Residency Education: How Does It Foster Coaching and Promote Feedback Use? (2018) · cites this paper as [12]
In the citing paper
“Programmatic assessment (a system of frequent formative assessments also used for end-of-year summative judgements) is designed to optimize learning and reduce exam stress [86].”
From Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education. (2015) · cites this paper as [86]
In the citing paper
“Instead, a novel assessment system has been proposed, by which the utility of assessment can complement the former approach by integrating the results of various types of feedback opportunities programmatically [42].”
From Developing Medical Education Curriculum Reform Strategies to Address the Impact of Generative AI: Qualitative Study (2023) · cites this paper as [42]
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Klein, G. A. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288385 · Cited by 2,434
Harvey, L., & Green, D. (1993) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293930180102 · Cited by 1,281
Assessing professional competence: from methods to programmes
Van Der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02094.x · Cited by 1,268
Self-citationLinking Theory and Practice: Changing the Pedagogy of Teacher Education
Korthagen, F. A. J., & Kessels, J. P. A. M. (1999) · Educational Researcher · doi:10.3102/0013189x028004004 · Cited by 1,266
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170
Research works printed but not linked: 6
- Cavalcanti RB, 2011, JAMA, 306, 993
- Cilliers FJ, 2011, Adv Health Sci Educ Theory Pract
- Dijkstra J, Galbraith R, Hodges B, McAvoy P, McCrorie P, Southgate L, Van der Vleuten C, Wass V, Schuwirth L. under editorial review. Fit-for-purpose guidelines for designing programmes of assessment
- Harden RM, 1984, Med Teach, 18, 284
- Van Merriënboer JJG, 1997, Training complex cognitive skills
- Verhoeven BH, 1999, Educ Health, 12, 49
Cited by
Sorted by citations
Items 701–800 of 892
Assessment of physicians’ professional performance
Wilma, V. D. M. M. (2020) · doi:10.26481/dis.20201015mm
シリーズ : 初期臨床研修と医学教育 (第6回) 教育の質の観点からの医師臨床研修制度の考察
日本医学教育学会, 望月, 篤., 安井, 浩., 卒後・専門教育委員会, 青松, 棟., 高橋, 弘., Konishi, Y., 石原, 慎., 清水, 貴., 高橋, 誠., et al. (2018) · 医学教育 · doi:10.11307/mededjapan.49.4_333
Competency-based portfolio assessment
Pool, A. O. (2020) · Research Publications (Maastricht University) · doi:10.26481/dis.20201106ao
Jongen-Hermus, F. J., der Wiel, I. D. K.-V., Smink, H. J. C., Thijs, A., Leistikow, I. P., Molendijk, A., Zwart, D. L. M., & Schouwenberg, B. J. J. W. (2020) · Bohn Stafleu van Loghum eBooks · doi:10.1007/978-90-368-2404-0_1
Virk, A., Joshi, A., Mahajan, R., & Singh, T. (2021) · Journal of Postgraduate Medicine · doi:10.4103/jpgm.jpgm_1269_20
Varghese, S. S. (2021) · International Journal of Dentistry and Oral Science · doi:10.19070/2377-8075-21000397
共同体という概念の脱/再構築 : 序にかえて( 共同体という概念の脱/再構築)
小田, 亮. (2004) · 文化人類学 · doi:10.14890/jjcanth.69.2_236
Family Medicine Clerkship Assessment Analysis: Application and Implications
Virani, A., Stumbar, S. E., & Bonnin, R. (2021) · PRiMER · doi:10.22454/primer.2021.915080
Relationships, continuity and time in health professions education
Ross, S., & Lee, A. (2021) · Medical Education · doi:10.1111/medu.14674
(2021) · De Gruyter eBooks · doi:10.1515/9783110720105-013
Southern Illinois University School of Medicine
Klamen, D. L. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003291
Seymour-Walsh, A. E. (2019) · Springer briefs in education · doi:10.1007/978-3-030-26792-6_4
All stakeholders matter in faculty development
Iqbal, (. Z. (2020) · Research Publications (Maastricht University) · doi:10.26481/dis.20201215mi
Crisis as the Catalyst for Meaningful Change
LaRochelle, J. S., & Aagaard, E. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-022-07667-2
Vision for Challenge Based Learning
Ruijten-Dodoiu, P. (2022) · De Gruyter eBooks · doi:10.1515/9783110729221-006
WHY WE HAVE TO REFORM MIDWIFERY EDUCATION?
Nugraheny, E., Yanti, Y., & Joewono, H. T. (2022) · Jurnal Pendidikan Kedokteran Indonesia The Indonesian Journal of Medical Education · doi:10.22146/jpki.72654
Going Beyond ‘Good Enough’ Teaching in Psychiatric Training
Sarkar, S. N., & Cohn, V. (2022) · Cambridge University Press eBooks · doi:10.1017/9781009053938.004
Elçin, M. (2022) · Akademisyen Kitabevi eBooks · doi:10.37609/akya.2282
ONLINE ASSESSMENT DRIVE LEARNING MODEL FOR COMPUTER-BASED TEST PREPARATION OF MEDICAL STUDENTS
Nazriati, E., Zulharman, Z., & Firdaus, F. (2022) · Jurnal Pendidikan Kedokteran Indonesia The Indonesian Journal of Medical Education · doi:10.22146/jpki.70473
How Written Assessment Fits into the Canvas of Programmatic Assessment
Iqbal, M. Z., & AlSheikh, M. H. (2023) · Springer eBooks · doi:10.1007/978-3-031-11752-7_12
Suhoyo, Y., & Rahayu, G. R. (2022) · Jurnal Pendidikan Kedokteran Indonesia The Indonesian Journal of Medical Education · doi:10.22146/jpki.66595
Marshall, L., & Castanelli, D. J. (2022) · Focus on Health Professional Education A Multi-Professional Journal · doi:10.11157/fohpe.v23i4.603
Assessing trainee's performance using reported observations: Perceptions of nurse meta-assessors
Blanchette, P. L., Poitras, M.-È., & St‐Onge, C. (2023) · Nurse Education Today · doi:10.1016/j.nedt.2023.105836
Upadhyaya, P. (2023) · Journal of BP Koirala Institute of Health Sciences · doi:10.3126/jbpkihs.v6i1.55784
Veasuvalingam, B., Yusoff, M. S. B., & Singh, D. K. A. (2023) · Education in Medicine Journal · doi:10.21315/eimj2023.15.3.6
An Equitable Approach to Academic Integrity Through Alternative Assessment
Elkhoury, E. (2023) · Springer eBooks · doi:10.1007/978-3-031-39989-3_135
An Equitable Approach to Academic Integrity Through Alternative Assessment
Elkhoury, E. (2024) · Springer international handbooks of education · doi:10.1007/978-3-031-54144-5_135
Staudenmann, D., Waldner, N., Lörwald, A. C., & Huwendiek, S. (2023) · Figshare · doi:10.6084/m9.figshare.24062475
Staudenmann, D., Waldner, N., Lörwald, A. C., & Huwendiek, S. (2023) · Figshare · doi:10.6084/m9.figshare.24062472
Psychometric Analysis of an Integrated Clinical Education Tool for Physical Therapists
Becker, M., Shields, R. K., & Sass, K. J. (2024) · Journal of Physical Therapy Education · doi:10.1097/jte.0000000000000341
Re-thinking doctoral education for future commerce academics and business leaders
Lamberti, P., & Benvenuti, S. (2024) · doi:10.4102/aosis.2024.bk454.09
van den Berg, L., Leendertz, V., Surujlal, J., & van der Merwe, H. (2024) · doi:10.4102/aosis.2024.bk454.08
Loots, E., & Oberholster, J. (2024) · doi:10.4102/aosis.2024.bk454.00
Developing ethics competence of future business leaders: Challenges in higher education
Wentzel, M., & Plant, K. (2024) · doi:10.4102/aosis.2024.bk454.12
Antonites, A. J., & Rosslyn-Smith, W. (2024) · doi:10.4102/aosis.2024.bk454.03
Salamy, A. Y. M. S., Claramita, M., & Suhoyo, Y. (2024) · Jurnal Pendidikan Kedokteran Indonesia The Indonesian Journal of Medical Education · doi:10.22146/jpki.87750
Netere, A. K., Sendekie, A. K., Chanie, G. S., & Belachew, E. A. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09273-w
He, R. (2024) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3632621.3671414
de Moraes, A. P. P., Guará, J. P., Lucas, M. Z. B. S. S., Lopes, M. K. D., & da Silva, N. B. P. (2024) · Revista Brasileira de Educação Médica · doi:10.1590/1981-5271v48.3-2023-0228.ing
de Moraes, A. P. P., Guará, J. P., Lucas, M. Z. B. S. S., Lopes, M. K. D., & da Silva, N. B. P. (2024) · Revista Brasileira de Educação Médica · doi:10.1590/1981-5271v48.3-2023-0228
O’Connor, M., & Richards, B. (2024) · doi:10.1093/med/9780197655979.003.0056
On Lampposts, Sneetches, and Stars: A Call to Go Beyond Bibliometrics for Determining Academic Value
Chan, T. M., & Kuehl, D. (2024) · doi:10.32920/27926373.v1
On Lampposts, Sneetches, and Stars: A Call to Go Beyond Bibliometrics for Determining Academic Value
Chan, T. M., & Kuehl, D. (2024) · doi:10.32920/27926373
Challenges in medical education
Henning, M. A., Doherty, I., Brown, M. E. L., & Lyndon, M. (2025) · doi:10.1093/med/9780192848710.003.0012
Processes and outcomes in a curriculum-level student self-assessment intervention: a case study
Köppe, C., Verhoeff, R. P., & van Joolingen, W. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2480603 · Cited by 3
Designing Assessment to Meet the Challenge of Competency-Based Medical Education
Keister, D. M., & Brohm, V. (2025) · Springer eBooks · doi:10.1007/978-3-031-70741-4_11
Transcending time, space, and culture
Kolm, A. (2025) · doi:10.26481/dis.20250324ak
Cheating 2.0: A reprofiling of the 10 most wanted test cheaters in the digital age
Sturrock, A. M., Myers, G., & Rees, E. L. (2025) · Medical Education · doi:10.1111/medu.15682
Decalogue for ensuring mediocrity of health care professions students and patient unsafety
Collares, C. F. (2025) · Medical Education · doi:10.1111/medu.15677
Kollewe, T., Sennekamp, M., & Ochsendorf, F. R. (2025) · Springer eBooks · doi:10.1007/978-3-662-70777-7_6
Avaliação como disputa: o exame de ordem e os rumos da educação médica
Kanashiro, E. (2025) · Revista Brasileira de Educação Médica · doi:10.1590/1981-5271v49.3-2025.0108
Assessment as dispute: the bar exam and the future of medical education
Kanashiro, E. (2025) · Revista Brasileira de Educação Médica · doi:10.1590/1981-5271v49.3-2025.0108.ing
Medina, M. D. P., Torres-Malca, J. R., Valerio, J. V., Valencia, J. S., Zambrano, M., Contreras-Pizarro, C. H., Hurtado-Muñoz, S., & Vera-Ponce, V. J. (2025) · Educación Médica · doi:10.1016/j.edumed.2025.101084
Parmar, P. B., & Rathod, G. (2025) · Journal of Forensic and Legal Medicine · doi:10.1016/j.jflm.2025.102968
A systematic review of methods for assessing clinical reasoning in nursing students
Salmani, N., & Bagheri, I. (2025) · Journal of Medical Education Development · doi:10.61882/edcj.18.2.129
Caretta‐Weyer, H. A., & Yarris, L. M. (2025) · Medical Teacher · doi:10.1080/0142159x.2025.2566967
Advancing assessment in general practice: the case for programmatic assessment in UK GP training
Wright, A., Johnson, J., & Ahluwalia, S. (2025) · Education for Primary Care · doi:10.1080/14739879.2025.2578790
Methods for Measuring Healthcare Worker Competence: An Integrative Literature ReviewPreprint
Ikoona, E. N., Namulemo, L., Kaluya, R., Ikoona, R., & Sahr, F. (2025) · Research Square · doi:10.21203/rs.3.rs-8360481/v1
Hsu, P. J., Wnuk, G., Leininger, L., Peterson, S., Hughes, D. T., Sandhu, G., Zwischenberger, J. B., George, B. C., & Aubry, S. (2024) · Figshare · doi:10.6084/m9.figshare.27000670
Fuentes‐Cimma, J., Sluijsmans, D. M. A., Riquelme, A., Villagran, I., Isbej, L., Olivares-Labbe, M. T., & Heeneman, S. (2024) · Figshare · doi:10.6084/m9.figshare.26710406
Zhou, Y., Wieringa, T. H., Brouwer, J., Diemers, A. D., & Bos, N. A. (2023) · Figshare · doi:10.6084/m9.figshare.22949400
Fuentes‐Cimma, J., Sluijsmans, D. M. A., Riquelme, A., Villagran, I., Isbej, L., Olivares-Labbe, M. T., & Heeneman, S. (2024) · Figshare · doi:10.6084/m9.figshare.26710409
Pinilla, S., Lenouvel, E., Cantisani, A., Klöppel, S., Strik, W., Huwendiek, S., & Nissen, C. (2021) · Figshare · doi:10.6084/m9.figshare.14251899
Pinilla, S., Kyrou, A., Klöppel, S., Strik, W., Nissen, C., & Huwendiek, S. (2021) · Figshare · doi:10.6084/m9.figshare.14462863
Additional file 2 of Pre-clerkship EPA assessments: a thematic analysis of rater cognition
Meyer, E. G., Harvey, E. J., Durning, S. J., & Uijtdehaage, S. H. J. (2022) · Figshare · doi:10.6084/m9.figshare.19728055
Pinilla, S., Lenouvel, E., Cantisani, A., Klöppel, S., Strik, W., Huwendiek, S., & Nissen, C. (2021) · Figshare · doi:10.6084/m9.figshare.14251902
Pinilla, S., Lenouvel, E., Cantisani, A., Klöppel, S., Strik, W., Huwendiek, S., & Nissen, C. (2021) · Figshare · doi:10.6084/m9.figshare.14251905
de Jong, L. H., Bok, H. G. J., Schellekens, L. H., Kremer, W. D. J., Jonker, F. H., & van der Vleuten, C. P. M. (2022) · Figshare · doi:10.6084/m9.figshare.19920977
Wadi, M., Yusoff, M.-H., Taha, M. H., Shorbagi, S., Lah, N. A. Z. N., & Rahim, A. F. A. (2024) · Figshare · doi:10.6084/m9.figshare.26580437
Additional file 1 of Pre-clerkship EPA assessments: a thematic analysis of rater cognition
Meyer, E. G., Harvey, E. J., Durning, S. J., & Uijtdehaage, S. H. J. (2022) · Figshare · doi:10.6084/m9.figshare.19728052
de Jong, L. H., Bok, H. G. J., Schellekens, L. H., Kremer, W. D. J., Jonker, F. H., & van der Vleuten, C. P. M. (2022) · Figshare · doi:10.6084/m9.figshare.19920974
A Critical Narrative Synthesis Toward Precision Medical Training in Radiology Education
Alkhalili, K., & Ali, S. (2025) · Inquisiva Open · doi:10.64551/001c.150391
The long shadow of assessment in the making of a physician
Goh, S. P. L., & Sarraf‐Yazdi, S. (2025) · Medical Education · doi:10.1111/medu.70157
Nair, K. C. (2025) · Springer eBooks · doi:10.1007/978-3-032-07551-2_8
Parmar, P. B., & Rathod, G. (2026) · Academic Forensic Pathology · doi:10.1177/19253621251409452
Saeed, I., Fatima, F., Ahmed, A., Baig, M. M., & Baig, A. (2025) · Journal of Rawalpindi Medical College · doi:10.37939/jrmc.v29i4.2974
Clinical Assessment Methods: Modes and Methods
Telang, A., Nerali, J. T., & Tilakaratne, W. M. (2025) · Springer eBooks · doi:10.1007/978-981-97-0275-6_14-1
Huang, M. H., Huang, J.-P., & Lee, H.-L. (2026) · Taiwanese Journal of Obstetrics and Gynecology · doi:10.1016/j.tjog.2025.10.003
Farid, K. A., El-Gendy, M. S., Youssef, S. R., & Nassar, O. T. (2022) · Annals of Pharmacy Education Safety and Public Health Advocacy · doi:10.51847/rl7zescuhj
Gómez-Martínez, A. M., del Cañizo-López, J. F., Vara, E., Núñez-Cortés, J. M., Bañares-Cañizares, R., Cuadrado-Perez, M. D. L. L., Villena-Garrido, V., & Arias‐Díaz, J. (2026) · Critical Public Health · doi:10.1080/09581596.2026.2613523
Wellbeing in medical training: The missing role of assessment design
Hernández, M. M., & Albarrán-Pérez, D. F. (2026) · Advances in Integrative Medicine · doi:10.1016/j.aimed.2026.100632
Integrating Artificial Intelligence into Endoscopy Training
Gimpaya, N., Landy, J. S., Tran, W. T., & Grover, S. C. (2026) · Gastrointestinal Endoscopy Clinics of North America · doi:10.1016/j.giec.2026.01.012
Educational activities as a pathway to postgraduate standardization: a qualitative study
Alrehaily, A., Alomair, A. M., Kattan, T., Alrumaihi, N., & Carrick, F. R. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08922-4
Evolution of Dental Education: Insights from Educational Measurement and Psychology
Kassim, N. L. A. (2026) · Springer eBooks · doi:10.1007/978-981-97-0275-6_18-1
Yusof, H. M., Abas, A., Ibrahim, M. M., & Abas, N. A. H. (2025) · International Conference on Artificial Intelligence and Teacher Education (ICAITE) · doi:10.1109/icaite68636.2025.11442419
Can We Change? Applying Vosniadou's Theory to Assessment Reform in Dental Education
Bonnici, E., Gray, J., & Valentine, N. A. (2026) · Journal of Dental Education · doi:10.1002/jdd.70212
Santen, S. A., Lawson, L. E., Manriquez, J. A. N., Westerveld, M., Turner, L., Wilson, A., Park, Y. S., Holmboe, E. S., Ryan, M. S., Katherine, B., et al. (2025) · Academic Medicine · doi:10.1093/acamed/wvaf027
Li, L., & Pangaro, L. N. (2026) · The Journal of Physician Assistant Education · doi:10.1097/jpa.0000000000000750
Curriculum Development and Review: Standards and Protocols
Azami, N. H., Noor, N. S. M., Fuad, N. A., Dasor, M. M., & Kasim, N. A. (2026) · Springer eBooks · doi:10.1007/978-981-97-0275-6_8-1
Metadata
- Authors
- van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J.
- Affiliations
- Flinders University (AU)
- Maastricht University (NL)
- Leiden University (NL)
- University of Applied Sciences Utrecht (NL)
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2012-02-25
- Volume
- 34
- Issue
- 3
- Pages
- 205-214
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2163467994
- Cited by
- 892
- References
- 69
- Citations by year
- 2026: 140 · 2025: 62 · 2024: 70 · 2023: 74 · 2022: 72 · 2021: 71 · 2020: 59 · 2019: 66 · 2018: 69 · 2017: 56 · 2016: 50 · 2015: 32 · 2014: 40 · 2013: 21 · 2012: 9
- FWCI
- 31.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Teacher (publishedVersion)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Research Publications (Maastricht University) (submittedVersion)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- programmatic assessment, assessment for learning, student progress, evaluation principles, expert opinion, bias mitigation, sampling, feedback, medical education
- MeSH terms
- Decision Making, Educational Measurement, Humans, Program Evaluation, Models, Educational
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review