The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
A systemic framework for the progress test: Strengths, constraints and issues: AMEE Guide No. 71
Abstract
There has been increasing use and significance of progress testing in medical education. It is used in many ways and with several formats to reflect the variety of curricula and assessment purposes. These developments have occurred alongside a recognised sensitivity for error variance inherent in multiple choice tests from which challenges to its validity and reliability have arisen. This Guide presents a generic, systemic framework to help identify and explore improvements in the quality and defensibility of progress test data. The framework draws on the combined experience of the Dutch consortium, an individual medical school in the United Kingdom, and the bulk of the progress test literature to date. It embeds progress testing as a quality-controlled assessment tool for improving learning, teaching and the demonstration of educational standards. The paper describes strengths, highlights constraints and explores issues for improvement. These may assist in the establishment of potential or new progress testing in medical education programmes. They can also guide the evaluation and improvement of existing programmes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment
Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002) · Applied Measurement in Education · doi:10.1207/s15324818ame1503_5 · Cited by 973
Repeated testing produces superior transfer of learning relative to repeated studying.
Butler, A. C. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0019902 · Cited by 492
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03518.x · Cited by 383
The effects of tests on learning and forgetting.
Carpenter, S. K., Pashler, H., Wixted, J. T., & Vul, E. (2008) · Memory & Cognition · doi:10.3758/mc.36.2.438 · Cited by 281
Research works printed but not linked: 82
- Aarts R, 2010, Med Teach, 32, 461, 10.3109/0142159X.2010.486059 · doi:10.3109/0142159x.2010.486059
- Albano MG, 1996, Med Educ, 30, 239, 10.1111/j.1365-2923.1996.tb00824.x · DOI
- Alnabhan M, 2002, Soc Behavior Personality, 30, 645, 10.2224/sbp.2002.30.7.645 · doi:10.2224/sbp.2002.30.7.645
- American Educational Research Association, American Psychological Association & National Council on Measurement in Education, 1999, Standards for educational and psychological testing
- Bandaranayake RJ, 2008, Med Teach, 30, 836, 10.1080/01421590802402247 · DOI
- Basu S, 2004, Med Educ, 38, 1253, 10.1111/j.1365-2929.2004.02017.x · DOI
- Bennett J, 2010, Med Teach, 32, 500, 10.3109/0142159X.2010.486057 · doi:10.3109/0142159x.2010.486057
- Boshuizen HPA, 1997, Med Educ, 31, 115, 10.1111/j.1365-2923.1997.tb02469.x · DOI
- Bridge PD, 2003, Med Teach, 25, 414, 10.1080/0142159031000100337 · doi:10.1080/0142159031000100337
- Burton RF, 2002, Med Educ, 36, 805, 10.1046/j.1365-2923.2002.01299.x · DOI
- Butler AC, 2010, J Experiment Psychol: Learning, Memory Cognit, 36, 1118
- Case SM, 2002, Constructing written test questions for the basic and clinical sciences
- Coderre S, 2009, Med Teach, 31, 322, 10.1080/01421590802225770 · DOI
- Coombes L, 2010, Med Teach, 32, 486, 10.3109/0142159X.2010.485652 · DOI
- Danish KF, 2010, J Rawalpindi Med Coll, 14, 98
- De Champlain A, 2010, Med Teach, 32, 503, 10.3109/01421590903514655 · doi:10.3109/01421590903514655
- Dijksterhuis MGK, 2009, Med Teach, 31, e464, 10.3109/01421590902849545 · DOI
- Downing SM, 2002, Adv Health Sci Educ, 7, 235, 10.1023/A:1021112514626 · DOI
- Downing SM, 2003, Med Educ, 37, 670, 10.1046/j.1365-2923.2003.01585.x · DOI
- Downing SM, 2005, Adv Health Sci Educ, 10, 133, 10.1007/s10459-004-4019-5 · DOI · Paper page
- 10.1207/s15328015tlm1801_11 · DOI · Paper page
- Espinoza MP, 2010, J Math Psychol, 54, 415, 10.1016/j.jmp.2010.06.001 · DOI
- Finucane P, 2010, Med Educ, 44, 184, 10.1111/j.1365-2923.2009.03567.x · doi:10.1111/j.1365-2923.2009.03567.x
- Frank JR, (Ed.) 2005. The CanMEDS 2005 physician competency framework. Better standards. Better physicians. Better Care., Ottawa, The Royal College of Physicians and Surgeons of Canada
- Freeman A, 2010, Med Teach, 32, 464, 10.3109/0142159X.2010.486056 · doi:10.3109/0142159x.2010.486056
- Freeman A, 2010, Med Teach, 32, 578, 10.3109/01421591003614858 · DOI
- Freeman A, 2010, Med Teach, 32, 451, 10.3109/0142159X.2010.485231 · DOI
- 10.1207/s15324818ame0201_3 · DOI · Paper page
- 10.1207/s15324818ame0201_4 · DOI · Paper page
- Holsgrove G, 1998, Med Educ, 32, 343, 10.1046/j.1365-2923.1998.00203.x · DOI
- Jozefowicz RF, 2002, Acad Med, 77, 156, 10.1097/00001888-200202000-00016 · DOI · Paper page
- Kerfoot BP, 2011, Acad Med, 86, 300, 10.1097/ACM.0b013e3182087bef · DOI
- Koens F, 2005, Med Educ, 39, 911, 10.1111/j.1365-2929.2005.02246.x · doi:10.1111/j.1365-2929.2005.02246.x
- Larsen DP, 2009, Medical Education, 43, 1174
- Malau-Aduli BS, 2011, Assess Eval Higher Educ
- Mardiastuti HW, 2011, J Med Med Sci, 2, 1302
- McCrorie P, 2009, Med Teach, 31, 223, 10.1080/01421590802574581 · DOI
- McHarg J, 2005, Med Educ, 39, 221, 10.1111/j.1365-2929.2004.02060.x · DOI
- McLaughlin K, 2005, Med Teach, 27, 544, 10.1080/01421590500136113 · doi:10.1080/01421590500136113
- Muijtjens AMM, 1998, Adv Health Sci Educ, 3, 81, 10.1023/A:1009728423412 · DOI
- Muijtjens AMM, 2007, Med Educ, 41, 1217
- Muijtjens AMM, 2008, Adv Health Sci Educ, 13, 593, 10.1007/s10459-007-9066-2 · doi:10.1007/s10459-007-9066-2
- 10.3109/0142159X.2010.486058 · DOI
- Muijtjens AMM, 1999, Med Educ, 33, 267, 10.1046/j.1365-2923.1999.00292.x · doi:10.1046/j.1365-2923.1999.00292.x
- Muijtjens AMM, 2010, Lessons from problem-based learning
- Munro N, 2000, Med Educ, 34, 35, 10.1046/j.1365-2923.2000.00599.x · DOI
- Naeem N, 2011, Adv Health Sci Educ
- Norman G, 2010, Med Teach, 32, 496, 10.3109/0142159X.2010.486063 · DOI
- Nouns ZM, 2010, Med Teach, 32, 467, 10.3109/0142159X.2010.485656 · DOI
- Prideaux D, 2002, Med Educ, 36, 404, 10.1046/j.1365-2923.2002.01240.x · doi:10.1046/j.1365-2923.2002.01240.x
- Rademakers J, 2005, Med Teach, 27, 578, 10.1080/01421590500062749 · DOI
- Ricketts C, 2010, Med Teach, 32, 513, 10.3109/0142159X.2010.485651 · DOI
- Ricketts C, 2009, Med Educ, 43, 589, 10.1111/j.1365-2923.2009.03372.x · doi:10.1111/j.1365-2923.2009.03372.x
- Ricketts C, 2011, Med Educ, 45, 570, 10.1111/j.1365-2923.2010.03902.x · doi:10.1111/j.1365-2923.2010.03902.x
- Roex A, 2004, Med Teach, 26, 178, 10.1080/01421590310001642975 · doi:10.1080/01421590310001642975
- Sales D, 2010, Med Teach, 32, e111, 10.3109/01421590903386781 · DOI
- Schaap L, 2011, Assess Eval Higher Educ, 1
- Scharf EM, 2007, Active Learn Higher Educ, 8, 31, 10.1177/1469787407074009 · DOI
- Schauber S, 2010, Med Teach, 32, 471, 10.3109/0142159X.2010.485653 · DOI
- Schuwirth L, 2007, Med Educ, 41, 1022, 10.1111/j.1365-2923.2007.02856.x · DOI
- Schuwirth L, 2010, Med Teach, 32, 476, 10.3109/0142159X.2010.485658 · DOI
- Stagnaro-Green AS, 2006, Med Teach, 28, 566, 10.1080/01421590600711153 · DOI
- Swanson DB, 2010, Med Teach, 32, 480, 10.3109/0142159X.2010.485655 · DOI
- Tarrant M, 2006, Nurse Educ Today, 26, 662, 10.1016/j.nedt.2006.07.006 · DOI
- Tarrant M, 2008, Med Educ, 42, 198, 10.1111/j.1365-2923.2007.02957.x · DOI · Paper page
- Tombleson P, 2000, Med Educ, 34, 566, 10.1046/j.1365-2923.2000.00553.x · DOI
- Tweed M, 2009, Med Teach, 31, 51, 10.1080/01421590802146018 · DOI
- Van der Veken J, 2009, Med Educ, 43, 704, 10.1111/j.1365-2923.2009.03397.x · DOI
- van der Vleuten CPM, 2004, Med Teach, 26, 719, 10.1080/01421590400016464 · DOI
- van der Vleuten CPM, 1996, Med Teach, 18, 103, 10.3109/01421599609034142 · DOI · Paper page
- van Diest R, 2004, Med Educ, 38, 1295, 10.1111/j.1365-2929.2004.02022.x · doi:10.1111/j.1365-2929.2004.02022.x
- van Herwaarden CLA, 2009, Raamplan artsopleiding 2009
- Vantini I, 2008, Clin Chim Acta, 393, 13, 10.1016/j.cca.2008.03.015 · DOI
- Verhoeven BH, 2005, Med Teach, 27, 514, 10.1080/01421590500136238 · doi:10.1080/01421590500136238
- Verhoeven BH, 1999, Med Educ, 33, 832, 10.1046/j.1365-2923.1999.00487.x · DOI
- Verhoeven BH, 2002, Med Educ, 36, 860, 10.1046/j.1365-2923.2002.01301.x · DOI
- Verhoeven BH, 2002, Med Educ, 36, 711, 10.1046/j.1365-2923.2002.01268.x · DOI
- Wade L, 2011, Adv Health Sci Educ
- Wallach PM, 2006, Adv Health Sci Educ, 11, 61, 10.1007/s10459-004-7515-8 · DOI
- Ware J, 2009, Med Teach, 31, 238, 10.1080/01421590802155597 · DOI
- World Federation for Medical Examinaton, 2003, Basic medical education
- Zimmerman DW, 2003, Appl Psychol Meas, 27, 357, 10.1177/0146621603254799 · DOI
Cited by
The integrated curriculum in medical education: AMEE Guide No. 96
Brauer, D. G., & Ferguson, K. J. (2015) · Medical Teacher · doi:10.3109/0142159x.2014.970998 · Cited by 571
ChatGPT in medical school: how successful is AI in progress testing?
Friederichs, H., Friederichs, W. J., & März, M. (2023) · Medical Education Online · doi:10.1080/10872981.2023.2220920 · Cited by 122
“The following key elements of progress testing are described in a guide published by the Association for Medical Education in Europe (AMEE) [7].”
BackgroundInfluentialComo avaliar programas de residência a partir do Teste de Progresso?
Romão, G. S., Fernandes, C. E., Silva Filho, A. L. D., Rocha, S. R., & Sá, M. F. S. D. (2022) · Revista Brasileira de Educação Médica · doi:10.1590/1981-5271v46.supl.1-20220284 · Cited by 1
Metadata
- Authors
- Wrigley, W., Van Der Vleuten, C. P., Freeman, A., & Muijtjens, A.
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2012-08-21
- Volume
- 34
- Issue
- 9
- Pages
- 683-697
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2000023539
- Cited by
- 159
- References
- 6
- FWCI
- 4.92
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.