The DOI matches its Crossref record; 46 of the 48 references it cites were found in a registry or an index; none of the 47 sources its claims cite is checked for support yet.
Test-enhanced learning in medical education
Open accessAbstract
Context In education, tests are primarily used for assessment, thus permitting teachers to assess the efficacy of their curriculum and to assign grades. However, research in cognitive psychology has shown that tests can also directly affect learning by promoting better retention of information, a phenomenon known as the testing effect. Cognitive psychology research Cognitive psychology laboratory studies show that repeated testing of information produces superior retention relative to repeated study, especially when testing is spaced out over time. Tests that require effortful retrieval of information, such as short‐answer tests, promote better retention than tests that require recognition, such as multiple‐choice tests. The mnemonic benefits of testing are further enhanced by feedback, which helps students to correct errors and confirm correct answers. Application to medical education Medical educational research has focused extensively on assessment issues. Such assessment research permits the conclusion that clinical expertise is founded on a broad fund of knowledge and effective memory networks that allow easy access to that knowledge. Test‐enhanced learning can potentially strengthen clinical knowledge that will lead to improved expertise. Conclusions Tests should be given often and spaced out in time to promote better retention of information. Questions that require effortful recall produce the greatest gains in memory. Feedback is crucial to learning from tests. Test‐enhanced learning may be an effective tool for medical educators to use in promoting retention of clinical knowledge.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This narrative review argues that tests are not merely assessment devices but active memory modifiers, and that "test-enhanced learning" — frequent, spaced, effortful retrieval with feedback — could strengthen the clinical knowledge base underlying medical expertise. It synthesizes cognitive psychology laboratory evidence and maps it onto the history and priorities of medical education assessment.
Key findings
- Repeated testing produces better long-term retention than repeated study. In Karpicke and Roediger's flashcard experiment with 40 Swahili–English word pairs, students in the standard and repeated-testing groups recalled approximately 80% of pairs on a test 1 week later, versus 36% (repeated study) and 33% (drop) — indicating that repeated retrieval, not continued study, drives retention.
- More tests are better than fewer: students who took three tests on picture names recalled more 1 week later than those who took one test, who in turn recalled more than those not tested at all (Wheeler & Roediger).
- Production tests (short-answer, fill-in-the-blank, essay) yield better retention than recognition tests (MCQ, true/false). In Butler and Roediger's art-history video lecture study, an initial short-answer test produced better retention on a final test 1 month later than an initial MCQ test or studying a lecture summary.
- Feedback enhances the testing benefit by correcting errors and confirming correct answers; feedback containing the correct answer is critical, and delayed feedback sometimes produces superior retention relative to immediate feedback.
Methods
- Design: narrative/conceptual review, not an empirical study; the authors state no new data were collected ("Ethical approval: not applicable").
- Evidence base: cognitive psychology laboratory experiments on the testing effect, spacing effect, test format, and feedback, plus a review of the medical education assessment literature (MCQ vs OEQ, key features problems, script-concordance questionnaires, progress tests, in-training assessment).
- Analysis: qualitative synthesis organized into three sections — testing research in cognitive psychology, the evolution of testing in medical education, and application of test-enhanced learning to medical education — concluding with recommendations for practice.
Limitations
- Stated: most evidence for the direct effects of testing comes from laboratory experiments, and many applied studies occurred in simulated classrooms; testing benefits have not been fully studied in lectures, problem-based sessions, or clinical activities.
- Stated: most "long-term" testing studies used retention intervals of less than 1 week, with a few up to 6 weeks, whereas medical trainees need to retain information for months to years, so efficacy over long periods is unestablished.
- Stated: it is unknown whether improved test recall translates into retrieval during patient encounters or better patient care; the authors call for real patient outcome and care metrics as the strongest validation. Evident from the text: the paper offers no primary data, effect sizes, or meta-analytic synthesis of its own, so its recommendations rest on the cited studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
33 Not checked yet · 8 Own interpretation
In the paper
“Repeated testing has been shown to promote better retention than taking a single test.”
§ Test-enhanced learning in medical education > Suggestions for further research
What the sources say
- Not checked yetcites [17] source
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Test-enhanced learning may be an effective tool for medical educators to use in promoting retention of clinical knowledge.”
- Also stated in: § CONCLUSIONS · hedged
“It could provide a welcome addition to the tools with which educators can help medical students, residents and practising doctors retain information and progress towards greater clinical expertise.”
§ Test-enhanced learning in medical education > Abstract
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § CONCLUSIONS · hedged
In the paper
“students in both the standard and repeated testing groups recalled approximately 80% of the word pairs, whereas students in the repeated study and drop groups recalled 36% and 33%, respectively.”
§ Test-enhanced learning in medical education > Suggestions for further research
What the sources say
- Not checked yetcites [16] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Cognitive psychology laboratory studies show that repeated testing of information produces superior retention relative to repeated study, especially when testing is spaced out over time.”
- Also stated in: § INTRODUCTION · plain
“Being tested is a better way to learn material than is further study, as we discuss below.”
§ Test-enhanced learning in medical education > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § INTRODUCTION · plain
None of the sources cited for this claim have been checked yet.
In the paper
“These indirect benefits of frequent testing have been shown to improve performance in large lecture classes.7,8”
§ Test-enhanced learning in medical education > INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These results indicate that repeated retrieval is key to promoting superior retention.”
§ Test-enhanced learning in medical education > Suggestions for further research
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Tests that require effortful retrieval of information, such as short-answer tests, promote better retention than tests that require recognition, such as multiple-choice tests.”
- Also stated in: § Suggestions for further research · plain
“Research has shown that production tests lead to better retention than recognition tests, presumably because production tests require more effortful retrieval of information from memory than recognition tests.3,22”
§ Test-enhanced learning in medical education > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Suggestions for further research · plain
In the paper
“The mnemonic benefits of testing are further enhanced by feedback, which helps students to correct errors and confirm correct answers.”
- Also stated in: § Suggestions for further research · plain
“Although testing improves retention in the absence of feedback, as shown in many of the studies described above, providing feedback enhances the benefits of testing by correcting errors and confirming correct responses.27”
§ Test-enhanced learning in medical education > Abstract
What the sources say
- Not checked yetcites [27] source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Suggestions for further research · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Interestingly, the standard group did not demonstrate better retention than the repeated testing group, which suggests that continuing to study an item once it has been recalled has a negligible effect on retention.”
§ Test-enhanced learning in medical education > Suggestions for further research
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Cognitive psychology laboratory studies show that repeated testing of information produces superior retention relative to repeated study, especially when testing is spaced out over time.”
- Also stated in: § Suggestions for further research · plain
“The benefits of repeated testing are even greater when tests are distributed over time.18,19”
§ Test-enhanced learning in medical education > Abstract
What the sources say
- Not checked yetcites [18] source
- Not checked yetcites [19]
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Suggestions for further research · plain
- It may state two separate claims as one. 10
- Probably not a substantial claim. 2
None of the sources cited for this claim have been checked yet.
In the paper
“Ultimately, the total time hypothesis was found to be incorrect by experiments showing that taking a test leads to better retention than re-studying the material for an equivalent amount of time.2,14,15”
§ Test-enhanced learning in medical education > Suggestions for further research
What the sources say
- Not checked yetcites [2] source
- Not checked yetcites [14]
- Not checked yetcites [15]
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The indirect effects of testing refer to the increase in the amount of study time and improvement in study strategies that result from frequent testing.”
- Also stated in: § TESTING IN MEDICAL EDUCATION · plain
“Studies of educational impact provide a thorough summary of the indirect effects of testing and assessment, which include increased motivation to study, more efficient learning strategies, and improved accuracy in the measurement of curriculum efficacy.32”
§ Test-enhanced learning in medical education > INTRODUCTION
What the sources say
- Not checked yetcites [32]
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § TESTING IN MEDICAL EDUCATION · plain
None of the sources cited for this claim have been checked yet.
In the paper
“Much research shows that spaced study sessions aid memory performance.5,6”
- Also stated in: § Suggestions for further research · boosted
“Indeed, the superiority of distributed or spaced practice over massed practice in promoting long-term retention, commonly referred to as the spacing effect, is highly replicable and quite robust.5,20”
§ Test-enhanced learning in medical education > INTRODUCTION
What the sources say
- Not checked yetcites [5] source
- Not checked yetcites [6]
- Not checked yetcites [20]
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § Suggestions for further research · boosted
None of the sources cited for this claim have been checked yet.
In the paper
“Later research also showed that learning does occur during tests and led to the re-conceptualisation of retrieval as a memory modifier.12,13”
§ Test-enhanced learning in medical education > TEST-ENHANCED LEARNING IN COGNITIVE PSYCHOLOGY
What the sources say
- Not checked yetcites [12]
- Not checked yetcites [13]
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Research has shown that production tests lead to better retention than recognition tests, presumably because production tests require more effortful retrieval of information from memory than recognition tests.3,22”
§ Test-enhanced learning in medical education > Suggestions for further research
What the sources say
- Not checked yetcites [3]
- Not checked yetcites [22]
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“One week later, the group that took three tests recalled more of the names on a final test than the group that took one test, which in turn recalled more names than the group that was not tested at all.”
§ Test-enhanced learning in medical education > Suggestions for further research
What the sources say
- Not checked yetcites [17]
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This finding could be interpreted as a testing effect because the simulations serve as handson tests.”
§ Test-enhanced learning in medical education > APPLICATION OF TEST-ENHANCED LEARNING IN MEDICAL EDUCATION
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“One potential clinical example concerns evidence that teaching cardiac life support through simulation prevents the forgetting of this knowledge over time.45”
§ Test-enhanced learning in medical education > APPLICATION OF TEST-ENHANCED LEARNING IN MEDICAL EDUCATION
What the sources say
- Not checked yetcites [45]
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“The repeated testing of the curriculum allows students to measure their growth in knowledge and plan their study strategies in an ongoing manner.32,42 The test results also allow faculty members to gauge the effectiveness of the curriculum and its integration over time.”
§ Test-enhanced learning in medical education > TESTING IN MEDICAL EDUCATION
What the sources say
- Not checked yetcites [32]
- Not checked yetcites [42]
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“However, much research has shown that simply providing information about the outcome of the response (i.e.right ⁄ wrong) does little to help students correct their errors, and that including the correct answer in the feedback message is critical.28”
§ Test-enhanced learning in medical education > Suggestions for further research
What the sources say
- Not checked yetcites [28]
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The types of test that seem to be most effective are those that involve active production of knowledge (rather than its more passive recognition), are spaced in time, and have feedback given at some delay after the test.”
§ Test-enhanced learning in medical education > CONCLUSIONS
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Most studies of Ôlong-termÕ testing effects have used retention intervals (i.e. the time before the final examination) of less than 1 week, although a few have used longer intervals of up to 6 weeks.16,23,24”
§ Test-enhanced learning in medical education > APPLICATION OF TEST-ENHANCED LEARNING IN MEDICAL EDUCATION
What the sources say
- Not checked yetcites [16] source
- Not checked yetcites [23]
- Not checked yetcites [24]
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper relies on this without support.
Testing in medical education has largely served as an instrument of assessment.
“Testing in medical education has largely served as an instrument of assessment.”
The paper relies on this without support.
Assessment drives learning.
“The importance of this context is encapsulated in the oft-repeated aphorism that assessment drives learning.”
The paper relies on this without support.
The majority of evidence for the direct effects of testing has come from laboratory experiments.
“For example, the majority of evidence for the direct effects of testing has come from laboratory experiments.”
The paper relies on this without support.
Improved retention through testing has not yet been fully studied in many teaching situations, such as lectures, problem-based sessions or clinical activities.
“Still, improved retention through testing has not yet been fully studied in many teaching situations, such as lectures, problem-based sessions or clinical activities.”
The paper relies on this without support.
Medical trainees need to retain information for months to years.
“However, medical trainees need to retain information for months to years.”
The paper relies on this without support.
The fact that tests can be used to improve learning is not widely realised within education, especially higher education.
“The fact that tests can be used to improve learning is not widely realised within education, especially higher education.”
The paper relies on this without support.
More than recall of information is needed to be an effective doctor.
“Although this is applicable in medical education, we recognise that more than recall of information is needed to be an effective doctor.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, randomized controlled trials demonstrate that repeated testing promotes better retention of information than repeated studying, a phenomenon known as the testing effect.3,4”
From Effect of repeated/spaced formative assessments on medical school final exam performance (2017) · cites this paper as [3]
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Memory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
Information Processing and Cognition: The Loyola Symposium
Brown, A. S., & Solso, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421430 · Cited by 2,398
Wechsler Adult Intelligence Scale--Third Edition
Wechsler, D. (2019) · PsycTESTS Dataset · doi:10.1037/t49755-000 · Cited by 2,327
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Distributed practice in verbal recall tasks: A review and quantitative synthesis.
Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.354 · Cited by 1,888
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Zechmeister, E. B., Gruneberg, M. M., Morris, P. E., & Sykes, R. N. (1980) · The American Journal of Psychology · doi:10.2307/1422245 · Cited by 1,528
Medical Problem Solving: An Analysis of Clinical Reasoning
Elstein, A. S., Shulman, L. S., & Sprafka, S. A. (1978) · doi:10.4159/harvard.9780674189089 · Cited by 1,377
The instructional effect of feedback in test-like events.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991) · Review of Educational Research · doi:10.3102/00346543061002213 · Cited by 1,313
Research works printed but not linked: 1
- Jones HE, 1923, The effects of examination on the performance of learning, Arch Psychol, 10, 1
Cited by
Sorted by citations
Items 101–200 of 609
Price, D. W., Wang, T., O’Neill, T. R., Morgan, Z. J., Chodavarapu, P., Bazemore, A., Peterson, L. E., & Newton, W. P. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005856 · Cited by 48
Spaced Repetition Flashcards for Teaching Medical Students Psychiatry
Sun, M., Tsai, S., Engle, D. L., & Holmer, S. (2021) · Medical Science Educator · doi:10.1007/s40670-021-01286-y · Cited by 42
Janse, R. J., van Wijk, E. V., Ruijter, B. N., Rohling, J. H. T., van der Kraan, J., Crobach, S., de Jonge, M., de Beaufort, A. J., Dekker, F. W., & Langers, A. M. J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0288558 · Cited by 42
Assessment of anatomical knowledge: Approaches taken by higher education institutions
Choudhury, B., & Freemont, A. J. (2017) · Clinical Anatomy · doi:10.1002/ca.22835 · Cited by 43
TBL - Aprendizaje Basado en Equipos
Moraga, D., & Soto, J. (2016) · Estudios pedagógicos · doi:10.4067/s0718-07052016000200025 · Cited by 41
Influences on medical students’ self‐regulated learning after test completion
Agrawal, S., Norman, G. R., & Eva, K. W. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04150.x · Cited by 41
Immediate detailed feedback to test-enhanced learning: An effective online educational tool
Wojcikowski, K., & Kirk, L. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.826793 · Cited by 41
Experiential learning improves the learning and retention of endotracheal intubation
Ti, L. K., Chen, F.-G., Tan, G.-M., Tan, W. T., Tan, J. M. J., Shen, L., & Goy, R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03399.x · Cited by 41
Taveira-Gomes, T., Prado-Costa, R., Severo, M., & Ferreira, M. A. (2015) · BMC Medical Education · doi:10.1186/s12909-014-0275-0 · Cited by 39
Computer‐based learning: Interleaving whole and sectional representation of neuroanatomy
Pani, J. R., Chariker, J. H., & Naaz, F. (2012) · Anatomical Sciences Education · doi:10.1002/ase.1297 · Cited by 39
Current Status and Future Direction of Nursing Education for Clinical Practice
Shin, S., Yang, E. B., Hwang, E., Kim, K.-H., Kim, Y., & Jung, D. (2017) · Korean Medical Education Review · doi:10.17496/kmer.2017.19.2.76 · Cited by 39
Quantitative research methods in medical education
Norman, G. R., & Eva, K. W. (2013) · Wiley eBooks · doi:10.1002/9781118472361.ch25 · Cited by 39
Lameris, A. L. L., Hoenderop, J. G. J., Bindels, R. J. M., & Eijsvogels, T. M. H. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0351-0 · Cited by 38
Sennhenn‐Kirchner, S., Görlich, Y., Kirchner, B., Notbohm, M., Schiekirka-Schwake, S., Simmenroth, A., & Raupach, T. (2017) · European Journal Of Dental Education · doi:10.1111/eje.12254 · Cited by 38
Pugh, D., Desjardins, I., & Eva, K. W. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1388502 · Cited by 39
Ludwig, S., Schuelper, N., Brown, J., Anders, S., & Raupach, T. (2018) · BMC Medicine · doi:10.1186/s12916-018-1090-y · Cited by 38
Cheung, J. J. H., Kulasegaram, K. M., Woods, N. N., & Brydges, R. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-04959-y · Cited by 50
Nia, P. S., Heuts, S., Daemen, J. H. T., Olsthoorn, J. R., Chitwood, W. R., & Maessen, J. G. (2020) · Interactive Cardiovascular and Thoracic Surgery · doi:10.1093/icvts/ivz323 · Cited by 38
Kimber, M., McTavish, J. R., Vanstone, M. G., Stewart, D. E., & MacMillan, H. L. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104743 · Cited by 38
Monteiro, S., Norman, G. R., & Sherbino, J. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12907 · Cited by 38
Palmer, S., Chu, Y., & Persky, A. M. (2019) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7217 · Cited by 40
Driving Deeper Learning by Assessment
Phillips, A. W., Smith, S. G., & Straus, C. M. (2013) · Academic Radiology · doi:10.1016/j.acra.2013.02.001 · Cited by 37
Learning to cure, but learning to care?
Michalec, B. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9249-0 · Cited by 37
The Impact of Pre- and Post-Lecture Quizzes on Performance in Intermediate Accounting II
Brink, A. G. (2013) · Issues in Accounting Education · doi:10.2308/iace-50445 · Cited by 43
Jonsson, B., Kulaksiz, Y. C., & Lithner, J. (2016) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2016.1192232 · Cited by 38
Spaced radiology: encouraging durable memory using spaced testing in pediatric radiology
Morin, C. E., Hostetter, J. M., Jeudy, J. J., Kim, W. G., McCabe, J. A., Merrow, A. C., Ropp, A. M., Shet, N. S., Sidhu, A. S., & Kim, J. S. (2019) · Pediatric Radiology · doi:10.1007/s00247-019-04415-3 · Cited by 36
Moghaddam, A. K., Khankeh, H. R., Shariati, M., Norcini, J. J., & Jalili, M. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031014 · Cited by 37
Cortés‐Pérez, I., Zagalaz‐Anula, N., López‐Ruiz, M. D. C., Díaz‐Fernández, Á., Obrero‐Gaitán, E., & Osuna‐Pérez, M. C. (2023) · Healthcare · doi:10.3390/healthcare11040578 · Cited by 41
Fransen, F., Martens, H., Nagtzaam, I. F., & Heeneman, S. (2018) · International Journal of Medical Education · doi:10.5116/ijme.5a47.8ab0 · Cited by 35
Finn, B., & Tauber, S. K. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9331-5 · Cited by 35
The Future Comes Early for Medical Educators
Minter, D. J., Geha, R. M., Manesh, R. S., & Dhaliwal, G. (2020) · Journal of General Internal Medicine · doi:10.1007/s11606-020-06128-y · Cited by 35
Mogali, S. R., Rotgans, J. I., Rosby, L., Ferenczi, M. A., & Low‐Beer, N. (2019) · Anatomical Sciences Education · doi:10.1002/ase.1931 · Cited by 34
Nutrition competencies for medicine: an integrative review and critical synthesis
Lepre, B., Mansfield, K. J., Ray, S., & Beck, E. J. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-043066 · Cited by 36
Feedback in the OSCE: What Do Residents Remember?
Humphrey-Murto, S., Mihok, M., Pugh, D., Touchie, C., Halman, S., & Wood, T. J. (2016) · Teaching and Learning in Medicine · doi:10.1080/10401334.2015.1107487 · Cited by 33
Effect of repeated/spaced formative assessments on medical school final exam performance
Chang, E. K., & Wimmers, P. F. (2017) · Health Professions Education · doi:10.1016/j.hpe.2016.08.001 · Cited by 33
An audience response system may influence student performance on anatomy examination questions
Hoyt, A. E., McNulty, J. A., Gruener, G., Chandrasekhar, A. J., Espiritu, B. R., Ensminger, D. C., Price, R., & Naheedy, R. (2010) · Anatomical Sciences Education · doi:10.1002/ase.184 · Cited by 33
Impact of Simulation-Based Mastery Learning on Resident Skill Managing Mechanical Ventilators
Schroedl, C. J., Frogameni, A., Barsuk, J. H., Cohen, E. R., Sivarajan, L., & Wayne, D. B. (2020) · ATS Scholar · doi:10.34197/ats-scholar.2020-0023oc · Cited by 33
Holland, J., O’Sullivan, R., & Arnett, R. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0452-9 · Cited by 33
Student assessment by objective structured examination in a neurology clerkship
Lukas, R. V., Adesoye, T., Smith, S. G., Blood, A. D., & Brorson, J. R. (2012) · Neurology · doi:10.1212/wnl.0b013e3182648ba1 · Cited by 33
Peer assessment as a method for facilitating cross-sector learning: A national pilot
Clymer, F., & Gibson, D. (2022) · Pharmacy Education · doi:10.46542/pe.2022.221.595608 · Cited by 32
Odongo, C. O., & Talbert‐Slagle, K. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1845-y · Cited by 32
Risavi, B. L., Terrell, M., Lee, W., & Holsten, D. L. (2013) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x13000241 · Cited by 32
Kumar, A., Nestel, D., East, C. E., Hay, M., Lichtwark, I. T., McLelland, G., Bentley, D., Hall, H. G., Fernando, S., Hobson, S. R., et al. (2017) · Australian and New Zealand Journal of Obstetrics and Gynaecology · doi:10.1111/ajo.12659 · Cited by 31
Roossien, L., Boerboom, T., Spaai, G. W. G., & de Vos, R. (2022) · Medical Teacher · doi:10.1080/0142159x.2022.2064736 · Cited by 30
Butler, A. C., & Raley, N. D. (2015) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-15-00236.1 · Cited by 30
Self-citationStudent use of PeerWise: A multi‐institutional, multidisciplinary evaluation
Kay, A. E., Hardy, J., & Galloway, R. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12754 · Cited by 32
Schwartz, S. M., Evans, C., & Agur, A. M. R. (2014) · Anatomical Sciences Education · doi:10.1002/ase.1508 · Cited by 29
Harindranathan, P., & Folkestad, J. (2019) · Online Learning · doi:10.24059/olj.v23i3.2057 · Cited by 30
Modelling the pre‐assessment learning effects of assessment: evidence in the validity chain
Cilliers, F. J., Schuwirth, L., & van der Vleuten, C. P. M. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04334.x · Cited by 28
Dolan, B. M., Yialamas, M. A., & McMahon, G. T. (2015) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-14-00571.1 · Cited by 28
Spreckelsen, C., & Juenger, J. (2017) · BMC Medical Education · doi:10.1186/s12909-017-1016-y · Cited by 28
The future of online testing and assessment: question quality in MOOCs
Costello, E., Holland, J., & Kirwan, C. (2018) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-018-0124-z · Cited by 33
Lufler, R. S., Lazarus, M. D., & Stefanik, J. J. (2019) · Anatomical Sciences Education · doi:10.1002/ase.1872 · Cited by 28
Twelve tips on guiding preparation for both high-stakes exams and long-term learning
Sein, A. S., Dathatri, S., & Bates, T. A. (2020) · Medical Teacher · doi:10.1080/0142159x.2020.1828570 · Cited by 28
Twelve tips for introducing very short answer questions (VSAQs) into your medical curriculum
Bala, L., Westacott, R. J., Brown, C., & Sam, A. H. (2022) · Medical Teacher · doi:10.1080/0142159x.2022.2093706 · Cited by 28
Cumulative assessment: strategic choices to influence students’ study effort
Kerdijk, W., Tio, R. A., Mulder, B. F., & Cohen‐Schotanus, J. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-172 · Cited by 27
Gahutu, J. B. (2010) · AJP Advances in Physiology Education · doi:10.1152/advan.00093.2009 · Cited by 27
Adaptive instruction and learner interactivity in online learning: a randomized trial
Warner, D. O., Nolan, M. B., García‐Marcinkiewicz, A. G., Schultz, C. R., Warner, M. A., Schroeder, D. R., & Cook, D. A. (2019) · Advances in Health Sciences Education · doi:10.1007/s10459-019-09907-3 · Cited by 28
Commentary: Assessment Is an Educational Tool
Krupat, E., & Dienstag, J. L. (2009) · Academic Medicine · doi:10.1097/acm.0b013e31819f7fb9 · Cited by 27
Characterizing the literature on validity and assessment in medical education: a bibliometric study
Young, M. E., St‐Onge, C., Xiao, J., Lachiver, É. V., & Torabi, N. (2018) · Perspectives on Medical Education · doi:10.1007/s40037-018-0433-x · Cited by 29
Using Semantic Technologies for Formative Assessment and Scoring in Large Courses and MOOCs
Lancho, M. S., Benítez, M. H., Paniagua, Á. S.-E., Encabo, J. M. L., & Jorge‐Botana, G. (2018) · Journal of Interactive Media in Education · doi:10.5334/jime.468 · Cited by 26
The impact of wearing scrubs on contextual learning
Finn, G. M., Patten, D., & McLachlan, J. C. (2010) · Medical Teacher · doi:10.3109/01421590903437196 · Cited by 26
A Neurology Clerkship Curriculum Using Video-Based Lectures and Just-in-Time Teaching (JiTT)
Dominguez, M., DiCapua, D. B., Leydon, G., Loomis, C., Longbrake, E. E., Schaefer, S. M., Becker, K. P., Detyniecki, K., Gottschalk, C. H., Salardini, A., et al. (2018) · MedEdPORTAL · doi:10.15766/mep_2374-8265.10691 · Cited by 26
Competency and confidence in ECG interpretation among medical students
Vishnevsky, G., Cohen, T., Elitzur, Y., & Reis, S. P. (2022) · International Journal of Medical Education · doi:10.5116/ijme.6372.2a55 · Cited by 25
Mehta, A., Brooke, N., Puskar, A., Woodson, M. C. C., Masi, B., Wallon, R. C., & Greeley, D. A. (2023) · Medical Science Educator · doi:10.1007/s40670-023-01839-3 · Cited by 25
Improving the impact of didactic resident training with online spaced education
Gyorki, D. E., Shaw, T. J., Nicholson, J., Baker, C., Pitcher, M. E., Skandarajah, A. R., Segelov, E., & Mann, G. B. (2013) · ANZ Journal of Surgery · doi:10.1111/ans.12166 · Cited by 25
Lee, M. S., Pusic, M. V., Carrière, B., Dixon, A., Stimec, J., & Boutis, K. (2019) · AEM Education and Training · doi:10.1002/aet2.10329 · Cited by 25
Suhoyo, Y., Schönrock-Adema, J., Rahayu, G. R., Kuks, J. B. M., & Cohen‐Schotanus, J. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.917160 · Cited by 26
Muzyk, A. J., Fuller, S. H., Jiroutek, M. R., Grochowski, C. O., Butler, A. C., & May, D. B. (2015) · Pharmacy Education · Cited by 24
Self-citationFatima, S. S., Ghias, K. K., Jabeen, K., & Sabzwari, S. R. (2019) · Cureus · doi:10.7759/cureus.3832 · Cited by 24
Implications of multiple-choice testing in nursing education
Bailey, P. H., Mossey, S., Moroso, S., Cloutier, J. D., & Love, A. (2011) · Nurse Education Today · doi:10.1016/j.nedt.2011.09.011 · Cited by 24
Continuous Assessment Improved Academic Achievement and Satisfaction of Psychology Students in Spain
Carrillo‐de‐la‐Peña, M. T., & Pérez, J. (2011) · Teaching of Psychology · doi:10.1177/0098628311430312 · Cited by 24
Hernick, M. (2015) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe79797 · Cited by 25
Wallihan, R. G., Smith, K. G., Hormann, M. D., Donthi, R. R., Boland, K. A., & Mahan, J. D. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1366-0 · Cited by 25
Spaced education and student learning: Results from a medical school
Chugh, P. K., & Tripathi, C. (2020) · The Clinical Teacher · doi:10.1111/tct.13180 · Cited by 23
Quiz-Based Microlearning at Scale: a Rapid Educational Response to COVID-19
Triana, A. J., White-Dzuro, C. G., Siktberg, J. C., Fowler, B. D., & Miller, B. M. (2021) · Medical Science Educator · doi:10.1007/s40670-021-01406-8 · Cited by 23
Samarasekera, D. D., Yeo, S. P., Yeo, S. P., & Ponnamperuma, G. G. (2022) · Korean journal of medical education · doi:10.3946/kjme.2022.216 · Cited by 23
Effectiveness of Web‐Based Teaching Modules: Test‐Enhanced Learning in Dental Education
Jackson, T. H., Hannum, W. H., Koroluk, L. D., & Proffit, W. R. (2011) · Journal of Dental Education · doi:10.1002/j.0022-0337.2011.75.6.tb05105.x · Cited by 23
Revisiting ‘Effectiveness of problem‐based learning curricula: theory, practice and paper darts’
Norman, G. R., & Schmidt, H. G. (2016) · Medical Education · doi:10.1111/medu.12800 · Cited by 29
Test-Enhanced E-Learning Strategies in Postgraduate Medical Education: A Randomized Cohort Study
DelSignore, L. A., Wolbrink, T. A., Zurakowski, D., & Burns, J. P. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6199 · Cited by 26
Longitudinal assessments in continuing specialty certification and lifelong learning
Price, D. W., Swanson, D. B., Irons, M., & Hawkins, R. E. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1471202 · Cited by 23
Daelmans, H. E. M., der Vossen, M. M., Croiset, G., & Kusurkar, R. A. (2016) · International Journal of Medical Education · doi:10.5116/ijme.5689.3c7f · Cited by 23
A summer prematriculation program to help students succeed in medical school
Schneid, S. D., Apperson, A., Laiken, N., Mandel, J., Kelly, C. J., & Brandl, K. (2018) · Advances in Health Sciences Education · doi:10.1007/s10459-017-9808-8 · Cited by 24
Dutt, D. D. C. S., Razavi, H., & Carr, S. (2023) · Medical Education Online · doi:10.1080/10872981.2023.2258633 · Cited by 22
Thompson, A. R., Kelso, R. S., Ward, P. J., Wines, K., & Hanna, J. B. (2016) · Medical Science Educator · doi:10.1007/s40670-016-0306-z · Cited by 22
Cheung, J. J. H., & Kulasegaram, K. M. (2022) · Advances in Health Sciences Education · doi:10.1007/s10459-022-10174-y · Cited by 22
The spacing effect: Improving electrocardiogram interpretation
Cunningham, J. M., Johnson, M., Kincaid, T., Christensen, W., Baker, J., Turbyfill, W., & Adams, J. E. (2023) · The Clinical Teacher · doi:10.1111/tct.13626 · Cited by 22
How much of the paediatric core curriculum do medical students remember?
Sullivan, P. B., Gregg, N., Adams, E., Rodgers, C. J., & Hull, J. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9375-y · Cited by 22
What is more effective: a daily or a weekly formative test?
Palmen, L. N., Vorstenbosch, M. A. T. M., Tanck, E., & Kooloos, J. G. M. (2015) · Perspectives on Medical Education · doi:10.1007/s40037-015-0178-8 · Cited by 23
Berger, A. C., Johnson, S. G., Beachy, S. H., & Olson, S. (2015) · Cited by 22
Vorstenbosch, M. A. T. M., Bouter, S., van den Hurk, M. M., Kooloos, J. G. M., Bolhuis, S. M., & Laan, R. (2013) · Anatomical Sciences Education · doi:10.1002/ase.1382 · Cited by 22
Science: the slow march of accumulating evidence
Picho, K., Maggio, L. A., & Artino, A. R. (2016) · Perspectives on Medical Education · doi:10.1007/s40037-016-0305-1 · Cited by 22
Impact of Virtual Patients as Optional Learning Material in Veterinary Biochemistry Education
Kleinsorgen, C., von Köckritz‐Blickwede, M., Naim, H. Y., Branitzki‐Heinemann, K., Kankofer, M., Mándoki, M., Adler, M., Tipold, A., & Ehlers, J. P. (2017) · Journal of Veterinary Medical Education · doi:10.3138/jvme.1016-155r1 · Cited by 22
Abbott, E., Thompson, W. S., Pandian, T. K., Zendejas, B., Farley, D. R., & Cook, D. A. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001924 · Cited by 24
Multiple-Choice and Short-Answer Quizzing on Equal Footing in the Classroom
McDaniel, M. A., & Little, J. L. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108235631.020 · Cited by 25
Bekkink, M. O., Donders, R. A. R. T., van Muijen, G. N. P., & Ruiter, D. J. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9291-6 · Cited by 22
Harris, J. M., & Sun, H. (2013) · Academic Medicine · doi:10.1097/acm.0b013e31829e7ec6 · Cited by 22
Skinner, T. A. A., Ho, L., & Touma, N. J. (2017) · Canadian Urological Association Journal · doi:10.5489/cuaj.4132 · Cited by 21
Guimarães, B., Ribeiro, J. C., Cruz, B., Ferreira, A., Alves, H., Cruz-Correia, R. J., Madeira, M. D., & Ferreira, M. A. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1720 · Cited by 21
Testing Test-Enhanced Continuing Medical Education: A Randomized Controlled Trial
Feldman, M. L., Fernando, O., Wan, M., Martimianakis, M. A., & Kulasegaram, K. M. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002377 · Cited by 21
Metadata
- Authors
- Larsen, D. P., Butler, A. C., & Roediger III, H. L.
- Affiliations
- Washington University in St. Louis (US)
- Corresponding author
- Larsen, Douglas P
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2008-09-15
- Volume
- 42
- Issue
- 10
- Pages
- 959-966
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2152957004
- Semantic Scholar
- 5348cd3116e8b3ecb6a37d9cb0f0719582f24cd4
- Cited by
- 610
- References
- 48
- Citations by year
- 2026: 27 · 2025: 24 · 2024: 23 · 2023: 37 · 2022: 49 · 2021: 42 · 2020: 41 · 2019: 51 · 2018: 54 · 2017: 36 · 2016: 42 · 2015: 39 · 2014: 24 · 2013: 38 · 2012: 29
- FWCI
- 17.81
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Medical Education (publishedVersion)
- PubMed (publishedVersion)
- Funders
- James S. McDonnell Foundation
- Washington University in St. Louis
- Institute of Education Sciences (R305H060080)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- retrieval practice, testing effect, spaced repetition, memory retention, feedback, clinical knowledge, assessment
- MeSH terms
- Education, Medical, Educational Measurement, Memory, Students, Medical, Time Factors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
