The DOI matches its Crossref record; 17 of the 18 references it cites were found in a registry or an index.
Repeated testing improves long‐term retention relative to repeated study: a randomised controlled trial
Abstract
Context Laboratory studies in cognitive psychology with relatively brief final recall intervals suggest that repeated retrieval in the form of tests may result in better retention of information compared with repeated study. Objectives Our study evaluates if repeated testing of material taught in a real‐life educational setting (a didactic conference for paediatric and emergency medicine residents) replicates these findings when measured at a more educationally relevant final recall interval of 6 months. Methods Residents participated in an interactive teaching session on two topics: (i) status epilepticus, and (ii) myasthenia gravis. Residents were randomised to two counter‐balanced groups which either took tests on status epilepticus and studied a review sheet on myasthenia gravis (SE‐T/MG‐S group) or took tests on myasthenia gravis and studied a review sheet on status epilepticus (MG‐T/SE‐S group). Testing and studying occurred immediately after teaching and then at two additional times at intervals of about 2 weeks. Residents received feedback after each test. Tests consisted of short‐answer questions and the review sheets consisted of information identical to that on the answer sheets for the tests. At about 6 months residents took a final test on both topics. Results Nineteen residents in the SE‐T/MG‐S group and 21 residents in the MG‐T/SE‐S group completed the study. Collapsing across groups, repeated testing produced final test scores that were an average of 13% higher than those produced by repeated study (39% versus 26%) at > 6 months after the initial teaching session (t[78] = 3.93, standard error of the difference = 0.03, P < 0.001, d = 0.91). Conclusions Repeated testing with feedback appears to result in significantly greater long‐term retention of information taught in a didactic conference than repeated, spaced study. Testing should be considered for its potential impact on learning and not only as an assessment device.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This effect, though, is also readily found in elementary school children (Fazio & Marsh 2019, Karpicke et al. 2016), in middle school (Roediger et al. 2011a) and high school students ( McDermott et al. 2014a), in college classrooms (Lyle & Crawford 2011, Mayer et al. 2009), and in medical students (Larsen et al. 2009).Older adults, too, can benefit from retrieval practice (Meyer & Logan 2013, Rog”
From Practicing Retrieval Facilitates Learning (2021) · cites this paper as Larsen et al. 2009
In the citing paper
“In the context of medical education, Larsen et al. [39] found that spaced quizzes on anatomy led to markedly better test performance compared to single assessments, demonstrating the advantages of frequent retrieval practice over time.”
From Formative assessment and feedback in medical education: A practical guide: AMEE Guide No. 189 (2026) · cites this paper as [39]
In the citing paper
“For example, randomized controlled trials demonstrate that repeated testing promotes better retention of information than repeated studying, a phenomenon known as the testing effect.3,4”
From Effect of repeated/spaced formative assessments on medical school final exam performance (2017) · cites this paper as [4]
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Test-enhanced learning in medical education
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03124.x · Cited by 610
Self-citationTesting the testing effect in the classroom
McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326154 · Cited by 563
Reifler, B. V. (1982) · Social Science & Medicine · doi:10.1016/0277-9536(82)90250-7 · Cited by 457
Testing improves long-term retention in a simulated classroom setting
Butler, A. C., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326097 · Cited by 434
Self-citationKarpicke, J. D., & Roediger, H. L. (2007) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.33.4.704 · Cited by 421
Albanese, M. (2000) · Medical Education · doi:10.1046/j.1365-2923.2000.00753.x · Cited by 418
The effect of testing on skills learning
Kromann, C. B., Jensen, M. L., & Ringsted, C. (2009) · Medical Education · doi:10.1111/j.1365-2923.2008.03245.x · Cited by 315
Research works printed but not linked: 1
- Accreditation Council for Graduate Medical Education, 2007, Common Program Requirements
Cited by
Sorted by citations
Items 301–382 of 382
Mapping the Nephron Exercise Incorporates Multiple Learning Strategies
Hopper, M. K., Anderson, M. A., & Lipp, S. N. (2017) · MedEdPORTAL · doi:10.15766/mep_2374-8265.10635 · Cited by 1
Examination of Different Learning Conditions in the Testing Effect: Example of Safe Internet Use
Ucar-Longford, B., & Çevik, Y. D. (2018) · Bartın University Journal of Faculty of Education · doi:10.14686/buefad.322792 · Cited by 1
Johnson, R. C., Johnson, C. W., Vijayan, S., Tata, D. V., & Villegas, R. (2018) · Journal of College Student Retention Research Theory & Practice · doi:10.1177/1521025118779803 · Cited by 1
The Role of Simulation in Safety and Training
Fehr, J. J., & Pessach, I. M. (2014) · Springer eBooks · doi:10.1007/978-1-4939-1390-9_35 · Cited by 1
Neumann, J., Simmrodt, S., & Gergs, U. (2020) · Education Research International · doi:10.1155/2020/6273806 · Cited by 1
Kaur, K., Singh, S., & Combs, K. (2018) · Cited by 1
Parasram, M., Loiseau, S. Y., Yoo, A. S., Stone, J. B., Ch’ang, J. H., & Robbins, M. S. (2024) · Neurology Education · doi:10.1212/ne9.0000000000200119 · Cited by 1
Realizing Academic Success Within the Health Science Learning Environment
Petersen, K. H., O’Connor, C. H., Ciesielski, S., & Eidtson, W. H. (2020) · Springer eBooks · doi:10.1007/978-3-030-46187-4_6 · Cited by 2
Mbako, M. K. (2020) · The International Journal of Humanities & Social Studies · doi:10.24940/theijhss/2020/v8/i10/hs2010-064 · Cited by 1
Comprehensive E-Learning Appraisal System
Antón, J. L. M., Soriano, J. V. I., Martinez, M. I. A., & García, F. B. (2018) · Advances in medical diagnosis, treatment, and care (AMDTC) book series · doi:10.4018/978-1-5225-7489-7.ch023 · Cited by 1
Comprehensive E-Learning Appraisal System
Antón, J. L. M., Soriano, J. V. I., Martinez, M. I. A., & García, F. B. (2017) · IGI Global eBooks · doi:10.4018/978-1-5225-2255-3.ch503 · Cited by 1
Integrating overconfidence and overclaiming : exaggeration harms performance
Dubois, P. J. (2021) · cIRcle (University of British Columbia) · doi:10.14288/1.0401810 · Cited by 1
Entwicklung von klinischem Denken bei Medizinstudierenden im Laufe des klinischen Studienabschnittes
de Temple, I. A. (2022) · doi:10.53846/goediss-9394 · Cited by 1
Optimizing learning through retrieval practice and spacing
Carpenter, S. K. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-818630-5.14078-3 · Cited by 2
Pillai, B., & Reejhsinghani, R. S. (2023) · Research Square · doi:10.21203/rs.3.rs-2440656/v1 · Cited by 1
Encoding-Retrieval Relationships in Episodic Memory: A Functional Neuroimaging Perspective
Wing, E. A. (2015) · DukeSpace (Duke University)
Brain Areas Involved in the Retrieval of Updated Memories : The Long-Term Effects
Öhlund, M. (2010) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Hurley, D. (2010) · Neurology Today · doi:10.1097/01.nt.0000383483.99653.34
TESTING EFFECT AND COMPLEX COMPREHENSION IN A LARGE INTRODUCTORY UNDERGRADUATE BIOLOGY COURSE
Pagliarulo, C. (2011) · UA Campus Repository (The University of Arizona)
Article A Deliberate Practice Approach to Teaching Phylogenetic Analysis
Hobbs, F. C., Johnson, D. J., Kearns, K. D., & Miller, K. R. (2013)
Learning through Osmosis: A collaborative platform for medical
Haynes, R., Gaglani, S. M., Wilcox, M. V., Mitchell, T. R., DeLeon, V. B., & Goldberg, H. R. (2014)
Using a recognition memory paradigm to assess student retention of course material
Nagle, C. (2015) · OpenBU (Boston University)
Delivering Training Assessments in a Soldier Centered Learning Environment: Year One
Brusso, R. C., Barnieu, J., Huang, J., Lodato, M. A., Mulvaney, R., Cummings, P. W., Zoellick, C., Thieme, K., & Spain, R. D. (2014)
Can Item Keyword Feedback Help Remediate Knowledge Gaps?
Feinberg, R. A., & Clauser, A. L. (2016) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-15-00463.1
Making Sense of Intercultural Interaction
Dunsmore, K. (2014) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-4666-5816-5.ch007
Infusing Automatic Question Generation with Natural Language Understanding
Mazidi, K. (2016) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc955021
Enhancing Diagnostic Accuracy in Oral Radiology: A Case for the Basic Sciences
Baghdady, M. T. (2013) · TSpace (University of Toronto)
Roediger, H. L., III (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.07.004
Hotta, C. (2015) · The Japanese Journal of Special Education · doi:10.6033/tokkyou.53.143
Face Symmetry Assessment: Educational and Clinical Implications of Expertise in Orthodontists
Jackson, T. H. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/rme4-tw29
Diş Hekimliği Eğitiminde Beceri ve Yeterliğin Değerlendirilmesi I: Kontrol Listeleri ve Ölçekler
Akaltan, F. (2019) · Selcuk Dental Journal · doi:10.15311/selcukdentj.562508
Piters, W. A. A. D. S., Frenkel, J., Brand, P. L. P., & Raphaël, M. F. (2014) · Medical Education · doi:10.1111/medu.12593
The effect of intentionality on verbal memory assessment over days
Kochhann, R., Beber, B. C., Ferreira, P. C. D. S., Holz, M. R., Ruschel, R., de Pádua, A. C., Godinho, C., Izquierdo, I., & Chaves, M. L. F. (2020) · Dementia & Neuropsychologia · doi:10.1590/1980-57642020dn14-040006 · Cited by 2
Pattana: An Online Course Learning Outcome Assessment Application
Sajjacholapunt, P., Permpholphattana, S., Sariyarsheeva, K., Phanphila, P., & Jatuviriyapornchai, W. (2020) · doi:10.1109/incit50588.2020.9310939
Additional Benefits of Incorporating Retrieval Practice Into Teaching Rounds
Nelson, A. (2021) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-20-01478.1
Prior Learning and the Efficacy of Retrieval PracticePreprint
Gupta, M. W., Pan, S. C., & Rickard, T. C. (2021) · doi:10.31234/osf.io/eqn29
Improving Learning: Underlying Factors And Suggestions To Improve Learning In Health Profession
Fatima, F., & Sultana, S. (2019) · Journal of Bahria University Medical and Dental College · doi:10.51985/jbumdc2019021
Playing With Your Phone in Class
Brewer, J. L., Lampotang, S., Algarra, N. N., & Teker, G. T. (2021) · American Journal of Medical Quality · doi:10.1097/01.jmq.0000743380.79942.41
Nebel, C. L., & Sumeracki, M. A. (2022) · Innovation and change in professional education · doi:10.1007/978-3-030-85524-6_1 · Cited by 1
Ludwig, S. (2022) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-9217
Neumann, J., Simmrodt, S., Bader, B., Opitz, B., & Gergs, U. (2021) · doi:10.2196/preprints.27179
Cumulative assessment: Does it improve students’ knowledge acquisition and retention?
Cecílio‐Fernandes, D., Nagtegaal, M., Noordzij, G., & Tio, R. A. (2018) · Scientia Medica · doi:10.15448/1980-6108.2018.4
Holmes, J. D. (2016) · Wiley eBooks · doi:10.1002/9781118760499.ch11
Educational Approaches That Enhance Online Clinical Clerkship during the COVID-19 Pandemic
Kuroda, N., Suzuki, A., Ozawa, K., Nagai, N., Okuyama, Y., Koshiishi, K., YAMADA, M., Raita, Y., Kakisaka, Y., Nakasato, N., et al. (2022) · Internal Medicine · doi:10.2169/internalmedicine.9291-21
Toward a Solutions Approach to the Problem of Black Underrepresentation in STEM
Norman, O., Pinder, P. J., Ragland, S., Shelley, M., Norman, N., & Shakwa, G. (2022) · Diversity in higher education · doi:10.1108/s1479-364420220000025002
Improving Mathematical Problem Solving in an Introductory Engineering Course With the Testing Effect
Morphew, J. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1431147
Impact of LMS-mediated readiness assurance testing on performance in pharmacy calculations
Bell, E. C. (2022) · Discover Education · doi:10.1007/s44217-022-00024-9
Comments on: Note-taking and note-making: The ever-cherished art!
Mekala, P., & Kalva, P. (2023) · Indian Journal of Ophthalmology · doi:10.4103/ijo.ijo_711_23
Semantic relatedness and the efficacy of retrieval practice
Gupta, M. W., Pan, S. C., & Rickard, T. C. (2026) · npj Science of Learning · doi:10.1038/s41539-026-00416-8
Shifting Our Focus in Medical Education
Larsen, D. P. (2024) · Neurology Education · doi:10.1212/ne9.0000000000200153
Self-citationMasters, S. E., Howard, K. K., Foote, D. C., Halka, J., Studzinski, D. M., Callahan, R. E., Ivascu, F. A., & Akay, B. (2025) · The American Surgeon · doi:10.1177/00031348251318381
Mennyit felejtenek az orvostanhallgatók?
Csaba, G., Füzesi, Z., & Csathó, Á. (2025) · Orvosi Hetilap · doi:10.1556/650.2025.33246 · Cited by 2
Saricilar, E. C., Massri, N. E., Meares, A., Chapuis, P. H., & Burgess, A. W. (2025) · The Clinical Teacher · doi:10.1111/tct.70141
Medical Simulation and Pediatric Sedation
Caplan, L. A., & Young, D. A. (2025) · Springer eBooks · doi:10.1007/978-3-031-68468-5_39
Daily Text-Message Retrieval Practice for Pediatric Residents
Nelson, A., Broder, M., Schwartz, A., Thomas, C., & Abramson, E. L. (2025) · Cureus · doi:10.7759/cureus.95568
The Benefits of Testing: Individual Differences Based on Student FactorsPreprint
Dougherty, M. R. P., & Robey, A. (2016) · OSF Preprints (OSF Preprints)
Oral examination as a tool for mastery learning in undergraduate microbiology
James, A. R. S., & Widener, C. (2026) · FEMS Microbiology Letters · doi:10.1093/femsle/fnag010
Morgan, M., Helms, J. T., & Lane, T. S. (2026) · Journal of Rehabilitation Practices and Research · doi:10.33790/jrpr1100192
Khordastan, F., Zeinalzadeh, A., Emadzadeh, A., & Aalaei, S. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09501-3
Cleary, A. M., & Robinson, D. H. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10188-7
Powers, D. B., & Mehra, P. (2026) · Oral Surgery Oral Medicine Oral Pathology and Oral Radiology · doi:10.1016/j.oooo.2026.06.010
Yokota, T., Matsunaga, T., Hatanaka, N., & Toyoda, H. (2026) · Dentistry Journal · doi:10.3390/dj14070461
Callahan, R. T., Boudreaux, K. A., Chigerwe, M., Al‐Nadaf, S., Rebhun, R. B., Skorupski, K. A., & Lejeune, A. T. (2026) · Journal of Veterinary Medical Education · doi:10.3138/jvme-2025-0060
DiLorenzo, A. N. (2026) · Anesthesiology Clinics · doi:10.1016/j.anclin.2026.06.012
Wang, Y., Wang, Y.-H., Yang, X., Cai, S., & Li, J. (2026) · BMC Medical Education · doi:10.1186/s12909-026-10032-0
Jain, J., Jain, H., & J, A. M. (2026) · International Journal of Health Sciences and Research · doi:10.52403/ijhsr.20260817
Xie, J., Shao, J., Wang, C., Shi, X., Miao, Q., Yip, C. C., & Ye, J. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1934529
Introducing GABLE: Lightweight infrastructure for longitudinal experiments using Google Apps Script
Berber, I., Kaş, İ., Sepuri, T., Macnamara, B. N., Çavuşoğlu, M. C., Wilson‐Delfosse, A. L., Krupinski, E. A., Smith, P. J., & Ray, S. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03205-8
Dobson, J. L. (2026) · Exercise Sport and Movement · doi:10.1249/esm.0000000000000074
Metadata
- Authors
- Larsen, D. P., Butler, A. C., & Roediger III, H. L.
- Affiliations
- Washington University in St. Louis (US)
- Corresponding author
- Larsen, Douglas P
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2009-11-17
- Volume
- 43
- Issue
- 12
- Pages
- 1174-1181
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2154424209
- Cited by
- 383
- References
- 18
- Citations by year
- 2026: 18 · 2025: 19 · 2024: 16 · 2023: 26 · 2022: 32 · 2021: 32 · 2020: 30 · 2019: 33 · 2018: 30 · 2017: 15 · 2016: 22 · 2015: 29 · 2014: 25 · 2013: 19 · 2012: 16
- FWCI
- 5.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Education (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- retesting, retrieval practice, long-term retention, feedback, medical residents, status epilepticus, myasthenia gravis
- MeSH terms
- Clinical Competence, Educational Measurement, Humans, Retention, Psychology, Teaching, Time Factors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review