Student-directed retrieval practice is a predictor of medical licensing examination performance
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Introduction A large body of evidence indicates that retrieval practice (test-enhanced learning) and spaced repetition increase long-term information retention. Implementation of these strategies in medical curricula is unfortunately limited. However, students may choose to apply them autonomously when preparing for high-stakes, cumulative assessments, such as the United States Medical Licensing Examination Step 1. Methods Seventy-two medical students at one institution completed a survey concerning their use of user-generated (Anki) or commercially-available (Firecracker) flashcards intended for spaced repetition and of boards-style multiple-choice questions (MCQs). Other information collected included Step 1 score, past academic performance (Medical College Admission Test [MCAT] score, preclinical grades), and psychological factors that may have affected exam preparation or performance (feelings of depression, burnout, and test anxiety). Results All students reported using practice MCQs (mean 3870, SD 1472). Anki and Firecracker users comprised 31 and 49 % of respondents, respectively. In a multivariate regression model, significant independent predictors of Step 1 score included MCQs completed (unstandardized beta coefficient [B] = 2.2 × 10− 3, p < 0.001), unique Anki flashcards seen (B = 5.9 × 10− 4, p = 0.024), second-year honours (B = 1.198, p = 0.002), and MCAT score (B = 1.078, p = 0.003). Conclusions Medical students engage extensively in self-initiated retrieval practice, often with spaced repetition. These practices are associated with superior performance on a medical licensing examination and should be considered for formal support by educators.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · cited 1×
“[2].”
West, C. P., Dyrbye, L. N., Sloan, J. A., & Shanafelt, T. D. (2009) · Journal of General Internal Medicine · doi:10.1007/s11606-009-1129-z · Cited by 725
Test-enhanced learning in medical education
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03124.x · Cited by 610 · cited 1×
“[4].”
Self-citationTest format and corrective feedback modify the effect of testing on long-term retention
Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440601056620 · Cited by 513
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03518.x · Cited by 383
Self-citationDevelopment of a Short Form of the Test Anxiety Inventory (TAI)
Taylor, J., & Deane, F. P. (2002) · The Journal of General Psychology · doi:10.1080/00221300209603133 · Cited by 147
Cited by
A review of the benefits and drawbacks of high-stakes final examinations in higher education
French, S., Dickerson, A., & Mulder, R. A. (2024) · Higher Education · doi:10.1007/s10734-023-01148-z · Cited by 126
Conceptualising spaced learning in health professions education: A scoping review
Versteeg, M., Hendriks, R. A., Thomas, A., Ommering, B. W. C., & Steendijk, P. (2020) · Medical Education · doi:10.1111/medu.14025 · Cited by 107
Gilbert, M. M., Frommeyer, T. C., Brittain, G. V., Stewart, N. A., Turner, T. M., Stolfi, A., & Parmelee, D. (2023) · Medical Science Educator · doi:10.1007/s40670-023-01826-8 · Cited by 56
The Evolving Importance of Artificial Intelligence and Radiology in Medical Trainee Education
Fischetti, C., Bhatter, P., Frisch, E., Sidhu, A., Helmy, M., Lungren, M., & Duhaime, E. (2022) · Academic Radiology · doi:10.1016/j.acra.2021.03.023 · Cited by 47
Metadata
- Authors
- Deng, F., Gluckstein, J. A., & Larsen, D. P.
- Venue
- Perspectives on Medical Education
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2015-10-23
- Volume
- 4
- Issue
- 6
- Pages
- 308-313
- ISSN
- 2212-2761 (ISSN-L)
- 2212-277X
- OpenAlex
- W2179973352
- Cited by
- 130
- References
- 8
- FWCI
- 2.26
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Student-directed retrieval practice is a predictor of medical licensing examination performance. https://app.cochat.ai/papers/10.1007/s40037-015-0220-x
- The paper
- Deng, F., Gluckstein, J. A., & Larsen, D. P. (2015). Student-directed retrieval practice is a predictor of medical licensing examination performance. Perspectives on Medical Education. https://doi.org/10.1007/s40037-015-0220-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.