The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Retrieving Essential Material at the End of Lectures Improves Performance on Statistics Exams
Abstract
At the end of each lecture in a statistics for psychology course, students answered a small set of questions that required them to retrieve information from the same day’s lecture. These exercises constituted retrieval practice for lecture material subsequently tested on four exams throughout the course. This technique is called the PUREMEM (pronounced “pure mem”) procedure for Pure Memory or Practicing Unassisted Retrieval to Enhance Memory for Essential Material. Exam scores were significantly and substantially higher in a section of the course taught with the PUREMEM procedure than one taught without it. Students liked the procedure and believed it increased learning via several different mechanisms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similar benefits of in-class quizzes in college classes have been seen in a Psychology Research Methods class (Bjork et al. 2014), in an Introductory Psychology class (Batsell et al. 2017), and in a Statistics for Psychology class (Lyle & Crawford 2011), all of them at large state universities.”
From Practicing Retrieval Facilitates Learning (2021) · cites this paper as Lyle & Crawford 2011
Citations
Cites
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Test format and corrective feedback modify the effect of testing on long-term retention
Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440601056620 · Cited by 513
Testing improves long-term retention in a simulated classroom setting
Butler, A. C., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326097 · Cited by 434
Generalizing test-enhanced learning from the laboratory to the classroom
Mcdaniel, M. A., Roediger, H. L., & Mcdermott, K. B. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194052 · Cited by 326
Recitation As a Factor in Memorizing
Gates, A. I. (2010) · Medical Entomology and Zoology · Cited by 310
The Exam-A-Day Procedure Improves Performance in Psychology Classes
Leeming, F. C. (2002) · Teaching of Psychology · doi:10.1207/s15328023top2903_06 · Cited by 222
Benefits of Prelecture Quizzes
Narloch, R., Garbin, C. P., & Turnage, K. D. (2006) · Teaching of Psychology · doi:10.1207/s15328023top3302_6 · Cited by 82
The Impact of Daily Extra Credit Quizzes on Exam Performance
Padilla‐Walker, L. M. (2006) · Teaching of Psychology · doi:10.1207/s15328023top3304_4 · Cited by 50
Introductory Psychology Student Performance: Weekly Quizzes Followed by a Cumulative Final Exam
Landrum, R. E. (2007) · Teaching of Psychology · doi:10.1080/00986280701498566 · Cited by 27
Flagged first, then by citations
Research works printed but not linked: 2
- Gates A. I., 1917, Archives of Psychology, 6
- Jones H. E., 1923, Archives of Psychology, 10, 1
Cited by
Sorted by citations
Items 101–180 of 180
Show Me the Mastery Learning! Obstacles to Adoption and Opportunities for New Solutions
Álvarez, C., Falkner, N., Kinnunen, P., Šavelka, J., & Zhang, L. (2025) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3724363.3729104 · Cited by 8
Shah, I. H., Lyn, A. A. Y., Morlet, G. M., & Rageth, L. (2024) · SAGE Open · doi:10.1177/21582440241240844 · Cited by 9
Λάππα, Χ. Σ., & Mantzikos, C. (2021) · IJPTE International Journal of Pedagogy and Teacher Education · doi:10.20961/ijpte.v5i1.54526 · Cited by 7
Using quizzes to assess and enhance learning of English as a foreign language
Manzano, M., Diego, C., & Fernández-Sánchez, A. (2017) · Revista Española de Lingüística Aplicada/Spanish Journal of Applied Linguistics · doi:10.1075/resla.30.1.13san · Cited by 6
Putnam, A. L., & Roediger, H. L., III (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn106 · Cited by 7
Nursing students' experiences with test-enhanced learning in teams: A cross-sectional study.
Emblemsvåg, M. S. (2024) · Nurse Education Today · doi:10.1016/j.nedt.2024.106188 · Cited by 6
Introducing desirable difficulty in STEM barrier courses with spaced retrieval practice
Bego, C. R., Lyle, K. B., Immekus, J. C., & Ralston, P. A. S. (2021) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie49875.2021.9637192 · Cited by 6
Self-citationBest Management Practices for Teaching Hydrologic Coding in Physical, Hybrid, and Virtual Classrooms
Kelleher, C. A., Gannon, J. P., Jones, C. N., & Aksoy, Ş. (2022) · Frontiers in Water · doi:10.3389/frwa.2022.875732 · Cited by 5
DeMara, R. F., Chen, B., Hartshorne, R., & Zand, R. (2018) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--28182 · Cited by 5
The Impact of Integration of Self-Tests into a Pre-Clerkship Medical Curriculum
Baatar, D., Lacy, N. L., Mulla, Z. D., & Piskurich, J. F. (2016) · Medical Science Educator · doi:10.1007/s40670-016-0351-7 · Cited by 6
Murray, E., Horner, A. J., & Göbel, S. M. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10035-1 · Cited by 4
Study of Efficacy of a Novel Formative Assessment Tool: Keywords Recall
Venkatesh, K., Muthukumar, D. E., Kamala, E., & Muhil, M. (2024) · Cureus · doi:10.7759/cureus.69881 · Cited by 4
Pires, D. F., Silva, J. R. D. F., & Barbosa, M. L. D. O. (2021) · Revista de Estudios y Experiencias en Educación · doi:10.21703/rexe.20212043feliciano22 · Cited by 4
Retrieval Practice as a Learning Strategy for Diverse Populations
Ekuni, R., & Jaeger, A. (2022) · Springer eBooks · doi:10.1007/978-3-031-06908-6_15 · Cited by 6
Meier, B. (2017) · Cognitive Research Principles and Implications · doi:10.1186/s41235-017-0075-2 · Cited by 4
Retrieval Practice—A Tool to Narrow the Achievement Gap in Learning Higher Mathematics
Muzsnay, A., Szabó, C., Zámbó, C., Szabó, G., & Szeibert, J. (2025) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-025-10607-1 · Cited by 11
Leonard, L. B., Deevy, P., & Kueser, J. B. (2024) · Autism & Developmental Language Impairments · doi:10.1177/23969415241275940 · Cited by 5
Lawson, T. J. (2021) · College Teaching · doi:10.1080/87567555.2021.1910124 · Cited by 3
Spaced Retrieval Practice in Two Fundamental Engineering Courses: Calculus and Physics
Patrick, R. J., Bego, C. R., Chastain, R. J., Ralston, P. A. S., Immekus, J. C., & Lyle, K. B. (2022) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie56618.2022.9962526 · Cited by 5
Self-citationTest Format, Learning Confidence, and Perceptions of Teaching Effectiveness
Boysen, G. A., & Osgood, P. N. (2024) · Teaching of Psychology · doi:10.1177/00986283231226187 · Cited by 2
Sarfaraz, S., Surti, A., Ali, R., Rehman, R., Heboyan, A. G., & Ahmed, N. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05892-3 · Cited by 3
A autorregulação, avaliação e promoção da aprendizagem por meio da prática de recuperação da memória
Oliveira, L. H., & Stein, L. M. (2018) · Psicologia Escolar e Educacional · doi:10.1590/2175-35392018018540 · Cited by 4
Biel, R. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-814702-3.00007-x · Cited by 2
Muzsnay, A., Zámbó, C., Szeibert, J., Bernáth, L., Szilágyi, B., & Szabó, C. (2024) · European Journal of Psychology of Education · doi:10.1007/s10212-024-00869-8 · Cited by 3
Lindquist, D. S., Sparrow, B. E., & Lindquist, J. M. (2024) · Instructional Science · doi:10.1007/s11251-024-09680-w · Cited by 7
D’Ambrosio, L. M. (2024) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00110-24 · Cited by 2
Karpicke, J. D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-15754-7.00074-2 · Cited by 3
Xiaofeng, M. A., Zhou, A., Cui, D., & ZHANG, R. (2014) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2014.00279 · Cited by 2
Hopkins, R. F., Lyle, K. B., Ralston, P. A. S., Bego, C. R., & Hieb, J. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--29900 · Cited by 2
Self-citationImproving retention by placing retrieval practice at the end of class: a naturalistic study
Ekuni, R., & Pompéia, S. (2020) · Revista Latinoamericana de Psicología · doi:10.14349/rlp.2020.v52.3 · Cited by 2
Contribuições de um curso de formação continuada na inclusão de estudantes com deficiência visual
Barbosa, M. L. D. O., Costa, A. R. D. B., Rodrigues, M. R., Faria, J. C. N. D. M., & de Sabóia‐Morais, S. M. T. (2021) · Debates em educação · doi:10.28998/2175-6600.2021v13n31p67-92 · Cited by 2
Middleton, E. L., Duquette, K. L., Rawson, K. A., & Mirman, D. (2022) · Neuropsychology · doi:10.1037/neu0000848 · Cited by 2
Student-centered Education in Metaverse: Transforming the Language Listening Curriculum
Lu, X.-M., Dai, G., Tian, L., & Liu, W. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-5847-4_34 · Cited by 2
3: FOSTERING A GROWTH MIND-SET
Fisher, B. A., Dufault, C., Repice, M. D., & Frey, R. F. (2013) · To improve the academy · doi:10.1002/j.2334-4822.2013.tb00697.x · Cited by 2
Wiklund‐Hörnqvist, C. (2014) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 2
On the Scope of Digital Vocabulary Trainers for Learning in Distance Education
Winchester, S. (2015) · Open Research Online (The Open University) · doi:10.21954/ou.ro.0000b0fa · Cited by 2
Debb, S. M., & Debb, S. M. (2012) · Cited by 1
Mapping the Nephron Exercise Incorporates Multiple Learning Strategies
Hopper, M. K., Anderson, M. A., & Lipp, S. N. (2017) · MedEdPORTAL · doi:10.15766/mep_2374-8265.10635 · Cited by 1
Fiorella, L., & Mayer, R. E. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781107707085.008 · Cited by 1
Fain, R. J., Hieb, J., Ralston, P. A. S., & Lyle, K. B. (2015) · ASEE Annual Conference & Exposition · doi:10.18260/p.23660 · Cited by 1
Self-citationOpinion of Teaching staff and Students' Toward Implementation of E-exam
Saleh, N. A. (2017) · Assiut Scientific Nursing Journal · doi:10.21608/asnj.2017.58458 · Cited by 1
Testing, Testing: In-Class Testing Facilitates Transfer on Cumulative Exams
Miller, T. M., & Connot, N. (2022) · Journal of Cognitive Education and Psychology · doi:10.1891/jcep-2021-0018 · Cited by 1
Rivers, M. L., Babineau, A. L., Neely, K., & Tauber, S. K. (2023) · Teaching of Psychology · doi:10.1177/00986283231199454 · Cited by 1
I. Csernyák László konferencia közleményei
(2023) · doi:10.29180/978-615-6342-61-4 · Cited by 1
Neuroscience & Education: A bridge astray?Preprint
Dougherty, M. R. P., & Robey, A. (2018) · doi:10.31234/osf.io/z5fm6 · Cited by 1
Crawford, N. A. (2013) · doi:10.18297/etd/2280
Self-citationFlipping the Computer Engineering Gateway Courses: A Discussion of the Processes and Results
Hartshorne, R., Chen, B., Edison, J., & DeMara, R. (2016) · Society for Information Technology & Teacher Education International Conference
Infusing Automatic Question Generation with Natural Language Understanding
Mazidi, K. (2016) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc955021
Αμερικάνου, Μ., Μασούρα, Ε., Παπαγεωργίου, Β., & Μoraitou, D. (2020) · Psychology the Journal of the Hellenic Psychological Society · doi:10.12681/psy_hps.23253
Hotta, C., Kato, H., & Tajika, H. (2018) · Journal of Human Environmental Studies · doi:10.4189/shes.16.111
An analysis of using online testing modules in engineering economics
Rane, V. (2018) · Iowa State University Digital Repository (Iowa State University)
3: Fostering a Growth Mind–set
Fisher, B. A., Dufault, C., Repice, M. D., & Frey, R. F. (2013) · To improve the academy · doi:10.3998/tia.17063888.0032.007
Metz, M. J. (2021) · ThinkIR: The University of Louisville's Institutional Repository (University of Louisville) · doi:10.18297/etd/3582
Changing Gears in the Assessment Cycle
Seipel, B., Bailey, P., & Teasdale, R. (2021) · Advances in educational marketing, administration, and leadership book series · doi:10.4018/978-1-7998-8579-5.ch008
Yang, L. (2022) · Advances in Educational Technology and Psychology · doi:10.23977/aetp.2022.060519
Brame, C. J. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-814702-3.00008-1
Az előhívási hatás megjelenésének lehetősége Gazdasági matematika előadáson
Erdélyi, É., Lőrincz, S., Boruzs, L. M., & Ittzés, A. (2023) · doi:10.29180/978-615-6342-61-4_18
Iqbal, A., & Lawanto, O. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--40994
Momox, E., & Cedillo-Zertuche, J. (2023) · IEEE International Conference on Social Sciences and Intelligence Management (SSIM) · doi:10.1109/ssim59263.2023.10469288
Application of Retesting as a Learning Tool in an Online Science Course
Ding, Q., & Zhu, H. (2024) · The journal of college science teaching · doi:10.1080/0047231x.2024.2338693
Retrieval practice – a tool to be able to retain higher mathematics even 3 months after the exam
Muzsnay, A., Szabó, C., & Szeibert, J. (2024) · Az Eszterházy Károly Tanárképző Főiskola tudományos közleményei. Tanulmányok a matematikai tudományok köréből/Az Eszterházy Károly Főiskola tudományos közleményei. Tanulmányok a matematikai tudományok köréből/Annales mathematicae et informaticae · doi:10.33039/ami.2024.05.002 · Cited by 3
The Promoting Effect of Retrieval Practice Effect on Students’ Learning
詹, 静. (2024) · Advances in Social Sciences · doi:10.12677/ass.2024.138708
Unpacking Students’ Emotional Experience in the Connecting Assessment of Blended Learning Context
Shurong, Z., & Junxia, S. (2025) · SAGE Open · doi:10.1177/21582440251328756
Gupta, S., & Agrawal, A. (2025) · The Nucleus · doi:10.1007/s13237-025-00580-z
Bego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678252
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678255
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678261
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678264
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678282
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678273
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678270
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678258
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678279
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678267
Self-citationBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26678276
Self-citationThe Benefits of Testing: Individual Differences Based on Student FactorsPreprint
Dougherty, M. R. P., & Robey, A. (2016) · OSF Preprints (OSF Preprints)
An, Y., & Hashmi, R. (2026) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3770761.3777185
Cleary, A. M., & Robinson, D. H. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10188-7
Embedding Better Learning: Retrieval Practice in an Embedded Systems Course
McPheron, B. D. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--59116
Metadata
- Authors
- Lyle, K. B., & Crawford, N. A.
- Affiliations
- University of Louisville (US)
- Corresponding author
- Lyle, Keith B.
- ORCID
- Lyle, Keith B.
- Venue
- Teaching of Psychology
- Publisher
- SAGE Publications
- Published
- 2011-03-23
- Volume
- 38
- Issue
- 2
- Pages
- 94-97
- ISSN
- 0098-6283 (ISSN-L)
- 1532-8023
- OpenAlex
- W2090017607
- Cited by
- 180
- References
- 9
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 25 · 2023: 11 · 2022: 11 · 2021: 14 · 2020: 8 · 2019: 17 · 2018: 17 · 2017: 12 · 2016: 14 · 2015: 13 · 2014: 8 · 2013: 9 · 2012: 7
- FWCI
- 4.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Teaching of Psychology (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Social Sciences › Education › Innovative Teaching Methods
- Keywords
- retrieval practice, statistics education, exam performance, memory enhancement, lecture method, student perceptions, statistics in psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review