Ecological Validity of the Testing Effect: The Use of Daily Quizzes in Introductory Psychology
Abstract
The testing effect is the enhanced retention of learned information by individuals who have studied and completed a test over the material relative to individuals who have only studied the material. Although numerous laboratory studies and simulated classroom studies have provided evidence of the testing effect, data from a natural class setting with motivated students are scant. The present two-class quasi-experiment explored the external validity of the testing effect in the Introductory Psychology classroom. The control class studied assigned chapters from the textbook whereas the quiz class studied chapters and completed daily quizzes on those readings. Subsequently, both classes completed exams over this textbook information. The quiz class scored significantly higher than the control class on these test questions about the textbook information; these differences were significant both when the test questions were the same as the quiz questions and when they were new, related questions from the textbook. These data suggest the use of daily quizzes to embed the testing effect into the Introductory Psychology classroom can improve student learning.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Similar benefits of in-class quizzes in college classes have been seen in a Psychology Research Methods class, an Introductory Psychology class, and a Statistics for Psychology class at large state universities.
“Similar benefits of in-class quizzes in college classes have been seen in a Psychology Research Methods class (Bjork et al. 2014), in an Introductory Psychology class (Batsell et al. 2017), and in a Statistics for Psychology class (Lyle & Crawford 2011), all of them at large state universities.”
From Practicing Retrieval Facilitates Learning (2021) · cites this paper as Batsell et al. 2017
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867 · see citing works
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · see citing works
The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · cited 1× · see citing works
“A recent meta-analysis of the testing effect by Rowland (2014) suggests that the necessary condition to produce the phenomenon is effortful recall.”
Testing the testing effect in the classroom
McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326154 · Cited by 563 · see citing works
Test format and corrective feedback modify the effect of testing on long-term retention
Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440601056620 · Cited by 513 · see citing works
Testing improves long-term retention in a simulated classroom setting
Butler, A. C., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326097 · Cited by 434 · see citing works
Test-enhanced learning in the classroom: Long-term improvements from quizzing.
Roediger, H. L., III, Agarwal, P. K., McDaniel, M. A., & McDermott, K. B. (2011) · Journal of Experimental Psychology Applied · doi:10.1037/a0026252 · Cited by 393 · see citing works
McDaniel, M. A., Agarwal, P. K., Huelser, B. J., McDermott, K. B., & Roediger, H. L. (2011) · Journal of Educational Psychology · doi:10.1037/a0021782 · Cited by 360 · cited 3× · see citing works
“Pertaining to population validity, researchers have shown a significant testing effect in an eighth-grade science class (McDaniel et al., 2011) or a sixth-grade social studies class (Roediger et al., 2011), yet these results may not be replicable with college students and their advanced approaches…”
BackgroundResultExamining the testing effect with open‐ and closed‐book tests
Agarwal, P. K., Karpicke, J. D., Kang, S. H. K., Roediger, H. L., III, & McDermott, K. B. (2007) · Applied Cognitive Psychology · doi:10.1002/acp.1391 · Cited by 346 · see citing works
Clickers in the Classroom: An Active Learning Approach.
Martyn, M. (2007) · The EDUCAUSE quarterly/EDUCAUSE quarterly · Cited by 265 · see citing works
The Exam-A-Day Procedure Improves Performance in Psychology Classes
Leeming, F. C. (2002) · Teaching of Psychology · doi:10.1207/s15328023top2903_06 · Cited by 222 · see citing works
A testing effect with multimedia learning.
Johnson, C. I., & Mayer, R. E. (2009) · Journal of Educational Psychology · doi:10.1037/a0015183 · Cited by 221 · see citing works
Tests enhance the transfer of learning
Rohrer, D., Taylor, K., & Sholar, B. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0017678 · Cited by 217 · see citing works
Testing beyond words: using tests to enhance visuospatial map learning
Carpenter, S. K., & Pashler, H. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194092 · Cited by 133 · see citing works
Long-term effects of testing on the recall of nontested materials
Chan, J. C. K. (2009) · Memory · doi:10.1080/09658210903405737 · Cited by 105 · see citing works
Daily Online Testing in Large Classes: Boosting College Performance while Reducing Achievement Gaps
Pennebaker, J. W., Gosling, S. D., & Ferrell, J. D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079774 · Cited by 101 · see citing works
Cranney, J., Ahn, M., McKinnon, R., Morris, S., & Watts, K. (2009) · European Journal of Cognitive Psychology · doi:10.1080/09541440802413505 · Cited by 80 · see citing works
Ungraded Pop Quizzes: Test-Enhanced Learning Without All the Anxiety
Khanna, M. M. (2015) · Teaching of Psychology · doi:10.1177/0098628315573144 · Cited by 77 · see citing works
Testing the limits of testing effects using completion tests
Hinze, S. R., & Wiley, J. (2011) · Memory · doi:10.1080/09658211.2011.560121 · Cited by 74 · see citing works
Tests enhance retention and transfer of spatial learning
Carpenter, S. K., & Kelly, J. W. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0221-2 · Cited by 69 · see citing works
Effects of testing on learning of functions
Kang, S. H. K., McDaniel, M. A., & Pashler, H. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0113-x · Cited by 57 · see citing works
Learning Adinkra symbols: The effect of testing
Coppens, L. C., Verkoeijen, P. P. J. L., & Rikers, R. M. J. P. (2011) · Journal of Cognitive Psychology · doi:10.1080/20445911.2011.507188 · Cited by 53 · see citing works
Using Quizzing to Assist Student Learning in the Classroom
Nguyen, K., & McDaniel, M. A. (2014) · Teaching of Psychology · doi:10.1177/0098628314562685 · Cited by 52 · see citing works
Fortner‐Wood, C., Armistead, L. D., Marchand, A., & Morris, F. B. (2012) · Teaching of Psychology · doi:10.1177/0098628312465860 · Cited by 38 · see citing works
Skeletal Lesions in Human Tuberculosis May Sometimes Heal: An Aid to Palaeopathological Diagnoses
Holloway‐Kew, K. L., Link, K., Rühli, F. J., & Henneberg, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062798 · Cited by 37 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Retrieval-Based Learning: A Decade of Progress
Karpicke, J. D. (2017) · Learning and Memory: A Comprehensive Reference · doi:10.1016/b978-0-12-809324-5.21055-9 · Cited by 223 · see citing works
Agarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09595-9 · Cited by 211 · see citing works
Practicing Retrieval Facilitates Learning
McDermott, K. B. (2021) · Annual review of psychology · doi:10.1146/annurev-psych-010419-051019 · Cited by 113 · see citing works
Retrieval Practice in Classroom Settings: A Review of Applied Research
Moreira, B. F. T., Pinto, T. S. S., Starling, D. S. V., & Jaeger, A. (2019) · Frontiers in Education · doi:10.3389/feduc.2019.00005 · Cited by 76 · see citing works
Sotola, L. K., & Credé, M. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09563-9 · Cited by 74 · see citing works
Examining the Testing Effect in University Teaching: Retrievability and Question Format Matter
Greving, S., & Richter, T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02412 · Cited by 70 · see citing works
Open-Book Versus Closed-Book Tests in University Classes: A Field Experiment
Rummer, R., Schweppe, J., & Schwede, A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00463 · Cited by 52 · see citing works
Ebersbach, M., Feierabend, M., & Nazari, K. B. B. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3639 · Cited by 45 · see citing works
How Personalization Affects Motivation in Gamified Review Assessments
Rodrigues, L., Palomino, P. T., Toda, A. M., Klock, A. C. T., Pessoa, M., Pereira, F. D., Oliveira, E., Oliveira, D. F., Cristea, A. I., Gasparini, I., et al. (2023) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-022-00326-x · Cited by 44 · see citing works
Naujoks-Schober, N., Harder, B., & Händel, M. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09295-x · Cited by 31 · see citing works
The benefits of testing: Individual differences based on student factors
Robey, A. (2019) · Journal of Memory and Language · doi:10.1016/j.jml.2019.104029 · Cited by 29 · see citing works
Gurung, R. A. R., & Burns, K. (2019) · Applied Cognitive Psychology · doi:10.1002/acp.3507 · Cited by 42 · see citing works
CSR motives on situational scepticism towards luxury brands
Teah, K., Sung, B., & Phau, I. (2021) · Marketing Intelligence & Planning · doi:10.1108/mip-05-2021-0143 · Cited by 23 · see citing works
Greving, S., & Richter, T. (2022) · Journal of Cognitive Psychology · doi:10.1080/20445911.2022.2085281 · Cited by 14 · see citing works
Gilmore, N. M., Ross, K., & Kiran, S. (2018) · American Journal of Speech-Language Pathology · doi:10.1044/2018_ajslp-17-0153 · Cited by 21 · see citing works
Davidesco, I., & Milne, C. E. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.18-12-0240 · Cited by 18 · see citing works
Generation and Retrieval Practice Effects in the Classroom Using PeerWise
Kelley, M. R., Chapman-Orr, E. K., Calkins, S., & Lemke, R. J. (2019) · Teaching of Psychology · doi:10.1177/0098628319834174 · Cited by 18 · see citing works
Retrieval practice improves learning in children with diverse visual word recognition skills
Moreira, B. F. T., Pinto, T. S. S., Justi, F. R. D. R., & Jaeger, A. (2019) · Memory · doi:10.1080/09658211.2019.1668017 · Cited by 15 · see citing works
A Classroom Study on the Role of Prior Knowledge and Retrieval Tool in the Testing Effect
Francis, A. P., Wieth, M. B., Zabel, K. L., & Carr, T. H. (2020) · Psychology Learning & Teaching · doi:10.1177/1475725720924872 · Cited by 15 · see citing works
Rummer, R., & Schweppe, J. (2021) · Unterrichtswissenschaft · doi:10.1007/s42010-021-00137-4 · Cited by 14 · see citing works
Matt, L. M., Seah, T. H. S., & Coifman, K. G. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299540 · Cited by 12 · see citing works
Comparing Two Models of Collaborative Testing for Teaching Statistics
Eastridge, J., & Benson, W. L. (2019) · Teaching of Psychology · doi:10.1177/0098628319888113 · Cited by 12 · see citing works
A Systematic Review on Instruments to Assess Critical Thinking & Problem-Solving Skills
Alias, A., Mohtar, L. E., Ayop, S. K., & Rahim, F. R. (2022) · EDUCATUM Journal of Science Mathematics and Technology · doi:10.37134/ejsmt.vol9.sp.5.2022 · Cited by 11 · see citing works
Use of practice tests with immediate feedback in an undergraduate molecular biology course
Plasencia, J. (2022) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21695 · Cited by 8 · see citing works
Fehringer, B. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11040066 · Cited by 9 · see citing works
Nevid, J. S., & Gordon, A. J. (2018) · Teaching of Psychology · doi:10.1177/0098628318796920 · Cited by 8 · see citing works
Comparing Review Strategies in the Classroom
Lloyd, E. P., Walker, R. J., Metz, M. A., & Diekman, A. B. (2018) · Teaching of Psychology · doi:10.1177/0098628318762871 · Cited by 7 · see citing works
Can tests improve learning in real university classrooms?
Lamotte, M., Izaute, M., & Darnon, C. (2021) · Journal of Cognitive Psychology · doi:10.1080/20445911.2021.1956939 · Cited by 7 · see citing works
The Importance of Taking Psychology: A Comparison of Three Levels of Exposure
Landrum, R. E., Gurung, R. A. R., & Amsel, E. A. (2019) · Teaching of Psychology · doi:10.1177/0098628319872574 · Cited by 7 · see citing works
Boysen, G. A. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.02.001 · Cited by 7 · see citing works
Achieving Testing Effects in an Authentic College Classroom
Shobe, E. R. (2021) · Teaching of Psychology · doi:10.1177/00986283211015669 · Cited by 7 · see citing works
Are open‐book tests still as effective as closed‐book tests even after a delay of 2 weeks?
Wenzel, K., Schweppe, J., & Rummer, R. (2022) · Applied Cognitive Psychology · doi:10.1002/acp.3943 · Cited by 5 · see citing works
Sullivan, D. (2017) · Journal of Education and Training · doi:10.5296/jet.v4i2.10777 · Cited by 5 · see citing works
Differential Effects of Additional Formative Assessments on Student Learning Behaviors and Outcomes
Borter, N. (2024) · Studia paedagogica · doi:10.5817/sp2023-3-1 · Cited by 6 · see citing works
Wenzel, K., & Reinhard, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.693585 · Cited by 4 · see citing works
Assessing Students Online – Enablers and Barriers to Using e-Proctoring and Alternative Methods
Dyer, J., Khan, Z. R., & Hill, C. (2022) · Ethics and integrity in educational contexts · doi:10.1007/978-3-031-16976-2_8 · Cited by 4 · see citing works
Lawson, T. J. (2021) · College Teaching · doi:10.1080/87567555.2021.1910124 · Cited by 3 · see citing works
Michaels, J. L. (2017) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000098 · Cited by 3 · see citing works
Eastridge, J. (2019) · Nurse Education Today · doi:10.1016/j.nedt.2019.06.001 · Cited by 3 · see citing works
Veinott, E. S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-22131-6_34 · Cited by 2 · see citing works
Case, J., & Kennedy, D. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--37996 · Cited by 2 · see citing works
Karpicke, J. D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-15754-7.00074-2 · Cited by 3 · see citing works
Comparing Quizzes and Social Annotation for Pre-Class Reading Accountability
Clinton‐Lisell, V. (2024) · Teaching of Psychology · doi:10.1177/00986283241275218 · Cited by 1 · see citing works
Re-designing A Practice Test Into A Game
Chen, H.-T. M., & Lee, M. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601790 · Cited by 1 · see citing works
Testing the Testing Effect in Electrical Science with Learning Approach as a Factor
Eustace, J., & Pathak, P. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-58459-7_18 · Cited by 1 · see citing works
Testing, Testing: In-Class Testing Facilitates Transfer on Cumulative Exams
Miller, T. M., & Connot, N. (2022) · Journal of Cognitive Education and Psychology · doi:10.1891/jcep-2021-0018 · Cited by 1 · see citing works
Using Technology to Promote Student Ownership of Retrieval Practice
Courchesne, S., & Cohen, S. M. (2019) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-7998-1770-3.ch003
Williamson, M. J., & Garbin, J. (2022) · Teaching of Psychology · doi:10.1177/00986283221081225
The use of GoSoapBox for teaching and learning
Sim, K. N. (2022) · Advances in Educational Research and Evaluation · doi:10.25082/aere.2022.01.001
Richmond, A. S., Ropp, A., Bradford, J., Ignizio, G., Hammond, J., Mowder, D., & Bittmann, J. M. (2022) · College Teaching · doi:10.1080/87567555.2022.2090488
Review Websites Improve College Exam Performance, but Review Strategy Might Not Matter
Vaughn, K. E., Goddard, P., & Krull, D. S. (2023) · College Teaching · doi:10.1080/87567555.2023.2257349
Using Debriefing as a Tool to Enhance the Educational Value of Undergraduate Research Participation
Flynn, M. K., & Bordieri, M. J. (2023) · Teaching of Psychology · doi:10.1177/00986283231211535
Supports for Discipline-Specific Reading in Introductory Psychology
Vilma, T., Nuccio, D. A., Durik, A. M., & Britt, M. A. (2024) · Psychology Learning & Teaching · doi:10.1177/14757257241296112 · Cited by 1 · see citing works
Enhancing Final Exam Performance Through Retrieval Practice: Evidence From a Diverse College Sample
Barideaux, K. J. (2025) · Teaching of Psychology · doi:10.1177/00986283251352475
The Benefits of Testing: Individual Differences Based on Student FactorsPreprint
Dougherty, M. R. P., & Robey, A. (2016) · OSF Preprints (OSF Preprints)
Cross-Domain Input, Mutual Exclusivity, and Inferential Reasoning: When LLMs Learn Words Like Humans
Mendoza, V., Zulueta, E., Basogain, X., Peña‐Ceballos, J., & Carasa-Castaño, J. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8090280
- Authors
- Batsell, W. R., Perry, J. L., Hanley, E., & Hostetter, A. B.
- Affiliations
- Kalamazoo College (US)
- Corresponding author
- Batsell, W. Robert
- ORCID
- Hostetter, Autumn B.
- Venue
- Teaching of Psychology
- Publisher
- SAGE Publications
- Published
- 2016-11-11
- Volume
- 44
- Issue
- 1
- Pages
- 18-23
- ISSN
- 0098-6283 (ISSN-L)
- 1532-8023
- OpenAlex
- W2551808616
- Cited by
- 56
- References
- 25
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 5 · 2023: 4 · 2022: 11 · 2021: 7 · 2020: 6 · 2019: 10 · 2018: 5 · 2017: 4 · 2016: 1
- FWCI
- 4.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Teaching of Psychology (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Education › Innovative Teaching Methods
- Keywords
- testing effect, retrieval practice, daily quizzes, ecological validity, generalizability, student learning, introductory psychology course, reading textbooks, exam performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review