The effect of type and timing of feedback on learning from multiple-choice tests.
Abstract
Two experiments investigated how the type and timing of feedback influence learning from a multiple-choice test. First, participants read 12 prose passages, which covered various general knowledge topics (e.g., The Sun) and ranged between 280 and 300 words in length. Next, they took an initial six-alternative, multiple-choice test on information contained in the passages. Feedback was given immediately for some of the multiple-choice items or after delay for other items. Participants were either shown the correct answer as feedback (standard feedback) or were allowed to keep answering until the correct answer was discovered (answer-until-correct feedback). Learning from the test was assessed on a delayed cued-recall test. The results indicated that delayed feedback led to superior final test performance relative to immediate feedback. However, type of feedback did not matter: discovering the correct answer through answer-until-correct feedback produced equivalent performance relative to standard feedback. This research suggests that delaying the presentation of feedback after a test is beneficial to learning because of the spaced presentation of information.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Delayed feedback produces superior retention relative to immediate feedback, at least in some cases.
“recent research shows that, at least in some cases, delayed feedback produces superior retention relative to immediate feedback.27,31”
From Test-enhanced learning in medical education (2008) · cites this paper as [31]
Cites
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882 · see citing works
Journal of Experimental Psychology: Human Learning and Memory
Bourne, L. E. (1977) · Cited by 4,328 · see citing works
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867 · see citing works
Self-citationThe power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037 · see citing works
Self-citationThe generation effect: delineation of a phenomenon
Slamecka, N. J., & Graf, P. (1978) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.4.6.592 · Cited by 1,659 · see citing works
Schmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · cited 4× · see citing works
“Presumably, the benefit of delayed feedback after a correct response is a type of spacing effect (Dempster, 1989; Schmidt & Bjork, 1992 ): after a correct response, delayed feedback represents a spaced presentation of the material, whereas immediate feedback constitutes a massed presentation.”
BackgroundInfluentialThe instructional effect of feedback in test-like events.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991) · Review of Educational Research · doi:10.3102/00346543061002213 · Cited by 1,313 · see citing works
The Science of Learning and the Art of Teaching.
Skinner, B. F. (2007) · Appleton-Century-Crofts eBooks · doi:10.1037/11324-010 · Cited by 1,140 · see citing works
On Knowing: Essays for the Left Hand
James, H. E. O., & Bruner, J. S. (1963) · British Journal of Educational Studies · doi:10.2307/3119384 · Cited by 760 · see citing works
Timing of feedback and verbal learning.
Kulik, J. A., & Kulik, C.-L. C. (1988) · Review of Educational Research · doi:10.3102/00346543058001079 · Cited by 703 · see citing works
Retrieval of propositional information from long-term memory
Anderson, J. R. (1974) · Cognitive Psychology · doi:10.1016/0010-0285(74)90021-8 · Cited by 674 · see citing works
On interpreting the effects of repetition: Solving a problem versus remembering a solution
Jacoby, L. L. (1978) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(78)90393-6 · Cited by 667 · see citing works
The influence of retrieval on retention
Carrier, L. M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 580 · see citing works
Feedback in Written Instruction
Kulhavy, R. W. (1977) · Review of Educational Research · doi:10.3102/00346543047002211 · Cited by 571 · cited 4× · see citing works
“The benefit of providing delayed feedback after incorrect responses may be the result of a decrease in response competition between the incorrect and correct responses (see also Kulhavy, 1977 ).”
BackgroundInfluentialWhen Does Feedback Facilitate Learning of Words?
Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.1.3 · Cited by 445 · see citing works
An Alternative to Null-Hypothesis Significance Tests
Killeen, P. R. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.01538.x · Cited by 443 · see citing works
Testing improves long-term retention in a simulated classroom setting
Butler, A. C., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326097 · Cited by 434 · see citing works
Self-citationFeinberg, W., & Soltis, J. F. (1985) · Medical Entomology and Zoology · Cited by 393 · see citing works
The Positive and Negative Consequences of Multiple-Choice Testing.
Roediger, H. L., III, & Marsh, E. J. (2005) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.31.5.1155 · Cited by 386 · see citing works
Chan, J. C. K., McDermott, K. B., & Roediger, H. L. (2006) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.135.4.553 · Cited by 364 · see citing works
Spacing effects and their implications for theory and practice
Dempster, F. N. (1989) · Educational Psychology Review · doi:10.1007/bf01320097 · Cited by 244 · see citing works
On Knowing: Essays for the Left Hand.
McFarland, H. S. N., & Bruner, J. S. (1965) · The Philosophical Quarterly · doi:10.2307/2218639 · Cited by 237 · see citing works
TEACHING MACHINES AND PROGRAMMED LEARNING, A SOURCE BOOK.
Lumsdaine, A. A., & Glaser, R. A. (1960) · Cited by 182 · see citing works
Dihoff, R. E., Brosvic, G. M., Epstein, M. L., & Cook, M. J. (2004) · The Psychological Record · doi:10.1007/bf03395471 · Cited by 181 · see citing works
The Role of Feedback During Academic Testing: The Delay Retention Effect Revisited
Dihoff, R. E., Brosvic, G. M., & Epstein, M. L. (2003) · The Psychological Record · doi:10.1007/bf03395451 · Cited by 125 · see citing works
Immediate Feedback during Academic Testing
Epstein, M. L., Epstein, B. B., & Brosvic, G. M. (2001) · Psychological Reports · doi:10.2466/pr0.2001.88.3.889 · Cited by 111 · see citing works
Effects of delay of information feedback and task complexity on the identification of concepts.
Bourne, L. E. (1957) · Journal of Experimental Psychology · doi:10.1037/h0044684 · Cited by 83 · see citing works
Mulligan, N. W., & Lozito, J. P. (2004) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(03)45005-6 · Cited by 81 · see citing works
Brosvic, G. M., Epstein, M. L., Cook, M. J., & Dihoff, R. E. (2005) · The Psychological Record · doi:10.1007/bf03395518 · Cited by 60 · see citing works
The Effect of Immediate Knowledge of Quiz Results on Final Examination Scores in Freshman Chemistry
Angell, G. W. (1949) · The Journal of Educational Research · doi:10.1080/00220671.1949.10881704 · Cited by 55 · see citing works
Effects of Systematic Variations in Reinforcement Contingencies on Learner Performance
Sullivan, H. J., Schutz, R. E., & Robert, L. B. (1971) · American Educational Research Journal · doi:10.3102/00028312008001135 · Cited by 23 · see citing works
The Immediate Feedback Assessment Technique: A Learner-centered Multiple-choice Response Form
DiBattista, D. (2013) · Canadian Journal of Higher Education · doi:10.47678/cjhe.v35i4.184475 · Cited by 23 · see citing works
Paige, D. D. (1966) · The Journal of Educational Research · doi:10.1080/00220671.1966.10883355 · Cited by 17 · see citing works
A New Device for Use in Teaching, Testing and Research in Learning
Peterson, J. (1930) · Transactions of the Kansas Academy of Science · doi:10.2307/3624611 · Cited by 11 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796 · see citing works
Self-citationThe effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · see citing works
Gamification of health professions education: a systematic review
van Gaalen, A. E. J., Brouwer, J., Schönrock-Adema, J., Bouwkamp-Timmer, T., Jaarsma, A. D. C., & Georgiadis, J. R. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-020-10000-3 · Cited by 625 · see citing works
Test-enhanced learning in medical education
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03124.x · Cited by 610 · see citing works
Self-citationRethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544 · see citing works
Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing
Butler, A. C., & Roediger, H. L. (2008) · Memory & Cognition · doi:10.3758/mc.36.3.604 · Cited by 457 · see citing works
Self-citationTen Benefits of Testing and Their Applications to Educational Practice
Roediger, H. L., III, Putnam, A. L., & Smith, M. A. (2011) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-387691-1.00001-6 · Cited by 453 · see citing works
Examining the testing effect with open‐ and closed‐book tests
Agarwal, P. K., Karpicke, J. D., Kang, S. H. K., Roediger, H. L., III, & McDermott, K. B. (2007) · Applied Cognitive Psychology · doi:10.1002/acp.1391 · Cited by 346 · see citing works
Self-citationCorrecting a metacognitive error: Feedback increases retention of low-confidence correct responses.
Butler, A. C., Karpicke, J. D., & Roediger, H. L., III (2008) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.34.4.918 · Cited by 332 · see citing works
Self-citationFeedback on feedback practice: perceptions of students and academics
Mulliner, E., & Tucker, M. (2017) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1103365 · Cited by 261 · see citing works
(2010) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(10)53003-2 · Cited by 255 · see citing works
Online Mathematics Homework Increases Student Achievement
Roschelle, J., Feng, M., Murphy, R. F., & Mason, C. A. (2016) · AERA Open · doi:10.1177/2332858416673968 · Cited by 267 · see citing works
Transfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286 · see citing works
Retrieval-Based Learning: A Decade of Progress
Karpicke, J. D. (2017) · Learning and Memory: A Comprehensive Reference · doi:10.1016/b978-0-12-809324-5.21055-9 · Cited by 223 · see citing works
Self-citationNassaji, H. (2016) · Language Teaching Research · doi:10.1177/1362168816644940 · Cited by 233 · see citing works
Timing matters when correcting fake news
Brashier, N. M., Pennycook, G., Berinsky, A. J., & Rand, D. G. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2020043118 · Cited by 216 · see citing works
Explanation feedback is better than correct answer feedback for promoting transfer of learning.
Butler, A. C., Godbole, N. R., & Marsh, E. J. (2012) · Journal of Educational Psychology · doi:10.1037/a0031026 · Cited by 177 · see citing works
Self-citationKeep it Coherent: A Meta-Analysis of the Seductive Details Effect
Sundararajan, N., & Adesope, O. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09522-4 · Cited by 176 · see citing works
The pretesting effect: do unsuccessful retrieval attempts enhance learning?
Richland, L. E., Kornell, N., & Kao, L. S. (2009) · Journal of Experimental Psychology: Applied · doi:10.1037/a0016496 · Cited by 302 · see citing works
Ullman, M. T., & Lovelett, J. T. (2016) · Second language Research · doi:10.1177/0267658316675195 · Cited by 157 · see citing works
Delayed versus immediate feedback in children’s and adults’ vocabulary learning
Metcalfe, J., Kornell, N., & Finn, B. (2009) · Memory & Cognition · doi:10.3758/mc.37.8.1077 · Cited by 149 · see citing works
Is expanding retrieval a superior method for learning text materials?
Karpicke, J. D., & Roediger, H. L. (2010) · Memory & Cognition · doi:10.3758/mc.38.1.116 · Cited by 137 · see citing works
Self-citationFeedback Both Helps and Hinders Learning: The Causal Role of Prior Knowledge
Fyfe, E. R., & Rittle-Johnson, B. (2016) · Journal of Educational Psychology · doi:10.1037/edu0000053 · Cited by 130 · see citing works
Benefits from retrieval practice are greater for students with lower working memory capacity
Agarwal, P. K., Finley, J. R., Rose, N. S., & Roediger, H. L., III (2016) · Memory · doi:10.1080/09658211.2016.1220579 · Cited by 127 · see citing works
Learning from feedback: Spacing and the delay–retention effect.
Smith, T. A., & Kimball, D. R. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0017407 · Cited by 123 · see citing works
Attali, Y., & van der Kleij, F. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.03.012 · Cited by 119 · see citing works
The Effects of Spaced Practice on Second Language Learning: A Meta‐Analysis
Kim, S. K., & Webb, S. (2022) · Language Learning · doi:10.1111/lang.12479 · Cited by 119 · see citing works
Lechermeier, J., & Faßnacht, M. (2018) · Management Review Quarterly · doi:10.1007/s11301-018-0136-8 · Cited by 115 · see citing works
Multiple-choice testing in education: Are the best practices for assessment also good for learning?
Butler, A. C. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.07.002 · Cited by 142 · see citing works
Self-citationTest-enhanced learning in health professions education: A systematic review: BEME Guide No. 48
Green, M. L., Moeller, J. J., & Spak, J. M. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1430354 · Cited by 103 · see citing works
Rawson, K. A., & Dunlosky, J. T. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9203-1 · Cited by 104 · see citing works
Learner regulated knowledge of results during the acquisition of multiple timing goals
Patterson, J. T., & Carter, M. (2010) · Human Movement Science · doi:10.1016/j.humov.2009.12.003 · Cited by 102 · see citing works
Rivers, M. L. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09578-2 · Cited by 104 · see citing works
Strengthening concept learning by repeated testing
Wiklund‐Hörnqvist, C., Jonsson, B., & Nyberg, L. H. (2013) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12093 · Cited by 99 · see citing works
Design principles for learning analytics information systems in higher education
Nguyen, A., Tuunanen, T., Gardner, L. A., & Sheridan, D. (2020) · European Journal of Information Systems · doi:10.1080/0960085x.2020.1816144 · Cited by 94 · see citing works
Mullet, H. G., Butler, A. C., Verdin, B., von Borries, R. F., & Marsh, E. J. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.05.001 · Cited by 90 · see citing works
Self-citationScaffolding feedback to maximize long-term error correction
Finn, B., & Metcalfe, J. (2010) · Memory & Cognition · doi:10.3758/mc.38.7.951 · Cited by 84 · see citing works
Using Testing as a Learning Tool
Yang, B. W., Razo, J. F., & Persky, A. M. (2019) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7324 · Cited by 83 · see citing works
THE EFFECTS OF IMMEDIATE AND DELAYED CORRECTIVE FEEDBACK ON L2 DEVELOPMENT
Fu, M., & Li, S. (2020) · Studies in Second Language Acquisition · doi:10.1017/s0272263120000388 · Cited by 95 · see citing works
Retrieval Practice in Classroom Settings: A Review of Applied Research
Moreira, B. F. T., Pinto, T. S. S., Starling, D. S. V., & Jaeger, A. (2019) · Frontiers in Education · doi:10.3389/feduc.2019.00005 · Cited by 76 · see citing works
Sotola, L. K., & Credé, M. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09563-9 · Cited by 74 · see citing works
Henderson, C. S. (2019) · Language Teaching Research · doi:10.1177/1362168819832907 · Cited by 75 · see citing works
Weighing Up Exercises on Phrasal Verbs: Retrieval Versus Trial‐and‐Error Practices
Strong, B., & Boers, F. (2019) · Modern Language Journal · doi:10.1111/modl.12579 · Cited by 71 · see citing works
The influences of a two-tier test strategy on student learning: A lag sequential analysis approach
Yang, T., Chen, S. Y., & Hwang, G. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.11.021 · Cited by 68 · see citing works
Improving Learning Efficiency of Factual Knowledge in Medical Education
Yeh, D. D., & Park, Y. S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.03.012 · Cited by 62 · see citing works
Yang, X., Lin, L., Cheng, P.-Y., Xue, Y., & Ren, Y. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.06.002 · Cited by 64 · see citing works
Multiple-choice testing as a desirable difficulty in the classroom.
Bjork, E. L., Little, J. L., & Storm, B. C. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.03.002 · Cited by 75 · see citing works
Distractors in Parsons Problems Decrease Learning Efficiency for Young Novice Programmers
Harms, K. J., Chen, J., & Kelleher, C. L. (2016) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2960310.2960314 · Cited by 60 · see citing works
Chan, J. C. K., & Langley, M. M. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0021204 · Cited by 59 · see citing works
The testing effect: The role of feedback and collaboration in a tertiary classroom setting
Vojdanoska, M., Cranney, J., & Newell, B. R. (2009) · Applied Cognitive Psychology · doi:10.1002/acp.1630 · Cited by 58 · see citing works
A Controlled Study of Clicker-Assisted Memory Enhancement in College Classrooms
Shapiro, A., & Gordon, L. T. (2012) · Applied Cognitive Psychology · doi:10.1002/acp.2843 · Cited by 60 · see citing works
Nakata, T. (2014) · Language Teaching Research · doi:10.1177/1362168814541721 · Cited by 57 · see citing works
Multiple-choice questions: Tips for optimizing assessment in-seat and online.
Xu, X., Kauer, S. D., & Tupy, S. (2016) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000062 · Cited by 59 · see citing works
Belief in corrective feedback for common misconceptions: Implications for knowledge revision.
Rich, P. R., van Loon, M. H., Dunlosky, J. T., & Zaragoza, M. S. (2016) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000322 · Cited by 55 · see citing works
Bould, M. D., Naik, V. N., & Hamstra, S. J. (2011) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-011-9633-0 · Cited by 48 · see citing works
Sein, A. S., Rashid, H., Meka, J., Amiel, J. M., & Pluta, W. J. (2020) · Medical Teacher · doi:10.1080/0142159x.2020.1789081 · Cited by 55 · see citing works
Using Fictional Sources in the Classroom: Applications from Cognitive Psychology
Marsh, E. J., Butler, A. C., & Umanath, S. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9204-0 · Cited by 53 · see citing works
Self-citationPrevention–Permission–Promotion: A Review of Approaches to Errors in Learning
Wong, S. S. H., & Lim, S. W. H. (2018) · Educational Psychologist · doi:10.1080/00461520.2018.1501693 · Cited by 52 · see citing works
How the timing of performance feedback impacts individual performance
Thornock, T. A. (2016) · Accounting Organizations and Society · doi:10.1016/j.aos.2016.09.002 · Cited by 51 · see citing works
Investigating the testing effect: Retrieval as a characteristic of effective study strategies
Bae, C. L. L., Therriault, D. J., & Redifer, J. L. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.12.008 · Cited by 49 · see citing works
Using verification feedback to correct errors made on a multiple-choice test
Marsh, E. J., Lozito, J. P., Umanath, S., Bjork, E. L., & Bjork, R. A. (2012) · Memory · doi:10.1080/09658211.2012.684882 · Cited by 46 · see citing works
Jang, Y., Wixted, J. T., Pecher, D., Zeelenberg, R., & Huber, D. E. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2011.638079 · Cited by 46 · see citing works
Tang, F., & Zhan, P. (2021) · AERA Open · doi:10.1177/23328584211060804 · Cited by 46 · see citing works
A Learning Analytics Approach to Monitoring the Quality of Online One-to-One Tutoring
Cukurova, M., Khan-Galaria, M., Millán, E., & Luckin, R. (2022) · Journal of Learning Analytics · doi:10.18608/jla.2022.7411 · Cited by 45 · see citing works
Mullaney, K. M., Carpenter, S. K., Grotenhuis, C., & Burianek, S. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0441-y · Cited by 46 · see citing works
Persky, A. M., Henry, T. R., & Campbell, A. (2015) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe79220 · Cited by 44 · see citing works
Clinical study of student learning using mastery style versus immediate feedback online activities
Gladding, G. E., Gutmann, B., Schroeder, N. L., & Stelzer, T. J. (2015) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.11.010114 · Cited by 43 · see citing works
Immediate detailed feedback to test-enhanced learning: An effective online educational tool
Wojcikowski, K., & Kirk, L. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.826793 · Cited by 41 · see citing works
Systematic review of distributed practice and retrieval practice in health professions education
Trumble, E., Lodge, J. M., Mandrusiak, A., & Forbes, R. (2023) · Advances in Health Sciences Education · doi:10.1007/s10459-023-10274-3 · Cited by 40 · see citing works
How Effective is Example Generation for Learning Declarative Concepts?
Rawson, K. A., & Dunlosky, J. T. (2016) · Educational Psychology Review · doi:10.1007/s10648-016-9377-z · Cited by 40 · see citing works
Toward consilience in the use of task-level feedback to promote learning
Butler, A. C., & Woodward, N. R. (2018) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/bs.plm.2018.09.001 · Cited by 42 · see citing works
Self-citationTaveira-Gomes, T., Prado-Costa, R., Severo, M., & Ferreira, M. A. (2015) · BMC Medical Education · doi:10.1186/s12909-014-0275-0 · Cited by 39 · see citing works
Pharmacy Student Self-Testing as a Predictor of Examination Performance
Stewart, D. W., Panus, P. C., Hagemeier, N. E., Thigpen, J. C., & Brooks, L. (2014) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe78232 · Cited by 39 · see citing works
Feedback and stimulus-offset timing effects in perceptual category learning
Worthy, D. A., Markman, A. B., & Maddox, W. T. (2013) · Brain and Cognition · doi:10.1016/j.bandc.2012.11.006 · Cited by 39 · see citing works
The benefits of computer-generated feedback for mathematics problem solving.
Fyfe, E. R., & Rittle-Johnson, B. (2016) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2016.03.009 · Cited by 36 · see citing works
Storkel, H., Komesidou, R., Fleming, K. K., & Romine, R. (2017) · Language, Speech & Hearing Services in Schools · doi:10.1044/2017_lshss-16-0058 · Cited by 28 · see citing works
The science of teaching science
Mostafa, T., Echazarra, A., & Guillou, H. (2018) · OECD education working papers · doi:10.1787/f5bd9e57-en · Cited by 44 · see citing works
Mathematics practice without feedback: A desirable difficulty in a classroom setting
Fyfe, E. R., & Rittle-Johnson, B. (2017) · Instructional Science · doi:10.1007/s11251-016-9401-1 · Cited by 37 · see citing works
A Systematic Review of the Testing Effect in Learning
Eisenkraemer, R. E., Jaeger, A., & Stein, L. M. (2013) · Paidéia (Ribeirão Preto) · doi:10.1590/1982-43272356201314 · Cited by 37 · see citing works
Automated Summarization Evaluation (ASE) Using Natural Language Processing Tools
Crossley, S. A., Kim, M., Allen, L. K., & McNamara, D. S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23204-7_8 · Cited by 36 · see citing works
Cogliano, M., Kardash, C. M., & Bernacki, M. L. (2018) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2018.12.001 · Cited by 36 · see citing works
Huff, M. J., Davis, S. D., & Meade, M. L. (2013) · Memory & Cognition · doi:10.3758/s13421-013-0299-4 · Cited by 34 · see citing works
Cogliano, M., Bernacki, M. L., & Kardash, C. M. (2020) · Journal of Educational Psychology · doi:10.1037/edu0000624 · Cited by 41 · see citing works
Trial-and-error learning improves source memory among young and older adults.
Cyr, A.-A., & Anderson, N. D. (2011) · Psychology and Aging · doi:10.1037/a0025115 · Cited by 32 · see citing works
Asterhan, C. S. C., & Dotan, A. (2017) · Instructional Science · doi:10.1007/s11251-017-9441-1 · Cited by 32 · see citing works
Providing immediate feedback improves recycling and composting accuracy
Luo, Y., Zelenika, I., & Zhao, J. (2018) · Journal of Environmental Management · doi:10.1016/j.jenvman.2018.11.061 · Cited by 32 · see citing works
Prior knowledge is more predictive of error correction than subjective confidence
Sitzman, D. M., Rhodes, M. G., & Tauber, S. K. (2013) · Memory & Cognition · doi:10.3758/s13421-013-0344-3 · Cited by 32 · see citing works
Test-enhanced learning: analysis of an experience with undergraduate nursing students
Messineo, L., Gentile, M., & Allegra, M. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0464-5 · Cited by 29 · see citing works
Taylor, A., Sanson, M., Burnell, R., Wade, K. A., & Garry, M. (2020) · Memory · doi:10.1080/09658211.2020.1758726 · Cited by 33 · see citing works
The Effectiveness of Positive Feedback in Teaching Speaking Skill
Muhsin, M. A. (2016) · Lingua Cultura · doi:10.21512/lc.v10i1.873 · Cited by 29 · see citing works
Collective firm-internal online idea development
Chen, Q., Magnusson, M. G., & Björk, J. (2019) · European Journal of Innovation Management · doi:10.1108/ejim-02-2018-0045 · Cited by 29 · see citing works
The effects of immediate versus delayed feedback on complex concept learning
Corral, D., Carpenter, S. K., & Clingan-Siverly, S. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820977739 · Cited by 31 · see citing works
Delayed instructional feedback may be more effective, but is this contrary to learners' preferences?
Lefevre, D., & Cox, B. (2017) · British Journal of Educational Technology · doi:10.1111/bjet.12495 · Cited by 20 · see citing works
Testing Is More Desirable When It Is Adaptive and Still Desirable When Compared to Note-Taking
Heitmann, S., Grund, A., Berthold, K., Fries, S., & Roelle, J. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02596 · Cited by 27 · see citing works
Cumulative assessment: strategic choices to influence students’ study effort
Kerdijk, W., Tio, R. A., Mulder, B. F., & Cohen‐Schotanus, J. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-172 · Cited by 27 · see citing works
Dood, A. J., Fields, K. B., de Arellano, D. C., & Raker, J. R. (2019) · Canadian Journal of Chemistry · doi:10.1139/cjc-2018-0479 · Cited by 26 · see citing works
PC-based hazard anticipation training for experienced cyclists: Design and evaluation
Kovácsová, N., Vlakveld, W. P., de Winter, J., & Hagenzieker, M. (2019) · Safety Science · doi:10.1016/j.ssci.2019.104561 · Cited by 25 · see citing works
Reconsolidation from negative emotional pictures: Is successful retrieval required?
Finn, B., Roediger, H. L., III, & Rosenzweig, E. Q. (2012) · Memory & Cognition · doi:10.3758/s13421-012-0203-7 · Cited by 25 · see citing works
Designing automated guidance for concept diagrams in inquiry instruction
Ryoo, K., & Linn, M. C. (2016) · Journal of Research in Science Teaching · doi:10.1002/tea.21321 · Cited by 25 · see citing works
Testing together: When do students learn more through collaborative tests?
LoGiudice, A. B., Pachai, A. A., & Kim, J. A. (2015) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000041 · Cited by 26 · see citing works
- Authors
- Butler, A. C., Karpicke, J. D., & Roediger, H. L.
- Affiliations
- Washington University in St. Louis (US)
- Venue
- Journal of Experimental Psychology: Applied
- Published
- 2007
- Volume
- 13
- Issue
- 4
- Pages
- 273-281
- ISSN
- 1076-898X (ISSN-L)
- 1939-2192
- OpenAlex
- W2122370331
- Cited by
- 321
- References
- 34
- Citations by year
- 2026: 3 · 2025: 20 · 2024: 12 · 2023: 16 · 2022: 14 · 2021: 20 · 2020: 28 · 2019: 26 · 2018: 30 · 2017: 17 · 2016: 23 · 2015: 17 · 2014: 23 · 2013: 20 · 2012: 14
- FWCI
- 4.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology Applied (publishedVersion)
- PubMed (publishedVersion)
- Funders
- James S. McDonnell Foundation
- Institute of Education Sciences
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- feedback timing, delayed feedback, immediate feedback, multiple-choice tests, test-based learning, cued recall, prose reading
- MeSH terms
- Choice Behavior, Educational Measurement, Feedback, Humans, Learning, Time Factors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review