Testing the limits of testing effects using completion tests
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Recent work on testing effects has shown that retrieval practice can facilitate memory even for complex prose materials (Roediger & Karpicke, 2006a, 2006b). In three experiments the current study explores the effectiveness of retrieval practice on fill-in-the-blank (FITB) tests requiring the recall of specific words or phrases from a text. Final tests included both repeated items that were directly taken from initial tests, and related items. In Experiment 1, with a 2-day delay between initial and final tests, FITB testing benefited performance only on repeated items. In Experiment 2 a 7-day delay between testing sessions led to more robust effects on repeated items. However, once again no benefits were seen for related items. In Experiment 3 the scope of retrieval was varied by comparing FITB tests to paragraph recall tests requiring retrieval of all sentences following a topic sentence. Only the more open-ended recall practice demonstrated improvements in transfer to novel questions. The results suggest that scope or type of processing required during retrieval practice is likely a critical factor in whether testing will have specific or robust benefits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 2×
“It is uncontroversial to argue that testing in classroom contexts can influence learning outcomes as tests can be used to provide summative and formative assessment of student progress, as well as to communicate information about the goals and standards of a course (Black & Wiliam, 1998 ; Crooks, 1988 ).”
BackgroundTest-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The Impact of Classroom Evaluation Practices on Students
Crooks, T. J. (1988) · Review of Educational Research · doi:10.3102/00346543058004438 · Cited by 1,369
Memory and Metamemory Considerations in the Training of Human Beings
Bjork, R. A. (1994) · Metacognition · doi:10.7551/mitpress/4561.003.0011 · Cited by 1,084
Testing the testing effect in the classroom
McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326154 · Cited by 563
Pyc, M. A., & Rawson, K. A. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.01.004 · Cited by 551 · cited 2×
“In testing effects not only is retrieval a more effortful process than re-exposure, but also more difficult (but successful) retrieval tasks are more effective for longterm retention than less difficult successful retrieval tasks (Carpenter, 2009; Carpenter & DeLosh, 2006; Pyc & Rawson, 2009).”
BackgroundTest format and corrective feedback modify the effect of testing on long-term retention
Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440601056620 · Cited by 513
Cue strength as a moderator of the testing effect: The benefits of elaborative retrieval.
Carpenter, S. K. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0017021 · Cited by 503
Repeated testing produces superior transfer of learning relative to repeated studying.
Butler, A. C. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0019902 · Cited by 492 · cited 2×
“That is, if availability of specific information in memory is a prerequisite for transfer, then any task that enhances the retrievability of this relevant information should lead to superior transfer (see Butler, 2010).”
BackgroundFeedback enhances the positive effects and reduces the negative effects of multiple-choice testing
Butler, A. C., & Roediger, H. L. (2008) · Memory & Cognition · doi:10.3758/mc.36.3.604 · Cited by 457 · cited 2×
“Other beneficial effects of testing include when feedback following testing leads to superior learning (Butler & Roediger, 2008 ; Kang, McDermott, & Roediger, 2007), or when initial testing facilitates future learning (see Szpunar, McDermott, & Roediger, 2008 ).”
BackgroundTesting improves long-term retention in a simulated classroom setting
Butler, A. C., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326097 · Cited by 434
Carpenter, S. K., & Delosh, E. L. (2006) · Memory & Cognition · doi:10.3758/bf03193405 · Cited by 386
Chan, J. C. K., McDermott, K. B., & Roediger, H. L. (2006) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.135.4.553 · Cited by 364 · cited 7×
“The authors termed this benefit of initial testing on related items ‘‘retrieval induced facilitation’’ (Chan et al., 2006).”
BackgroundResultInfluentialGeneralizing test-enhanced learning from the laboratory to the classroom
Mcdaniel, M. A., Roediger, H. L., & Mcdermott, K. B. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194052 · Cited by 326
The effects of tests on learning and forgetting.
Carpenter, S. K., Pashler, H., Wixted, J. T., & Vul, E. (2008) · Memory & Cognition · doi:10.3758/mc.36.2.438 · Cited by 281
Application of the testing and spacing effects to name learning
Carpenter, S. K., & DeLosh, E. L. (2005) · Applied Cognitive Psychology · doi:10.1002/acp.1101 · Cited by 270 · cited 2×
“Testing effects are prominent in paired associates learning (Carpenter & DeLosh, 2005 ; Carpenter, Pashler, & Vul, 2006 ) and list-learning tasks (Karpicke & Roediger, 2007 ; Wheeler, Ewers, & Buonanno, 2003).”
InfluentialTests enhance the transfer of learning
Rohrer, D., Taylor, K., & Sholar, B. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0017678 · Cited by 217 · cited 1×
“More recently some studies have been able to demonstrate improvements beyond just those repeated test items (Butler, 2010 ; Chan, 2009 ; Rohrer, Taylor & Sholar, 2010 ).”
BackgroundHow recall facilitates subsequent recall: A reappraisal.
Thompson, C. P., Wenger, S. K., & Bartling, C. A. (1978) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.4.3.210 · Cited by 143 · cited 1×
“Some have suggested that retrieval practice serves to attenuate the forgetting of information (Carpenter, Pashler, Wixted, & Vul, 2008; Roediger & Karpicke, 2006b; Thompson et al., 1978; Wheeler et al., 2003).”
BackgroundTesting Effects Measured with Alternate Test Forms
Duchastel, P. C., & Nungester, R. J. (1982) · The Journal of Educational Research · doi:10.1080/00220671.1982.10885400 · Cited by 47
Cited by
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066
Rethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544
Transfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286
Retrieval-Based Learning: Active Retrieval Promotes Meaningful Learning
Karpicke, J. D. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412443552 · Cited by 277
Metadata
- Authors
- Hinze, S. R., & Wiley, J.
- Venue
- Memory
- Publisher
- Informa UK Limited
- Published
- 2011-04
- Volume
- 19
- Issue
- 3
- Pages
- 290-304
- ISSN
- 0965-8211 (ISSN-L)
- 1464-0686
- OpenAlex
- W2081838529
- Cited by
- 73
- References
- 20
- FWCI
- 2.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.