Does incorrect guessing impair fact learning?
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Taking a test has been shown to produce enhanced retention of the retrieved information. On tests, however, students often encounter questions the answers for which they are unsure. Should they guess anyway, even if they are likely to answer incorrectly? Or are errors engrained, impairing subsequent learning of the correct answer? We sought to answer this question in 3 experiments. In Experiments 1 and 2, subjects read 80 obscure facts (e.g., “Where is Disko Island? Greenland”) and then took a cued recall test. When a subject reported being unable to answer a question, on a randomly chosen half of those questions the computer program insisted upon a guess. Corrective feedback was provided either immediately (Experiment 1) or after a delay (Experiment 2). Forced guessing did not affect subjects' performance on a final test given 1 day later. We extended the investigation to more complex material in Experiment 3. Subjects saw a question (e.g., “Why do ice cubes often pop as they melt in your drink?”) and its answer, but for half of the questions, subjects did not see the answer until they first provided a plausible explanation. On a test administered either on the same day or 1 week later, recall performance was again unaffected by a prior wrong guess.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,459
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
BERLYNE, D. E. (1954) · British Journal of Psychology. General Section · doi:10.1111/j.2044-8295.1954.tb01243.x · Cited by 905
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T.-Y., & Camerer, C. F. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02402.x · Cited by 882 · cited 1×
“He argued that guessing enhanced curiosity about the topics and offered some evidence from subjects' self-reports that was consistent with this interpretation (cf. M. J. Kang et al., 2009).”
DISCRIMINATION LEARNING WITH AND WITHOUT “ERRORS”1
Terrace, H. S. (1963) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1963.6-1 · Cited by 725
When implicit learning fails: Amnesia and the problem of error elimination
Baddeley, A., & Wilson, B. A. (1994) · Neuropsychologia · doi:10.1016/0028-3932(94)90068-x · Cited by 696
Test format and corrective feedback modify the effect of testing on long-term retention
Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440601056620 · Cited by 513
Self-citationUnsuccessful retrieval attempts enhance subsequent learning.
Kornell, N., Hays, M. J., & Bjork, R. A. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0015729 · Cited by 484 · cited 1×
“More recently, similar positive effects of prequestioning were also reported by Kornell, Hays, and Bjork (2009) and by Richland, Kornell, and Kao (2009).”
BackgroundWhen Does Feedback Facilitate Learning of Words?
Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.1.3 · Cited by 445
Self-citationThe Positive and Negative Consequences of Multiple-Choice Testing.
Roediger, H. L., & Marsh, E. J. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.5.1155 · Cited by 383
Generalizing test-enhanced learning from the laboratory to the classroom
Mcdaniel, M. A., Roediger, H. L., & Mcdermott, K. B. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194052 · Cited by 326
The pretesting effect: do unsuccessful retrieval attempts enhance learning?
Richland, L. E., Kornell, N., & Kao, L. S. (2009) · Journal of Experimental Psychology: Applied · doi:10.1037/a0016496 · Cited by 302
Enhancing learning and retarding forgetting: Choices and consequences
Pashler, H., Rohrer, D., Cepeda, N. J., & Carpenter, S. K. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194050 · Cited by 282
Self-citationEvans, J. J., Wilson, B. A., Schuri, U., Andrade, J., Baddeley, A., Bruna, O., Canavan, T., Del Sala, S., Green, R., Laaksonen, R., et al. (2000) · Neuropsychological Rehabilitation · doi:10.1080/096020100389309 · Cited by 243
Errors committed with high confidence are hypercorrected.
Butterfield, B., & Metcalfe, J. (2001) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.27.6.1491 · Cited by 223 · cited 1×
“The observed pattern is consistent with the hypercorrection effect reported by Butterfield and Metcalfe (2001), who found that errors made with high confidence were paradoxically better corrected after feedback.”
ResultAN EXPERIMENTAL STUDY OF HUMAN CURIOSITY
BERLYNE, D. E. (1954) · British Journal of Psychology. General Section · doi:10.1111/j.2044-8295.1954.tb01253.x · Cited by 186
The correction of errors committed with high confidence
Butterfield, B., & Metcalfe, J. (2006) · Metacognition and Learning · doi:10.1007/s11409-006-6894-z · Cited by 159
Errorless learning of novel associations in amnesia
Squires, E. J., Hunkin, N. M., & Parkin, A. J. (1997) · Neuropsychologia · doi:10.1016/s0028-3932(97)00039-0 · Cited by 153
Pressey, S. L. (1950) · The Journal of Psychology · doi:10.1080/00223980.1950.9916043 · Cited by 144
Surprising feedback improves later memory
Fazio, L. K., & Marsh, E. J. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.1.88 · Cited by 124
Feedback and response confidence.
Kulhavy, R. W., Yekovich, F. R., & Dyer, J. W. (1976) · Journal of Educational Psychology · doi:10.1037/0022-0663.68.5.522 · Cited by 103
LEARNING AND RETAINING VERBAL MATERIAL
Kay, H. (1955) · British Journal of Psychology · doi:10.1111/j.2044-8295.1955.tb00527.x · Cited by 89
The mnemonic mechanisms of errorless learning
Anderson, N. D., & Craik, F. I. M. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.05.026 · Cited by 86
When further learning fails: Stability and change following repeated presentation of text
Fritz, C. O., Morris, P. E., Bjork, R. A., Gelman, R., & Wickens, T. D. (2000) · British Journal of Psychology · doi:10.1348/000712600161952 · Cited by 74
Benefits of testing memory: Best practices and boundary conditions
(2009) · Current Issues in Applied Memory Research · doi:10.4324/9780203869611-10 · Cited by 64
Proceedings of the Twenty- Sixth Annual Conference of the Cognitive Science Society.
Forbus, K., Dedre Gentner, C., & Regier (2004) · Cited by 62
Jacoby, L. L., & Hollingshead, A. (1990) · Canadian Journal of Psychology / Revue canadienne de psychologie · doi:10.1037/h0084259 · Cited by 55
Thorndike, E. L. (1972) · Cited by 54
Learning and Programmed Instruction.
Taber, J. I., Glaser, R. J., & Schaefer, H. H. (1965) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 49
Conditioning: A theory of learning in terms of stimulus, response, and association.
Guthrie, E. R. (2007) · University of Chicago Press eBooks · doi:10.1037/11335-001 · Cited by 43
Learning from Tests: The Case of True-False Examinations
Toppino, T. C., & Ann Brochin, H. (1989) · The Journal of Educational Research · doi:10.1080/00220671.1989.10885940 · Cited by 41
Current Issues in Applied Memory Research
Davies, G. M. 1. (2009) · Psychology Press eBooks · doi:10.4324/9780203869611 · Cited by 40
Conditions of prequestioning and retention of meaningful material.
Berlyne, D. E. (1966) · Journal of Educational Psychology · doi:10.1037/h0023346 · Cited by 40
Generality of the Negative Suggestion Effect in Objective Tests
Toppino, T. C., & Luipersbeck, S. M. (1993) · The Journal of Educational Research · doi:10.1080/00220671.1993.9941229 · Cited by 38
Using Testing to Enhance Learning: A Comparison of Two Hypotheses: (537052012-223)
Mozer, M. C., Pashler, H. E., & Howe, M. (2004) · PsycEXTRA Dataset · doi:10.1037/e537052012-223 · Cited by 20
Self-citationGuessing and telling methods in learning words of a foreign language.
Forlano, G., & Hoffman, M. N. H. (1937) · Journal of Educational Psychology · doi:10.1037/h0056518 · Cited by 14
Cited by
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Metcalfe, J. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044022 · Cited by 483
When and why do retrieval attempts enhance subsequent encoding?
Grimaldi, P. J., & Karpicke, J. D. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0174-0 · Cited by 200
“The second theory, which we refer to as an error correction theory, is that failed retrieval attempts enhance learning through a general error correction process (Carrier & Pashler, 1992; Kang et al., 2011; McClelland & Rumelhart, 1985).”
BackgroundThe benefit of generating errors during learning
Potts, R., & Shanks, D. R. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033194 · Cited by 166
Making related errors facilitates learning, but learners do not know it
Huelser, B. J., & Metcalfe, J. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0167-z · Cited by 171
“Similarly, Kang et al. (2011) found that forced guessing did not lead to better or worse memory for the correct answer on a later retention test, neither immediately nor at a 1-week delay.”
Background
Metadata
- Authors
- Kang, S. H. K., Pashler, H., Cepeda, N. J., Rohrer, D., Carpenter, S. K., & Mozer, M. C.
- Affiliations
- University of California San Diego (US)
- York University (CA)
- University of South Florida (US)
- Iowa State University (US)
- University of Colorado Boulder (US)
- Venue
- Journal of Educational Psychology
- Published
- 2011
- Volume
- 103
- Issue
- 1
- Pages
- 48-59
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W1969239630
- Cited by
- 67
- References
- 41
- Citations by year
- 2026: 5 · 2025: 5 · 2023: 7 · 2022: 1 · 2021: 6 · 2020: 5 · 2019: 7 · 2018: 6 · 2017: 1 · 2016: 3 · 2015: 3 · 2014: 5 · 2013: 5 · 2012: 5
- FWCI
- 2.91
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Educational Psychology (publishedVersion)
- Digital Commons - University of South Florida (University of South Florida) (submittedVersion)
- Funders
- US Department of Education (R305H020061; R305H040108)
- National Science Foundation (BCS-0720375, SBE-0542013)
- J. S. McDonnell Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- guessing, fact learning, retrieval practice, incorrect answers, corrective feedback, cued recall, memory retention, self-assessment of knowledge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.