Does incorrect guessing impair fact learning?
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Taking a test has been shown to produce enhanced retention of the retrieved information. On tests, however, students often encounter questions the answers for which they are unsure. Should they guess anyway, even if they are likely to answer incorrectly? Or are errors engrained, impairing subsequent learning of the correct answer? We sought to answer this question in 3 experiments. In Experiments 1 and 2, subjects read 80 obscure facts (e.g., “Where is Disko Island? Greenland”) and then took a cued recall test. When a subject reported being unable to answer a question, on a randomly chosen half of those questions the computer program insisted upon a guess. Corrective feedback was provided either immediately (Experiment 1) or after a delay (Experiment 2). Forced guessing did not affect subjects' performance on a final test given 1 day later. We extended the investigation to more complex material in Experiment 3. Subjects saw a question (e.g., “Why do ice cubes often pop as they melt in your drink?”) and its answer, but for half of the questions, subjects did not see the answer until they first provided a plausible explanation. On a test administered either on the same day or 1 week later, recall performance was again unaffected by a prior wrong guess.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,459
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,051
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
BERLYNE, D. E. (1954) · British Journal of Psychology. General Section · doi:10.1111/j.2044-8295.1954.tb01243.x · Cited by 905
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T.-Y., & Camerer, C. F. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02402.x · Cited by 882 · cited 1×
“He argued that guessing enhanced curiosity about the topics and offered some evidence from subjects' self-reports that was consistent with this interpretation (cf. M. J. Kang et al., 2009).”
DISCRIMINATION LEARNING WITH AND WITHOUT “ERRORS”1
Terrace, H. S. (1963) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1963.6-1 · Cited by 725
Cited by
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Metcalfe, J. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044022 · Cited by 483
When and why do retrieval attempts enhance subsequent encoding?
Grimaldi, P. J., & Karpicke, J. D. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0174-0 · Cited by 200
“The second theory, which we refer to as an error correction theory, is that failed retrieval attempts enhance learning through a general error correction process (Carrier & Pashler, 1992; Kang et al., 2011; McClelland & Rumelhart, 1985).”
BackgroundThe benefit of generating errors during learning
Potts, R., & Shanks, D. R. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033194 · Cited by 166
Making related errors facilitates learning, but learners do not know it
Huelser, B. J., & Metcalfe, J. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0167-z · Cited by 171
“Similarly, Kang et al. (2011) found that forced guessing did not lead to better or worse memory for the correct answer on a later retention test, neither immediately nor at a 1-week delay.”
BackgroundRawson, K. A., & Dunlosky, J. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9203-1
“Third, regarding the amount of practice, prior research provides some relevant evidence suggesting that the benefit of retrieval practice is particularly pronounced when students answer correctly versus incorrectly (e.g., Pashler et al. 2003; Kang et al. 2011).”
BackgroundMethodInfluentialKornell, N. (2014) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0033699 · Cited by 88
Learning from errors: Students' and instructors' practices, attitudes, and beliefs
Pan, S. C., Sana, F., Samani, J., Cooke, J., & Kim, J. A. (2020) · Memory · doi:10.1080/09658211.2020.1815790 · Cited by 65
Pan, S. C., & Carpenter, S. K. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09814-5 · Cited by 60
“The prediction error account suggests that the discrepancy between an erroneous response and subsequent correct answer feedback triggers an error signal, which in turn enhances attention and subsequent learning (Kang et al., 2011; Metcalfe, 2017; see also Brod, 2021).”
BackgroundSelf-citationDistractors in Parsons Problems Decrease Learning Efficiency for Young Novice Programmers
Harms, K. J., Chen, J., & Kelleher, C. L. (2016) · Proceedings of the 2016 ACM Conference on International Computing Education Research · doi:10.1145/2960310.2960314 · Cited by 60
“…students Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page.”
BackgroundMera, Y., Rodríguez, G., & Marin-Garcia, E. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-02022-8 · Cited by 86
Predicting as a learning strategy
Brod, G. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01904-1 · Cited by 52
Failure to accept retractions: A contribution to the continued influence effect
O’Rear, A. E., & Radvansky, G. A. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00967-9 · Cited by 58
Prevention–Permission–Promotion: A Review of Approaches to Errors in Learning
Wong, S. S. H., & Lim, S. W. H. (2019) · Educational Psychologist · doi:10.1080/00461520.2018.1501693 · Cited by 51
“…cognitive and educational psychology studies have often investigated the effects of making errors on memory recall (e.g., Cyr & Anderson, 2015; Kang et al., 2011; Kornell et al., 2009) but seldom in relation to higher order learning outcomes such as evaluation and application, with some…”
BackgroundInfluentialMistakes as stepping stones: Effects of errors on episodic memory among younger and older adults.
Cyr, A.-A., & Anderson, N. D. (2015) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000073 · Cited by 47
Mullaney, K. M., Carpenter, S. K., Grotenhuis, C., & Burianek, S. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0441-y · Cited by 53
Self-citationToward consilience in the use of task-level feedback to promote learning
Butler, A. C., & Woodward, N. R. (2018) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/bs.plm.2018.09.001 · Cited by 50
Gordon, K. R. (2020) · Language Speech and Hearing Services in Schools · doi:10.1044/2020_lshss-19i-00001 · Cited by 46
Testing potentiates new learning in the misinformation paradigm
Gordon, L. T., & Thomas, A. K. (2013) · Memory & Cognition · doi:10.3758/s13421-013-0361-2 · Cited by 44
“Retrieval attempts may enhance subsequent learning through a general error correction process (Carrier & Pashler, 1992; Kang et al., 2011; McClelland & Rumelhart, 1985).”
BackgroundResultFailure to learn from feedback underlies word learning difficulties in toddlers at risk for autism
BEDFORD, R., GLIGA, T., FRAME, K., HUDRY, K., CHANDLER, S., JOHNSON, M. H., CHARMAN, T., & THE BASIS TEAM (2013) · Journal of Child Language · doi:10.1017/s0305000912000086 · Cited by 36
“…investigating learning in typically developing older children, performance in a fact-acquisition task was not affected by initial incorrect guessing (Kang, Pashler, Cepeda, Rohrer, Carpenter & Mozer, 2011), suggesting that self-generated hypotheses are typically easily overwritten by explicitly…”
Learning from errors is attributable to episodic recollection rather than semantic mediation
Metcalfe, J., & Huelser, B. J. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107296 · Cited by 43
Prequestions do not enhance the benefits of retrieval in a STEM classroom
Geller, J., Carpenter, S. K., Lamm, M. H., Rahman, S., Armstrong, P. I., & Coffman, C. R. (2017) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-017-0078-z · Cited by 35
“Assuming that the learning gains from practice questions would be enhanced when feedback is provided (Carpenter, Sachs, Martin, Schmidt, & Looft, 2012; Fazio, Huelser, Johnson, & Marsh, 2010; Finn & Metcalfe, 2010; Kang et al., 2011; Pashler, Cepeda, Wixted, & Rohrer, 2005), practice questions on two occasions might b…”
BackgroundSelf-citationHuff, M. J., Davis, S. D., & Meade, M. L. (2013) · Memory & Cognition · doi:10.3758/s13421-013-0299-4 · Cited by 37
“…the contagion items (because of the schematic nature of the scenes; cf. Brewer & Treyens, 1981) and that these contagion items were persisting on subsequent tests (cf. Bartlett, 1932; Kang et al., 2011; Kay, 1955; Lane, Mather, Villa, & Morita, 2001; McDermott, 1996; Roediger et al., 1996).”
Believing that Humans Swallow Spiders in Their Sleep
Marsh, E. J., Cantor, A. D., & Brashier, N. M. (2015) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/bs.plm.2015.09.003 · Cited by 51
“Across experiments, forced guessing yielded performance that matched, and sometimes exceeded, studying (Kornell, Hays, & Bjork, 2009; see also Grimaldi & Karpicke, 2012; Kang et al., 2011).”
ResultThe Value of Standardized Testing: A Perspective From Cognitive Psychology
Benjamin, A. S., & Pashler, H. (2015) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732215601116 · Cited by 46
“Even when tests require people to construct explanations for scientific observations, being required to produce what were generally erroneous speculations did not reduce subsequent learning from feedback (Kang et al., 2011).”
BackgroundSelf-citationRetrieval practice and spacing effects in multi-session treatment of naming impairment in aphasia
Middleton, E. L., Rawson, K. A., & Verkuilen, J. (2019) · Cortex · doi:10.1016/j.cortex.2019.07.003 · Cited by 29
Carpenter, S. K., Sachs, R. E., Martin, B., Schmidt, K., & Looft, R. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0185-7 · Cited by 36
Self-citationLearning from your mistakes: does it matter if you’re out in left foot, I mean field?
Cyr, A.-A., & Anderson, N. D. (2018) · Memory · doi:10.1080/09658211.2018.1464189 · Cited by 20
“…& Metcalfe, 2012; Kornell, Hays, & Bjork, 2009; Metcalfe, 2017; Vaughn & Rawson, 2012), and also for more pedagogical materials such as facts (Kang et al., 2011; Richland, Kornell & Kao, 2009; Kornell, Klein, & Rawson, 2015; Pashler, Rohrer, Cepeda, & Carpenter, 2007; Pressley, Tanenbaum,…”
BackgroundInfluentialErrorful and errorless learning: The impact of cue–target constraint in learning from errors
Bridger, E. K., & Mecklinger, A. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0408-z · Cited by 24
Wong, S. S. H. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09739-z · Cited by 21
Moments of Confusion in Simulation-Based Learning Environments
Nawaz, S., Kennedy, G. E., Bailey, J., & Mead, C. (2020) · Journal of Learning Analytics · doi:10.18608/jla.2020.73.9 · Cited by 24
“Examples of such learning designs are refutation texts (Tippett, 2010), desirable difficulties (Bjork, 2011), productive failure (Kapur, 2016), and impasse-driven learning (Brown & VanLehn, 1980; VanLehn, Siler, Murray, Yamauchi, & Baggett, 2003).”
The benefits of errors during training
Eldridge, H., Stimac, J., & Vanderkolk, J. R. (2021) · Forensic Science International Synergy · doi:10.1016/j.fsisyn.2021.100207 · Cited by 19
“In a rare break from word-pair or general-knowledge testing studies often used in this domain, Kang [19] focused on studying the learning of unfamiliar scientific phenomena that were either explained upfront, or explained only after the subjects were required to think up a plausible explanation (which was often incorr…”
BackgroundMetcalfe, J., & Eich, T. S. (2019) · Cognitive Research Principles and Implications · doi:10.1186/s41235-019-0153-8 · Cited by 20
Memory and availability-biased metacognitive illusions for flags of varying familiarity
Blake, A. B., & Castel, A. D. (2018) · Memory & Cognition · doi:10.3758/s13421-018-0872-y · Cited by 16
Enhancing the quantity and accuracy of eyewitness memory via initial memory testing
Pansky, A., & Nemets, E. (2011) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2011.06.001 · Cited by 18
The costs and benefits of testing and guessing on recognition memory.
Huff, M. J., Balota, D. A., & Hutchison, K. A. (2016) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000269 · Cited by 12
Huff, M. J., Yates, T. J., & Balota, D. A. (2018) · Memory · doi:10.1080/09658211.2018.1467929 · Cited by 11
“…previous research has indicated that, in cases in which corrective feedback is not provided, errors generated on early tests often persist into later tests at high rates (Bartlett, 1932/1967; Huff, Davis, & Meade, 2013; Kang et al., 2011; Kay, 1955; McDermott, 1996; Tse, Balota, & Roediger, 2010).”
Scheper, I., de Bruijn, E. R. A., Bertens, D., Kessels, R. P. C., & Brazil, I. A. (2019) · Memory · doi:10.1080/09658211.2019.1661493 · Cited by 12
“Several studies have demonstrated that TEL can be ben-e fi cial, depending on factors like the timing of feedback (Kang et al., 2011; Kornell, 2014), the presence of a relationship between a recall cue and the target stimulus (Bridger & Mecklinger, 2014; Grimaldi & Karpicke, 2012; Huesler &…”
BackgroundPan, S. C., Yu, L., Wong, M. J., Selvarajan, G., & Teo, A. Z. J. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104608 · Cited by 11
Effects of making errors in learning a foreign language
Guzmán-Muñoz, F. J. (2020) · Journal of Cognitive Psychology · doi:10.1080/20445911.2020.1711766 · Cited by 12
Fraundorf, S. H., Caddick, Z. A., Nokes‐Malach, T. J., & Rottman, B. M. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00508-8 · Cited by 10
“…errors generated by learners in practice testing do not impair long-term performance (Butler et al., 2008, EL: 3; Huelser & Metcalfe, 2012, EL: 3; Kang et al., 2011a, 2011b, EL: 3; Kornell et al., 2015, EL: 3; Kornell et al., 2009, EL: 3; Kornell & Metcalfe, 2014, EL: 4; Metcalfe, 2017, EL: 3;…”
Maraver, M. J., Lapa, A., Garcia‐Marques, L., Carneiro, P., & Raposo, A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0272427 · Cited by 14
Umanath, S., Barrett, T. E., Kim, S., Walsh, C. A., & Coane, J. H. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1145278 · Cited by 5
“The benefits of corrective feedback are especially powerful when the error is semantically related to the correct answer (Kang et al., 2011; Huelser and Metcalfe, 2012).”
BackgroundA Personalized Online Homework System in a Freshman Engineering Linear Algebra Course
Kang, K., Wong, W. P., Liu, X., Kushnarev, S., Tan, D. Y., Ortiz, O., Goyal, S., & Singhal, R. (2021) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale52509.2021.9678890 · Cited by 4
The Pretesting Effect: Exploring the Impact of Feedback and Final Test Timing
Mera, Y., Dianova, N., & Marin-Garcia, E. (2025) · Journal of Cognition · doi:10.5334/joc.455 · Cited by 4
“Retrieval practice, in contrast, follows a study phase, allowing for more meaningful retrieval attempts and clearer comparisons between correct and incorrect responses (e.g., Kang et al., 2011).”
Protective effects of testing across misinformation formats in the household scene paradigm
Pereverseff, R. S., Bodner, G. E., & Huff, M. J. (2019) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021819881948 · Cited by 3
The Testing Effect: Looking Through Implicit Theories’ Perspectives
Devi, S. P., & Mishra, A. K. (2023) · Psychological Studies · doi:10.1007/s12646-022-00710-6 · Cited by 3
“However, the benefit of testing is far beyond the evaluation purpose; it becomes a mechanism that enhances knowledge acquisition (Kang et al., 2011; Richland et al., 2009; Roediger & Karpicke, 2006).”
BackgroundWhy do learners ignore expected feedback in making metacognitive decisions about retrieval practice?
Toppino, T. C., Heslin, K. A., Curley, T. M., Jackiewicz, M. K., Flowers, C. S., & Phelan, H.-A. (2021) · Memory & Cognition · doi:10.3758/s13421-021-01171-4 · Cited by 2
Memory interference and the benefits and costs of testing
Potts, R. B. (2014) · UCL Discovery (University College London) · Cited by 4
Testing before learning: Exploring the robustness of the pretesting effect
Mera, Y., Dianova, N., & Marin-Garcia, E. (2025) · Memory & Cognition · doi:10.3758/s13421-025-01813-x · Cited by 6
“…various types of learning materials, including word pairs (Clark, 2016; Grimaldi & Karpicke, 2012; Vaughn & Rawson, 2012), factual information (Kang et al., 2011; Richland et al., 2009), sentence translations (Guzmán-Muñoz, 2020), and video lectures (Toftness et al., 2018), in both laboratory…”
Li, X., Bai, H., Feng, X., Liang, Z., Chen, S., & Zhao, Q. (2026) · Learning and Instruction · doi:10.1016/j.learninstruc.2026.102356 · Cited by 1
Pan, S. C., & Carpenter, S. K. (2023) · doi:10.31234/osf.io/9rqpm · Cited by 1
Self-citationCourtier, P. (2019) · theses.fr (ABES) · doi:10.70675/42da4bccz458fz4926z892ez2baec0cd1f73 · Cited by 21
Rozbruch, E. V. (2015) · CU Scholar (University of Colorado Boulder) · doi:10.13140/rg.2.1.1307.8486
Bedford, R. (2012) · IOE EPrints
The Effect of Overt/Covert Unsuccessful Retrieval upon Subsequent Learning
서, 혜., Park, J., & 남, 서. (2012) · 한국심리학회지: 인지 및 생물 · doi:10.22172/cogbio.2012.24.3.001
Pan, S. C., Sana, F., Samani, J., Cooke, J., & Kim, J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/eqmhu
Burt, J. S., Leggett, J. M. I., Chalmers, K. A., & Boulton, P. A. (2021) · Memory · doi:10.1080/09658211.2021.1988645 · Cited by 1
A Positive-Negative Dual-View Model for Knowledge Tracing
Xu, Q., Chen, G., Shuai, L., Pu, S., Liu, H., & Hao, T. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-5847-4_35
Learning from errors: deliberate errors enhance learning
Qiang, X., Ma, X., & Li, T. (2025) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2025.102379 · Cited by 3
Multiple Practice Success Scaffolds Long-Term Test-Enhanced Learning in Preschoolers
Káldi, T., Szöllősi, Á., & Racsmány, M. (2025) · Child Development · doi:10.1111/cdev.70018 · Cited by 1
“Similarly, incorrect guessing does not impair long-term retention when feedback is provided (Kang et al. 2011), and feedback only improves retrieval practice efficiency when retrieval is unsuccessful (Pashler et al. 2005).”
Huelser, B. J. (2014) · doi:10.7916/d8kw5d5c · Cited by 1
Pretesting effects for facts reflect lexical over semantic or structural features
Pan, S. C., & Siauw, F. A. (2026) · Memory & Cognition · doi:10.3758/s13421-025-01823-9
“Future research could explore whether similar patterns occur with term-definition facts (e.g., Pan & Rick-ard, 2017) or more complex fact learning (e.g., Kang et al., 2011).”
Der Vortesteffekt: Wenn Tests bereits vor dem Lernen das Gedächtnis fördern
Kliegl, O. (2026) · Psychologische Rundschau · doi:10.1026/0033-3042/a000750
A Comparison of Traditional and Non-traditional True-False Measures in a Business Task
Perlow, R., & Kopp, L. S. (2026) · International Journal of Business and Social Science Research · doi:10.47742/ijbssr.v7n4p1
“…methods to understand guessing behavior better (Campbell, 2015; Chiu & Camilli, 2013; Dutke & Barenberg, 2015; Espinosa & Gardeazabal, 2010; Kang, Pashler, Cepeda, Rohrer, Carpenter, & Mozer, 2011; Lau, Lau, Hong, & Usop, 2011; Siddiqui, Bhavsar, Bhavsar & Bose 2016), one gap in the…”
Safadi, M. A., Chatburn, A., Cross, Z. R., Dawson, S., & Bornkessel‐Schlesewsky, I. (2026) · doi:10.21428/8e6ba8ef.029c9ce6
Metadata
- Authors
- Kang, S. H. K., Pashler, H., Cepeda, N. J., Rohrer, D., Carpenter, S. K., & Mozer, M. C.
- Affiliations
- University of California San Diego (US)
- York University (CA)
- University of South Florida (US)
- Iowa State University (US)
- University of Colorado Boulder (US)
- Venue
- Journal of Educational Psychology
- Published
- 2011
- Volume
- 103
- Issue
- 1
- Pages
- 48-59
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W1969239630
- Cited by
- 67
- References
- 41
- Citations by year
- 2026: 5 · 2025: 5 · 2023: 7 · 2022: 1 · 2021: 6 · 2020: 5 · 2019: 7 · 2018: 6 · 2017: 1 · 2016: 3 · 2015: 3 · 2014: 5 · 2013: 5 · 2012: 5
- FWCI
- 2.91
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Educational Psychology (publishedVersion)
- Digital Commons - University of South Florida (University of South Florida) (submittedVersion)
- Funders
- US Department of Education (R305H020061; R305H040108)
- National Science Foundation (BCS-0720375, SBE-0542013)
- J. S. McDonnell Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- guessing, fact learning, retrieval practice, incorrect answers, corrective feedback, cued recall, memory retention, self-assessment of knowledge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.