Effects of testing on learning of functions
Open accessAbstract
Is learning of a complex functional relationship enhanced by trying to predict what output will go with a given input, as compared to studying an input-output pair? We examined learning of a bilinear function and transfer to new items outside the trained range. Subjects either saw the input-output pairs (study-only condition) or attempted to guess the output and then saw the pair (test/study condition). The total study times were equated, and motivation was enhanced with a monetary bonus. Performance was markedly better for the test/study condition, both within the trained range and in the transfer test. This benefit of testing during training was observed on a criterial test administered shortly after training. Testing has long been shown to enhance the explicit learning and retention of verbal material; our present findings reveal a novel domain for which testing can also be advantageous-that is, function learning.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Retrieval benefits have also been found with non-declarative tasks, including resuscitation skills learning and inductive learning of input-output functions.
“Retrieval benefits have also been found with non-declarative tasks, including resuscitation skills learning (Kromann et al., 2009) and inductive learning of input-output functions (Kang et al., 2011).”
From Neural Correlates of Long-Term Memory Enhancement Following Retrieval Practice (2021) · cites this paper as Kang et al., 2011
The Abstract reports that predicting outputs during training improved learning of input-output functions compared with studying the pairs. The Discussion cautions, however, that participants may not have retrieved prior examples from memory, so the study establishes a testing benefit but not necessarily a retrieval benefit. (LLM, conf=0.83)
Experimental — accuracy not yet measuredRetrieval practice can enhance near transfer.
“The phenomenon of retrieval-induced facilitation has ties to the literature on transfer, which has shown that retrieval practice can enhance near transfer (Butler 2010, Kang et al. 2011, Rohrer et al. 2010).”
From Practicing Retrieval Facilitates Learning (2021) · cites this paper as Kang et al. 2011
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The role of theories in conceptual coherence.
Murphy, G. L., & Medin, D. L. (1985) · Psychological Review · doi:10.1037/0033-295x.92.3.289 · Cited by 2,805 · see citing works
Information Processing and Cognition: The Loyola Symposium
Brown, A. S., & Solso, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421430 · Cited by 2,398 · see citing works
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037 · see citing works
The paramorphic representation of clinical judgment.
Hoffman, P. (1960) · Psychological Bulletin · doi:10.1037/h0047807 · Cited by 711 · see citing works
The influence of retrieval on retention
Carrier, L. M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 580 · see citing works
Self-citationProbabilistic functioning and the clinical method.
Hammond, K. R. (1955) · Psychological Review · doi:10.1037/h0046845 · Cited by 535 · see citing works
Cue strength as a moderator of the testing effect: The benefits of elaborative retrieval.
Carpenter, S. K. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0017021 · Cited by 503 · see citing works
Misperception of exponential growth
Wagenaar, W. A., & Sagaria, S. D. (1975) · Perception & Psychophysics · doi:10.3758/bf03204114 · Cited by 293 · see citing works
The essential brunswik: Beginnings, explications, applications.
Brunswik, E., Hammond, K. R., & Stewart, T. R. (2001) · Cited by 292 · see citing works
Application of the testing and spacing effects to name learning
Carpenter, S. K., & DeLosh, E. L. (2005) · Applied Cognitive Psychology · doi:10.1002/acp.1101 · Cited by 270 · see citing works
Knowledge Concepts and Categories
Lamberts, K. (2013) · Psychology Press eBooks · doi:10.4324/9780203765418 · Cited by 248 · see citing works
Altering memory representations through retrieval.
McDaniel, M. A., & Masson, M. E. J. (1985) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.11.2.371 · Cited by 229 · see citing works
Self-citationTests enhance the transfer of learning
Rohrer, D., Taylor, K., & Sholar, B. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0017678 · Cited by 217 · see citing works
Extrapolation: The sine qua non for abstraction in function learning.
DeLosh, E. L., Busemeyer, J. R., & McDaniel, M. A. (1997) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.23.4.968 · Cited by 210 · see citing works
Self-citationEffects of recall tests on long-term retention of paired associates
Allen, G. A., Mahler, W. A., & Estes, W. K. (1969) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(69)80090-3 · Cited by 180 · see citing works
On the analysis of the factor of recall in the learning process.
Abott, E. E. (1909) · The Psychological Monographs · doi:10.1037/h0093018 · Cited by 159 · see citing works
Tests and test feedback as learning sources
McDaniel, M. A., & Fisher, R. P. (1991) · Contemporary Educational Psychology · doi:10.1016/0361-476x(91)90037-l · Cited by 137 · see citing works
Self-citationTesting beyond words: using tests to enhance visuospatial map learning
Carpenter, S. K., & Pashler, H. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194092 · Cited by 133 · see citing works
Self-citationExtrapolation: The sine qua non for abstraction in function learning.
DeLosh, E. L., Busemeyer, J. R., & McDaniel, M. A. (1997) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.23.4.968 · Cited by 120 · see citing works
Self-citationPROCEEDINGS OF THE TWENTY-SIXTH ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY
Goede, D. D., Wester, F., den Ouden, D., Bastiaanse, R., Shapiro, L. P., & Swinney, D. (2005) · Conference Cognitive Science · Cited by 119 · see citing works
Function learning: Induction of continuous stimulusesponse relations.
Koh, K., & Meyer, D. E. (1991) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.17.5.811 · Cited by 95 · see citing works
Carroll, J. D. (1963) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1963.tb00958.x · Cited by 94 · see citing works
Retrieval As A Memory Modifier: An Interpretation of Negative Recency and Related Phenomena
Bjork, R. A. (2024) · Routledge eBooks · doi:10.4324/9781032722450-7 · Cited by 90 · see citing works
Busemeyer, J. R., Byun, E., DeLosh, E. L., & McDaniel, M. A. (1997) · The MIT Press eBooks · doi:10.7551/mitpress/4071.003.0015 · Cited by 86 · see citing works
Self-citationEnhancing visuospatial learning: The benefit of retrieval practice
Kang, S. H. K. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.1009 · Cited by 77 · see citing works
Self-citationFunction learning: Induction of continuous stimulus-response relations.
Koh, K., & Meyer, D. E. (1991) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.17.5.811 · Cited by 77 · see citing works
McDaniel, M. A., & Busemeyer, J. R. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196347 · Cited by 65 · see citing works
Self-citationProceedings of the Twenty- Sixth Annual Conference of the Cognitive Science Society.
Forbus, K., Gentner, D., & Regier (2004) · Cited by 62 · see citing works
Is a test trial a training trial in free recall learning?
Lachman, R., & Laughery, K. R. (1968) · Journal of Experimental Psychology · doi:10.1037/h0025278 · Cited by 60 · see citing works
Using Testing to Enhance Learning: A Comparison of Two Hypotheses
Mozer, M. C., Pashler, H., & Howe, M. (2004) · PsycEXTRA Dataset · doi:10.1037/e537052012-223 · Cited by 21 · see citing works
Self-citationPredicting transfer performance: A comparison of competing function learning models.
McDaniel, M. A., Dimperio, E., Griego, J. A., & Busemeyer, J. R. (2009) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0013982 · Cited by 20 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- Hove, U.K.: Psychology Press.
Cited by
Sorted by citations
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138 · see citing works
Spaced Repetition Promotes Efficient and Effective Learning: Policy Implications for Instruction
Kang, S. H. K. (2016) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732215624708 · Cited by 408 · see citing works
Self-citationTransfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286 · see citing works
Testing Enhances the Transfer of Learning
Carpenter, S. K. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412452728 · Cited by 230 · see citing works
Comparative effects of test‐enhanced learning and self‐explanation on long‐term retention
Larsen, D. P., Butler, A. C., & Roediger, H. L., III (2013) · Medical Education · doi:10.1111/medu.12141 · Cited by 193 · see citing works
The science of effective learning with spacing and retrieval practice
Carpenter, S. K., Pan, S. C., & Butler, A. C. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00089-1 · Cited by 184 · see citing works
van Gog, T., & Sweller, J. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9310-x · Cited by 164 · see citing works
Practicing Retrieval Facilitates Learning
McDermott, K. B. (2021) · Annual review of psychology · doi:10.1146/annurev-psych-010419-051019 · Cited by 113 · see citing works
Learning as a Generative Activity: Eight Learning Strategies that Promote Understanding
Fiorella, L., & Mayer, R. E. (2015) · Cited by 109 · see citing works
Neurocognitive mechanisms of the “testing effect”: A review
van den Broek, G. S. E., Takashima, A., Wiklund‐Hörnqvist, C., Wirebring, L. K., Segers, E., Verhoeven, L. T. W., & Nyberg, L. H. (2016) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2016.05.001 · Cited by 91 · see citing works
Tests enhance retention and transfer of spatial learning
Carpenter, S. K., & Kelly, J. W. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0221-2 · Cited by 69 · see citing works
van Gog, T., Kester, L., Dirkx, K., Hoogerheide, V., Boerboom, J., & Verkoeijen, P. P. J. L. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9297-3 · Cited by 68 · see citing works
Ecological Validity of the Testing Effect: The Use of Daily Quizzes in Introductory Psychology
Batsell, W. R., Perry, J. L., Hanley, E., & Hostetter, A. B. (2017) · Teaching of Psychology · doi:10.1177/0098628316677492 · Cited by 56 · see citing works
Yeo, D. J. S., & Fazio, L. K. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000268 · Cited by 55 · see citing works
Testing can counteract proactive interference by integrating competing information
Wahlheim, C. N. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0455-5 · Cited by 48 · see citing works
Extending Cognition to External Agents
Nestojko, J. F., Finley, J. R., & Roediger, H. L., III (2013) · Psychological Inquiry · doi:10.1080/1047840x.2013.844056 · Cited by 48 · see citing works
Effects of spaced versus massed training in function learning.
McDaniel, M. A., Fadler, C. L., & Pashler, H. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0032184 · Cited by 43 · see citing works
Self-citationHodges, N. J., & Lohse, K. R. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.08.006 · Cited by 35 · see citing works
Bailey, E. G., Jensen, J. L., Nelson, J., Wiberg, H. K., & Bell, J. D. (2017) · CBE—Life Sciences Education · doi:10.1187/cbe.16-02-0104 · Cited by 32 · see citing works
Strategies for remediating the impact of math anxiety on high school math performance
Pizzie, R. G., & Kraemer, D. J. M. (2023) · npj Science of Learning · doi:10.1038/s41539-023-00188-5 · Cited by 41 · see citing works
Four semesters investigating frequency of testing, the testing effect, and transfer of training.
Foss, D. J., & Pirozzolo, J. W. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000197 · Cited by 30 · see citing works
Does test-enhanced learning transfer for triple associates?
Pan, S. C., Wong, C. M., Potter, Z. E., Mejia, J., & Rickard, T. C. (2015) · Memory & Cognition · doi:10.3758/s13421-015-0547-x · Cited by 22 · see citing works
Testing Effect on High-Level Cognitive Skills
Jensen, J. L., McDaniel, M. A., Kummer, T. A., Godoy, P. D. D. M., & Clair, B. S. (2020) · CBE—Life Sciences Education · doi:10.1187/cbe.19-10-0193 · Cited by 21 · see citing works
Self-citationEmerging and Future Directions in Test-Enhanced Learning Research
Pan, S. C., Dunlosky, J., Xu, K. M., & Ouwehand, K. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09857-2 · Cited by 18 · see citing works
Long-term inference and memory following retrieval practice
Siler, J., & Benjamin, A. S. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00997-3 · Cited by 18 · see citing works
Test-potentiated learning of motor sequences
Tempel, T., & Kubik, V. (2016) · Memory · doi:10.1080/09658211.2016.1171880 · Cited by 14 · see citing works
Testing promotes effector transfer
Boutin, A., Panzer, S., Salesse, R. N., & Blandin, Y. (2012) · Acta Psychologica · doi:10.1016/j.actpsy.2012.09.014 · Cited by 11 · see citing works
Neural Correlates of Long-Term Memory Enhancement Following Retrieval Practice
Marin-Garcia, E., Mattfeld, A. T., & Gabrieli, J. D. E. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.584560 · Cited by 11 · see citing works
When high working memory capacity is and is not beneficial for predicting nonlinear processes
Fischer, H., & Holt, D. V. (2016) · Memory & Cognition · doi:10.3758/s13421-016-0665-0 · Cited by 11 · see citing works
Confidence in accuracy moderates the benefits of retrieval practice
Zhang, M., Chen, X., & Liu, X. L. (2018) · Memory · doi:10.1080/09658211.2018.1529796 · Cited by 9 · see citing works
Perez, K. D. (2011) · Cited by 9 · see citing works
Effects of making errors in learning a foreign language
Guzmán-Muñoz, F. J. (2020) · Journal of Cognitive Psychology · doi:10.1080/20445911.2020.1711766 · Cited by 6 · see citing works
Fraundorf, S. H., Caddick, Z. A., Nokes‐Malach, T. J., & Rottman, B. M. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00508-8 · Cited by 10 · see citing works
Bailey, E. G., Greenall, R. F., Tullis, M. M., & Williams, K. R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250143 · Cited by 7 · see citing works
MEMCONS: How Contemporaneous Note‐Taking Shapes Memory for Conversation
Brown‐Schmidt, S., Jaeger, C. B., Evans, M. J., & Benjamin, A. S. (2023) · Cognitive Science · doi:10.1111/cogs.13271 · Cited by 7 · see citing works
Tempel, T., Kaufmann, K., Kranz, J., & Möller, A. (2018) · Psychological Research · doi:10.1007/s00426-018-1088-2 · Cited by 6 · see citing works
Tracing the path of forgetting in rule abstraction and exemplar retrieval
Hoffmȧnn, J., von Helversen, B., Weilbächer, R. A., & Rieskamp, J. (2018) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021817739861 · Cited by 6 · see citing works
Treating limb apraxia via action semantics: a preliminary study
Stoll, H., de Wit, M. M., Middleton, E. L., & Buxbaum, L. J. (2020) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2020.1762672 · Cited by 5 · see citing works
Do Domain Knowledge and Retrieval Practice Predict Students’ Study Order Decisions?
Babineau, A. L., Witherby, A. E., Ariel, R., Pelch, M. A., & Tauber, S. K. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10040122 · Cited by 3 · see citing works
Xiaofeng, M. A., Zhou, A., Cui, D., & ZHANG, R. (2014) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2014.00279 · Cited by 2 · see citing works
Memory Skill: The Proceduralization of Declarative Memory Through Retrieval Practice
Racsmány, M., & Szőllősi, Á. (2021) · Language, Cognition, and Mind · doi:10.1007/978-3-030-66175-5_25 · Cited by 1 · see citing works
Does Covert Retrieval Benefit Adolescents’ Learning in 8th Grade Science Classes?
Witherby, A. E., Northern, P. E., & Tauber, S. K. (2025) · Behavioral Sciences · doi:10.3390/bs15070843 · Cited by 1 · see citing works
Fiorella, L., & Mayer, R. E. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781107707085.008 · Cited by 1 · see citing works
Fain, R. J., Hieb, J., Ralston, P. A. S., & Lyle, K. B. (2015) · ASEE Annual Conference & Exposition · doi:10.18260/p.23660 · Cited by 1 · see citing works
Arenas, C. J. M. (2014) · Scholars' Bank (University of Oregon) · Cited by 1 · see citing works
Test-enhanced learning, working memory and fluid intelligence
Nordstrand, D. (2016) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 1 · see citing works
Strategies for Remediating the Impact of Math Anxiety on High School Math PerformancePreprint
Pizzie, R. G., & Kraemer, D. (2017) · doi:10.31234/osf.io/ye526 · Cited by 1 · see citing works
The Effect of JOLs and Free Recall on Reading Comprehension and Study Choices
Beziat, T. L. R., & Was, C. A. (2015) · International Research in Higher Education · doi:10.5430/irhe.v1n1p60
The Testing Effect and Judgments of Learning: Their Effects on Reading Comprehension.
Beziat, R., & Lynne, T. (2012) · ProQuest LLC eBooks
Psychological Inquiry: An International Journal for the Advancement of Psychological Theory
Nestojko, J. F., Finley, J. R., & Roediger, H. L., III (2013)
The testing effect and recall : exploring the role of attention in long-term retention
Lutz, R. R., & Kim, G. H. (2012)
Pan and Rickard (2018) Transfer of test-enhanced learning meta-analysis (preprint)Preprint
Pan, S. C. (2018) · doi:10.31234/osf.io/4qpyn
Examining the Transfer of Function Representations
Douglass, A., & Kalish, M. (2019) · Syracuse University Libraries (Syracuse University) · doi:10.17605/osf.io/j6cmr
Spaced Retrieval Improves Retention and Transfer of Foreign VocabularyPreprint
Alakbarova, D., & Ball, H. (2023) · doi:10.31234/osf.io/tfv64
Pan, S. C., Dunlosky, J. T., Xu, K. M., & Ouwehand, K. (2024) · doi:10.31234/osf.io/gs5yr
The Promoting Effect of Retrieval Practice Effect on Students’ Learning
詹, 静. (2024) · Advances in Social Sciences · doi:10.12677/ass.2024.138708
Qu, K., Wang, X., Zhou, J., & Zhang, Y. (2026) · Current Psychology · doi:10.1007/s12144-026-09632-2
- Authors
- Kang, S. H. K., McDaniel, M. A., & Pashler, H.
- Affiliations
- University of California San Diego (US)
- Washington University in St. Louis (US)
- Corresponding author
- Kang, Sean H. K.
- Venue
- Psychonomic Bulletin & Review
- Published
- 2011-06-01
- Volume
- 18
- Issue
- 5
- Pages
- 998-1005
- ISSN
- 1069-9384 (ISSN-L)
- 1531-5320
- OpenAlex
- W2116422964
- Cited by
- 57
- References
- 30
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 4 · 2022: 2 · 2021: 3 · 2020: 5 · 2019: 2 · 2018: 6 · 2017: 3 · 2016: 6 · 2015: 7 · 2014: 3 · 2013: 5 · 2012: 5
- FWCI
- 2.27
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Psychonomic Bulletin & Review (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Physical Sciences › Mathematics › Statistics and Probability › Cognitive and developmental aspects of mathematical skills
- Keywords
- testing effect, function learning, bilinear functions, transfer of learning, input-output pairs, explicit learning, financial incentives, motivation
- MeSH terms
- Educational Measurement, Humans, Learning, Models, Psychological, Motivation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review