Test-enhanced learning of natural concepts: effects on recognition memory, classification, and metacognition

Jacoby, Larry L.; Wahlheim, Christopher N.; Coane, Jennifer H.

doi:10.1037/a0020636

Cited by 128Memory Processes and InfluencesMemory and Neural MechanismsCategorization, perception, and language

Test-enhanced learning of natural concepts: effects on recognition memory, classification, and metacognition

Jacoby, Larry L., Wahlheim, Christopher N., Coane, Jennifer H.·2010·Journal of Experimental Psychology Learning Memory and Cognition

DOI 10.1037/a0020636

Open this paper in CoChat — free account

Abstract

Three experiments examined testing effects on learning of natural concepts and metacognitive assessments of such learning. Results revealed that testing enhanced recognition memory and classification accuracy for studied and novel exemplars of bird families on immediate and delayed tests. These effects depended on the balance of study and test trials during training. Metacognitive measures provided results suggesting that participants were aware of the beneficial effects of testing. A new measure of metacognition at the level of categories is introduced and shown to be potentially useful for theory and applied purposes. It is argued that focusing on optimizing the learning of natural concepts encourages the convergence of theorizing about memory, concept learning, and metacognition and holds promise for the development of applications to education.

Integrity signals

Registry

Crossref · 10.1037/a0020636

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The benefits of testing have been shown to support non-verbal visual and spatial information, including locations on maps, identifying birds, name-face associations, statistics, and spatial locations of objects.
“However, the benefits of testing have been shown to support non-verbal visual and spatial information, including locations on maps (Carpenter and Pashler, 2007; Rohrer et al., 2010), identifying birds (Jacoby et al., 2010), name-face associations (Morris and Fritz, 2002; Helder and Shaughnessy, 2008), statistics (Szpunar et al., 2013), and spatial locations of objects (Sommer et al., 2008).”
From Neural Correlates of Long-Term Memory Enhancement Following Retrieval Practice (2021) · cites this paper as Jacoby et al., 2010

Detection Theory: A User's Guide
Macmillan, N. A., & Creelman, C. D. (1991) · Cited by 5,415 · see citing works
Cognitive representations of semantic categories.
Rosch, E. H. (1975) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.104.3.192 · Cited by 4,811 · see citing works
Taxonomy of Educational Objectives. Handbook I: Cognitive Domain
Bloom, B., & Krathwohl, D. R. (1966) · Cited by 4,624 · see citing works
Context theory of classification learning
Medin, D. L., & Schaffer, M. M. (1978) · Psychological Review · doi:10.1037/0033-295x.85.3.207 · Cited by 3,061 · see citing works
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867 · see citing works
Cognition and Categorization
Rosch, E. H., & Lloyd, B. (2024) · Routledge eBooks · doi:10.4324/9781032633275 · Cited by 2,865 · see citing works
The Big Book of Concepts
Murphy, G. L. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1602.001.0001 · Cited by 2,797 · see citing works
Similarity and Analogical Reasoning
(1989) · Cambridge University Press eBooks · doi:10.1017/cbo9780511529863 · Cited by 2,404 · see citing works
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037 · see citing works
On the genesis of abstract ideas.
Posner, M. I., & Keele, S. W. (1968) · Journal of Experimental Psychology · doi:10.1037/h0025953 · Cited by 1,983 · see citing works
"Schema abstraction" in a multiple-trace memory model.
Hintzman, D. L. (1986) · Psychological Review · doi:10.1037/0033-295x.93.4.411 · Cited by 1,918 · see citing works
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · see citing works
Metacognition
(1994) · The MIT Press eBooks · doi:10.7551/mitpress/4561.001.0001 · Cited by 1,741 · see citing works
Becoming a “Greeble” Expert: Exploring Mechanisms for Face Recognition
Gauthier, L., & Tarr, M. J. (1997) · Vision Research · doi:10.1016/s0042-6989(96)00286-6 · Cited by 1,017 · see citing works
A comparison of current measures of the accuracy of feeling-of-knowing predictions
Nelson, T. O. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.109 · Cited by 976 · see citing works
Metacognitive strategies in student learning: Do students practise retrieval when they study on their own?
Karpicke, J. D., Butler, A. C., & Roediger III, H. L. (2009) · Memory · doi:10.1080/09658210802647009 · Cited by 745 · see citing works
Object categories and expertise: Is the basic level in the eye of the beholder?
Tanaka, J. W., & Taylor, M. (1991) · Cognitive Psychology · doi:10.1016/0010-0285(91)90016-h · Cited by 730 · see citing works
Similarity, typicality, and categorization
Rips, L. J. (1989) · Cambridge University Press eBooks · doi:10.1017/cbo9780511529863.004 · Cited by 598 · see citing works
The influence of retrieval on retention
Carrier, L. M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 580 · see citing works
Testing the testing effect in the classroom
McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326154 · Cited by 563 · see citing works
Attention and performance XVII: Cognitive regulation of performance: Interaction of theory and application.
Gopher, D., & Koriat, A. (1999) · Cited by 550 · see citing works
Exemplar-based accounts of relations between classification, recognition, and typicality.
Nosofsky, R. M. (1988) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.14.4.700 · Cited by 524 · see citing works
Archives of Psychology
(2021) · Archives of Psychology · doi:10.31296/aop · Cited by 500 · see citing works
The intricate relationships between monitoring and control in metacognition: Lessons for the cause-and-effect relation between subjective experience and behavior.
Koriat, A., Ma’ayan, H., & Nussinson, R. (2006) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.135.1.36 · Cited by 424 · see citing works
Classification and cognition
Estes, W. K. (1994) · Choice Reviews Online · doi:10.5860/choice.32-1815 · Cited by 416 · see citing works
Training ‘greeble’ experts: a framework for studying expert object recognition processes
Gauthier, L., Williams, P., Tarr, M. J., & Tanaka, J. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00442-2 · Cited by 401 · see citing works
Retrieval-induced facilitation: Initially nontested material can benefit from prior testing of related material.
Chan, J. C. K., McDermott, K. B., & Roediger, H. L. (2006) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.135.4.553 · Cited by 364 · see citing works
Assessing Our Own Competence: Heuristics and Illusions
Bjork, R. A. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/1480.003.0023 · Cited by 340 · see citing works
The cognitive side of probability learning.
Estes, W. K. (1976) · Psychological Review · doi:10.1037/0033-295x.83.1.37 · Cited by 326 · see citing works
Recitation As a Factor in Memorizing
Gates, A. I. (2010) · Medical Entomology and Zoology · Cited by 317 · see citing works
Salience of item knowledge in learning artificial grammars.
Vokey, J. R., & Brooks, L. R. (1992) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.18.2.328 · Cited by 299 · see citing works
Analogic and abstraction strategies in synthetic grammar learning: A functionalist interpretation
Reber, A. S., & Allen, R. (1978) · Cognition · doi:10.1016/0010-0277(78)90013-6 · Cited by 285 · see citing works
Observational versus feedback training in rule-based and information-integration category learning
Ashby, F. G., Maddox, W. T., & Bohil, C. J. (2002) · Memory & Cognition · doi:10.3758/bf03196423 · Cited by 211 · see citing works
The Training and Transfer of Real-World Perceptual Expertise
Tanaka, J. W., Curran, T., & Sheinberg, D. L. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.00795.x · Cited by 176 · see citing works
Categories and resemblance.
Rips, L. J., & Collins, A. (1993) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.122.4.468 · Cited by 95 · see citing works
Event observation in probability learning.
Reber, A. S., & Millward, R. B. (1968) · Journal of Experimental Psychology · doi:10.1037/h0025760 · Cited by 71 · see citing works
Function of test trials in paired-associate learning.
Izawa, C. (1967) · Journal of Experimental Psychology · doi:10.1037/h0024971 · Cited by 70 · see citing works

Flagged first, then by citations

Sorted by citations

Improving Students’ Learning With Effective Learning Techniques: Promising Directions From Cognitive and Educational Psychology
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138 · see citing works
The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · see citing works
Rethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544 · see citing works
Ten Benefits of Testing and Their Applications to Educational Practice
Roediger, H. L., III, Putnam, A. L., & Smith, M. A. (2011) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-387691-1.00001-6 · Cited by 453 · see citing works
Testing (quizzing) boosts classroom learning: a systematic and meta-analytic review
Yang, C., Luo, L., Vadillo, M. A., Yu, R., & Shanks, D. R. (2021) · Psychological Bulletin · doi:10.1037/bul0000309 · Cited by 333 · see citing works
Transfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286 · see citing works
Testing Enhances the Transfer of Learning
Carpenter, S. K. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412452728 · Cited by 230 · see citing works
The science of effective learning with spacing and retrieval practice
Carpenter, S. K., Pan, S. C., & Butler, A. C. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00089-1 · Cited by 184 · see citing works
Spacing enhances the learning of natural concepts: an investigation of mechanisms, metacognition, and aging
Wahlheim, C. N., Dunlosky, J., & Jacoby, L. L. (2011) · Memory & Cognition · doi:10.3758/s13421-010-0063-y · Cited by 172 · see citing works
Self-citation
Retrieval practice & Bloom’s taxonomy: Do students need fact knowledge before higher order learning?
Agarwal, P. K. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000282 · Cited by 178 · see citing works
Relational categories as a bridge between cognitive and educational research.
Goldwater, M. B., & Schalk, L. (2016) · Psychological Bulletin · doi:10.1037/bul0000043 · Cited by 152 · see citing works
Covert retrieval practice benefits retention as much as overt retrieval practice.
Smith, M. A., Roediger, H. L., III, & Karpicke, J. D. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0033569 · Cited by 124 · see citing works
Using electronic flashcards to promote learning in medical students: retesting versus restudying
Schmidmaier, R., Ebersbach, R., Schiller, M., Hege, I., Holzer, M., & Fischer, M. R. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04043.x · Cited by 104 · see citing works
Metacognition About Practice Testing: a Review of Learners’ Beliefs, Monitoring, and Control of Test-Enhanced Learning
Rivers, M. L. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09578-2 · Cited by 104 · see citing works
The Power of Examples: Illustrative Examples Enhance Conceptual Learning of Declarative Concepts
Rawson, K. A., Thomas, R. C., & Jacoby, L. L. (2015) · Educational Psychology Review · doi:10.1007/s10648-014-9273-3 · Cited by 89 · see citing works
Self-citation
Testing unsuccessfully: A specification of the underlying mechanisms supporting its influence on retention
Knight, J. B., Ball, B. H., Brewer, G. A., Dewitt, M. R., & Marsh, R. L. (2012) · Journal of Memory and Language · doi:10.1016/j.jml.2011.12.008 · Cited by 76 · see citing works
A dual memory theory of the testing effect
Rickard, T. C., & Pan, S. C. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1298-4 · Cited by 65 · see citing works
Improving Learning Efficiency of Factual Knowledge in Medical Education
Yeh, D. D., & Park, Y. S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.03.012 · Cited by 64 · see citing works
Pop-up Questions Within Educational Videos: Effects on Students’ Learning
Haagsman, M. E., Scager, K., Boonstra, J. C., & Koster, M. (2020) · Journal of Science Education and Technology · doi:10.1007/s10956-020-09847-3 · Cited by 53 · see citing works
Desirable Difficulty: Theory and application of intentionally challenging learning
Nelson, A., & Eliasz, K. L. (2022) · Medical Education · doi:10.1111/medu.14916 · Cited by 60 · see citing works
Metacognitive judgments of repetition and variability effects in natural concept learning: evidence for variability neglect
Wahlheim, C. N., Finn, B., & Jacoby, L. L. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0180-2 · Cited by 53 · see citing works
Self-citation
Testing can counteract proactive interference by integrating competing information
Wahlheim, C. N. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0455-5 · Cited by 48 · see citing works
Self-citation
Extending Cognition to External Agents
Nestojko, J. F., Finley, J. R., & Roediger, H. L., III (2013) · Psychological Inquiry · doi:10.1080/1047840x.2013.844056 · Cited by 48 · see citing works
Category learning judgments in the classroom: Can students judge how well they know course topics?
Hartwig, M. K., & Dunlosky, J. T. (2016) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2016.12.002 · Cited by 40 · see citing works
Testing prepares students to learn better: The forward effect of testing in category learning.
Lee, H. S., & Ahn, D. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000211 · Cited by 40 · see citing works
Testing enhances learning: A review of the literature
Binks, S. (2018) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2017.08.008 · Cited by 38 · see citing works
A Systematic Review of the Testing Effect in Learning
Eisenkraemer, R. E., Jaeger, A., & Stein, L. M. (2013) · Paidéia (Ribeirão Preto) · doi:10.1590/1982-43272356201314 · Cited by 37 · see citing works
The forward effects of testing transfer to different domains of learning.
Yang, C., Chew, S.-J., Sun, B., & Shanks, D. R. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000320 · Cited by 35 · see citing works
Does Individual Performance Feedback Increase the Use of Retrieval Practice?
Hui, L., de Bruin, A. D., Donkers, J., & van Merriënboer, J. V. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09604-x · Cited by 29 · see citing works
The Value of Standardized Testing
Benjamin, A. S., & Pashler, H. (2015) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732215601116 · Cited by 32 · see citing works
Comparisons in Category Learning: How Best to Compare For What
Higgins, E. J., & Ross, B. H. (2011) · eScholarship (California Digital Library) · Cited by 30 · see citing works
The forward testing effect: Interim testing enhances inductive learning.
Yang, C., & Shanks, D. R. (2017) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000449 · Cited by 28 · see citing works
Concepts at the Interface
Shea, N. J. (2024) · doi:10.1093/9780191997167.001.0001 · Cited by 28 · see citing works
The effects of prequestions versus postquestions on memory retention in children.
de Lima, N. K., & Jaeger, A. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.08.005 · Cited by 24 · see citing works
Concept‐metacognition
Shea, N. J. (2019) · Mind & Language · doi:10.1111/mila.12235 · Cited by 21 · see citing works
Student‐Generated Pre‐Exam Questions is an Effective Tool for Participatory Learning: A Case Study from Ecology of Waterborne Pathogens Course
Teplitski, M., Irani, T. A., Krediet, C., Cesare, M. D., & Marvasi, M. (2018) · Journal of Food Science Education · doi:10.1111/1541-4329.12129 · Cited by 24 · see citing works
Testing enhances both memorization and conceptual learning of categorical materials.
Cho, K. W., & Powers, A. (2019) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2019.01.003 · Cited by 21 · see citing works
Testing Effect on High-Level Cognitive Skills
Jensen, J. L., McDaniel, M. A., Kummer, T. A., Godoy, P. D. D. M., & Clair, B. S. (2020) · CBE—Life Sciences Education · doi:10.1187/cbe.19-10-0193 · Cited by 21 · see citing works
Concept Appraisal
Thorne, S. R., Quilty‐Dunn, J., Smortchkova, J., Shea, N. J., & Hampton, J. A. (2021) · Cognitive Science · doi:10.1111/cogs.12978 · Cited by 20 · see citing works
The contribution of classroom exams to formative evaluation of concept-level knowledge
Rivers, M. L., Dunlosky, J. T., & Joynes, R. L. (2019) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2019.101806 · Cited by 20 · see citing works
Emerging and Future Directions in Test-Enhanced Learning Research
Pan, S. C., Dunlosky, J., Xu, K. M., & Ouwehand, K. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09857-2 · Cited by 18 · see citing works
Long-term inference and memory following retrieval practice
Siler, J., & Benjamin, A. S. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00997-3 · Cited by 18 · see citing works
Effects of belief generation on social exploration, culturally-appropriate actions, and cross-cultural concept learning in a game-based social simulation
Gjicali, K., Finn, B., & Hebert, D. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103959 · Cited by 18 · see citing works
Do people use category-learning judgments to regulate their learning of natural categories?
Morehead, K., Dunlosky, J. T., & Foster, N. L. (2017) · Memory & Cognition · doi:10.3758/s13421-017-0729-9 · Cited by 18 · see citing works
The Testing Effect and Far Transfer: The Role of Exposure to Key Information
van Eersel, G. G., Verkoeijen, P. P. J. L., Povilenaite, M., & Rikers, R. M. J. P. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01977 · Cited by 17 · see citing works
Reversing the testing effect by feedback is a matter of performance criterion at practice
Racsmány, M., Szöllősi, Á., & Marián, M. (2020) · Memory & Cognition · doi:10.3758/s13421-020-01041-5 · Cited by 17 · see citing works
Diminishing-cues retrieval practice: A memory-enhancing technique that works when regular testing doesn’t
Fiechter, J. L., & Benjamin, A. S. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1366-9 · Cited by 16 · see citing works
Classification versus inference learning contrasted with real-world categories
Jones, E. L., & Ross, B. H. (2010) · Memory & Cognition · doi:10.3758/s13421-010-0058-8 · Cited by 16 · see citing works
The testing effect and analogical problem-solving
Peterson, D. J., & Wissman, K. T. (2018) · Memory · doi:10.1080/09658211.2018.1491603 · Cited by 15 · see citing works
Is Concept Appraisal Modulated by Procedural or Declarative Manipulations?
Thorne, S. R., Smortchkova, J., Quilty‐Dunn, J., Shea, N. J., & Hampton, J. A. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.774629 · Cited by 14 · see citing works
Metacognitive monitoring during category learning: how success affects future behaviour
Doyle, M. E., & Hourihan, K. L. (2015) · Memory · doi:10.1080/09658211.2015.1086805 · Cited by 14 · see citing works
Prior experience shapes metacognitive judgments at the category level: the role of testing and category difficulty
Thomas, R. C., Finn, B., & Jacoby, L. L. (2015) · Metacognition and Learning · doi:10.1007/s11409-015-9144-4 · Cited by 14 · see citing works
Self-citation
Long-Lasting Effects of an Instructional Intervention on Interleaving Preference in Inductive Learning and Transfer
Sun, Y., Shi, A., Zhao, W., Yang, Y., Li, B., Hu, X., Shanks, D. R., Yang, C., & Luo, L. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09666-5 · Cited by 13 · see citing works
Millikan’s consistency testers and the cultural evolution of concepts
Shea, N. J. (2023) · Evolutionary Linguistic Theory · doi:10.1075/elt.00048.she · Cited by 13 · see citing works
Recommendations From Cognitive Psychology for Enhancing the Teaching of Natural-Science Categories
Nosofsky, R. M., & McDaniel, M. A. (2019) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732218814861 · Cited by 14 · see citing works
Improving Metacognition in the Classroom
Hausman, H. E., Myers, S. J., & Rhodes, M. G. (2021) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000440 · Cited by 12 · see citing works
Study preferences for exemplar variability in self-regulated category learning
Wahlheim, C. N., & DeSoto, K. A. (2016) · Memory · doi:10.1080/09658211.2016.1152378 · Cited by 12 · see citing works
Self-citation
Neural Correlates of Long-Term Memory Enhancement Following Retrieval Practice
Marin-Garcia, E., Mattfeld, A. T., & Gabrieli, J. D. E. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.584560 · Cited by 11 · see citing works
Monitoring of learning at the category level when learning a natural concept: Will task experience improve its resolution?
Tauber, S. K., & Dunlosky, J. T. (2014) · Acta Psychologica · doi:10.1016/j.actpsy.2014.11.011 · Cited by 10 · see citing works
Knowing Is Not Half the Battle: the Role of Actual Test Experience in the Forward Testing Effect
Choi, H. J., & Lee, H. S. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09518-0 · Cited by 11 · see citing works
Mitigating cue competition effects in human category learning
Lau, J. S.-H., Casale, M. B., & Pashler, H. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820915151 · Cited by 9 · see citing works
Making educational videos more engaging and enjoyable for all ages: an exploratory study on the influence of embedded questions
Zolkwer, M. B., Hidalgo, R., & Singer, B. F. (2023) · International Journal of Lifelong Education · doi:10.1080/02601370.2023.2196449 · Cited by 12 · see citing works
When More Is Not Better: Effects of Interim Testing and Feature Highlighting in Natural Category Learning
Kang, Y., Ha, H., & Lee, H. S. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09772-y · Cited by 7 · see citing works
Cognitive perspectives on maintaining physicians’ medical expertise: IV. Best practices and open questions in using testing to enhance learning and retention
Fraundorf, S. H., Caddick, Z. A., Nokes‐Malach, T. J., & Rottman, B. M. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00508-8 · Cited by 10 · see citing works
All of the above: When multiple correct response options enhance the testing effect
Bishara, A. J., & Lanzo, L. A. (2014) · Memory · doi:10.1080/09658211.2014.946425 · Cited by 8 · see citing works
Comparison versus reminding
Tullis, J. G., & Goldstone, R. L. (2016) · Cognitive Research Principles and Implications · doi:10.1186/s41235-016-0028-1 · Cited by 8 · see citing works
The retention benefits of cumulative versus non-cumulative midterms in introductory biology may depend on students’ reasoning skills
Bailey, E. G., Greenall, R. F., Tullis, M. M., & Williams, K. R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250143 · Cited by 7 · see citing works
Scalable Science Education via Online Cooperative Questioning
Hilton, C. B., Goldwater, M. B., Hancock, D., Clemson, M., Huang, A., & Denyer, G. S. (2021) · CBE—Life Sciences Education · doi:10.1187/cbe.19-11-0249 · Cited by 7 · see citing works
Combining desirable difficulty learning strategies to address the amount-to-learn vs. time-to-learn imbalance in residency training
Nelson, A., & Eliasz, K. L. (2022) · Medical Teacher · doi:10.1080/0142159x.2022.2058389 · Cited by 7 · see citing works
Metacognitive Illusion in Category Learning: Contributions of Processing Fluency and Beliefs
Wang, J., & Xing, Q. (2019) · Advances in Cognitive Psychology · doi:10.5709/acp-0260-3 · Cited by 8 · see citing works
Evaluating the Judgment of Learning: its Limited Impact and the Power of Retrieval on Inductive Learning
Ha, H., & Lee, H. S. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09899-6 · Cited by 6 · see citing works
Concurrent Dynamics of Category Learning and Metacognitive Judgments
Žauhar, V., Bajšanski, I., & Domijan, D. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01473 · Cited by 6 · see citing works
Retrieval Practice Produces More Learning in Multiple-list Tests with Higher-Order Skills
Zhou, A., Tiancheng, Y. A. N. G., CHENG, C., Xiaofeng, M. A., & Jing, Z. H. A. O. (2015) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2015.00928 · Cited by 6 · see citing works
The influence of rule availability and item similarity on metacognitive monitoring during categorisation
Žauhar, V., Bajšanski, I., & Domijan, D. (2017) · Journal of Cognitive Psychology · doi:10.1080/20445911.2017.1396991 · Cited by 4 · see citing works
Apply Small Teaching Tactics in an Introductory Programming Course: Impact on Learning Performance
Jiang, Y. (2022) · Journal of Information Systems Education · doi:10.62273/vifv7767 · Cited by 4 · see citing works
Does the testing effect depend on presentation modality?
Pierce, B. H., & Hawthorne, M. J. (2016) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2016.01.001 · Cited by 4 · see citing works
Why Desirable Difficulties ‘Work’: A Review of the Evidence From Cognitive and Educational Psychology and Some Caveats for the Health Professions Education Field
Binks, S. (2026) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70349 · Cited by 7 · see citing works
Far transfer of retrieval-practice benefits: rule-based learning as the underlying mechanism
Opitz, B., & Kubik, V. (2024) · Cognitive Research Principles and Implications · doi:10.1186/s41235-024-00598-y · Cited by 3 · see citing works
Do Domain Knowledge and Retrieval Practice Predict Students’ Study Order Decisions?
Babineau, A. L., Witherby, A. E., Ariel, R., Pelch, M. A., & Tauber, S. K. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10040122 · Cited by 3 · see citing works
Retrieval practice and verbal-visuospatial transfer: From memorization to inductive learning
Hughes, G. I., & Thomas, A. K. (2022) · Journal of Memory and Language · doi:10.1016/j.jml.2022.104402 · Cited by 3 · see citing works
Visual Search for Letters in the Right Versus Left Visual Hemifields
Gorbunova, E. S., & Falikman, M. V. (2019) · Advances in Cognitive Psychology · doi:10.5709/acp-0258-5 · Cited by 3 · see citing works
Examining the Relationship Between Fact Learning and Higher Order Learning via Retrieval Practice
Agarwal, P. K. (2011) · DigitalCommons-IMSA (Illinois Mathematics and Science Academy) · doi:10.7936/k7j38qng · Cited by 3 · see citing works
Covert Retrieval Practice Benefits Retention as Much as Overt Retrieval Practice
Smith, M. A., & Roediger, H. L., III (2011) · PsycEXTRA Dataset · doi:10.1037/e520602012-354 · Cited by 3 · see citing works
How do testing and test-potentiated learning versus worked example method affect medium- and long-term knowledge in abstract algebra for pre-service mathematics teachers?
Muzsnay, A., Zámbó, C., Szeibert, J., Bernáth, L., Szilágyi, B., & Szabó, C. (2024) · European Journal of Psychology of Education · doi:10.1007/s10212-024-00869-8 · Cited by 2 · see citing works
Acquiring complex concepts through classification versus observation
Corral, D., & Carpenter, S. K. (2024) · Cognitive Research Principles and Implications · doi:10.1186/s41235-024-00608-z · Cited by 2 · see citing works
Psychology Data on the Effects of Study Schedules on Category-Member Classification
DeSoto, K. A., & Votta, C. M. (2016) · Journal of Open Psychology Data · doi:10.5334/jopd.26 · Cited by 2 · see citing works
Promoting Meaningful Learning through Retrieval Practice: Experimental Evidences and Pedagogical Application
Xiaofeng, M. A., Zhou, A., Cui, D., & ZHANG, R. (2014) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2014.00279 · Cited by 2 · see citing works
Self-Retrieval Practice of the Cranial-Nerve Table During a Gross Anatomy Class Review
Lu, Y., & Lynch, J. C. (2017) · Medical Science Educator · doi:10.1007/s40670-017-0445-x · Cited by 2 · see citing works
Capturing Expert Knowledge of Mushrooms
Mégalakaki, O., Crimet, A., Ballenghein, U., & Gounden, Y. (2019) · SAGE Open · doi:10.1177/2158244019852484 · Cited by 2 · see citing works
Memory Skill: The Proceduralization of Declarative Memory Through Retrieval Practice
Racsmány, M., & Szőllősi, Á. (2021) · Language, Cognition, and Mind · doi:10.1007/978-3-030-66175-5_25 · Cited by 1 · see citing works
Functional underpinnings of feedback-enhanced test-potentiated encoding
Ludowicy, P., Czernochowski, D., Arnaez-Telleria, J., Gurunandan, K., Lachmann, T., & Paz‐Alonso, P. M. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac494 · Cited by 2 · see citing works
The Forward Effect of Judgements of Learning on Memory and Transfer in Inductive Learning
Ritter, C., Hausman, H., Gaschler, R., Tiffin‐Richards, S. P., & Kubik, V. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10094-4 · Cited by 1 · see citing works
Effects of specific-level versus broad-level training for broad-level category learning in a complex natural science domain.
Miyatsu, T., Nosofsky, R. M., & McDaniel, M. A. (2019) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000240 · Cited by 1 · see citing works
Increased metamemory accuracy with practice does not require practice with metamemory
West, J. T., Kuhns, J. M., Touron, D. R., & Mulligan, N. W. (2024) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241269322 · Cited by 1 · see citing works
Can the Spacing Effect Improve the Effectiveness of a Math Intervention Course for Engineering Students?
Fain, R. J., Hieb, J., Ralston, P. A. S., & Lyle, K. B. (2015) · ASEE Annual Conference & Exposition · doi:10.18260/p.23660 · Cited by 1 · see citing works
Plant-Based Proteins and Mind-Sets Underlying Concerns
(2023) · doi:10.31038/nrfsj.2023614 · Cited by 1 · see citing works
Untitled work
(2013) · eScholarship (California Digital Library) · Cited by 1 · see citing works
Psychological Inquiry: An International Journal for the Advancement of Psychological Theory
Nestojko, J. F., Finley, J. R., & Roediger, H. L., III (2013)
Utilizing Multiple-level Category Information to Enhance Category Learning: Theoretical and practical considerations in application to authentic natural categories
Miyatsu, T. (2016) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k77m0677
The effect of generating errors on subsequent learning and generalization
Siler, J. (2017) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)

Testing enhances both memorization and conceptual learning of categorical materials.
Cho, K. W., & Powers, A. (2019) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2019.01.003 · Cited by 21 · see citing works
Metacognitive judgments of repetition and variability effects in natural concept learning: evidence for variability neglect
Wahlheim, C. N., Finn, B., & Jacoby, L. L. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0180-2 · Cited by 53 · see citing works
Self-citation
Testing the testing effect with natural categoriesPreprint
Searston, R. A. (2017) · OSF Preprints (OSF Preprints) · doi:10.17605/osf.io/z9dnm
DOI 10.3758/s13421-012-0274-5 Metacognition of the testing effect: Guiding learners to predict the benefits of retrieval
Tullis, J. G., Finley, J. R., Benjamin, A. S., Tullis, J. G., & Finley, J. R. (2012)
Metacognition of the testing effect: Guiding learners to predict the benefits of retrieval
Tullis, J. G., Finley, J. R., & Benjamin, A. S. (2013) · Memory & Cognition · doi:10.3758/s13421-012-0274-5 · Cited by 118 · see citing works

Authors: Jacoby, L. L., Wahlheim, C. N., & Coane, J. H.
Affiliations: Washington University in St. Louis (US)
ORCID: Jacoby, Larry L.
Wahlheim, Christopher N.
Coane, Jennifer H.
Venue: Journal of Experimental Psychology Learning Memory and Cognition
Publisher: American Psychological Association (APA)
Published: 2010-11
Volume: 36
Issue: 6
Pages: 1441-1451
ISSN: 0278-7393 (ISSN-L)
1939-1285
DOI: 10.1037/a0020636
OpenAlex: W2113098345
Cited by: 127
References: 37
Citations by year: 2026: 5 · 2025: 1 · 2024: 19 · 2023: 6 · 2022: 10 · 2021: 10 · 2020: 9 · 2019: 13 · 2018: 6 · 2017: 11 · 2016: 9 · 2015: 6 · 2014: 6 · 2013: 6 · 2012: 4
FWCI: 3.29
Type: journal article
Language: en
Open access: closed
Locations: Journal of Experimental Psychology Learning Memory and Cognition (publishedVersion)
PubMed (publishedVersion)
NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro) (submittedVersion)
Funders: Ames S. McDonnell Foundation (22020166)
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
Keywords: retrieval practice, natural concepts, recognition memory, classification accuracy, metacognition, metacognitive awareness, bird families, concept learning
MeSH terms: Cognition, Feedback, Generalization, Psychological, Genetic Testing, Humans, Judgment, Learning, Neuropsychological Tests, Probability, Students, Teaching, Universities, Signal Detection, Psychological, Recognition, Psychology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Test-enhanced learning of natural concepts: effects on recognition memory, classification, and metacognition

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks