The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Testing Is More Desirable When It Is Adaptive and Still Desirable When Compared to Note-Taking
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Testing (i.e., retrieval practice) is a more powerful learning strategy by comparison with many others, such as restudying (Roediger & Karpicke, 2006), note-taking (Heitmann et al., 2018), and concept-mapping (Karpicke & Blunt, 2011).”
From Effects of Test Anxiety on Self-Testing and Learning Performance (2024) · cites this paper as Heitmann et al., 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796 · cited 3×
“Making the learning process more difficult by providing learners with test questions that require retrieval from memory after an initial study phase has been shown to foster retention and transfer (Roediger and Butler, 2011; Dunlosky et al., 2013; Rowland, 2014; Adesope et al., 2017; Pan and Rickard, 2018).”
The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · cited 5×
“Similar to general testing, several studies show that specific testing entails beneficial effects (Adesope et al., 2017; Rowland, 2014).”
InfluentialExpertise Reversal Effect and Its Implications for Learner-Tailored Instruction
Kalyuga, S. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9054-3 · Cited by 1,056 · cited 3×
“…are closely in line with the general Frontiers in Psychology | www.frontiersin.org 9 December 2018 | Volume 9 | Article 2596 notion that learning outcomes can be improved by matching the complexity of learning tasks to the learner’s current state of knowledge (see Kalyuga, 2007; Metcalfe, 2009).”
BackgroundResultRethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544 · cited 3×
“Similar to general testing, several studies show that specific testing entails beneficial effects (Adesope et al., 2017; Rowland, 2014).”
BackgroundResultTest format and corrective feedback modify the effect of testing on long-term retention
Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440601056620 · Cited by 513
Metacognitive Judgments and Control of Study
Metcalfe, J. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01628.x · Cited by 374
Relevance and Goal-Focusing in Text Processing
McCrudden, M. T., & Schraw, G. (2007) · Educational Psychology Review · doi:10.1007/s10648-006-9010-7 · Cited by 372 · cited 2×
“…discussed in the literature, such as questions on targeted segments and elaborative investigation questions, are often designed to not only focus learners’ attention on certain content items but also elicit some kind of elaboration or retrieval (for an overview, see McCrudden and Schraw, 2007).”
McDaniel, M. A., Agarwal, P. K., Huelser, B. J., McDermott, K. B., & Roediger, H. L. (2011) · Journal of Educational Psychology · doi:10.1037/a0021782 · Cited by 360
The effect of type and timing of feedback on learning from multiple-choice tests.
Butler, A. C., Karpicke, J. D., & Roediger, H. L. (2007) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.13.4.273 · Cited by 321
Transfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286
The effects of tests on learning and forgetting.
Carpenter, S. K., Pashler, H., Wixted, J. T., & Vul, E. (2008) · Memory & Cognition · doi:10.3758/mc.36.2.438 · Cited by 281
Rapid dynamic assessment of expertise to improve the efficiency of adaptive e-learning
Kalyuga, S., & Sweller, J. (2005) · Educational Technology Research and Development · doi:10.1007/bf02504800 · Cited by 265
Rethinking the Boundaries of Cognitive Load Theory in Complex Learning
Kalyuga, S., & Singh, A.-M. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9352-0 · Cited by 241
The testing effect in free recall is associated with enhanced organizational processes
Zaromb, F. M., & Roediger, H. L. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.995 · Cited by 206
The Expertise Reversal Effect is a Variant of the More General Element Interactivity Effect
Chen, O., Kalyuga, S., & Sweller, J. (2017) · Educational Psychology Review · doi:10.1007/s10648-016-9359-1 · Cited by 200
Learning with retrieval-based concept mapping.
Blunt, J. R., & Karpicke, J. D. (2014) · Journal of Educational Psychology · doi:10.1037/a0035934 · Cited by 171 · cited 1×
“Research clearly shows that learners substantially benefit from various forms of retrieval practice (e.g., Rawson and Dunlosky, 2012; Blunt and Karpicke, 2014; Lechuga et al., 2015; Bae et al., 2018; Eglington and Kang, 2018; for recent overviews see Roediger and Butler, 2011; Karpicke and Grimaldi, 2012; Rowland, 201…”
Backgroundvan Gog, T., & Sweller, J. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9310-x · Cited by 164 · cited 2×
“There is evidence that if testing is too difficult, it can become ineffective or even counter-effective (e.g., Karpicke et al., 2014; van Gog and Sweller, 2015; Carpenter et al., 2016; Roelle and Berthold, 2017).”
Endres, T., & Renkl, A. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01054 · Cited by 71
Roelle, J., Lehmkuhl, N., Beyer, M.-U., & Berthold, K. (2015) · Journal of Educational Psychology · doi:10.1037/edu0000010 · Cited by 42
Self-citation
Research works printed but not linked: 45
- Agarwal, 2008, Examining the testing effect with open- and closed-book tests., Appl. Cogn. Psychol., 22, 861, 10.1002/acp.1391 · DOI · Paper page
- Bae, 2018, Investigating the testing effect: retrieval as a characteristic of effective study strategies., Learn. Instr., 10.1016/j.learninstruc.2017.12.008 · DOI
- Berthold, 2010, How to foster active processing of explanations in instructional communication., Educ. Psychol. Rev., 22, 25, 10.1007/s10648-010-9124-9 · DOI
- Bjork, 1992, “Making things hard on yourself, but in a good way: creating desirable difficulties to enhance learning,” in, Psychology and the Real World: Essays Illustrating Fundamental Contributions to Society, 55
- Brewer, 2010, The effects of free recall testing on subsequent source memory., Memory, 18, 385, 10.1080/09658211003702163 · DOI
- Callender, 2009, The limited benefits of rereading educational texts., Contemp. Educ. Psychol., 34, 30, 10.1016/j.cedpsych.2008.07.001 · DOI · Paper page
- Carpenter, 2016, A classroom study on the relationship between student achievement and retrieval-enhanced learning., Educ. Psychol. Rev., 28, 353, 10.1007/s10648-015-9311-9 · DOI
- Cohen, 1988, Statistical Power Analysis for the Behavioral Sciences
- Corbalan, 2009, Dynamic task selection: effects of feedback and learner control on efficiency and motivation., Learn. Instr., 19, 455, 10.1016/j.learninstruc.2008.07.002 · DOI
- Dobson, 2015, Self-testing promotes superior retention of anatomy and physiology information., Adv. Health Sci. Educ. Theory Pract., 20, 149, 10.1007/s10459-014-9514-8 · DOI
- Dunlosky, 2011, Improving college students’ evaluation of text learning using idea-unit standards., Q. J. Exp. Psychol., 64, 467, 10.1080/17470218.2010.502239 · DOI
- Eglington, 2018, Retrieval practice benefits deductive inference., Educ. Psychol. Rev., 30, 215, 10.1007/s10648-016-9386-y · DOI
- Glogger-Frey, 2017, Learning from direct instruction: best prepared by several self-regulated or guided invention activities?, Learn. Instr., 51, 26, 10.1016/j.learninstruc.2016.11.002 · DOI
- Grimaldi, 2014, Guided retrieval practice of educational materials using automated scoring., J. Educ. Psychol., 106, 58, 10.1037/a0033208 · DOI
- Hattie, 2009, Visible Learning.
- Hayes, 2013, Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression based Approach.
- Jensen, 2014, Teaching to the test…or testing to teach: exams requiring higher order thinking skills encourage greater conceptual understanding., Educ. Psychol. Rev., 26, 307, 10.1007/s10648-013-9248-9 · DOI · Paper page
- Jiang, 2011, Instructional effectiveness of higher-order questions: the devil is in the detail of students’ use of questions., Learn. Environ. Res., 14, 279, 10.1007/s10984-011-9095-x · DOI
- Johnson, 2009, A testing effect with multimedia learning., J. Educ. Psychol., 101, 621, 10.1037/a0015183 · DOI · Paper page
- Kalyuga, 2010, Expertise reversal effect and its instructional implications: introduction to the special issue., Instr. Sci., 38, 209, 10.1007/s11251-009-9102-0 · DOI
- Kalyuga, 2012, Educational implications of expertise reversal effects in learning and performance of complex cognitive and sensorimotor skills., Educ. Psychol. Rev., 24, 313, 10.1007/s10648-012-9195-x · DOI
- Karpicke, 2012, Retrieval-based learning: a perspective for enhancing meaningful learning., Educ. Psychol. Rev., 24, 401, 10.1007/s10648-012-9202-2 · DOI · Paper page
- Karpicke, 2014, “Retrieval-based learning,” in, Psychology of Learning and Motivation, 237, 10.1016/B978-0-12-800283-4.00007-1 · DOI · Paper page
- Kornell, 2012, Tests enhanced learning– Compared to what?, J. Appl. Res. Mem. Cogn., 1, 257, 10.1016/j.jarmac.2012.10.002 · DOI
- Lechuga, 2015, Further evidence that concept mapping is not better than repeated retrieval as a tool for learning from texts., Learn. Instr., 40, 61, 10.1016/j.learninstruc.2015.08.002 · DOI
- Lipko, 2009, Using standards to improve middle school students’ accuracy at evaluating the quality of their recall., J. Exp. Psychol. Appl., 15, 307, 10.1037/a0017599 · DOI
- Lipowski, 2014, Establishing and explaining the testing effect in free recall for young children., Dev. Psychol., 50, 994, 10.1037/a0035202 · DOI
- Mayer, 2009, Clickers in college classrooms: fostering learning with questioning methods in large lecture classes., Contemp. Educ. Psychol., 34, 51, 10.1016/j.cedpsych.2008.04.002 · DOI · Paper page
- McDaniel, 2009, The read-recite-review study strategy: effective and portable., Psychol. Sci., 20, 516, 10.1111/j.1467-9280.2009.02325.x · DOI · Paper page
- McDermott, 2014, Both multiple-choice and short-answer quizzes enhance later exam performance in middle and high school classes., J. Exp. Psychol. Appl., 20, 3, 10.1037/xap0000004 · DOI · Paper page
- Metcalfe, 2002, Is study time allocated selectively to a region of proximal learning?, J. Exp. Psychol. Gen., 131, 349, 10.1037//0096-3445.131.3.349 · DOI · Paper page
- Metcalfe, 2011, “Desirable difficulties and studying in the region of proximal learning,” in, Successful Remembering and Successful Forgetting: A Festschrift in Honor of Robert A. Bjork, 259
- Meyer, 2013, Taking the testing effect beyond the college freshman: benefits for lifelong learning., Psychol. Aging, 28, 142, 10.1037/a0030890 · DOI
- Miyatsu, 2018, Five popular study strategies: their pitfalls and optimal implementations., Perspect. Psychol. Sci., 13, 390, 10.1177/1745691617710510 · DOI
- Rawson, 2012, When is practice testing most effective for improving the durability and efficiency of student learning?, Educ. Psychol. Rev., 24, 419, 10.1007/s10648-012-9203-1 · DOI
- Renkl, 2015, Different roads lead to Rome: the case of principle-based cognitive skills., Learn. Res. Practice, 1, 79, 10.1080/23735082.2015.994255 · DOI
- Roelle, 2017, Effects of incorporating retrieval into learning tasks: the complexity of the tasks matters., Learn. Instr., 49, 142, 10.1016/j.learninstruc.2017.01.008 · DOI
- Roelle, 2014, Two instructional aids to optimise processing and learning from instructional explanations., Instr. Sci., 42, 207, 10.1007/s11251-013-9277-2 · DOI
- Roelle, Learning from instructional explanations: effects of prompts based on the active-constructive-interactive framework., PLoS One, 10, 10.1371/journal.pone.0124115 · DOI
- Roelle, 2018, Test-based learning: inconsistent effects between higher- and lower-level test questions., J. Exp. Educ., 10.1080/00220973.2018.1434756 · DOI
- Rummer, 2017, Is testing a more effective learning strategy than note-taking?, J. Exp. Psychol. Appl., 23, 293, 10.1037/xap0000134 · DOI
- Salden, 2004, Mental effort and performance as determinants for the dynamic selection of learning tasks in air traffic control training., Instr. Sci., 32, 153, 10.1023/B:TRUC.0000021814.03996.ff · DOI
- Schnotz, 2010, Reanalyzing the expertise reversal effect., Instr. Sci., 38, 315, 10.1007/s11251-009-9104-y · DOI
- Wilkinson, 1999, Statistical methods in psychology journals., Am. Psychol., 54, 594, 10.1037/0003-066X.54.8.594 · DOI · Paper page
- Zamary, 2016, How accurately can students evaluate the quality of self-generated examples of declarative concepts? Not well, and feedback does not help., Learn. Instr., 46, 12, 10.1016/j.learninstruc.2016.08.002 · DOI
Cited by
Testing (quizzing) boosts classroom learning: a systematic and meta-analytic review
Yang, C., Luo, L., Vadillo, M. A., Yu, R., & Shanks, D. R. (2021) · Psychological Bulletin · doi:10.1037/bul0000309 · Cited by 333
Effects of Test Anxiety on Self-Testing and Learning Performance
Liu, S., Zhao, W., Shanks, D. R., Hu, X., Luo, L., & Yang, C. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09882-1 · Cited by 14
Retrieval Practice Versus Elaborative Encoding: A Systematic and Meta-analytic Review
Gonçalves, A. D. O., Muniz, B. F. B., & Jaeger, A. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10076-6 · Cited by 1
Metadata
- Authors
- Heitmann, S., Grund, A., Berthold, K., Fries, S., & Roelle, J.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2018-12-18
- Volume
- 9
- ISSN
- 1664-1078
- Cited by
- 23
- References
- 22
- Funders
- Bundesministerium für Bildung und Forschung
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.