An Evaluation of Interspersing the Testing Effect During Lecture on Test Performance and Notes in High Schoolers
The DOI matches its DataCite record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Testing is the most common way to assess student learning at all ages and grade levels. Testing is traditionally viewed as a measure of knowledge, and not as a way to enhance learning. Nonetheless, a large body of literature demonstrates that testing is actually an effective way to facilitate learning and enhance long-term memory for information. This finding, that retrieval of information from memory leads to better retention than re-studying or re-reading the same information, has been termed the testing effect. The benefit of testing compared to review of material is typically seen after a delay between practice and final test, with review being a better strategy when the test is given immediately or after a short delay. This phenomenon has been shown across a variety of contexts, test formats, retention intervals, and ranges of ages and abilities. However, one domain in which the testing effect has not been shown to work is in the review of student-produced lecture notes. Lecture note-taking is a ubiquitous learning strategy and notes have been shown to be highly correlated with academic outcomes such as test performance and GPA. Note-taking in itself is a cognitively demanding process, and students often struggle to take accurate and complete notes from lecture, thus limiting the benefits of note-taking and review. There is limited research on ways to improve the review function of notes. Thus, this dissertation sought to understand the effect of integrating the testing effect into the context of lecture note-taking on memory for information compared to review of notes and a lecture-only control. A sample of 59 high school students watched a video lecture and took notes on the information. The lecture was divided into three sections with two-minute pauses in between each segment. During each pause, students were asked to either reread their notes from the previous section (review group), recall and write down what they remembered to be the most important ideas from the lecture they were just shown (self-testing group), or complete a distractor word search puzzle for the duration of the pause (lecture-only control group). Participants were given a written recall test of lecture information following a one-day delay. Comparisons were made between lecture groups on test performance and note quantity. Measures of sustained attention and mind-wandering during lecture were examined as covariates. While participants in the self-testing group scored higher on the written recall test, this difference did not reach statistical significance. Self-testing and reviewing notes during lecture pauses were both significantly better than lecture note-taking alone. Results also showed that it was actually the students in the review group who took significantly more notes than those in the lecture-only control. There was a main effect for time, indicating that students in all lecture groups took increasingly more notes as the lecture progressed. Note quantity was found to be a significant predictor of test performance. Examination of attentional variables showed that students who reported lower instances of mind-wandering took significantly more notes and did significantly better on the recall test. Further, students in the self-testing group reported less of an increase in mind-wandering as the lecture progressed compared to those in the control group. Differences between the results of this study and other studies in the testing effect literature are hypothesized to be due several factors, including complexity of lecture information, encoding difficulties, and the presentation of new information at each self-testing time point. Future research should continue to explore the testing effect in conjunction with note taking.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Higher rates of mind wandering have also been associated with taking fewer and poorer quality notes during lectures (Dewey, 2020; Jing et al., 2016; Kane et al., 2017; Szpunar et al., 2013; Wong & Lim, 2021)”
From Listen up, kids! How mind wandering affects immediate and delayed memory in children (2024) · cites this paper as Dewey, 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The attention system of the human brain
Posner, M. I., & Petersen, S. E. (1990) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.13.030190.000325 · Cited by 8,070
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796 · cited 3×
“The testing effect refers to the finding that self-testing, or retrieval of information from memory, leads to better retention than re-studying or re-reading the same information (Roediger & Butler, 2011).”
BackgroundMethodInfluentialKarpicke, J. D., Butler, A. C., & Roediger III, H. L. (2009) · Memory · doi:10.1080/09658210802647009 · Cited by 745
On interpreting the effects of repetition: Solving a problem versus remembering a solution
Jacoby, L. L. (1978) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(78)90393-6 · Cited by 667
Barkley, R. A. (1997) · Psychological Bulletin · doi:10.1037//0033-2909.121.1.65 · Cited by 580 · cited 1×
“For example, due to the deficiencies in working memory and sustained attention, students with ADHD are less likely to recall and hold information in mind and have greater difficulty maintaining attention for long amounts of time (Barkley, 1997), like during lecture learning.”
BackgroundTesting the testing effect in the classroom
McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326154 · Cited by 563
The promise and perils of self-regulated study
Kornell, N., & Bjork, R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194055 · Cited by 527 · cited 1×
“In a review of the research on self-regulated study by Kornell and Bjork (2007), it was reported that in a survey of undergraduates’ study habits, 68% of survey participants utilized testing “to figure out how well I have learned the information I’m studying” (p. 222).”
BackgroundCognitive effort during note taking
Piolat, A., Olive, T., & Kellogg, R. T. (2005) · Applied Cognitive Psychology · doi:10.1002/acp.1086 · Cited by 517
When Does Feedback Facilitate Learning of Words?
Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.1.3 · Cited by 445
Testing improves long-term retention in a simulated classroom setting
Butler, A. C., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326097 · Cited by 434
Interpolated memory tests reduce mind wandering and improve learning of online lectures
Szpunar, K. K., Khan, N. Y., & Schacter, D. L. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1221764110 · Cited by 415
Learning as a Generative Activity: Eight Learning Strategies that Promote Understanding
Fiorella, L., & Mayer, R. E. (2015) · doi:10.1017/cbo9781107707085 · Cited by 388
Carpenter, S. K., & Delosh, E. L. (2006) · Memory & Cognition · doi:10.3758/bf03193405 · Cited by 386 · cited 2×
“In addition to paired associates, the testing effect has also been demonstrated using a wide variety of materials, including singleword lists (e.g., Carpenter & DeLosh, 2006; Rowland & DeLosh, 2015; Zaromb & Roediger, 2010), nonverbal materials (e.g., Carpenter & Pashler, 2007; Kang, 2010), and…”
MethodMetacognitive Judgments and Control of Study
Metcalfe, J. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01628.x · Cited by 374
Why Testing Improves Memory: Mediator Effectiveness Hypothesis
Pyc, M. A., & Rawson, K. A. (2010) · Science · doi:10.1126/science.1191465 · Cited by 371 · cited 2×
“…1936; Sones & Stroud, 1940) and the use of paired associates or word lists have been a common method for evaluating the testing effect in the laboratory (Allen, Mahler, & Estes, 1969; Carpenter, 2009; Carrier & Izawa, 1966, 1967, 1970; Jacoby, 1978; Carrier & Pashler, 1992; Pyc & Rawson, 2010).”
MethodChan, J. C. K., McDermott, K. B., & Roediger, H. L. (2006) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.135.4.553 · Cited by 364
McDaniel, M. A., Agarwal, P. K., Huelser, B. J., McDermott, K. B., & Roediger, H. L. (2011) · Journal of Educational Psychology · doi:10.1037/a0021782 · Cited by 360 · cited 5×
“Providing corrective feedback to students on their performance following the quizzes served as a potent learning strategy, and allowed students to evaluate their performance, thus becoming aware that there were certain things they needed to improve upon before the final cumulative tests (Kang et al., 2007; McDaniel et…”
BackgroundInfluentialSpitzer, H. F. (1939) · Journal of Educational Psychology · doi:10.1037/h0063404 · Cited by 306 · cited 2×
“Another influential study in the testing effect literature was conducted by Spitzer (1939), who showed that testing without feedback enhances test performance when the initial test occurs within a week or so after learning.”
BackgroundMethodWhat limits the encoding effect of note-taking? A meta-analytic examination
Kobayashi, K. (2005) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2004.10.001 · Cited by 232 · cited 3×
“The literature indicates that while both encoding and external storage have strong effects on test performance, note review is much more predictive of academic outcomes (DiVesta & Gray, 1972; Fisher & Harris 1974; Kiewra & Fletcher, 1984; Kiewra, 1989; Kobayashi, 2005; Kobayashi, 2006).”
BackgroundInfluentialThe testing effect in free recall is associated with enhanced organizational processes
Zaromb, F. M., & Roediger, H. L. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.995 · Cited by 206
Learners’ choices and beliefs about self-testing
Kornell, N., & Son, L. K. (2009) · Memory · doi:10.1080/09658210902832915 · Cited by 190
When forgetting helps memory: an analysis of repetition effects
Cuddy, L. J., & Jacoby, L. L. (1982) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(82)90727-7 · Cited by 170 · cited 1×
“Relatedly, a finding in the testing effect literature known as the spacing effect argues that verbal information is better when learning trials are spaced rather than massed (Cuddy & Jacoby, 1982; Dellarosa & Bourne, 1985).”
BackgroundTesting beyond words: using tests to enhance visuospatial map learning
Carpenter, S. K., & Pashler, H. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194092 · Cited by 133
Leahy, W., Hanham, J., & Sweller, J. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9296-4 · Cited by 77
Mnemonic benefits of retrieval practice at short retention intervals
Rowland, C. A., & DeLosh, E. L. (2015) · Memory · doi:10.1080/09658211.2014.889710 · Cited by 64 · cited 2×
“Typical tasks used in these studies include memorizing word lists (e.g., Carpenter & DeLosh, 2006; Rowland & DeLosh, 2015; Zaromb & Roediger, 2010) or paired associates (Allen, Mahler & Estes, 1969; Carpenter, 2009; Carrier & Izawa, 1966, 1967, 1970; Jacoby, 1978; Carrier & Pashler, 1992; Pyc &…”
BackgroundMethodRuhl, K. L., & Suritsky, S. (1995) · Learning Disability Quarterly · doi:10.2307/1511361 · Cited by 61 · cited 1×
“Research has shown the pause technique to be effective in improving immediate and long-term free recall for both typically functioning and learning-disabled students (Ruhl et al., 1987; Ruhl, Hughes, & Gajar, 1990; Ruhl & Suritsky, 1995).”
BackgroundRuhl, K. L., Hughes, C. A., & Gajar, A. H. (1990) · Learning Disability Quarterly · doi:10.2307/1510392 · Cited by 36
Cited by
Listen up, kids! How mind wandering affects immediate and delayed memory in children
Cherry, J., McCormack, T., & Graham, A. J. (2024) · Memory & Cognition · doi:10.3758/s13421-023-01509-0 · Cited by 14
Metadata
- Authors
- Dewey, A.
- Venue
- Columbia University
- Publisher
- Columbia University
- Published
- 2020
- References
- 30
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.