Using Testing to Enhance Learning: A Comparison of Two Hypotheses: (537052012-223)
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Using Testing to Enhance Learning: A Comparison of Two Hypotheses Michael C. Mozer Department of Computer Science & Institute of Cognitive Science University of Colorado Boulder, CO 80309 USA Michael Howe Department of Computer Science & Institute of Cognitive Science University of Colorado Boulder, CO 80309 USA Harold Pashler Department of Psychology University of California at San Diego La Jolla, CA 92093 USA this paradigm, the outcome is ambiguous (Carrier & Pashler, 1992): self testing outperforms study in some experiments (e.g. Hogan & Kintsch, 1971), but not oth- ers (e.g., McDaniel & Masson, 1985). One explanation for the inconsistency is that the rate of retrieval success on self test trials varies among experiments, and the mechanisms of learning are likely to be dependent on retrieval success. The experiments have other problems, including different amounts of time for study-only and self-test conditions, and failure to control the time spent on individual items (Carrier & Pashler, 1992). To overcome these metholological difficulties, Car- rier and Pashler (1992) compared a study-only or SO condition in which each cue-target pair was presented for ten seconds to a test/study or TS condition in which the cue was presented alone for five seconds and then the target appeared for the final five seconds. In TS tri- als, participants were supposed to use the cue to retrieve the target, but even if retrieval failed, the trial still had value due to the presentation of cue and target together for five seconds. Consequently, the dependence on retrieval success rate is minimized. Also, the paradigm matches the total time per item in SO and TS conditions. If anything, self testing is at a disadvantage because the total viewing time for cue plus target was lower. In Experiments 1 and 2 of Carrier and Pashler, 40 cue-target pairs were used, half each assigned to the SO and TS conditions. The experiment began with a study only phase in which participants viewed each of the 40 pairs once for ten seconds. Then two more passes were made through the pairs, presented in the manner desig- nated for that pair—SO or TS. For both conditions, par- ticipants were instructed to say aloud the target. In the TS condition, this instruction required that participants recall the target, or if they failed to recall, to wait until the target appeared. Following the three presentations of each pair, a final test phase evaluated performance in the two conditions via cued recall. In Experiment 1, the cues were consonant-vowel- consonant trigrams and the targets were two digit num- bers. For the sake of ecological validity, Experiment 2 used a language learning task with English language word cues and the corresponding Siberian Eskimo Yupik language translation targets. Table 1 shows the percentage of error responses. In both Experiments 1 and 2, performance was better in the TS condition than Abstract Students learning facts such as foreign language vocabu- lary often rely on a self-testing procedure in which they cue themselves with the English word and try to recall the foreign language target, instead of simply memorizing cue-target pairs. The value of this strategy has been empirically verified by a long history of research, yet existing computational models of human learning do not address the enhancing-learning-through-testing phenom- enon. Using a simple, well studied model—a feedforward neural net with no hidden units—we propose two differ- ent hypotheses for characterizing the phenomenon. Hypothesis 1 is that self-testing generates a target which is used for additional training. Hypothesis 2 is that self- testing produces a more reliable error signal for training than rote memorization. Through simulation studies, we find that hypothesis 2 readily explains the phenomenon whereas hypothesis 1 does not. Further, hypothesis 2 makes predictions worthy of further empirical study, and can be viewed as a natural consequence of temporal dif- ference learning. When learning foreign language vocabulary and other facts, students often study using index cards that have an English vocabulary word (or cue) on one side and a for- eign language vocabulary word (or target) on the other. The intuition is that by testing oneself, the associations are better learned and retained. This intuition has been supported by a long history of empirical demonstrations (e.g., Izawa, 1966; Young, 1971). For example, Bartlett and Tulving (1974) asked participants to learn a list of paired associates (the study phase), and later tested retention of the pairs using free recall or recognition (the final test). Before the final test, subjects were given a cued-recall test (a self test) of some of the paired associates. Retention was better on the final test for those items that received the self test. In this paradigm, it is unclear whether the benefit of the self test is attributable to attempting retrieval per se, or to the fact that successful retrieval of
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · cited 2×
“The TD framework has been valuable for explaining a broad range of data, from the animal conditioning literature ( Sutton & Barto, 1981 ) to the neural basis of reward (Schultz, Dayan, & Montague, 1997).”
On the time relations of mental processes: An examination of systems of processes in cascade.
McClelland, J. L. (1979) · Psychological Review · doi:10.1037/0033-295x.86.4.287 · Cited by 1,298 · cited 2×
“An elegant instantiation of this hypothesis in the context of neural net models is via the incorporation of time into the neural net, specifically, the notion that units in a neural net are slow integrators of information and therefore require many time steps for information to propagate from the input layer to the ou…”
Individual choice behavior: A theoretical analysis.
Luce, R. D. (2005) · doi:10.1037/14396-000 · Cited by 1,157 · cited 1×
“A standard procedure for reading out from a neural is to a Luce choice or Boltzmann ( Luce, 1959 ).”
Method
Cited by
When Does Feedback Facilitate Learning of Words?
Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.1.3 · Cited by 445
“Although the Skinnerian perspective seems far off the mark, the errorcorrection learning framework (Mozer et al., 2004; Rizzuto & Kahana, 2001; Rosenblatt, 1959; Widrow & Hoff, 1960) seems quite congenial to the overall pattern of results described here.”
BackgroundSelf-citationTransfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286
Enhancing learning and retarding forgetting: Choices and consequences
Pashler, H., Rohrer, D., Cepeda, N. J., & Carpenter, S. K. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194050 · Cited by 282
“Interestingly, this search often leads us to questions that drew more attention during an earlier era of psychology (see, e.g., Starch, 1927) than they have in recent years (even though, we contend, some of them have implications for issues of much current theoretical interest; see, e.g., Mozer, Howe, & Pashler, 2004…”
BackgroundSelf-citationThe effects of tests on learning and forgetting.
Carpenter, S. K., Pashler, H., Wixted, J. T., & Vul, E. (2008) · Memory & Cognition · doi:10.3758/mc.36.2.438 · Cited by 281
Self-citationTesting beyond words: using tests to enhance visuospatial map learning
Carpenter, S. K., & Pashler, H. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194092 · Cited by 133
Self-citation
Metadata
- Authors
- Mozer, M. C., Pashler, H. E., & Howe, M.
- Venue
- PsycEXTRA Dataset
- Published
- 2004
- OpenAlex
- W2767557879
- Cited by
- 20
- References
- 3
- Type
- dataset
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Testing to Enhance Learning: A Comparison of Two Hypotheses: (537052012-223). https://app.cochat.ai/papers/10.1037/e537052012-223
- The paper
- Mozer, M. C., Pashler, H. E., & Howe, M. (2004). Using Testing to Enhance Learning: A Comparison of Two Hypotheses: (537052012-223). PsycEXTRA Dataset. https://doi.org/10.1037/e537052012-223
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.