The Positive and Negative Consequences of Multiple-Choice Testing.
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final cued-recall performance. However, prior testing also had negative consequences. Prior reading of a greater number of multiple-choice lures decreased the positive testing effect and increased production of multiple-choice lures as incorrect answers on the final test. Multiple-choice testing may inadvertently lead to the creation of false knowledge.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“After taking an initial multiple-choice test, students tend to produce the incorrect answers they had previously chosen when later given a short-answer test (Marsh et al. 2009, Roediger & Marsh 2005).”
From Practicing Retrieval Facilitates Learning (2021) · cites this paper as Roediger & Marsh 2005
In the citing paper
“However, foil answers in multiple-choice tests may also lead to learning of incorrect information (Butler et al., 2006; Marsh et al., 2007; Roediger & Marsh, 2005).”
From Learning new word meanings from story reading: the benefit of immediate testing (2021) · cites this paper as Roediger & Marsh, 2005
In the citing paper
“This is consistent with studies that have found a testing effect arising from an immediate cued recall test (Karpicke & Smith, 2012) or an immediate test using multiple-choice questions (Roediger & Marsh, 2005).”
From Learning new word meanings from story reading: the benefit of immediate testing (2021) · cites this paper as Roediger & Marsh, 2005
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · Psychology of Learning and Motivation · doi:10.1016/c2009-0-62209-1 · Cited by 5,994
Journal of Experimental Psychology: Human Learning and Memory
Bourne, L. E. (1977) · Cited by 4,328
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Self-citationReconstruction of automobile destruction: An example of the interaction between language and memory
Loftus, E. F., & Palmer, J. C. (1974) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(74)80011-3 · Cited by 1,909
Principles of Learning and Memory
Murdock, B. B., & Crowder, R. G. (1977) · The American Journal of Psychology · doi:10.2307/1422060 · Cited by 1,309
Frequency and the conference of referential validity
Hasher, L., Goldstein, D., & Toppino, T. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80012-1 · Cited by 920 · cited 1×
“Reading the lures also increases the fluency or familiarity of the incorrect answers and may result in the " mere truth " effect from statement repetition (e.g., Hasher et al., 1977).”
BackgroundThe influence of retrieval on retention
Carrier, M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 575
Forgetting and the law of disuse.
McGeoch, J. A. (1932) · Psychological Review · doi:10.1037/h0069819 · Cited by 484
The effects of presentation and recall of material in free-recall learning
Tulving, E. (1967) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(67)80092-6 · Cited by 402
The "testing" phenomenon: Not gone but nearly forgotten.
Glover, J. A. (1989) · Journal of Educational Psychology · doi:10.1037/0022-0663.81.3.392 · Cited by 392
Spitzer, H. F. (1939) · Journal of Educational Psychology · doi:10.1037/h0063404 · Cited by 306
Differential effects of study and test trials on long-term recognition and recall
Hogan, R. M., & Kintsch, W. (1971) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(71)80029-4 · Cited by 297
Credibility of repeated statements: Memory for trivia.
Bacon, F. (1979) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037//0278-7393.5.3.241 · Cited by 291
Altering memory representations through retrieval.
McDaniel, M. A., & Masson, M. E. (1985) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.11.2.371 · Cited by 230
Memorial consequences of forced confabulation: Age differences in susceptibility to false memories.
Ackil, J. K., & Zaragoza, M. S. (1998) · Developmental Psychology · doi:10.1037//0012-1649.34.6.1358 · Cited by 196
The encoding versus the external storage hypothesis in note taking
Rickards, J. P., & Friedman, F. (1978) · Contemporary Educational Psychology · doi:10.1016/0361-476x(78)90020-6 · Cited by 172
Misinformation Effects in Recall: Creating False Memories through Repeated Retrieval
Roediger, H. L., III, Jacoby, J. D., & McDermott, K. B. (1996) · Journal of Memory and Language · doi:10.1006/jmla.1996.0017 · Cited by 157
Interviewing Witnesses: Forced Confabulation and Confirmatory Feedback Increase False Memories
Zaragoza, M. S., Payment, K. E., Ackil, J. K., Drivdahl, S. B., & Beck, M. R. (2001) · Psychological Science · doi:10.1111/1467-9280.00388 · Cited by 152
On believing what we remember.
Begg, I., Armour, V., & Kerr, T. (1985) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/h0080140 · Cited by 147
How recall facilitates subsequent recall: A reappraisal.
Thompson, C. P., Wenger, S. K., & Bartling, C. A. (1978) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.4.3.210 · Cited by 143
Tests and test feedback as learning sources
McDaniel, M. A., & Fisher, R. P. (1991) · Contemporary Educational Psychology · doi:10.1016/0361-476x(91)90037-l · Cited by 143
Izawa, C. (1970) · Journal of Experimental Psychology · doi:10.1037/h0028541 · Cited by 115
Interference with real world knowledge
Lewis, C., & Anderson, J. R. (1976) · Cognitive Psychology · doi:10.1016/0010-0285(76)90010-4 · Cited by 109
Information Processing and Cognition
(1993) · Duke University Press eBooks · doi:10.1215/9780822396697-010 · Cited by 109
Investigations of the Testing Effect
Kuo, T.-M., & Hirshman, E. (1996) · The American Journal of Psychology · doi:10.2307/1423016 · Cited by 93
The Effects of Notetaking and Test Expectancy on the Learning of Text Material1
Kulhavy, R. W., Dyer, J. W., & Silver, L. (1975) · The Journal of Educational Research · doi:10.1080/00220671.1975.10884802 · Cited by 73
Remembering, Knowing, and Reconstructing the Past
Roediger, H. L., III, Wheeler, M. A., & Rajaram, S. (1993) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60295-9 · Cited by 71
Some deleterious consequences of the act of recollection
Schooler, J. W., Foster, R. A., & Loftus, E. F. (1988) · Memory & Cognition · doi:10.3758/bf03197757 · Cited by 65
Encountering misspellings and spelling performance: Why wrong isn't right.
Brown, A. S. (1988) · Journal of Educational Psychology · doi:10.1037/0022-0663.80.4.488 · Cited by 62
Jacoby, L. L., & Hollingshead, A. (1990) · Canadian Journal of Psychology / Revue canadienne de psychologie · doi:10.1037/h0084259 · Cited by 55
The negative suggestion effect: Pondering incorrect alternatives may be hazardous to your knowledge.
Brown, A. S., Schilling, H. E. H., & Hockensmith, M. L. (1999) · Journal of Educational Psychology · doi:10.1037//0022-0663.91.4.756 · Cited by 43
Learning from Tests: The Case of True-False Examinations
Toppino, T. C., & Ann Brochin, H. (1989) · The Journal of Educational Research · doi:10.1080/00220671.1989.10885940 · Cited by 41
The effect of testing on the forgetting of related and unrelated associates.
Runquist, W. N. (1986) · Canadian Journal of Psychology/Revue Canadienne de Psychologie · doi:10.1037/h0080086 · Cited by 41
The Effect of Forced Recall on Illusory Recollection in Younger and Older Adults
Meade, M. L., & Roediger, H. L., III (2006) · The American Journal of Psychology · doi:10.2307/20445352 · Cited by 39
Generality of the Negative Suggestion Effect in Objective Tests
Toppino, T. C., & Luipersbeck, S. M. (1993) · The Journal of Educational Research · doi:10.1080/00220671.1993.9941229 · Cited by 38
The negative suggestion effect on true-false examination questions.
Remmers, H. H., & Remmers, E. M. (1926) · Journal of Educational Psychology · doi:10.1037/h0070067 · Cited by 33
Do medical students learn from multiple choice examinations?
REES, P. J. (1986) · Medical Education · doi:10.1111/j.1365-2923.1986.tb01058.x · Cited by 21
Cited by
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Self-citationThe power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Self-citationThe critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
Self-citationThe effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066
Rethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544
Metadata
- Authors
- Roediger, H. L., & Marsh, E. J.
- Venue
- Journal of Experimental Psychology: Learning, Memory, and Cognition
- Published
- 2005
- Volume
- 31
- Issue
- 5
- Pages
- 1155-1159
- ISSN
- 0278-7393 (ISSN-L)
- 1939-1285
- OpenAlex
- W2104671973
- Cited by
- 383
- References
- 37
- FWCI
- 4.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.