Improving college students’ evaluation of text learning using idea-unit standards
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
When recalling key definitions from class materials, college students are often overconfident in the quality of their responses. Even with commission errors, they often judge that their response is entirely or partially correct. To further understand this overconfidence, we investigated whether idea-unit judgements would reduce overconfidence (Experiments 1 and 2) and whether students inflated their scores because they believed that they knew answers but just responded incorrectly (Experiment 2). College students studied key-term definitions and later attempted to recall each definition when given the key term (e.g., What is the availability heuristic?). All students judged the quality of their recall, but some were given a full-definition standard to use, whereas other students first judged whether their response included each of the individual ideas within the corresponding correct answer. In Experiment 1, making these idea-unit judgements reduced overconfidence for commission errors. In Experiment 2, some students were given the correct definitions and graded other students’ responses, and some students generated idea units themselves before judging their responses. Students were overconfident even when they graded other students’ responses, and, as important, self-generated idea units for each definition also reduced overconfidence in commission errors. Thus, overconfidence appears to result from difficulties in evaluating the quality of recall responses, and such overconfidence can be reduced by using idea-unit judgements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Handbook of Metacognition in Education
Hacker, D. J., Dunlosky, J., & Graesser, A. C. (2009) · doi:10.4324/9780203876428 · Cited by 1,509
Self-citationExecutive Attention, Working Memory Capacity, and a Two-Factor Theory of Cognitive Control
Engle, R. W., & Kane, M. J. (2003) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(03)44005-x · Cited by 1,104 · cited 1×
“Working memory is capacity limited, which may result from a relatively fixed storage buffer and/or from limitations in executive control (for reviews on how it may be limited, see Cowan, 2005 ; Engle & Kane, 2004 ; Oberauer & Kliegl, 2006 ).”
BackgroundAccuracy of metacognitive monitoring affects learning of texts.
Thiede, K. W., Anderson, M. C. M., & Therriault, D. (2003) · Journal of Educational Psychology · doi:10.1037//0022-0663.95.1.66 · Cited by 826
Pyc, M. A., & Rawson, K. A. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.01.004 · Cited by 551 · cited 1×
“Ironically, however, the underconfidence may actually benefit students’ performance, because even after a student correctly recalls an item, their memory for it improves after further recall and restudy attempts (Pyc & Rawson, 2009 ).”
BackgroundSelf-citationThe promise and perils of self-regulated study
Kornell, N., & Bjork, R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194055 · Cited by 527 · cited 1×
“Many students use this technique to some extent (eg, using flashcards, Kornell & Bjork, 2007 ), especially given that textbook chapters often end with lists of key terms for review that encourage testing and evaluating the quality of what has been recalled.”
MethodNietfeld, J. L., Cao, L., & Osborne, J. W. (2006) · Metacognition and Learning · doi:10.1007/s10409-006-9595-6 · Cited by 260 · cited 1×
“Students’ judgements were highly overconfident: On average, they judged that they had scored 68% on the essay tests, but their test score was only 36%! Given that students tend to terminate study once they believe that they can recall what they are attempting to learn (Kornell & Bjork, 2008 ), overconfidence can lead…”
BackgroundDunlosky, J., Rawson, K. A., & Middleton, E. L. (2005) · Journal of Memory and Language · doi:10.1016/j.jml.2005.01.011 · Cited by 163 · cited 1×
“Such overconfidence is even more troubling given that commission errors are relatively common when students are learning complex definitions (Dunlosky et al, 2005 ; Kikas, 1998 ; Rawson & Dunlosky, 2007).”
BackgroundSelf-citation
Cited by
Dunlosky, J., & Rawson, K. A. (2012) · Learning and Instruction · doi:10.1016/j.learninstruc.2011.08.003 · Cited by 713
Self-citationMeta-Reasoning: Monitoring and Control of Thinking and Reasoning
Ackerman, R., & Thompson, V. A. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.05.004 · Cited by 400
“Data from educational contexts suggest that feedback about the accuracy of learners’ confidence may both increase test performance and reduce overconfidence [64-66].”
Optimizing schedules of retrieval practice for durable and efficient learning: How much is enough?
Rawson, K. A., & Dunlosky, J. (2011) · Journal of Experimental Psychology: General · doi:10.1037/a0023956 · Cited by 303
Self-citationHow and when do students use flashcards?
Wissman, K. T., Rawson, K. A., & Pyc, M. A. (2012) · Memory · doi:10.1080/09658211.2012.687052 · Cited by 164
“Importantly, even when students check their answers against external information, they often still overestimate the correctness of their own answer (e.g., Dunlosky et al., 2011; Lipko et al., 2009; Rawson et al., 2011).”
BackgroundSelf-citationMonitoring and regulation of learning in medical education: The need for predictive cues
de Bruin, A. B. H., Dunlosky, J., & Cavalcanti, R. B. (2017) · Medical Education · doi:10.1111/medu.13267 · Cited by 112
Metadata
- Authors
- Dunlosky, J., Hartwig, M. K., Rawson, K. A., & Lipko, A. R.
- Venue
- Quarterly Journal of Experimental Psychology
- Publisher
- SAGE Publications
- Published
- 2011-03
- Volume
- 64
- Issue
- 3
- Pages
- 467-484
- ISSN
- 0033-555X (ISSN-L)
- 1747-0218
- 1747-0226
- OpenAlex
- W2043699864
- Cited by
- 73
- References
- 8
- FWCI
- 1.99
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Improving college students’ evaluation of text learning using idea-unit standards. https://app.cochat.ai/papers/10.1080/17470218.2010.502239
- The paper
- Dunlosky, J., Hartwig, M. K., Rawson, K. A., & Lipko, A. R. (2011). Improving college students’ evaluation of text learning using idea-unit standards. Quarterly Journal of Experimental Psychology. https://doi.org/10.1080/17470218.2010.502239
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.