The impact of an online tool for monitoring and regulating learning at university: overconfidence, learning strategy, and personality
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Being overconfident when estimating scores for an upcoming exam is a widespread phenomenon in higher education and presents threats to self-regulated learning and academic performance. The present study sought to investigate how overconfidence and poor monitoring accuracy vary over the length of a college course, and how an intervention consisting of (1) a monitoring exercise and (2) a monitoring and regulation strategy, improves students’ monitoring accuracy and academic performance. Moreover, we investigated how personality factors (i.e., grandiose and vulnerable narcissism, optimism) influence monitoring accuracy. We found that the Monitoring and Regulation Strategy positively influenced monitoring accuracy and exam scores, whereas the Monitoring Exercise that confronted students with their overconfidence protected students against overconfidence in the second exam score prediction but did not affect exam score. The results further revealed that exam score predictions lowered from the start to the end of the course for both poor and high performing students, but still leaving poor performers overconfident and high performers underconfident. Topic knowledge gained in the course did not wash out the Dunning Kruger effect, and results indicate that poor and high performers use different cues when predicting exam scores. Both grandiose and vulnerable narcissism contributed to overconfidence on exam score predictions but not on the Monitoring Exercise. These findings underline the potential of the Monitoring and Regulation Strategy intervention and ask for upscaling it to include measurements of self-regulated learning activities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Self-Efficacy: An Essential Motive to Learn
Zimmerman, B. J. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1016 · Cited by 4,294
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Metamemory: A Theoretical Framework and New Findings
Nelson, T. O. (1990) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60053-5 · Cited by 2,583 · cited 3×
“In this study, we examined (1) how students’monitoring as measured through predictions of exam scores changed during the length of a course, and (2) how feedback on their monitoring accuracy and a strategy to improve SRL (through an online intervention) influenced their monitoring accuracy and exam grades.”
MethodCarver, C. S., Scheier, M. F., & Segerstrom, S. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.01.006 · Cited by 2,051
Calibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
Flawed Self-Assessment: Implications for Health, Education, and the Workplace
Dunning, D., Heath, C., & Suls, J. M. (2004) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2004.00018.x · Cited by 1,865
Probabilistic mental models: a Brunswikian theory of confidence
Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991) · Psychological Review · doi:10.1037/0033-295x.98.4.506 · Cited by 1,506 · cited 1×
“This robust observation, typically found withinjudges, is termed the hard-easy effect (Lichtenstein et al. 1982) and explained by several factors, among which a biased selection of test questions (Gigerenzer et al. 1991), and students’ insensitivity to actual difficulty of the items (Price 1998).”
BackgroundMonitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning
Koriat, A. (1997) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.126.4.349 · Cited by 1,363
Why People Fail to Recognize Their Own Incompetence
Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003) · Current Directions in Psychological Science · doi:10.1111/1467-8721.01235 · Cited by 1,224 · cited 2×
“Absolute accuracy (Dunning et al. 2003) for exam score predictions at t=0 and t=2, as well as for the judgments during the monitoring exercise (t=1a) was calculated.”
MethodNarcissism, Self-Esteem, and the Positivity of Self-Views: Two Portraits of Self-Love
Campbell, W. K., Rudich, E. A., & Sedikides, C. (2002) · Personality and Social Psychology Bulletin · doi:10.1177/0146167202286007 · Cited by 866
Narcissism, confidence, and risk attitude
Campbell, W. K., Goodie, A. S., & Foster, J. D. (2004) · Journal of Behavioral Decision Making · doi:10.1002/bdm.475 · Cited by 854 · cited 1×
“In a similar vein, there is evidence for an association between narcissism and overconfidence, possibly contingent on the mechanism by which people high in narcissism believe their intelligence is higher than actually measured (Campbell et al. 2004; Buratti et al. 2013).”
BackgroundAssessing Hypersensitive Narcissism: A Reexamination of Murray's Narcism Scale
Hendin, H. M., & Cheek, J. M. (1997) · Journal of Research in Personality · doi:10.1006/jrpe.1997.2204 · Cited by 851 · cited 1×
“Vulnerable narcissism The Hypersensitive Narcissism Scale (HSNS, n=219) was used to measure vulnerable or covert narcissism (Hendin and Cheek 1997).”
MethodAccuracy of metacognitive monitoring affects learning of texts.
Thiede, K. W., Anderson, M. C. M., & Therriault, D. (2003) · Journal of Educational Psychology · doi:10.1037//0022-0663.95.1.66 · Cited by 826
The Intention-to-Treat Principle: How to Assess the True Effect of Choosing a Medical Treatment
Detry, M. A., & Lewis, R. J. (2014) · JAMA · doi:10.1001/jama.2014.7523 · Cited by 634
Test prediction and performance in a classroom context.
Hacker, D. J., Bol, L., Horgan, D. D., & Rakow, E. A. (2000) · Journal of Educational Psychology · doi:10.1037/0022-0663.92.1.160 · Cited by 464 · cited 3×
“Comparable to Hacker et al. (2000), they called for more classroom-based studies attempting to measure and improve students’ monitoring accuracy.”
BackgroundInfluentialNietfeld, J. L., Cao, L., & Osborne, J. W. (2006) · Metacognition and Learning · doi:10.1007/s10409-006-9595-6 · Cited by 260 · cited 3×
“Moreover, Nietfeld et al. (2006) provided evidence that repeated monitoring exercises during the length of a college course can affect exam performance.”
BackgroundCarlson, E. N., Vazire, S., & Oltmanns, T. F. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0023781 · Cited by 222
Dunlosky, J., Rawson, K. A., & Middleton, E. L. (2005) · Journal of Memory and Language · doi:10.1016/j.jml.2005.01.011 · Cited by 163 · cited 1×
“In line with Dunlosky et al. (2005), participants then provided pre-judgment retrieval; While shown their own definition, they were asked to judge its quality (on a scale from 1 Bcompletely incorrect^ to 5 Bcompletely correct^).”
ResultRepeated testing sessions and scholastic aptitude in college students’ metacognitive accuracy
Kelemen, W. L., Winningham, R. G., & Weaver, C. A. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326170 · Cited by 51 · cited 2×
“Overconfidence in predicting exam grades is particularly common among poor performing students (Bol et al. 2005; Hacker et al. 2000; Kelemen et al. 2007; Kruger and Dunning 1999; Miller and Geraci 2011a; Nietfeld et al. 2006), a phenomenon termed the Dunning-Kruger effect.”
Background
Cited by
Meta-Reasoning: Monitoring and Control of Thinking and Reasoning
Ackerman, R., & Thompson, V. A. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.05.004 · Cited by 400
“Data from educational contexts suggest that feedback about the accuracy of learners’ confidence may both increase test performance and reduce overconfidence [64-66].”
Kim, D., Yoon, M., Jo, I.-H., & Branch, R. M. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.08.023 · Cited by 151
Urbina, S., Villatoro, S., & Salinas, J. (2021) · Sustainability · doi:10.3390/su13137281 · Cited by 43
Metadata
- Authors
- de Bruin, A. B. H., Kok, E. M., Lobbestael, J., & de Grip, A.
- Venue
- Metacognition and Learning
- Published
- 2016-06-02
- Volume
- 12
- Issue
- 1
- Pages
- 21-43
- ISSN
- 1556-1623 (ISSN-L)
- 1556-1631
- OpenAlex
- W2469095610
- Cited by
- 82
- References
- 19
- FWCI
- 11.40
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.