Manipulating prior beliefs causally induces under- and overconfidence
Open accessPreprint — published as 10.1177/09567976241231572
Abstract
Abstract Making a decision is invariably accompanied by a sense of confidence in that decision. Across subjects and tasks, there is widespread variability in the exact level of confidence, even for tasks that do not differ in objective difficulty. Such expressions of under- and overconfidence are of vital importance, as they relate to fundamental life outcomes. Yet, a computational account specifying the mechanisms underlying under- and overconfidence is currently missing. Here, we propose that prior beliefs in the ability to perform a task, based on prior experience with this or a similar task, explain why confidence can differ dramatically across subjects and tasks, despite similar performance. In two perceptual decision-making experiments, we provide evidence for this hypothesis by showing that manipulating prior beliefs about task performance in a training phase causally influences reported levels of confidence in a test phase, while leaving objective performance in the test phase unaffected. This is true both when prior beliefs are induced via manipulated comparative feedback and via manipulating task difficulty during the training phase. We account for these results within an accumulation-to-bound model by explicitly modeling prior beliefs based on earlier exposure to the task. Decision confidence is then quantified as the probability of being correct conditional on these prior beliefs, leading to under- or overconfidence depending on the task context. Our results provide a fundamental mechanistic insight into the computations underlying under- and overconfidence in perceptual decision-making.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The influence of false feedback on confidence was best captured by a model in which the parameters relating evidence accumulation to confidence were modified by a prior belief, without affecting objective accuracy or response times.
“This influence was best captured by a model in which the parameters relating evidence accumulation to confidence were modified by a prior belief, without affecting objective accuracy or response times.”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Marcke et al. 2022
The modeling sections (pages unavailable) describe a prior belief changing the mapping from accumulated evidence to confidence, and report that the model reproduced the feedback effect. The Experiment 1 results (page unavailable) report that feedback affected confidence but not objective accuracy or reaction times. The paper does not establish that this model captured the effect *best* relative to alternative models. (LLM, conf=0.84)
Experimental — accuracy not yet measuredSelf-models may furnish beliefs about the parameters of the confidence formation process, which may not always match the actual parameters of such a process.
“One possibility is that self-models furnish beliefs about the parameters of the confidence formation process (which may not always match the actual parameters of such a process; Fleming & Daw 2017, Khalvati et al. 2021, Marcke et al. 2022).”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Marcke et al. 2022
False feedback on relative scores compared to other participants modulates people's priors on perceptual confidence.
“In an elegant experiment, Marcke et al. (2022) modulated people's priors on perceptual confidence through the use of false feedback on their relative scores compared to those of other participants.”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Marcke et al. 2022
Global confidence can be considered a higher-order prior on estimates of local propositional confidence, naturally modeled as a probability distribution over expected success.
“One fruitful approach considers global confidence as a higher-order prior on estimates of (local) propositional confidence (Boldt et al. 2019, Marcke et al. 2022), which can be naturally modeled as a probability distribution over expected success (Rouault et al. 2019).”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Marcke et al. 2022
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,386 · see citing works
Two-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722 · see citing works
Choice Certainty Is Informed by Both Evidence and Decision Time
Kiani, R., Corthell, L., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.12.015 · Cited by 470 · see citing works
Abnormalities of confidence in psychiatry: an overview and future perspectives
Hoven, M., Lebreton, M., Engelmann, J. B., Denys, D., Luigjes, J., & van Holst, R. J. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0602-7 · Cited by 171 · see citing works
Forming global estimates of self-performance from local confidence
Rouault, M., Dayan, P., & Fleming, S. M. (2019) · Nature Communications · doi:10.1038/s41467-019-09075-3 · Cited by 134 · see citing works
Computations underlying confidence in visual perception.
Spence, M. L., Dux, P. E., & Arnold, D. H. (2016) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000179 · Cited by 89 · see citing works
Relation between belief and performance in perceptual decision making
Drugowitsch, J., Moreno-Bote, R., & Pouget, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096511 · Cited by 72 · see citing works
Modeling perceptual confidence and the confidence forced-choice paradigm.
Mamassian, P., & de Gardelle, V. (2022) · Psychological Review · doi:10.1037/rev0000312 · Cited by 70 · see citing works
Khalvati, K., Kiani, R., & Rao, R. P. N. (2021) · Nature Communications · doi:10.1038/s41467-021-25419-4 · Cited by 64 · see citing works
Neurocomputational mechanisms of confidence in self and others
Bang, D., Moran, R., Daw, N. D., & Fleming, S. M. (2022) · Nature Communications · doi:10.1038/s41467-022-31674-w · Cited by 39 · see citing works
Lee, A. L. F., de Gardelle, V., & Mamassian, P. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01869-7 · Cited by 32 · see citing works
Flagged first, then by citations
Research works printed but not linked: 12
- G. Saposnik, D. Redelmeier, C. C. Ruff, P. N. Tobler, Cognitive biases associated with medical decisions: a systematic review. BMC Medical Informatics and Decision Making 16, 1-14 (2016).
- M. E. Moses-Payne, M. Rollwage, S. M. Fleming, J. P. Roiser, Postdecision Evidence Integration and Depressive Symptoms. Frontiers in Psychiatry 10, 639 (2019).
- P. Belmi, M. A. Neale, D. Reiff, R. Ulfe, The Social Advantage of Miscalibrated Individuals: The Relationship Between Social Class and Overconfidence and Its Implications for Class-Based Inequality. Journal of Personality and Social Psychology 118, 254-282 (2019).
- S. J. Petruzzello, C. B. Corbin, Tie Effects of Performance Feedback on Female Self-Confidence. Journal of Sport and Exercise Psychology 10, 174-183 (1988).
- S. M. Fleming, N. D. Daw, Self-evaluation of decision-making: A general Bayesian framework for metacognitive computation. Psychological Review 124, 91 (2016).
- D. M. Green, J. A. Swets, Signal detection theory and psychophysics (John Wiley, 1966) (June 14, 2022).
- N. A. Macmillan, C. D. Creelman, Detection Theory: A User's Guide: 2nd edition. Detection Theory: A User's Guide: 2nd edition, 1-445 (2004).
- H. Olawole-Scott, D. Yon, Expectations about precision bias metacognition and awareness https:/doi.org/10.31234/OSF.IO/UM2WX (June 14, 2022). · DOI
- A. Boldt, V. de Gardelle, N. Yeung, The impact of evidence reliability on sensitivity and bias in decision confidence. Journal of Experimental Psychology: Human Perception and Performance 43, 1520-1531 (2017).
- A. Kuznetsova, P. B. Brockhoff, R. H. B. Christensen, lmerTest Package: Tests in Linear Mixed Effects Models. Journal of Statistical Software 82, 1-26 (2017).
- R. Ratcliff, F. Tuerlinckx, Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability. Psychonomic Bulletin & Review 2002 9:3 9, 438-481 (2002).
- K. M. Mullen, D. Ardia, D. L. Gil, D. Windover, J. Cline, DEoptim: An R Package for Global Optimization by Differential Evolution. Journal of Statistical Software 40, 1-26 (2011).
Cited by
Sorted by citations
Metacognition and Confidence: A Review and Synthesis
Fleming, S. M. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022423-032425 · Cited by 256 · see citing works
- Authors
- Van Marcke, H., Le Denmat, P., Verguts, T., & Desender, K.
- Affiliations
- Ghent University (BE)
- KU Leuven (BE)
- Venue
- bioRxiv (Cold Spring Harbor Laboratory)
- Publisher
- openRxiv
- Published
- 2022-03-04
- OpenAlex
- W4214879557
- Cited by
- 13
- References
- 11
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 8
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- Vlaamse regering
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- underconfidence, overconfidence, decision confidence, prior beliefs, perceptual decision making, training effects, comparative feedback, task difficulty, confidence calibration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review