PreprintCited by 13Decision-Making and Behavioral EconomicsVisual perception and processing mechanismsNeural and Behavioral Psychology Studies

Manipulating prior beliefs causally induces under- and overconfidence

Open access
Van Marcke, Hélène, Le Denmat, Pierre, Verguts, Tom, Desender, Kobe·2022·bioRxiv (Cold Spring Harbor Laboratory)

Preprint — published as 10.1177/09567976241231572

Abstract

Abstract Making a decision is invariably accompanied by a sense of confidence in that decision. Across subjects and tasks, there is widespread variability in the exact level of confidence, even for tasks that do not differ in objective difficulty. Such expressions of under- and overconfidence are of vital importance, as they relate to fundamental life outcomes. Yet, a computational account specifying the mechanisms underlying under- and overconfidence is currently missing. Here, we propose that prior beliefs in the ability to perform a task, based on prior experience with this or a similar task, explain why confidence can differ dramatically across subjects and tasks, despite similar performance. In two perceptual decision-making experiments, we provide evidence for this hypothesis by showing that manipulating prior beliefs about task performance in a training phase causally influences reported levels of confidence in a test phase, while leaving objective performance in the test phase unaffected. This is true both when prior beliefs are induced via manipulated comparative feedback and via manipulating task difficulty during the training phase. We account for these results within an accumulation-to-bound model by explicitly modeling prior beliefs based on earlier exposure to the task. Decision confidence is then quantified as the probability of being correct conditional on these prior beliefs, leading to under- or overconfidence depending on the task context. Our results provide a fundamental mechanistic insight into the computations underlying under- and overconfidence in perceptual decision-making.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2022.03.01.482511

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The influence of false feedback on confidence was best captured by a model in which the parameters relating evidence accumulation to confidence were modified by a prior belief, without affecting objective accuracy or response times.

    “This influence was best captured by a model in which the parameters relating evidence accumulation to confidence were modified by a prior belief, without affecting objective accuracy or response times.”

    From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Marcke et al. 2022

    The modeling sections (pages unavailable) describe a prior belief changing the mapping from accumulated evidence to confidence, and report that the model reproduced the feedback effect. The Experiment 1 results (page unavailable) report that feedback affected confidence but not objective accuracy or reaction times. The paper does not establish that this model captured the effect *best* relative to alternative models. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Self-models may furnish beliefs about the parameters of the confidence formation process, which may not always match the actual parameters of such a process.

    “One possibility is that self-models furnish beliefs about the parameters of the confidence formation process (which may not always match the actual parameters of such a process; Fleming & Daw 2017, Khalvati et al. 2021, Marcke et al. 2022).”

    From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Marcke et al. 2022

  • False feedback on relative scores compared to other participants modulates people's priors on perceptual confidence.

    “In an elegant experiment, Marcke et al. (2022) modulated people's priors on perceptual confidence through the use of false feedback on their relative scores compared to those of other participants.”

    From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Marcke et al. 2022

  • Global confidence can be considered a higher-order prior on estimates of local propositional confidence, naturally modeled as a probability distribution over expected success.

    “One fruitful approach considers global confidence as a higher-order prior on estimates of (local) propositional confidence (Boldt et al. 2019, Marcke et al. 2022), which can be naturally modeled as a probability distribution over expected success (Rouault et al. 2019).”

    From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Marcke et al. 2022

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 12

  1. G. Saposnik, D. Redelmeier, C. C. Ruff, P. N. Tobler, Cognitive biases associated with medical decisions: a systematic review. BMC Medical Informatics and Decision Making 16, 1-14 (2016).
  2. M. E. Moses-Payne, M. Rollwage, S. M. Fleming, J. P. Roiser, Postdecision Evidence Integration and Depressive Symptoms. Frontiers in Psychiatry 10, 639 (2019).
  3. P. Belmi, M. A. Neale, D. Reiff, R. Ulfe, The Social Advantage of Miscalibrated Individuals: The Relationship Between Social Class and Overconfidence and Its Implications for Class-Based Inequality. Journal of Personality and Social Psychology 118, 254-282 (2019).
  4. S. J. Petruzzello, C. B. Corbin, Tie Effects of Performance Feedback on Female Self-Confidence. Journal of Sport and Exercise Psychology 10, 174-183 (1988).
  5. S. M. Fleming, N. D. Daw, Self-evaluation of decision-making: A general Bayesian framework for metacognitive computation. Psychological Review 124, 91 (2016).
  6. D. M. Green, J. A. Swets, Signal detection theory and psychophysics (John Wiley, 1966) (June 14, 2022).
  7. N. A. Macmillan, C. D. Creelman, Detection Theory: A User's Guide: 2nd edition. Detection Theory: A User's Guide: 2nd edition, 1-445 (2004).
  8. H. Olawole-Scott, D. Yon, Expectations about precision bias metacognition and awareness https:/doi.org/10.31234/OSF.IO/UM2WX (June 14, 2022). · DOI
  9. A. Boldt, V. de Gardelle, N. Yeung, The impact of evidence reliability on sensitivity and bias in decision confidence. Journal of Experimental Psychology: Human Perception and Performance 43, 1520-1531 (2017).
  10. A. Kuznetsova, P. B. Brockhoff, R. H. B. Christensen, lmerTest Package: Tests in Linear Mixed Effects Models. Journal of Statistical Software 82, 1-26 (2017).
  11. R. Ratcliff, F. Tuerlinckx, Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability. Psychonomic Bulletin & Review 2002 9:3 9, 438-481 (2002).
  12. K. M. Mullen, D. Ardia, D. L. Gil, D. Windover, J. Cline, DEoptim: An R Package for Global Optimization by Differential Evolution. Journal of Statistical Software 40, 1-26 (2011).

Cited by

Sorted by citations

Authors
Van Marcke, H., Le Denmat, P., Verguts, T., & Desender, K.
Affiliations
  • Ghent University (BE)
  • KU Leuven (BE)
Venue
bioRxiv (Cold Spring Harbor Laboratory)
Publisher
openRxiv
Published
2022-03-04
OpenAlex
W4214879557
Cited by
13
References
11
Citations by year
2026: 1 · 2025: 1 · 2024: 3 · 2023: 8
Type
posted content
Language
en
Open access
Licence
cc-by-nc-nd
Locations
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • OSF Preprints (OSF Preprints) (submittedVersion)
Funders
Vlaamse regering
Topics
  • Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Keywords
underconfidence, overconfidence, decision confidence, prior beliefs, perceptual decision making, training effects, comparative feedback, task difficulty, confidence calibration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review