Two sides of the same coin: Monetary incentives concurrently improve and bias confidence judgments
Published version of a preprint
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Investigating the effects of incentive motivation on confidence accuracy and overconfidence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, induction of negative vs. positive affect or low vs. high reward expectations can decrease vs. increase local confidence, respectively12–14.”
From Distorted learning from local metacognition supports transdiagnostic underconfidence (2025) · cites this paper as [14]
In the citing paper
“By demonstrating a robust impact of feedback on global confidence, we extend previous work depicting a malleability of confidence through affective induction12,13, expected reward14,33 and feedback15,16.”
From Distorted learning from local metacognition supports transdiagnostic underconfidence (2025) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Loss aversion in riskless choice: A reference-dependent model.
Tversky, A., & Kahneman, D. (1991) · The Quarterly Journal of Economics · doi:10.2307/2937956 · Cited by 6,432 · cited 3×
“2018;4 : eaaq0668 30 May 2018 asymmetries observed in economic decision-making theories such as prospect theory (49).”
BackgroundInfluentialCalibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
Baumeister, R. F. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.46.3.610 · Cited by 1,665
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408 · cited 12×
“2018;4 : eaaq0668 30 May 2018 Effects of incentives on confidence (metacognitive) accuracy To explore how incentives affect confidence accuracy, we adopted the signal detection theory (SDT) approach developed for metacognition (7, 46, 47).”
BackgroundMethodInfluentialThe root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342
A comparison of current measures of the accuracy of feeling-of-knowing predictions
Nelson, T. O. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.109 · Cited by 976 · cited 1×
“Measuring confidence accuracy – i.e. the quality of metacognitive judgments - is challenging (Brier, 1950; Fleming and Lau, 2014; Nelson, 1984), but confidence accuracy can consensually be split in a bias (or calibration) component measuring how confidence judgments differ from the overall…”
BackgroundMotivation and cognitive control: from behavior to neural mechanism
Botvinick, M., & Braver, T. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015044 · Cited by 909
Mindful Economics: The Production, Consumption, and Value of Beliefs
Bénabou, R., & Tirole, J. (2016) · Journal of Economic Perspectives · doi:10.1257/jep.30.3.141 · Cited by 817
The neural basis of metacognitive ability
Fleming, S. M., & Dolan, R. J. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0417 · Cited by 747 · cited 4×
“Just like in this example, most decisions in everyday life are accompanied by a subjective feeling of confidence emerging from the constant monitoring of our own thoughts and actions by metacognitive processes (Fleming and Dolan, 2012; Yeung and Summerfield, 2012).”
BackgroundInfluentialMetacognition in human decision-making: confidence and error monitoring
Yeung, N., & Summerfield, C. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0416 · Cited by 667
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
Confidence in value-based choice
De Martino, B., Fleming, S. M., Garrett, N., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3279 · Cited by 534
Confidence and certainty: Distinct probabilistic quantities for different goals
Pouget, A., Drugowitsch, J., & Kepecs, A. (2016) · Nature Neuroscience · doi:10.1038/nn.4240 · Cited by 528
Galvin, S. J., Podd, J. V., Drga, V., & Whitmore, J. (2003) · Psychonomic Bulletin & Review · doi:10.3758/bf03196546 · Cited by 405
The Mechanics of Motivated Reasoning
Epley, N., & Gilovich, T. (2016) · Journal of Economic Perspectives · doi:10.1257/jep.30.3.133 · Cited by 360
A common mechanism underlies changes of mind about decisions and confidence
van den Berg, R., Anandalingam, K., Zylberberg, A., Kiani, R., Shadlen, M. N., & Wolpert, D. M. (2016) · eLife · doi:10.7554/elife.12192 · Cited by 270
Automatic integration of confidence in the brain valuation signal
Lebreton, M., Abitbol, R., Daunizeau, J., & Pessiglione, M. (2015) · Nature Neuroscience · doi:10.1038/nn.4064 · Cited by 265
Self-citationGoldstein, R. Z., Alia-Klein, N., Tomasi, D., Zhang, L., Cottone, L. A., Maloney, T., Telang, F., Caparelli, E. C., Chang, L., Ernst, T., et al. (2007) · American Journal of Psychiatry · doi:10.1176/ajp.2007.164.1.43 · Cited by 258 · cited 2×
“…states modulate confidence judgements, other disorders with abnormal incentive processing such as addictions, mood-disorders, obsessive-compulsive disorder and schizophrenia could be at particular risk for confidence miscalibration (Figee et al., 2011; Goldstein et al., 2007; Whitton et al., 2015).”
BackgroundSignatures of a Statistical Computation in the Human Sense of Confidence
Sanders, J. I., Hangya, B., & Kepecs, A. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.025 · Cited by 253
Unexpected arousal modulates the influence of sensory noise on confidence
Allen, M., Frank, D., Schwarzkopf, D. S., Fardo, F., Winston, J. S., Hauser, T. U., & Rees, G. (2016) · eLife · doi:10.7554/elife.18103 · Cited by 182
The Sense of Confidence during Probabilistic Learning: A Normative Account
Meyniel, F., Schlunegger, D., & Dehaene, S. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004305 · Cited by 163 · cited 1×
“Altogether, the importance of confidence as a cognitive variable mitigating decision-making and the societal relevance of its miscalibration have considerably stimulated the search for the computational and neurobiological mechanisms subsuming confidence estimation (14, 15).”
BackgroundRelating inter-individual differences in metacognitive performance on different perceptual tasks
Song, C., Kanai, R., Fleming, S. M., Weil, R. S., Schwarzkopf, D. S., & Rees, G. (2011) · Consciousness and Cognition · doi:10.1016/j.concog.2010.12.011 · Cited by 158
Interoceptive Ability Predicts Survival on a London Trading Floor
Kandasamy, N., Garfinkel, S. N., Page, L., Hardy, B., Critchley, H. D., Gurnell, M., & Coates, J. M. (2016) · Scientific Reports · doi:10.1038/srep32986 · Cited by 121
Vinckier, F., Gaillard, R., Palminteri, S., Rigoux, L., Salvador, A., Fornito, A., Adapa, R., Krebs, M. O., Pessiglione, M., & Fletcher, P. C. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.73 · Cited by 87
Relation between belief and performance in perceptual decision making
Drugowitsch, J., Moreno-Bote, R., & Pouget, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096511 · Cited by 72
Confidence measurement in the light of signal detection theory
Massoni, S., Gajdos, T., & Vergnaud, J.-C. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01455 · Cited by 58
Verification of forecasts expressed in terms of probability
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078%3c0001:vofeit%3e2.0.co;2 · cited 3×
“Measuring confidence accuracy—that is, the quality of metacognitive judgments—is challenging (6–8), but confidence accuracy can consensually be split into a bias (or calibration) component measuring how confidence judgments differ from the overall probability of being correct and a sensitivity (or discrimination) comp…”
Background
Research works printed but not linked: 43
- R. M. Cooke Experts in Uncertainty: Opinion and Subjective Probability in Science (Oxford Univ. Press 1992). · DOI · Paper page
- J. K. Adams, A confidence scale defined in terms of expected percentages. Am. J. Psychol. 70, 432–436 (1957). · DOI
- 10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2 · DOI · Paper page
- T. Folke, C. Jacobsen, S. M. Fleming, B. De Martino, Explicit representation of confidence informs future value-based decisions. Nat. Hum. Behav. 1, 0002 (2016). · DOI
- 10.1126/science.1252254 · DOI · Paper page
- J. V. Baranski, W. M. Petrusic, The calibration and resolution of confidence in perceptual judgments. Percept. Psychophys. 55, 412–428 (1994). · DOI · Paper page
- R. F. West, K. E. Stanovich, The domain specificity and generality of overconfidence: Individual differences in performance estimation bias. Psychon. Bull. Rev. 4, 387–392 (1997). · DOI
- E. S. Berner, M. L. Graber, Overconfidence as a cause of diagnostic error in medicine. Am. J. Med. 121, S2–S23 (2008). · DOI · Paper page
- C. Camerer, D. Lovallo, Overconfidence and excess entry: An experimental approach. Am. Econ. Rev. 89, 306–318 (1999). · DOI · Paper page
- U. Malmendier, G. Tate, CEO overconfidence and corporate investment. J. Finance 60, 2661–2700 (2005). · DOI · Paper page
- V. L. Smith, J. M. Walker, Monetary rewards and decision cost in experimental economics. Econ. Inq. 31, 245–261 (1993). · DOI · Paper page
- S. E. Bonner, G. B. Sprinkle, The effects of monetary incentives on effort and task performance: Theories, evidence, and a framework for research. Account. Organ. Soc. 27, 303–345 (2002). · DOI · Paper page
- 10.2307/2234473 · DOI · Paper page
- F. Giardini G. Coricelli M. Joffily A. Sirigu Overconfidence in predictions as an effect of desirability bias in Advances in Decision Making Under Risk and Uncertainty M. Abdellaoui J. D. Hey Eds. (Springer Berlin Heidelberg 2008) pp. 163–180. · DOI
- P. Koellinger, T. Treffers, Joy leads to overconfidence, and a simple countermeasure. PLOS ONE 10, e0143263 (2015). · DOI · Paper page
- S. Massoni, Emotion as a boost to metacognition: How worry enhances the quality of confidence. Conscious. Cogn. 29, 189–198 (2014). · DOI
- F. U. Jönsson, H. Olsson, M. J. Olsson, Odor emotionality affects the confidence in odor naming. Chem. Senses 30, 29–35 (2005). · DOI · Paper page
- M. Guggenmos, G. Wilbertz, M. N. Hebart, P. Sterzer, Mesolimbic confidence signals guide perceptual learning in the absence of external feedback. eLife 5, e13388 (2016). · DOI · Paper page
- M. N. Hebart, Y. Schriever, T. H. Donner, J.-D. Haynes, The relationship between perceptual decision variables and confidence in the human brain. Cereb. Cortex 26, 118–130 (2016). · DOI · Paper page
- N. Schwarz, G. L. Clore, Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states. J. Pers. Soc. Psychol. 45, 513–523 (1983). · DOI · Paper page
- G. M. Becker, M. H. Degroot, J. Marschak, Measuring utility by a single-response sequential method. Behav. Sci. 9, 226–232 (1964). · DOI · Paper page
- W. M. Ducharme, M. L. Donnell, Intrasubject comparison of four response modes for “subjective probability” assessment. Organ. Behav. Hum. Perform. 10, 108–117 (1973). · doi:10.1016/0030-5073(73)90007-x
- A. Schotter, I. Trevino, Belief elicitation in the laboratory. Annu. Rev. Econ. 6, 103–128 (2014). · DOI · Paper page
- K. H. Schlag, J. Tremewan, J. J. van der Weele, A penny for your thoughts: A survey of methods for eliciting beliefs. Exp. Econ. 18, 457–490 (2015). · DOI · Paper page
- G. Hollard, S. Massoni, J.-C. Vergnaud, In search of good probability assessors: An experimental comparison of elicitation rules for confidence judgments. Theory Decis. 80, 363–387 (2016). · DOI
- J. Drugowitsch, Becoming confident in the statistical nature of human confidence judgments. Neuron 90, 425–427 (2016). · DOI
- B. Maniscalco, H. Lau, A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings. Conscious. Cogn. 21, 422–430 (2012). · DOI · Paper page
- S. M. Fleming, R. J. Dolan, Effects of loss aversion on post-decision wagering: Implications for measures of awareness. Conscious. Cogn. 19, 352–363 (2010). · DOI · Paper page
- J. Navajas, B. Bahrami, P. E. Latham, Post-decisional accounts of biases in confidence. Curr. Opin. Behav. Sci. 11, 55–60 (2016). · DOI · Paper page
- S. T. Trautmann, G. van de Kuilen, Belief elicitation: A horse race among truth serums. Econ. J. 125, 2116–2135 (2015). · DOI
- P. P. Wakker, On the composition of risk preference and belief. Psychol. Rev. 111, 236–241 (2004). · DOI
- C. R. Fox R. A. Poldrack Prospect theory and the brain in Neuroeconomics: Decision Making and the Brain P. W. Glimcher C. F. Camerer E. Fehr R. A. Poldrack Eds. (Academic Press 2009) pp. 145–173. · DOI · Paper page
- Z. Murad, M. Sefton, C. Starmer, How do risk attitudes affect measured confidence? J. Risk Uncertain. 52, 21–46 (2016). · DOI
- H. A. Harsay, M. X. Cohen, L. Reneman, K. R. Ridderinkhof, How the aging brain translates motivational incentive into action: The role of individual differences in striato-cortical white matter pathways. Dev. Cogn. Neurosci. 1, 530–539 (2011). · DOI
- H. Olsson, A. Winman, Underconfidence in sensory discrimination: The interaction between experimental setting and response strategies. Percept. Psychophys. 58, 374–382 (1996). · DOI
- P. Juslin, A. Winman, H. Olsson, Naive empiricism and dogmatism in confidence research: A critical examination of the hard–easy effect. Psychol. Rev. 107, 384–396 (2000). · doi:10.1037/0033-295x.107.2.384 · Paper page
- D. D. P. Johnson, J. H. Fowler, The evolution of overconfidence. Nature 477, 317–320 (2011). · DOI · Paper page
- J. A. R. Marshall, P. C. Trimmer, A. I. Houston, J. M. McNamara, On evolutionary explanations of cognitive biases. Trends Ecol. Evol. 28, 469–473 (2013). · DOI
- F. Meyniel, M. Sigman, Z. F. Mainen, Confidence as Bayesian probability: From neural origins to behavior. Neuron 88, 78–92 (2015). · DOI · Paper page
- A. S. Goodie, The role of perceived control and overconfidence in pathological gambling. J. Gambl. Stud. 21, 481–502 (2005). · DOI
- M. Figee, M. Vink, F. Geus, N. Vulink, D. J. Veltman, H. Westenberg, D. Denys, Dysfunctional reward circuitry in obsessive-compulsive disorder. Biol. Psychiatry 69, 867–874 (2011). · DOI · Paper page
- 10.1097/YCO.0000000000000122 · DOI · Paper page
- 10.1037/xge0000062 · DOI · Paper page
Cited by
Domain-general enhancements of metacognitive ability through adaptive training.
Carpenter, J., Sherman, M. T., Kievit, R. A., Seth, A. K., Lau, H., & Fleming, S. M. (2019) · Journal of Experimental Psychology: General · doi:10.1037/xge0000505 · Cited by 174
Distorted learning from local metacognition supports transdiagnostic underconfidence
Katyal, S., Huys, Q. J., Dolan, R. J., & Fleming, S. M. (2025) · Nature Communications · doi:10.1038/s41467-025-57040-0 · Cited by 47
Hoven, M., Rouault, M., van Holst, R., & Luigjes, J. (2023) · Psychological Medicine · doi:10.1017/s003329172300209x · Cited by 28
Self-citation
Metadata
- Authors
- Lebreton, M., Langdon, S., Slieker, M. J., Nooitgedacht, J. S., Goudriaan, A. E., Denys, D., van Holst, R. J., & Luigjes, J.
- Venue
- Science Advances
- Published
- 2018-05-04
- Volume
- 4
- Issue
- 5
- ISSN
- 2375-2548
- Cited by
- 70
- References
- 28
- Language
- en
- Funders
- Netherlands Organisation for Health Research and Development (ASPASIA)
- University of Amsterdam (ABC Talent Grant 2014, ABC Talent Grant 2015)
- The Netherlands Organisation for Scientific research (NWO-Veni 451-15-015, NWO-Vidi (91713354))
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.