CoChat

Two sides of the same coin: Monetary incentives concurrently improve and bias confidence judgments

Lebreton, Maël, Langdon, Shari, Slieker, Matthijs J., Nooitgedacht, Jip S., Goudriaan, Anna E., Denys, Damiaan, van Holst, Ruth J., Luigjes, Judy · 2018 · Science Advances

Published version of a preprint

Cited by 70

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

Investigating the effects of incentive motivation on confidence accuracy and overconfidence.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1126/sciadv.aaq0668

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 43

  1. R. M. Cooke Experts in Uncertainty: Opinion and Subjective Probability in Science (Oxford Univ. Press 1992). · DOI · Paper page
  2. J. K. Adams, A confidence scale defined in terms of expected percentages. Am. J. Psychol. 70, 432–436 (1957). · DOI
  3. 10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2 · DOI · Paper page
  4. T. Folke, C. Jacobsen, S. M. Fleming, B. De Martino, Explicit representation of confidence informs future value-based decisions. Nat. Hum. Behav. 1, 0002 (2016). · DOI
  5. 10.1126/science.1252254 · DOI · Paper page
  6. J. V. Baranski, W. M. Petrusic, The calibration and resolution of confidence in perceptual judgments. Percept. Psychophys. 55, 412–428 (1994). · DOI · Paper page
  7. R. F. West, K. E. Stanovich, The domain specificity and generality of overconfidence: Individual differences in performance estimation bias. Psychon. Bull. Rev. 4, 387–392 (1997). · DOI
  8. E. S. Berner, M. L. Graber, Overconfidence as a cause of diagnostic error in medicine. Am. J. Med. 121, S2–S23 (2008). · DOI · Paper page
  9. C. Camerer, D. Lovallo, Overconfidence and excess entry: An experimental approach. Am. Econ. Rev. 89, 306–318 (1999). · DOI · Paper page
  10. U. Malmendier, G. Tate, CEO overconfidence and corporate investment. J. Finance 60, 2661–2700 (2005). · DOI · Paper page
  11. V. L. Smith, J. M. Walker, Monetary rewards and decision cost in experimental economics. Econ. Inq. 31, 245–261 (1993). · DOI · Paper page
  12. S. E. Bonner, G. B. Sprinkle, The effects of monetary incentives on effort and task performance: Theories, evidence, and a framework for research. Account. Organ. Soc. 27, 303–345 (2002). · DOI · Paper page
  13. 10.2307/2234473 · DOI · Paper page
  14. F. Giardini G. Coricelli M. Joffily A. Sirigu Overconfidence in predictions as an effect of desirability bias in Advances in Decision Making Under Risk and Uncertainty M. Abdellaoui J. D. Hey Eds. (Springer Berlin Heidelberg 2008) pp. 163–180. · DOI
  15. P. Koellinger, T. Treffers, Joy leads to overconfidence, and a simple countermeasure. PLOS ONE 10, e0143263 (2015). · DOI · Paper page
  16. S. Massoni, Emotion as a boost to metacognition: How worry enhances the quality of confidence. Conscious. Cogn. 29, 189–198 (2014). · DOI
  17. F. U. Jönsson, H. Olsson, M. J. Olsson, Odor emotionality affects the confidence in odor naming. Chem. Senses 30, 29–35 (2005). · DOI · Paper page
  18. M. Guggenmos, G. Wilbertz, M. N. Hebart, P. Sterzer, Mesolimbic confidence signals guide perceptual learning in the absence of external feedback. eLife 5, e13388 (2016). · DOI · Paper page
  19. M. N. Hebart, Y. Schriever, T. H. Donner, J.-D. Haynes, The relationship between perceptual decision variables and confidence in the human brain. Cereb. Cortex 26, 118–130 (2016). · DOI · Paper page
  20. N. Schwarz, G. L. Clore, Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states. J. Pers. Soc. Psychol. 45, 513–523 (1983). · DOI · Paper page
  21. G. M. Becker, M. H. Degroot, J. Marschak, Measuring utility by a single-response sequential method. Behav. Sci. 9, 226–232 (1964). · DOI · Paper page
  22. W. M. Ducharme, M. L. Donnell, Intrasubject comparison of four response modes for “subjective probability” assessment. Organ. Behav. Hum. Perform. 10, 108–117 (1973). · doi:10.1016/0030-5073(73)90007-x
  23. A. Schotter, I. Trevino, Belief elicitation in the laboratory. Annu. Rev. Econ. 6, 103–128 (2014). · DOI · Paper page
  24. K. H. Schlag, J. Tremewan, J. J. van der Weele, A penny for your thoughts: A survey of methods for eliciting beliefs. Exp. Econ. 18, 457–490 (2015). · DOI · Paper page
  25. G. Hollard, S. Massoni, J.-C. Vergnaud, In search of good probability assessors: An experimental comparison of elicitation rules for confidence judgments. Theory Decis. 80, 363–387 (2016). · DOI
  26. J. Drugowitsch, Becoming confident in the statistical nature of human confidence judgments. Neuron 90, 425–427 (2016). · DOI
  27. B. Maniscalco, H. Lau, A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings. Conscious. Cogn. 21, 422–430 (2012). · DOI · Paper page
  28. S. M. Fleming, R. J. Dolan, Effects of loss aversion on post-decision wagering: Implications for measures of awareness. Conscious. Cogn. 19, 352–363 (2010). · DOI · Paper page
  29. J. Navajas, B. Bahrami, P. E. Latham, Post-decisional accounts of biases in confidence. Curr. Opin. Behav. Sci. 11, 55–60 (2016). · DOI · Paper page
  30. S. T. Trautmann, G. van de Kuilen, Belief elicitation: A horse race among truth serums. Econ. J. 125, 2116–2135 (2015). · DOI
  31. P. P. Wakker, On the composition of risk preference and belief. Psychol. Rev. 111, 236–241 (2004). · DOI
  32. C. R. Fox R. A. Poldrack Prospect theory and the brain in Neuroeconomics: Decision Making and the Brain P. W. Glimcher C. F. Camerer E. Fehr R. A. Poldrack Eds. (Academic Press 2009) pp. 145–173. · DOI · Paper page
  33. Z. Murad, M. Sefton, C. Starmer, How do risk attitudes affect measured confidence? J. Risk Uncertain. 52, 21–46 (2016). · DOI
  34. H. A. Harsay, M. X. Cohen, L. Reneman, K. R. Ridderinkhof, How the aging brain translates motivational incentive into action: The role of individual differences in striato-cortical white matter pathways. Dev. Cogn. Neurosci. 1, 530–539 (2011). · DOI
  35. H. Olsson, A. Winman, Underconfidence in sensory discrimination: The interaction between experimental setting and response strategies. Percept. Psychophys. 58, 374–382 (1996). · DOI
  36. P. Juslin, A. Winman, H. Olsson, Naive empiricism and dogmatism in confidence research: A critical examination of the hard–easy effect. Psychol. Rev. 107, 384–396 (2000). · doi:10.1037/0033-295x.107.2.384 · Paper page
  37. D. D. P. Johnson, J. H. Fowler, The evolution of overconfidence. Nature 477, 317–320 (2011). · DOI · Paper page
  38. J. A. R. Marshall, P. C. Trimmer, A. I. Houston, J. M. McNamara, On evolutionary explanations of cognitive biases. Trends Ecol. Evol. 28, 469–473 (2013). · DOI
  39. F. Meyniel, M. Sigman, Z. F. Mainen, Confidence as Bayesian probability: From neural origins to behavior. Neuron 88, 78–92 (2015). · DOI · Paper page
  40. A. S. Goodie, The role of perceived control and overconfidence in pathological gambling. J. Gambl. Stud. 21, 481–502 (2005). · DOI
  41. M. Figee, M. Vink, F. Geus, N. Vulink, D. J. Veltman, H. Westenberg, D. Denys, Dysfunctional reward circuitry in obsessive-compulsive disorder. Biol. Psychiatry 69, 867–874 (2011). · DOI · Paper page
  42. 10.1097/YCO.0000000000000122 · DOI · Paper page
  43. 10.1037/xge0000062 · DOI · Paper page

Cited by

See all 70

Metadata

Authors
Lebreton, M., Langdon, S., Slieker, M. J., Nooitgedacht, J. S., Goudriaan, A. E., Denys, D., van Holst, R. J., & Luigjes, J.
Venue
Science Advances
Published
2018-05-04
Volume
4
Issue
5
ISSN
2375-2548
Cited by
70
References
28
Language
en
Funders
  • Netherlands Organisation for Health Research and Development (ASPASIA)
  • University of Amsterdam (ABC Talent Grant 2014, ABC Talent Grant 2015)
  • The Netherlands Organisation for Scientific research (NWO-Veni 451-15-015, NWO-Vidi (91713354))

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.