The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Behavioural and neural characterization of optimistic reinforcement learning
Open accessAbstract
When forming and updating beliefs about future life outcomes, people tend to consider good news and to disregard bad news. This tendency is assumed to support the optimism bias. Whether this learning bias is specific to ‘high-level’ abstract belief update or a particular expression of a more general ‘low-level’ reinforcement learning process is unknown. Here we report evidence in favour of the second hypothesis. In a simple instrumental learning task, participants incorporated better-than-expected outcomes at a higher rate than worse-than-expected ones. In addition, functional imaging indicated that inter-individual difference in the expression of optimistic update corresponds to enhanced prediction error signalling in the reward circuitry. Our results constitute a step towards the understanding of the genesis of optimism bias at the neurocomputational level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
The Logic of Scientific Discovery
(2013) · A Realist Theory of Science · doi:10.4324/9780203090732-9 · Cited by 7,731
Unrealistic optimism about future life events
Weinstein, N. D. (1980) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.39.5.806 · Cited by 4,999
The dragons of inaction: Psychological barriers that limit climate change mitigation and adaptation.
Gifford, R. (2011) · American Psychologist · doi:10.1037/a0023566 · Cited by 2,326
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Carver, C. S., Scheier, M. F., & Segerstrom, S. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.01.006 · Cited by 2,051
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927
The Logic of Scientific Discovery
Popper, K. (2005) · Routledge eBooks · doi:10.4324/9780203994627 · Cited by 1,142
Computational psychiatry as a bridge from neuroscience to clinical applications
Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4238 · Cited by 1,002
How unrealistic optimism is maintained in the face of reality
Sharot, T., Korn, C. W., & Dolan, R. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2949 · Cited by 729
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706111104 · Cited by 683
Neural mechanisms mediating optimism bias
Sharot, T., Riccardi, A. M., Raio, C. M., & Phelps, E. A. (2007) · Nature · doi:10.1038/nature06280 · Cited by 659
The Good News-Bad News Effect: Asymmetric Processing of Objective Information about Yourself
Eil, D., & Rao, J. M. (2011) · American Economic Journal: Microeconomics · doi:10.1257/mic.3.2.114 · Cited by 657
A Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
The evolution of overconfidence
Johnson, D. D. P., & Fowler, J. H. (2011) · Nature · doi:10.1038/nature10384 · Cited by 603
Exploration versus exploitation in space, mind, and society
Hills, T. T., Todd, P. M., Lazer, D., Redish, A. D., & Couzin, I. D. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.10.004 · Cited by 549
Model‐Based fMRI and Its Application to Reward Learning and Decision Making
O'DOHERTY, J. P., HAMPTON, A., & KIM, H. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.022 · Cited by 508
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498
Tindle, H. A., Chang, Y.-F., Kuller, L. H., Manson, J. E., Robinson, J. G., Rosal, M. C., Siegle, G. J., & Matthews, K. A. (2009) · Circulation · doi:10.1161/circulationaha.108.827642 · Cited by 483
Raafat, R. M., Chater, N., & Frith, C. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.08.002 · Cited by 479
Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies
Garrison, J., Erdeniz, B., & Done, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.023 · Cited by 438
Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference
Dienes, Z. P. (2008) · Cited by 418
Shepperd, J. A., Ouellette, J. A., & Fernandez, J. K. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.4.844 · Cited by 389
VBA: A Probabilistic Treatment of Nonlinear Models for Neurobiological and Behavioural Data
Daunizeau, J., Adam, V., & Rigoux, L. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003441 · Cited by 385
Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms
Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2978-14.2015 · Cited by 362
Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain
Niv, Y., Edlund, J. A., Dayan, P., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5498-10.2012 · Cited by 356
Taking Stock of Unrealistic Optimism
Shepperd, J. A., Klein, W. M. P., Waters, E. A., & Weinstein, N. D. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691613485247 · Cited by 355
Forming beliefs: Why valence matters
Sharot, T., & Garrett, N. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.11.002 · Cited by 345
Contextual modulation of value signals in reward and punishment learning
Palminteri, S., Khamassi, M., Joffily, M., & Coricelli, G. (2015) · Nature Communications · doi:10.1038/ncomms9096 · Cited by 286
Self-citationvan den Bos, W., Cohen, M. X., Kahnt, T., & Crone, E. A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr198 · Cited by 276
Automatic integration of confidence in the brain valuation signal
Lebreton, M., Abitbol, R., Daunizeau, J., & Pessiglione, M. (2015) · Nature Neuroscience · doi:10.1038/nn.4064 · Cited by 265
Self-citationA Primer on Unrealistic Optimism
Shepperd, J. A., Waters, E. A., Weinstein, N. D., & Klein, W. M. P. (2015) · Current Directions in Psychological Science · doi:10.1177/0963721414568341 · Cited by 263
Multiple signals in anterior cingulate cortex
Kolling, N., Behrens, T., Wittmann, M., & Rushworth, M. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.12.007 · Cited by 249
Critical Roles for Anterior Insula and Dorsal Striatum in Punishment-Based Avoidance Learning
Palminteri, S., Justo, D., Jauffret, C., Pavlicek, B., Dauta, A., Delmaire, C., Czernecki, V., Karachi, C., Capelle, L., Durr, A., et al. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.017 · Cited by 242
Self-citationExecutive control and decision-making in the prefrontal cortex
Domenech, P., & Koechlin, E. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2014.10.007 · Cited by 236
How Dopamine Enhances an Optimism Bias in Humans
Sharot, T., Guitart-Masip, M., Korn, C. W., Chowdhury, R., & Dolan, R. J. (2012) · Current Biology · doi:10.1016/j.cub.2012.05.053 · Cited by 215
MacLeod, A. K., & Conway, C. (2005) · Cognition & Emotion · doi:10.1080/02699930441000247 · Cited by 194
Dopaminergic Genes Predict Individual Differences in Susceptibility to Confirmation Bias
Doll, B. B., Hutchison, K. E., & Frank, M. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6486-10.2011 · Cited by 184
Skvortsova, V., Palminteri, S., & Pessiglione, M. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.1350-14.2014 · Cited by 177
Self-citationLosing the rose tinted glasses: neural substrates of unbiased belief updating in depression
Garrett, N., Sharot, T., Faulkner, P., Korn, C. W., Roiser, J. P., & Dolan, R. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00639 · Cited by 174
Schoenbaum, M. (1997) · American Journal of Public Health · doi:10.2105/ajph.87.5.755 · Cited by 162
The English Philosophers from Bacon to Mill
Burtt, E. A. (1977) · Medical Entomology and Zoology · Cited by 161
Assessing inter individual differences with task related functional neuroimaging
Lebreton, M., Bavard, S., Daunizeau, J., & Palminteri, S. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0681-8 · Cited by 160
Self-citationHuman development of the ability to learn from bad news
Moutsiana, C., Garrett, N., Clarke, R. C., Lotto, R. B., Blakemore, S.-J., & Sharot, T. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1305631110 · Cited by 119
Adaptive properties of differential learning rates for positive and negative outcomes
Cazé, R. D., & van der Meer, M. A. A. (2013) · Biological Cybernetics · doi:10.1007/s00422-013-0571-5 · Cited by 118
A pessimistic view of optimistic belief updating
Shah, P., Harris, A. J. L., Bird, G., Catmur, C., & Hahn, U. (2016) · Cognitive Psychology · doi:10.1016/j.cogpsych.2016.05.004 · Cited by 118
The role of the neural reward circuitry in self-referential optimistic belief updates
Kuzmanovic, B., Jefferson, A., & Vogeley, K. T. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.014 · Cited by 107
Brain Hemispheres Selectively Track the Expected Value of Contralateral Options
Palminteri, S., Boraud, T., Lafargue, G., Dubois, B., & Pessiglione, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1500-09.2009 · Cited by 100
Self-citationVinckier, F., Gaillard, R., Palminteri, S., Rigoux, L., Salvador, A., Fornito, A., Adapa, R., Krebs, M. O., Pessiglione, M., & Fletcher, P. C. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.73 · Cited by 87
Self-citationCorrelates of unrealistic risk beliefs in a nationally representative sample
Waters, E. A., Klein, W. M. P., Moser, R. P., Yu, M., Waldron, W. R., McNeel, T. S., & Freedman, A. N. (2010) · Journal of Behavioral Medicine · doi:10.1007/s10865-010-9303-7 · Cited by 87
Human Frontal–Subcortical Circuit and Asymmetric Belief Updating
Moutsiana, C., Charpentier, C. J., Garrett, N., Cohen, M. X., & Sharot, T. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.1120-15.2015 · Cited by 83
Worbe, Y., Palminteri, S., Hartmann, A., Vidailhet, M., Lehéricy, S., & Pessiglione, M. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.137 · Cited by 66
Self-citationThe Myth of a Pessimistic View of Optimistic Belief Updating – A Commentary on Shah et al.Preprint
Sharot, T., & Garrett, N. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2811752 · Cited by 2
Cited by
The Importance of Falsification in Computational Cognitive Modeling
Palminteri, S., Wyart, V., & Koechlin, E. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.03.011 · Cited by 448
Self-citationSerotonin neurons modulate learning rate through uncertainty
Grossman, C. D., Bari, B. A., & Cohen, J. Y. (2022) · Current Biology · doi:10.1016/j.cub.2021.12.006 · Cited by 164
Forming global estimates of self-performance from local confidence
Rouault, M., Dayan, P., & Fleming, S. M. (2019) · Nature Communications · doi:10.1038/s41467-019-09075-3 · Cited by 134
Optimistic update bias holds firm: three tests of robustness following Shah et al
Garrett, N., & Sharot, T. (2017) · Consciousness and Cognition · doi:10.1016/j.concog.2016.10.013 · Cited by 123
Updating beliefs under perceived threat
Garrett, N., González-Garzón, A. M., Foulkes, L., Levita, L., & Sharot, T. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0716-18.2018 · Cited by 109
Metadata
- Authors
- Lefebvre, G., Lebreton, M., Meyniel, F., Bourgeois-Gironde, S., & Palminteri, S.
- Venue
- Nature Human Behaviour
- Published
- 2017-03-20
- Volume
- 1
- Issue
- 4
- ISSN
- 2397-3374 (ISSN-L)
- OpenAlex
- W2595891121
- Cited by
- 290
- References
- 56
- FWCI
- 12.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.