Neuronal Distortions of Reward Probability without Choice
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Reward probability crucially determines the value of outcomes. A basic phenomenon, defying explanation by traditional decision theories, is that people often overweigh small and underweigh large probabilities in choices under uncertainty. However, the neuronal basis of such reward probability distortions and their position in the decision process are largely unknown. We assessed individual probability distortions with behavioral pleasantness ratings and brain imaging in the absence of choice. Dorsolateral frontal cortex regions showed experience dependent overweighting of small, and underweighting of large, probabilities whereas ventral frontal regions showed the opposite pattern. These results demonstrate distorted neuronal coding of reward probabilities in the absence of choice, stress the importance of experience with probabilistic outcomes and contrast with linear probability coding in the striatum. Input of the distorted probability estimations to decision-making mechanisms are likely to contribute to well known inconsistencies in preferences formalized in theories of behavioral economics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733
Common regions of the human frontal lobe recruited by diverse cognitive demands
Duncan, J., & Owen, A. M. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01633-7 · Cited by 2,498 · cited 4×
“Conversely, dorsal prefrontal regions are preferentially involved in cognitive and evaluative functions (Fuster, 1997; Duncan and Owen, 2000; Rolls, 2004).”
BackgroundInfluentialThe neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · cited 1×
“Conversely, reward magnitude and delay become apparent with less experience and are processed preferentially by more medial and orbitofrontal regions (Wallis and Miller, 2003; Padoa-Schioppa and Assad, 2006; Roesch et al., 2006; Rudebeck et al., 2006).”
BackgroundThe functions of the orbitofrontal cortex
Rolls, E. T. (2004) · Brain and Cognition · doi:10.1016/s0278-2626(03)00277-x · Cited by 1,327
Distributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955 · cited 1×
“Previous neuroimaging research showed that prefrontal regions are activated by reward magnitude (Knutson et al., 2005; Yacubian et al., 2006).”
BackgroundNeural correlates of a decision in the dorsolateral prefrontal cortex of the macaque
Kim, J.-N., & Shadlen, M. N. (1999) · Nature Neuroscience · doi:10.1038/5739 · Cited by 950 · cited 1×
“Although prefrontal neurons are also active in choice situations (Kim and Shadlen, 1999; Barraclough et al., 2004), it is currently unknown whether this activity is specifically choice-related.”
BackgroundA general mechanism for perceptual decision-making in the human brain
Heekeren, H. R., Marrett, S., Bandettini, P. A., & Ungerleider, L. G. (2004) · Nature · doi:10.1038/nature02966 · Cited by 741 · cited 3×
“Neuroimaging research suggests a substantial involvement of the left superior frontal sulcus in perceptual decisions (Heekeren et al., 2004, 2006).”
BackgroundNeural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692 · cited 2×
“Previous research suggests linear reward probability coding in the striatum (Abler et al., 2006; Preuschoff et al., 2006).”
BackgroundResultReward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · cited 1×
“In tasks not requiring choice activity of lateral prefrontal neurons codes reward quality and probability and shows a preferential relation to reward rather than punishment (Watanabe, 1996; Kobayashi et al., 2002, 2006).”
BackgroundPrefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678 · cited 3×
“Although prefrontal neurons are also active in choice situations (Kim and Shadlen, 1999; Barraclough et al., 2004), it is currently unknown whether this activity is specifically choice-related.”
BackgroundHornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., & Polkey, C. E. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322926791 · Cited by 603
Self-citationNeural Activity in the Primate Prefrontal Cortex during Associative Learning
Asaad, W. F., Rainer, G., & Miller, E. K. (1998) · Neuron · doi:10.1016/s0896-6273(00)80658-3 · Cited by 593
Separate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580 · cited 1×
“Conversely, reward magnitude and delay become apparent with less experience and are processed preferentially by more medial and orbitofrontal regions (Wallis and Miller, 2003; Padoa-Schioppa and Assad, 2006; Roesch et al., 2006; Rudebeck et al., 2006).”
BackgroundYacubian, J., Gläscher, J., Schroeder, K., Sommer, T., Braus, D. F., & Büchel, C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2915-06.2006 · Cited by 537
Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems
Tobler, P. N., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00745.2006 · Cited by 472 · cited 4×
“Individual differences in ambiguity and risk attitude seem to be expressed primarily in prefrontal rather than striatal activity (Huettel et al., 2006; Tobler et al., 2007).”
BackgroundResultInfluentialSelf-citationThe neuropsychology of ventral prefrontal cortex: Decision-making and reversal learning
Clark, L., Cools, R., & Robbins, T. W. (2004) · Brain and Cognition · doi:10.1016/s0278-2626(03)00284-7 · Cited by 439
Event-related functional magnetic resonance imaging: modelling, inference and optimization
Josephs, O., & Henson, R. N. A. (1999) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1999.0475 · Cited by 425 · cited 4×
“…trials in strictly random order and using randomly varying intertrial intervals, it is possible to separate out fMRI responses to rapidly presented events without waiting for the hemodynamic response to reach baseline after each single trial (Dale and Buckner, 1997; Josephs and Henson, 1999).”
BackgroundMethodInfluentialThe role of prelimbic cortex in instrumental conditioning
Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423
Prediction error as a linear function of reward probability is coded in human nucleus accumbens
Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.001 · Cited by 376 · cited 2×
“Previous research suggests linear reward probability coding in the striatum (Abler et al., 2006; Preuschoff et al., 2006).”
BackgroundResultA new perceptual illusion reveals mechanisms of sensory decoding
Jazayeri, M., & Movshon, J. A. (2007) · Nature · doi:10.1038/nature05739 · Cited by 173 · cited 1×
“As with sensory illusions (Chen et al., 2003; Jazayeri and Movshon, 2007), our results suggest that reward probability distortions can occur at different processing stages.”
Background
Cited by
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
Peers increase adolescent risk taking by enhancing activity in the brain’s reward circuitry
Chein, J., Albert, D., O’Brien, L., Uckert, K., & Steinberg, L. (2011) · Developmental Science · doi:10.1111/j.1467-7687.2010.01035.x · Cited by 1,180
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
“Human neuroimaging has shown probability distortions of values analogous to Equation 10 (241, 595) but no behavioral distortions with valueless probabilities (110).”
BackgroundSelf-citationLiu, X., Hairston, J., Schrier, M., & Fan, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.012 · Cited by 916
What Motivates the Adolescent? Brain Regions Mediating Reward Sensitivity across Adolescence
Van Leijenhorst, L., Zanolie, K., Van Meel, C. S., Westenberg, P. M., Rombouts, S. A. R. B., & Crone, E. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp078 · Cited by 449
Metadata
- Authors
- Tobler, P. N., Christopoulos, G. I., O'Doherty, J. P., Dolan, R. J., & Schultz, W.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2008-11-05
- Volume
- 28
- Issue
- 45
- Pages
- 11703-11711
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1974600775
- Cited by
- 89
- References
- 22
- FWCI
- 4.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.