The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Expected Value, Reward Outcome, and Temporal Difference Error Representations in a Probabilistic Decision Task
Abstract
In probabilistic decision tasks, an expected value (EV) of a choice is calculated, and after the choice has been made, this can be updated based on a temporal difference (TD) prediction error between the EV and the reward magnitude (RM) obtained. The EV is measured as the probability of obtaining a reward x RM. To understand the contribution of different brain areas to these decision-making processes, functional magnetic resonance imaging activations related to EV versus RM (or outcome) were measured in a probabilistic decision task. Activations in the medial orbitofrontal cortex were correlated with both RM and with EV and confirmed in a conjunction analysis to extend toward the pregenual cingulate cortex. From these representations, TD reward prediction errors could be produced. Activations in areas that receive from the orbitofrontal cortex including the ventral striatum, midbrain, and inferior frontal gyrus were correlated with the TD error. Activations in the anterior insula were correlated negatively with EV, occurring when low reward outcomes were expected, and also with the uncertainty of the reward, implicating this region in basic and crucial decision-making parameters, low expected outcomes, and uncertainty.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space
Collins, D. L., Neelin, P., Peters, T. M., & Evans, A. C. (1994) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199403000-00005 · Cited by 3,431 · cited 2×
“Preprocessing of the data used SPM2 realignment, reslicing with sinc interpolation, normalization to the Montreal Neurological Institute (MNI) coordinate system (Collins et al. 1994), and spatial smoothing with a 8-mm full width at half maximum isotropic Gaussian kernel.”
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 2×
“For brain regions where there was a prior hypothesis as described in the Introduction and under Methods, namely, in the parts of the orbitofrontal cortex, pregenual cingulate cortex, ventral striatum, and midbrain shown to be of interest because of activations found in prior studies in reward paradigms or because neur…”
Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making
Bechara, A., Damasio, H., Damasio, A. R., & Lee, G. P. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05473.1999 · Cited by 2,001
KRINGELBACH, M. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.03.006 · Cited by 1,977
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · cited 1×
“…of action (or the expected utility of a choice) in oculomotor tasks is reflected in the firing of parietal and cingulate cortex neurons (Platt and Glimcher 1999; Glimcher 2003, 2004; Dorris and Glimcher 2004; Sugrue et al. 2004, 2005; McCoy and Platt 2005) and that dopamine neurons may…”
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · cited 2×
“McCoy and Platt 2005) and that dopamine neurons may respond to conditioned stimuli predicting reward with increasing probability and to reward uncertainty (Schultz 2006).”
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Cited by
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Self-Control in Decision-Making Involves Modulation of the vmPFC Valuation System
Hare, T. A., Camerer, C. F., & Rangel, A. (2009) · Science · doi:10.1126/science.1168450 · Cited by 1,928
Liu, X., Hairston, J., Schrier, M., & Fan, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.012 · Cited by 916
The cingulate cortex and limbic systems for emotion, action, and memory
Rolls, E. T. (2019) · Brain Structure and Function · doi:10.1007/s00429-019-01945-2 · Cited by 859
Self-citationThe orbitofrontal cortex and beyond: From affect to decision-making
Rolls, E. T., & Grabenhorst, F. (2008) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2008.09.001 · Cited by 807
Self-citationHuman insula activation reflects risk prediction errors as well as risk
Preuschoff, K., Quartz, S. R., & Bossaerts, P. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4286-07.2008 · Cited by 784
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792
Value, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766
Self-citationBeckmann, M., Johansen-Berg, H., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3328-08.2009 · Cited by 789
Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006598 · Cited by 769
Mendl, M., Burman, O. H. P., Parker, R. M. A., & Paul, E. S. (2009) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2009.02.023 · Cited by 755
Hare, T. A., Camerer, C. F., Knoepfle, D. T., O'Doherty, J. P., & Rangel, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4089-09.2010 · Cited by 527
Neural correlates of value, risk, and risk aversion contributing to decision making under risk
Christopoulos, G. I., Tobler, P. N., Bossaerts, P., Dolan, R. J., & Schultz, W. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2614-09.2009 · Cited by 451
Limbic systems for emotion and for memory, but no single limbic system
Rolls, E. T. (2015) · Cortex · doi:10.1016/j.cortex.2013.12.005 · Cited by 428
Self-citationOldham, S., Murawski, C., Fornito, A., Youssef, G., Yücel, M., & Lorenzetti, V. (2018) · Human Brain Mapping · doi:10.1002/hbm.24184 · Cited by 425
Mohr, P. N. C., Biele, G., & Heekeren, H. R. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0003-10.2010 · Cited by 411
Stochastic dynamics as a principle of brain function
Deco, G., Rolls, E. T., & Romo, R. (2009) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2009.01.006 · Cited by 382
Self-citationTransformation of stimulus value signals into motor commands during simple choice
Hare, T. A., Schultz, W., Camerer, C. F., O'Doherty, J. P., & Rangel, A. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1109322108 · Cited by 372
Knowing how much you don't know: a neural organization of uncertainty estimates
Bach, D. R., & Dolan, R. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3289 · Cited by 339
Social and monetary reward learning engage overlapping neural substrates
Lin, A., Adolphs, R., & Rangel, A. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr006 · Cited by 351
Diekhof, E. K., Kaps, L., Falkai, P., & Gruber, O. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.02.007 · Cited by 331
The orbitofrontal cortex and emotion in health and disease, including depression
Rolls, E. T. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.09.021 · Cited by 329
Self-citationEffects of Expectation on Placebo-Induced Dopamine Release in Parkinson Disease
Lidstone, S. C., Schulzer, M., Dinelle, K., Mak, E., Sossi, V., Ruth, T. J., de la Fuente-Fernández, R., Phillips, A. G., & Stoessl, A. J. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.88 · Cited by 323
Distinct Value Signals in Anterior and Posterior Ventromedial Prefrontal Cortex
Smith, D. V., Hayden, B. Y., Truong, T.-K., Song, A. W., Platt, M. L., & Huettel, S. A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3319-09.2010 · Cited by 300
Rolls, E. T. (2023) · Brain Structure and Function · doi:10.1007/s00429-023-02644-9 · Cited by 312
Self-citationTaste, olfactory, and food reward value processing in the brain
Rolls, E. T. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.03.002 · Cited by 288
Self-citationNucleus accumbens and impulsivity
Basar, K., Sesia, T., Groenewegen, H., Steinbusch, H. W. M., Visser-Vandewalle, V., & Temel, Y. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.08.007 · Cited by 280
Range-adapting representation of economic value in the orbitofrontal cortex
Padoa-Schioppa, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3751-09.2009 · Cited by 276
Food reward, hyperphagia, and obesity
Berthoud, H.-R., Lenard, N. R., & Shin, A. C. (2011) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.00028.2011 · Cited by 275
Warm pleasant feelings in the brain
Rolls, E. T., Grabenhorst, F., & Parris, B. A. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.005 · Cited by 227
Self-citationSeparate Neural Mechanisms Underlie Choices and Strategic Preferences in Risky Decision Making
Venkatraman, V., Payne, J. W., Bettman, J. R., Luce, M. F., & Huettel, S. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.04.007 · Cited by 222
Bellebaum, C., Polezzi, D., & Daum, I. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.07.023 · Cited by 202
The development of the ventral prefrontal cortex and social flexibility
Nelson, E. E., & Guyer, A. E. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.01.002 · Cited by 201
Enhanced affective brain representations of chocolate in cravers vs. non‐cravers
Rolls, E. T., & McCabe, C. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05724.x · Cited by 188
Self-citationThe Neurobiology of Reference-Dependent Value Computation
De Martino, B., Kumaran, D., Holt, B., & Dolan, R. J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4832-08.2009 · Cited by 174
Jiang, J., Beck, J., Heller, K., & Egner, T. (2015) · Nature Communications · doi:10.1038/ncomms9165 · Cited by 160
Human cortical representation of oral temperature
Guest, S., Grabenhorst, F., Essick, G., Chen, Y., Young, M., McGlone, F., de Araujo, I., & Rolls, E. T. (2007) · Physiology & Behavior · doi:10.1016/j.physbeh.2007.07.004 · Cited by 129
The effects of insula damage on decision-making for risky gains and losses
Weller, J. A., Levin, I. P., Shiv, B., & Bechara, A. (2009) · Social Neuroscience · doi:10.1080/17470910902934400 · Cited by 119
Neural representation of expected value in the adolescent brain
Barkley-Levenson, E., & Galván, A. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319762111 · Cited by 114
Neural correlates of risk prediction error during reinforcement learning in humans
d'Acremont, M., Lu, Z.-L., Li, X., Van der Linden, M., & Bechara, A. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.04.096 · Cited by 94
“have revealed neural correlates of risky stimuli or decisions in various brain regions including the striatum, the insula, the inferior frontal gyrus, the lateral orbitofrontal cortex, and the anterior cingulate cortex (Paulus et al., 2003; Huettel et al., 2005; Kuhnen and Knutson, 2005; Rolls et al., 2007; Tobler et…”
D'Cruz, A.-M., Mosconi, M. W., Ragozzino, M. E., Cook, E. H., & Sweeney, J. A. (2016) · Translational Psychiatry · doi:10.1038/tp.2016.161 · Cited by 77
Macoveanu, J., Meluken, I., Chase, H. W., Phillips, M. L., Kessing, L. V., Siebner, H. R., Vinberg, M., & Miskowiak, K. W. (2021) · Psychological Medicine · doi:10.1017/s0033291720000367 · Cited by 12
Metadata
- Authors
- Rolls, E. T., McCabe, C., & Redoute, J.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-06-22
- Volume
- 18
- Issue
- 3
- Pages
- 652-663
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2120652175
- Cited by
- 236
- References
- 29
- FWCI
- 11.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.