The neural dynamics of reward value and risk coding in the human orbitofrontal cortex
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
See Kringelbach and Rapuano (doi: 10.1093/brain/aww049 ) for a scientific commentary on this article. The orbitofrontal cortex is known to carry information regarding expected reward, risk and experienced outcome. Yet, due to inherent limitations in lesion and neuroimaging methods, the neural dynamics of these computations has remained elusive in humans. Here, taking advantage of the high temporal definition of intracranial recordings, we characterize the neurophysiological signatures of the intact orbitofrontal cortex in processing information relevant for risky decisions. Local field potentials were recorded from the intact orbitofrontal cortex of patients suffering from drug-refractory partial epilepsy with implanted depth electrodes as they performed a probabilistic reward learning task that required them to associate visual cues with distinct reward probabilities. We observed three successive signals: (i) around 400 ms after cue presentation, the amplitudes of the local field potentials increased with reward probability; (ii) a risk signal emerged during the late phase of reward anticipation and during the outcome phase; and (iii) an experienced value signal appeared at the time of reward delivery. Both the medial and lateral orbitofrontal cortex encoded risk and reward probability while the lateral orbitofrontal cortex played a dominant role in coding experienced value. The present study provides the first evidence from intracranial recordings that the human orbitofrontal cortex codes reward risk both during late reward anticipation and during the outcome phase at a time scale of milliseconds. Our findings offer insights into the rapid mechanisms underlying the ability to learn structural relationships from the environment. See Kringelbach and Rapuano (doi: 10.1093/brain/aww049 ) for a scientific commentary on this article. The orbitofrontal cortex processes information regarding expected reward, risk and experienced outcome, but the neural dynamics of these computations remain unclear. Li et al. exploit the high temporal definition of intracranial recordings to characterize the neurophysiological signatures of the intact human orbitofrontal cortex when processing information relevant to risky decisions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
The human orbitofrontal cortex: linking reward to hedonic experience
Kringelbach, M. L. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1747 · Cited by 2,180 · cited 1×
“An important functional dissociation within the OFC is that the medial OFC is involved in positive reinforcers, whereas the lateral OFC would be concerned with the evaluation of punishments (Kringelbach and Rolls, 2004; Kringelbach, 2005).”
BackgroundDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 6×
“The medial OFC has been shown to be a core component of a risksensitive processing network comprising the basal ganglia, amygdala, parietal cortex, anterior cingulate cortex and insular cortex (Fiorillo et al., 2003; Hsu et al., 2005; McCoy and Platt, 2005; Preuschoff et al., 2006; Christopoulos et al., 2009; Tobler e…”
BackgroundInfluentialKRINGELBACH, M. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.03.006 · Cited by 1,977 · cited 1×
“An important functional dissociation within the OFC is that the medial OFC is involved in positive reinforcers, whereas the lateral OFC would be concerned with the evaluation of punishments (Kringelbach and Rolls, 2004; Kringelbach, 2005).”
BackgroundNeurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · cited 1×
“…by Nanjing University user on 03 May 2018 Reward probability coding in the orbitofrontal cortex Electrophysiological recordings in animals indicate that value is coded in the firing rates of orbitofrontal neurons (Padoa-Schioppa and Assad, 2006; Wallis, 2012).”
BackgroundNeural systems responding to degrees of uncertainty in human decision-making
Hsu, M., Bhatt, M., Adolphs, R., Tranel, D., & Camerer, C. F. (2005) · Science · doi:10.1126/science.1115327 · Cited by 1,411
The root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342
Frontal cortex and reward-guided learning and decision-making
Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.014 · Cited by 1,111
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
Architectonic subdivision of the human orbital and medial prefrontal cortex
Öngür, D., Ferry, A. T., & Price, J. L. (2003) · Journal of Comparative Neurology · doi:10.1002/cne.10609 · Cited by 944
Choice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642 · cited 2×
“The orbitofrontal cortex (OFC) is known to code at least three different types of reward-related information: reward probability, risk and experienced value (or outcome value) (Doya, 2008; Rushworth and Behrens, 2008; Peters and Büchel, 2010; Padoa-Schioppa and Cai, 2011; Levy and Glimcher, 2012).”
BackgroundDifferential effects of insular and ventromedial prefrontal cortex lesions on risky decision-making
Clark, L., Bechara, A., Damasio, H., Aitken, M. R. F., Sahakian, B. J., & Robbins, T. W. (2008) · Brain · doi:10.1093/brain/awn066 · Cited by 613
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems
Tobler, P. N., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00745.2006 · Cited by 472 · cited 4×
“Our intracranial EEG results bridge the gap between neuroimaging studies in healthy humans (Tobler et al., 2007, 2009) and electrophysiological recordings in animals (O’Neill and Schultz, 2010).”
BackgroundResultInfluentialNeurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · cited 2×
“to absolute reward values (Roesch et al., 2006; Kennerley et al., 2009).”
ResultNeural correlates of value, risk, and risk aversion contributing to decision making under risk
Christopoulos, G. I., Tobler, P. N., Bossaerts, P., Dolan, R. J., & Schultz, W. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2614-09.2009 · Cited by 451 · cited 2×
“The medial OFC has been shown to be a core component of a risksensitive processing network comprising the basal ganglia, amygdala, parietal cortex, anterior cingulate cortex and insular cortex (Fiorillo et al., 2003; Hsu et al., 2005; McCoy and Platt, 2005; Preuschoff et al., 2006; Christopoulos et al., 2009; Tobler e…”
BackgroundHabenula: crossroad between the basal ganglia and the limbic system
Hikosaka, O., Sesack, S. R., Lecourtier, L., & Shepard, P. D. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3463-08.2008 · Cited by 432
Mohr, P. N. C., Biele, G., & Heekeren, H. R. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0003-10.2010 · Cited by 411
Neural representations of subjective reward value
Peters, J., & Büchel, C. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.04.031 · Cited by 405 · cited 2×
“The orbitofrontal cortex (OFC) is known to code at least three different types of reward-related information: reward probability, risk and experienced value (or outcome value) (Doya, 2008; Rushworth and Behrens, 2008; Peters and Büchel, 2010; Padoa-Schioppa and Cai, 2011; Levy and Glimcher, 2012).”
BackgroundPlassmann, H., O'Doherty, J. P., & Rangel, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0788-10.2010 · Cited by 356 · cited 1×
“However, recent Pavlovian conditioning studies associating abstract cues to different types of rewards and punishments did not report such dissociation but found a common engagement of the medial OFC in expectation of rewards and punishments (Plassmann et al., 2010; Metereau and Dreher, 2015).”
BackgroundThe Architecture of Reward Value Coding in the Human Orbitofrontal Cortex
Sescousse, G., Redouté, J., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3501-10.2010 · Cited by 353
Self-citationSeparate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., & Rushworth, M. F. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012246107 · Cited by 340 · cited 5×
“Rather, it seems that vmPFC/OFC neurons are linked to the processing of the reception of their preferred outcomes (Bouret and Richmond, 2010; Noonan et al., 2010; Rudebeck and Murray, 2011b; Rushworth et al., 2011).”
BackgroundInfluentialExpectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex
Takahashi, Y. K., Roesch, M. R., Wilson, R. C., Toreson, K., O'Donnell, P., Niv, Y., & Schoenbaum, G. (2011) · Nature Neuroscience · doi:10.1038/nn.2957 · Cited by 280 · cited 3×
“…of slowly rising reward probability responses in the human OFC is also consistent with current conceptualizations of OFC-dopamine neuron relationships supporting that the role of the OFC is to represent states in partially observable scenarios (Takahashi et al., 2011; Metereau and Dreher, 2015).”
BackgroundResultThe neural code of reward anticipation in human orbitofrontal cortex
Kahnt, T., Heinzle, J., Park, S. Q., & Haynes, J.-D. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0912838107 · Cited by 274 · cited 1×
“A large body of evidence from human functional MRI studies also confirms that reward probability is coded in this region (Rolls et al., 2008; Kahnt et al., 2010).”
BackgroundHuman substantia nigra neurons encode unexpected financial rewards
Zaghloul, K. A., Blanco, J. A., Weidemann, C. T., McGill, K., Jaggi, J. L., Baltuch, G. H., & Kahana, M. J. (2009) · Science · doi:10.1126/science.1167342 · Cited by 264
Bouret, S., & Richmond, B. J. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0049-10.2010 · Cited by 192 · cited 2×
“Rather, it seems that vmPFC/OFC neurons are linked to the processing of the reception of their preferred outcomes (Bouret and Richmond, 2010; Noonan et al., 2010; Rudebeck and Murray, 2011b; Rushworth et al., 2011).”
BackgroundNeural coding of distinct statistical properties of reward information in humans
Dreher, J.-C., Kohn, P., & Berman, K. F. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj004 · Cited by 180
Self-citationKim, H., Shimojo, S., & O'Doherty, J. P. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq145 · Cited by 176 · cited 2×
“A number of functional MRI studies indicate that expected value is represented in a ‘common currency’ network encompassing the medial part of the OFC/ventromedial prefrontal cortex (vmPFC) and ventral striatum (O’Doherty et al., 2002; Kim et al., 2011; Sescousse et al., 2015; Metereau and Dreher, 2015).”
BackgroundSelective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice
Stopper, C. M., Green, E. B., & Floresco, S. B. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs297 · Cited by 117 · cited 2×
“Lesion studies also emphasize the crucial role of the OFC in guiding adaptive behaviour on the basis of reward value, both in animals (Stopper et al., 2014) and in humans (Hsu et al.”
Background
Cited by
On Cuteness: Unlocking the Parental Brain and Beyond
Kringelbach, M. L., Stark, E. A., Alexander, C., Bornstein, M. H., & Stein, A. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.05.003 · Cited by 310
Keep Calm and Cuddle on: Social Touch as a Stress Buffer
Morrison, I. (2016) · Adaptive Human Behavior and Physiology · doi:10.1007/s40750-016-0052-x · Cited by 256
Rao, V. R., Sellers, K. K., Wallace, D. L., Lee, M. B., Bijanzadeh, M., Sani, O. G., Yang, Y., Shanechi, M. M., Dawes, H. E., & Chang, E. F. (2018) · Current Biology · doi:10.1016/j.cub.2018.10.026 · Cited by 181
Behavior- and Modality-General Representation of Confidence in Orbitofrontal Cortex
Masset, P., Ott, T., Lak, A., Hirokawa, J., & Kepecs, A. (2020) · Cell · doi:10.1016/j.cell.2020.05.022 · Cited by 109
Ketamine Normalizes the Structural Alterations of Inferior Frontal Gyrus in Depression
Dai, D., Lacadie, C. M., Holmes, S. E., Cool, R., Anticevic, A., Averill, C., Abdallah, C., & Esterlis, I. (2020) · Chronic Stress · doi:10.1177/2470547020980681 · Cited by 34
Metadata
- Authors
- Li, Y., Vanni-Mercier, G., Isnard, J., Mauguière, F., & Dreher, J.-C.
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-01-25
- Volume
- 139
- Issue
- 4
- Pages
- 1295-1309
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2265060472
- Cited by
- 66
- References
- 31
- FWCI
- 4.51
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.