Identity-Specific Reward Representations in Orbitofrontal Cortex Are Modulated by Selective Devaluation
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Goal-directed behavior is sensitive to the current value of expected outcomes. This requires independent representations of specific rewards, which have been linked to orbitofrontal cortex (OFC) function. However, the mechanisms by which the human brain updates specific goals on the fly, and translates those updates into choices, have remained unknown. Here we implemented selective devaluation of appetizing food odors in combination with pattern-based neuroimaging and a decision-making task. We found that in a hungry state, participants chose to smell high-intensity versions of two value-matched food odor rewards. After eating a meal corresponding to one of the two odors, participants switched choices toward the low intensity of the sated odor but continued to choose the high intensity of the nonsated odor. This sensory-specific behavioral effect was mirrored by pattern-based changes in fMRI signal in lateral posterior OFC, where specific reward identity representations were altered after the meal for the sated food odor but retained for the nonsated counterpart. In addition, changes in functional connectivity between the OFC and general value coding in ventromedial prefrontal cortex (vmPFC) predicted individual differences in satiety-related choice behavior. These findings demonstrate how flexible representations of specific rewards in the OFC are updated by devaluation, and how functional connections to vmPFC reflect the current value of outcomes and guide goal-directed behavior. SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is critical for goal-directed behavior. A recent proposal is that OFC fulfills this function by representing a variety of state and task variables (“cognitive maps”), including a conjunction of expected reward identity and value. Here we tested how identity-specific representations of food odor reward are updated by satiety. We found that fMRI pattern-based signatures of reward identity in lateral posterior OFC were modulated after selective devaluation, and that connectivity between this region and general value coding ventromedial prefrontal cortex (vmPFC) predicted choice behavior. These results provide evidence for a mechanism by which devaluation modulates a cognitive map of expected reward in OFC and thereby alters general value signals in vmPFC to guide goal-directed behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · cited 2×
“…et al., 2014; Howard et al., 2015; Rich and Wallis, 2016), identity-general signals are typically observed at the time of choice (Daw et al., 2006; Padoa-Schioppa and Assad, 2006; Hampton and O’Doherty, 2007; Plassmann et al., 2007; Kennerley et al., 2011; McNamee et al., 2013; Strait et al.,…”
BackgroundGoal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · cited 1×
“Behavioral control mechanisms that can flexibly adapt to changes in the subjective value of these rewards are operationally defined as “goal-directed behaviors” (Balleine and Dickinson, 1998; O’Doherty et al., 2017).”
BackgroundMcLaren, D. G., Ries, M. L., Xu, G., & Johnson, S. C. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.068 · Cited by 1,445
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · cited 2×
“Neural signals in this region reflect predictive reward information (Schoenbaum et al., 1998; Tremblay and Schultz, 1999; O’Doherty et al., 2002), and these anticipatory responses are modulated according to changes in value without the need for additional stimulus– outcome learning (Gottfried et al.”
BackgroundChanges in brain activity related to eating chocolate: From pleasure to aversion
Small, D. M. (2001) · Brain · doi:10.1093/brain/124.9.1720 · Cited by 1,179 · cited 1×
“…signals in anterior OFC (Howard et al., 2015), as well as with studies showing that anterior OFC tracks satiety-related changes in reward value (Small et al., 2001; Gottfried et al., 2003), raising the possibility that anterior and posterior OFC differentially contribute to goal-directed…”
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · cited 1×
“Importantly, updating of these representations must occur on the fly, and thus without the need for additional stimulus– outcome learning (Dickinson and Balleine, 1994).”
BackgroundOrbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855
Dopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718 · cited 1×
“…to correlate with midbrain activity (Kahnt et al., 2012) in a dopamine-dependent manner (Kahnt and Tobler, 2017), and midbrain-derived dopamine levels are reduced after feeding in the rodent VS and medial prefrontal cortex (Ahn and Phillips, 1999; Roitman et al., 2004; de Araujo et al., 2012).”
BackgroundChib, V. S., Rangel, A., Shimojo, S., & O'Doherty, J. P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2575-09.2009 · Cited by 643 · cited 2×
“This is in line with human imaging studies showing value processing in vmPFC (Plassmann et al., 2007; Chib et al., 2009; Lebreton et al., 2009; Levy and Glimcher, 2011; McNamee et al., 2013; Howard et al., 2015), as well as studies showing that lesions to the vmPFC and adjacent OFC impair…”
BackgroundResultGremel, C. M., & Costa, R. M. (2013) · Nature Communications · doi:10.1038/ncomms3264 · Cited by 618 · cited 4×
“Prior studies using devaluation tasks across a variety of model species have identified OFC as a key substrate for mediating goaldirected behavior (Rolls et al., 1989; Gallagher et al., 1999; O’Doherty et al., 2000; Gottfried et al., 2003; Pickens et al., 2003; Valentin et al., 2007; Gremel and Costa, 2013; Rhodes and…”
BackgroundInfluentialOrbitofrontal Cortex and Representation of Incentive Value in Associative Learning
Gallagher, M., McMahan, R. W., & Schoenbaum, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-15-06610.1999 · Cited by 593 · cited 3×
“Prior studies using devaluation tasks across a variety of model species have identified OFC as a key substrate for mediating goaldirected behavior (Rolls et al., 1989; Gallagher et al., 1999; O’Doherty et al., 2000; Gottfried et al., 2003; Pickens et al., 2003; Valentin et al., 2007; Gremel and Costa, 2013; Rhodes and…”
BackgroundIzquierdo, A., Suda, R. K., & Murray, E. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-04.2004 · Cited by 588
Baxter, M. G., Parker, A., Lindner, C. C. C., Izquierdo, A. D., & Murray, E. A. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04311.2000 · Cited by 582 · cited 1×
“Previous work has suggested that updating of reward associations involves interactions between OFC and amygdala (Baxter et al., 2000; Rhodes and Murray, 2013; Zeeb and Winstanley, 2013).”
BackgroundDetermining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529
Sensory-specific satiety-related olfactory activation of the human orbitofrontal cortex
OʼDoherty, J., Rolls, E. T., Francis, S., Bowtell, R., McGlone, F., Kobal, G., Renner, B., & Ahne, G. (2000) · NeuroReport · doi:10.1097/00001756-200002070-00035 · Cited by 482
Learning, reward, and decision making
O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475
Rolls, E. T., Sienkiewicz, Z. J., & Yaxley, S. (1989) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1989.tb00774.x · Cited by 466
An automatic valuation system in the human brain: Evidence from functional neuroimaging
Lebreton, M., Jorge, S., Michel, V., Thirion, B., & Pessiglione, M. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.040 · Cited by 455 · cited 2×
“This is in line with human imaging studies showing value processing in vmPFC (Plassmann et al., 2007; Chib et al., 2009; Lebreton et al., 2009; Levy and Glimcher, 2011; McNamee et al., 2013; Howard et al., 2015), as well as studies showing that lesions to the vmPFC and adjacent OFC impair…”
BackgroundResultRudebeck, P. H., & Murray, E. A. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.049 · Cited by 405
Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating
Rudebeck, P. H., Saunders, R. C., Prescott, A. T., Chau, L. S., & Murray, E. A. (2013) · Nature Neuroscience · doi:10.1038/nn.3440 · Cited by 383
Sensory-specific satiety-related olfactory activation of the human orbitofrontal cortex
OʼDoherty, J., Rolls, E. T., Francis, S., Bowtell, R., McGlone, F., Kobal, G., Renner, B., & Ahne, G. (2000) · NeuroReport · doi:10.1097/00001756-200003200-00046 · Cited by 361
The Architecture of Reward Value Coding in the Human Orbitofrontal Cortex
Sescousse, G., Redouté, J., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3501-10.2010 · Cited by 353 · cited 4×
“Such signals have been identified in the OFC across species (Burke et al., 2008; Sescousse et al., 2010; Klein-Flügge et al., 2013; McDannald et al., 2014; Stalnaker et al., 2014; Howard et al., 2015; Boorman et al., 2016).”
BackgroundInfluentialFellows, L. K., & Farah, M. J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl176 · Cited by 337 · cited 1×
“…et al., 2009; Lebreton et al., 2009; Levy and Glimcher, 2011; McNamee et al., 2013; Howard et al., 2015), as well as studies showing that lesions to the vmPFC and adjacent OFC impair value-based choices (Bechara et al., 2000; Izquierdo et al., 2004; Fellows and Farah, 2007; Camille et al., 2011).”
ResultValuation and decision-making in frontal cortex: one or many serial or parallel systems?
Rushworth, M. F., Kolling, N., Sallet, J., & Mars, R. B. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.04.011 · Cited by 309 · cited 1×
“These findings are in line with the idea that lateral OFC is associated with specific reward information, whereas vmPFC and anterior cingulate implement value comparisons to guide choice behavior (Rushworth et al., 2012).”
ResultConnectivity-based parcellation of the human orbitofrontal cortex
Kahnt, T., Chang, L. J., Park, S. Q., Heinzle, J., & Haynes, J.-D. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.0257-12.2012 · Cited by 299 · cited 1×
“Indeed, fMRI signals in posteromedial pOFC have been shown to correlate with midbrain activity (Kahnt et al., 2012) in a dopamine-dependent manner (Kahnt and Tobler, 2017), and midbrain-derived dopamine levels are reduced after feeding in the rodent VS and medial prefrontal cortex (Ahn and…”
BackgroundSelf-citationReward value comparison via mutual inhibition in ventromedial prefrontal cortex
Strait, C. E., Blanchard, T. C., & Hayden, B. Y. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.032 · Cited by 294
The neural code of reward anticipation in human orbitofrontal cortex
Kahnt, T., Heinzle, J., Park, S. Q., & Haynes, J.-D. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0912838107 · Cited by 274 · cited 2×
“To test this, we implemented a pattern-based fMRI analysis using linear SVM classification and a searchlight approach (Kriegeskorte et al., 2006; Kahnt et al., 2010).”
MethodSelf-citationThe gut–brain dopamine axis: a regulatory system for caloric intake
de Araujo, I. E., Ferreira, J. G., Tellez, L. A., Ren, X., & Yeckel, C. W. (2012) · Physiology & Behavior · doi:10.1016/j.physbeh.2012.02.026 · Cited by 140 · cited 1×
“…to correlate with midbrain activity (Kahnt et al., 2012) in a dopamine-dependent manner (Kahnt and Tobler, 2017), and midbrain-derived dopamine levels are reduced after feeding in the rodent VS and medial prefrontal cortex (Ahn and Phillips, 1999; Roitman et al., 2004; de Araujo et al., 2012).”
BackgroundGABAA-Mediated Inhibition of Basolateral Amygdala Blocks Reward Devaluation in Macaques
Wellman, L. L., Gale, K., & Malkova, L. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2257-04.2005 · Cited by 126
Evidence for model-based computations in the human amygdala during Pavlovian conditioning
Prévost, C., McNamee, D., Jessup, R. K., Bossaerts, P., & O'Doherty, J. P. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002918 · Cited by 79
Cited by
Orbitofrontal Cortex: A Neural Circuit for Economic Decisions
Padoa-Schioppa, C., & Conen, K. E. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.031 · Cited by 306
Sequential replay of nonspatial task states in the human hippocampus
Schuck, N. W., & Niv, Y. (2019) · Science · doi:10.1126/science.aaw5181 · Cited by 304
Rudebeck, P. H., & Rich, E. L. (2018) · Current Biology · doi:10.1016/j.cub.2018.07.018 · Cited by 263
Specializations for reward-guided decision-making in the primate ventral prefrontal cortex
Murray, E. A., & Rudebeck, P. H. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0013-4 · Cited by 169
Basolateral amygdala to orbitofrontal cortex projections enable cue-triggered reward expectations
Lichtenberg, N. T., Pennington, Z. T., Holley, S. M., Greenfield, V. Y., Cepeda, C., Levine, M. S., & Wassum, K. M. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.0486-17.2017 · Cited by 171
“Moreover, activity in the OFC of humans (Gottfried et al., 2003; KleinFlügge et al., 2013; Howard et al., 2015; Howard and Kahnt, 2017), nonhuman primates (Rich and Wallis, 2016), and rodents (McDannald et al., 2014; Farovik et al., 2015; Lopatina et al., 2015) can represent detailed information…”
Metadata
- Authors
- Howard, J. D., & Kahnt, T.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2017-02-03
- Volume
- 37
- Issue
- 10
- Pages
- 2627-2638
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2584987470
- Cited by
- 136
- References
- 34
- FWCI
- 7.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.