Orbitofrontal Cortical Neurons Encode Expectation-Driven Initiation of Reward-Seeking
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Adaptive execution and inhibition of behavior are guided by the activity of neuronal populations across multiple frontal cortical areas. The rodent medial prefrontal cortex has been well studied with respect to these behaviors, influencing behavioral execution/inhibition based on context. Other frontal regions, in particular the orbitofrontal cortex (OFC), are critical in directing behavior to obtain rewards, but the relationship between OFC neuronal activity and response execution or inhibition has been poorly characterized. In particular, little is known about OFC with respect to extinction learning, an important example of context-guided response inhibition. Here, we recorded the activity of OFC neurons while rats performed a discriminative-stimulus (DS)-driven sucrose-seeking task followed by multiple days of extinction of the DS. OFC neuronal activity was maximally responsive (1) to reward-predicting stimuli (RS) that triggered a lever press (i.e., lever-response initiation) and (2) during reward-well approach in pursuit of sucrose (i.e., well-response initiation). RS presentation that was not followed by a lever press or RS presentation during extinction produced weak activation, as did nonrewarded stimulus (NS) presentation regardless of response (press or withhold) or session (DS-sucrose or extinction). Activity related to nonrewarded well entry was minor, and activity was significantly inhibited during reward consumption. Finally, OFC neuronal activity switched selectivity to track rewarded behaviors when the RS/NS contingencies were reversed. Thus, rather than signaling variables related to extinction or response inhibition, activity in OFC was strongest at the initiation of multiple components of reward-seeking behavior, most prominently when valid reward-predicting cues drove these behaviors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 2×
“%) may actually encode heightened salience resulting from reward unpredictability (Ogawa et al., 2013), in line with models that combine reward prediction and uncertainty (Mackintosh, 1975; Pearce and Hall, 1980) in the A”
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · cited 2×
“%) may actually encode heightened salience resulting from reward unpredictability (Ogawa et al., 2013), in line with models that combine reward prediction and uncertainty (Mackintosh, 1975; Pearce and Hall, 1980) in the A”
ResultNeurons in medial prefrontal cortex signal memory for fear extinction
Milad, M. R., & Quirk, G. J. (2002) · Nature · doi:10.1038/nature01138 · Cited by 1,836 · cited 1×
“Specifically, OFC neurons do not increase activity during the presentation of the NS or extinguished RS as neurons in infralimbic cortex do in fear-extinction studies (Milad and Quirk, 2002).”
BackgroundStop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans
Aron, A. R., Fletcher, P. C., Bullmore, E. T., Sahakian, B. J., & Robbins, T. W. (2003) · Nature Neuroscience · doi:10.1038/nn1003 · Cited by 1,771 · cited 2×
“, 2009), despite studies proposing its role in such behavior (Aron et al., 2003; Chudasama et al., 2003; Eagle et al., 2008; Eagle and Baunez, 2010).”
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · cited 3×
“We hypothesize that some OFC responses may reflect cue salience or attention (Ogawa et al., 2013), but that the majority of neuronal responses are maximal for reward-predicting stimuli (Tremblay and Schultz, 1999; Roesch et al., 2010; PadoaSchioppa and Cai, 2011).”
BackgroundNeural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809
Projections from the amygdaloid complex to the cerebral cortex and thalamus in the rat and cat
Krettek, J. E., & Price, J. L. (1977) · Journal of Comparative Neurology · doi:10.1002/cne.901720408 · Cited by 785 · cited 1×
“…play an important role in execution and extinction of reward-seeking (Peters et al., 2005, 2009), given the strong connectivity among these areas (Krettek and Price, 1977; McDonald, 1991a,b; Wright et al., 1996; Schoenbaum et al., 1998, 1999, 2000; Shi and Cassell, 1998; Saddoris et al., 2005).”
BackgroundValue, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766
Extinction circuits for fear and addiction overlap in prefrontal cortex
Peters, J., Kalivas, P. W., & Quirk, G. J. (2009) · Learning & Memory · doi:10.1101/lm.1041309 · Cited by 736 · cited 1×
“…OFC, medial prefrontal cortex (mPFC) and basolateral amygdala (BLA) may also play an important role in execution and extinction of reward-seeking (Peters et al., 2005, 2009), given the strong connectivity among these areas (Krettek and Price, 1977; McDonald, 1991a,b; Wright et al., 1996;…”
BackgroundOrbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat
McAlonan, K., & Brown, V. J. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.019 · Cited by 618
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600 · cited 2×
“…interest in the relationships among risk, confidence, salience, and reward signaling, particularly in OFC and related brain regions (Kepecs et al., 2008; van Duuren et al., 2009; O’Neill and Schultz, 2010; Roitman and Roitman, 2010; Padoa-Schioppa, 2011; Wallis, 2012; Ogawa et al., 2013).”
BackgroundOrbitofrontal Cortex and Representation of Incentive Value in Associative Learning
Gallagher, M., McMahan, R. W., & Schoenbaum, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-15-06610.1999 · Cited by 593 · cited 1×
“OFC lesions or inactivation weakens stimulus-outcome updating (Gallagher et al., 1999; Schoenbaum et al., 2002; Chudasama and Robbins, 2003; McAlonan and Brown, 2003; Roberts, 2006; Riceberg and Shapiro, 2012).”
BackgroundA new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Schoenbaum, G., Chiba, A. A., & Gallagher, M. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01876.1999 · Cited by 579 · cited 2×
“In contrast, reversal of outcome-predicting odors disrupted OFC response selectivity (Schoenbaum et al., 1999; Roesch et al., 2007).”
BackgroundResultChudasama, Y., & Robbins, T. W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-25-08771.2003 · Cited by 543 · cited 2×
“The reversal of OFC responses aligns with other studies that have posited a role for OFC in reversal behavior (Chudasama and Robbins, 2003; McAlonan and Brown, 2003; Kim and Ragozzino, 2005; Burke et al., 2009).”
BackgroundResultChudasama, Y., Passetti, F., Rhodes, S. E. V., Lopian, D., Desai, A., & Robbins, T. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.020 · Cited by 518 · cited 2×
“, 2009), despite studies proposing its role in such behavior (Aron et al., 2003; Chudasama et al., 2003; Eagle et al., 2008; Eagle and Baunez, 2010).”
BackgroundStop-Signal Reaction-Time Task Performance: Role of Prefrontal Cortex and Subthalamic Nucleus
Eagle, D. M., Baunez, C., Hutcheson, D. M., Lehmann, O., Shah, A. P., & Robbins, T. W. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm044 · Cited by 404
Orbitofrontal cortex neurons: role in olfactory and visual association learning
Rolls, E. T., Critchley, H. D., Mason, R., & Wakeman, E. A. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.5.1970 · Cited by 398 · cited 1×
“Reversal studies by Rolls and colleagues demonstrated that a greater proportion of primate OFC neurons reversed selectivity for visual (i.e., more spatial) than olfactory (i.e., less spatial) stimuli (Rolls et al., 1996).”
BackgroundOrbitofrontal Cortex Mediates Outcome Encoding in Pavlovian But Not Instrumental Conditioning
Ostlund, S. B., & Balleine, B. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5443-06.2007 · Cited by 379 · cited 1×
“Second, recent work suggests that OFC encodes outcomes in Pavlovian contexts (Ostlund and Balleine, 2007), but this hypothesis has only begun to be tested (Luk and Wallis, 2013).”
BackgroundMcdonald, A. J. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90248-m · Cited by 372
Gottfried, J. A., & Dolan, R. J. (2004) · Nature Neuroscience · doi:10.1038/nn1314 · Cited by 353 · cited 2×
“Fourth, and related, some studies have reported an OFC influence in extinction learning (Butter et al., 1963; Gottfried and Dolan, 2004; Izquierdo and Murray, 2005; Finger et al., 2008; Zeeb and Winstanley, 2013; Panayi and Killcross, 2014) but others have not (Burke et al.”
BackgroundEncoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation
Roesch, M. R., Taylor, A. R., & Schoenbaum, G. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.027 · Cited by 297 · cited 3×
“Activity is also influenced by location (Feierstein et al., 2006; Roesch et al., 2006; Kennerley and Wallis, 2009), outcome probability, certainty or confidence (Kepecs et al., 2008; van Duuren et al., 2009), salience (Ogawa et al., 2013), and risk (O’Neill and Schultz, 2010; Roitman and Roitman,…”
Reynolds, S. M., & Zahm, D. S. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3432-05.2005 · Cited by 239 · cited 1×
“These similarities may reflect a circuit involving OFC and NAc that regulates these behaviors, anatomically demonstrated by robust retrograde labeling in the lateral OFC and agranular insular cortex from injections in the NAc core (Reynolds and Zahm, 2005).”
BackgroundRoles of Nucleus Accumbens Core and Shell in Incentive-Cue Responding and Behavioral Inhibition
Ambroggi, F., Ghazizadeh, A., Nicola, S. M., & Fields, H. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6491-10.2011 · Cited by 206
Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement
Noonan, M. P., Kolling, N., Walton, M. E., & Rushworth, M. F. S. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08023.x · Cited by 169 · cited 2×
“Here we demonstrated a strong relationship between OFC activity and reward-seeking, consistent with previous results (Roesch and Olson, 2004; Mainen and Kepecs, 2009; Schoenbaum et al., 2011; Noonan et al., 2012; Wallis, 2012), and a limited association between OFC activity and response inhibition or extinction.”
ResultKennerley, S. W., & Wallis, J. D. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00273.2009 · Cited by 108 · cited 2×
“Activity is also influenced by location (Feierstein et al., 2006; Roesch et al., 2006; Kennerley and Wallis, 2009), outcome probability, certainty or confidence (Kepecs et al.”
BackgroundChoice Coding in Frontal Cortex during Stimulus-Guided or Action-Guided Decision-Making
Luk, C.-H., & Wallis, J. D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4920-12.2013 · Cited by 96 · cited 1×
“Second, recent work suggests that OFC encodes outcomes in Pavlovian contexts (Ostlund and Balleine, 2007), but this hypothesis has only begun to be tested (Luk and Wallis, 2013).”
BackgroundBurke, K. A., Takahashi, Y. K., Correll, J., Leon Brown, P., & Schoenbaum, G. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06992.x · Cited by 76 · cited 1×
“Fourth, and related, some studies have reported an OFC influence in extinction learning (Butter et al., 1963; Gottfried and Dolan, 2004; Izquierdo and Murray, 2005; Finger et al., 2008; Zeeb and Winstanley, 2013; Panayi and Killcross, 2014) but others have not (Burke et al., 2008, 2009).”
BackgroundRisk-Responsive Orbitofrontal Neurons Track Acquired Salience
Ogawa, M., van der Meer, M. A. A., Esber, G. R., Cerri, D. H., Stalnaker, T. A., & Schoenbaum, G. (2013) · Neuron · doi:10.1016/j.neuron.2012.11.006 · Cited by 74
Dissociable roles of medial orbitofrontal cortex in human operant extinction learning
Finger, E. C., Mitchell, D. G. V., Jones, M., & Blair, R. J. R. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.08.021 · Cited by 45 · cited 2×
“Fourth, and related, some studies have reported an OFC influence in extinction learning (Butter et al., 1963; Gottfried and Dolan, 2004; Izquierdo and Murray, 2005; Finger et al., 2008; Zeeb and Winstanley, 2013; Panayi and Killcross, 2014) but others have not (Burke et al.”
Background
Cited by
The neural basis of reversal learning: An updated perspective
Izquierdo, A., Brigman, J. L., Radke, A. K., Rudebeck, P. H., & Holmes, A. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2016.03.021 · Cited by 670
Redish, A. D. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.30 · Cited by 479
The impact of sugar consumption on stress driven, emotional and addictive behaviors
Jacques, A., Chaaya, N., Beecher, K., Ali, S. A., Belmer, A., & Bartlett, S. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.05.021 · Cited by 271
“We suggest the neuroadaptations that occur to depression-related brain regions, namely the hippocampus, PFC and AMG, following sugar intake (reviewed above) contributes to the incidence of depression (Robinson et al., 2014; Moorman and Aston-Jones, 2014; Hsu et al., 2015).”
BackgroundFunctional Heterogeneity within Rat Orbitofrontal Cortex in Reward Learning and Decision Making
Izquierdo, A. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1678-17.2017 · Cited by 258
Behavioral flexibility in rats and mice: contributions of distinct frontocortical regions
Hamilton, D. A., & Brigman, J. L. (2015) · Genes, Brain and Behavior · doi:10.1111/gbb.12191 · Cited by 168
Metadata
- Authors
- Moorman, D. E., & Aston-Jones, G.
- Venue
- Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2014-07-30
- Volume
- 34
- Issue
- 31
- Pages
- 10234-10246
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2164912026
- Cited by
- 99
- References
- 30
- FWCI
- 4.26
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.