Dynamic Changes in Representations of Preceding and Upcoming Reward in Monkey Orbitofrontal Cortex
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
We investigated how orbitofrontal cortex (OFC) contributes to adaptability in the face of changing reward contingencies by examining how reward representations in monkey orbitofrontal neurons change during a visually cued, multi-trial reward schedule task. A large proportion of orbitofrontal neurons were sensitive to events in this task (69/80 neurons in the valid and 48/58 neurons in the random cue context). Neuronal activity depended upon preceding reward, upcoming reward, reward delivery, and schedule state. Preceding reward-dependent activity occurred in both the valid and random cue contexts, whereas upcoming reward-dependent activity was observed only in the valid context. A greater proportion of neurons encoded preceding reward in the random than the valid cue context. The proportion of neurons with preceding reward-dependent activity declined as each trial progressed, whereas the proportion encoding upcoming reward increased. Reward information was represented by ensembles of neurons, the composition of which changed with task context and time. Overall, neuronal activity in OFC adapted to reflect the importance of different types of reward information in different contexts and time periods. This contextual and temporal adaptability is one hallmark of neurons participating in executive functions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · cited 1×
“Overall, neuronal activity in OFC adapted to reflect the importance of different types of reward information in different contexts and time periods.”
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · cited 4×
“Keywords: electrophysiology, executive function, motivation, prefrontal cortex, reward schedule”
InfluentialLimbic connections of the orbital and medial prefrontal cortex in macaque monkeys
Carmichael, S. T., & Price, J. L. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903630408 · Cited by 1,197 · cited 1×
“Comparison to Other Areas OFC is strongly interconnected with the midbrain dopaminergic nuclei, ventral striatum, amygdala, and anterior cingulate cortex (Oades and Halliday 1987; Barbas and De Olmos 1990; Carmichael and Price 1995; Haber et al. 1995).”
Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030
Distributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · cited 2×
“use action-outcome histories to guide behavior ( Kennerley et al. 2006 ).”
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836 · cited 4×
“…expectancy during different task time periods, and change with learning or changes in stimulusreinforcer contingencies (Rosenkilde et al. 1981; Thorpe et al. 1983; Rolls et al. 1996; Tremblay and Schultz 1999; Hikosaka and Watanabe 2000; Tremblay and Schultz 2000a, 2000b; Wallis and Miller…”
InfluentialKringelbach, M. L. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.10.1064 · Cited by 824
Haber, S. N., Kim, K.-S., Mailly, P., & Calzavara, R. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0271-06.2006 · Cited by 686
Prefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678 · cited 2×
“Comparison to Decision-Making Tasks In other work using stochastic decision-making tasks, neurons in dorsolateral prefrontal cortex and parietal cortex have been shown to carry signals reflecting the reward value expected in a trial as estimated from choices made and rewards received over some number of previous trial…”
Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey
Carmichael, S. T., & Price, J. L. (1994) · Journal of Comparative Neurology · doi:10.1002/cne.903460305 · Cited by 656 · cited 1×
“A recording chamber and head fixation post (Crist Instrument Co., Inc., Hagerstown, MD) were implanted using a sterile surgical procedure under general anesthesia in a veterinary operating facility.”
Izquierdo, A., Suda, R. K., & Murray, E. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-04.2004 · Cited by 588
Schultz, W. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.017 · Cited by 517
Orbitofrontal cortex neurons: role in olfactory and visual association learning
Rolls, E. T., Critchley, H. D., Mason, R., & Wakeman, E. A. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.5.1970 · Cited by 398 · cited 3×
“…different task time periods, and change with learning or changes in stimulusreinforcer contingencies (Rosenkilde et al. 1981; Thorpe et al. 1983; Rolls et al. 1996; Tremblay and Schultz 1999; Hikosaka and Watanabe 2000; Tremblay and Schultz 2000a, 2000b; Wallis and Miller 2003; Roesch and Olson…”
Projections from the amygdala to basoventral and mediodorsal prefrontal regions in the rhesus monkey
Barbas, H., & de Olmos, J. (1990) · Journal of Comparative Neurology · doi:10.1002/cne.903000409 · Cited by 324 · cited 2×
“Comparison to Other Areas OFC is strongly interconnected with the midbrain dopaminergic nuclei, ventral striatum, amygdala, and anterior cingulate cortex (Oades and Halliday 1987; Barbas and De Olmos 1990; Carmichael and Price 1995; Haber et al. 1995).”
O'Reilly, R. C. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.3.246 · Cited by 241 · cited 1×
“OFC has been seen as one component of the prefrontal cortical system underlying executive functions (Schoenbaum and Setlow 2001; O’Reilly et al. 2002).”
Single cell activity in ventral prefrontal cortex of behaving monkeys
Rosenkilde, C. E., Bauer, R. H., & Fuster, J. M. (1981) · Brain Research · doi:10.1016/0006-8993(81)90160-8 · Cited by 233 · cited 4×
“The 400-ms duration of the time windows was chosen because it was similar to that used in other studies of orbitofrontal neurons (Rosenkilde et al. 1981; Thorpe et al. 1983; Tremblay and Schultz 2000b) and because it was compatible with the times separating successive events in the reward schedule…”
InfluentialREMIJNSE, P., NIELEN, M., UYLINGS, H., & VELTMAN, D. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.009 · Cited by 163 · cited 2×
“…direct experience of scoring points or winning money (Rolls et al. 1990; Thut et al. 1997; O’Doherty, Kringelbach, et al. 2001; O’Doherty, Rolls, et al. 2001; O’Doherty et al. 2002; Elliott et al. 2003, 2004; Kringelbach et al. 2003; Rogers et al. 2004; Pritchard et al. 2005; Remijnse et al. 2005).”
Cited by
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Frontal cortex and reward-guided learning and decision-making
Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.014 · Cited by 1,111
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
“Simmons and Richmond (2008) also demonstrated that small changes in a task can cause significant changes to OFC representations .”
Walton, M. E., Behrens, T. E. J., Buckley, M. J., Rudebeck, P. H., & Rushworth, M. F. S. (2010) · Neuron · doi:10.1016/j.neuron.2010.02.027 · Cited by 397
Range-adapting representation of economic value in the orbitofrontal cortex
Padoa-Schioppa, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3751-09.2009 · Cited by 276
Metadata
- Authors
- Simmons, J. M., & Richmond, B. J.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-04-13
- Volume
- 18
- Issue
- 1
- Pages
- 93-103
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2146888468
- Cited by
- 70
- References
- 21
- FWCI
- 4.02
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.