The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Orbitofrontal Cortex
Abstract
This study investigated how neuronal activity in orbitofrontal cortex related to the expectation of reward changed while monkeys repeatedly learned to associate new instruction pictures with known behavioral reactions and reinforcers. In a delayed go-nogo task with several trial types, an initial picture instructed the animal to execute or withhold a reaching movement and to expect a liquid reward or a conditioned auditory reinforcer. When novel instruction pictures were presented, animals learned according to a trial-and-error strategy. After experience with a large number of novel pictures, learning occurred in a few trials, and correct performance usually exceeded 70% in the first 60–90 trials. About 150 task-related neurons in orbitofrontal cortex were studied in both familiar and learning conditions and showed two major forms of changes during learning. Quantitative changes of responses to the initial instruction were seen as appearance of new responses, increase of existing responses, or decrease or complete disappearance of responses. The changes usually outlasted initial learning trials and persisted during subsequent consolidation. They often modified the trial selectivities of activations. Increases might reflect the increased attention during learning and induce neuronal changes underlying the behavioral adaptations. Decreases might be related to the unreliable reward-predicting value of frequently changing learning instructions. The second form of changes reflected the adaptation of reward expectations during learning. In initial learning trials, animals reacted as if they expected liquid reward in every trial type, although only two of the three trial types were rewarded with liquid. In close correspondence, neuronal activations related to the expectation of reward occurred initially in every trial type. The behavioral indices for reward expectation and their neuronal correlates adapted in parallel during the course of learning and became restricted to rewarded trials. In conclusion, these data support the notion that neurons in orbitofrontal cortex code reward information in a flexible and adaptive manner during behavioral changes after novel stimuli.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Self-citationThe formation of learning sets.
Harlow, H. F. (1949) · Psychological Review · doi:10.1037/h0062474 · Cited by 1,959
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527
Attentional modulation of visual motion processing in cortical areas MT and MST
Treue, S., & Maunsell, J. H. R. (1996) · Nature · doi:10.1038/382539a0 · Cited by 1,025
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · cited 1×
“Rewards play a central role in mediating voluntary behavior (Dickinson and Balleine 1994).”
BackgroundThe Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836
Orbitofrontal cortex neurons: role in olfactory and visual association learning
Rolls, E. T., Critchley, H. D., Mason, R., & Wakeman, E. A. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.5.1970 · Cited by 398
Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380
Self-citationNeuronal activity in monkey striatum related to the expectation of predictable environmental events
Apicella, P., Scarnati, E., Ljungberg, T., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.945 · Cited by 305
Self-citation
Cited by
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Self-citationBehavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637
Self-citationMultiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415
Self-citationRidderinkhof, K. R., van den Wildenberg, W. P. M., Segalowitz, S. J., & Carter, C. S. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.09.016 · Cited by 1,407
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
Self-citationNeuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Self-citationBaxter, M. G., & Murray, E. A. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn875 · Cited by 1,200
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955
Reward processing in primate orbitofrontal cortex and basal ganglia
Schultz, W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.272 · Cited by 942
Self-citationLiu, X., Hairston, J., Schrier, M., & Fan, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.012 · Cited by 916
Dissociation of Neural Representation of Intensity and Affective Valuation in Human Gustation
Small, D. M., Gregory, M. D., Mak, Y. E., Gitelman, D., Mesulam, M. M., & Parrish, T. (2003) · Neuron · doi:10.1016/s0896-6273(03)00467-7 · Cited by 788
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Frank, M. J., & Claus, E. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.300 · Cited by 585
Kincade, J. M., Abrams, R. A., Astafiev, S. V., Shulman, G. L., & Corbetta, M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0236-05.2005 · Cited by 561
“…reflects an error of prediction in sensory stimulation or reward , which is known to drive dopa - minergic and neuroadrenergic neurons in the brainstem that project to frontal and temporoparietal areas similar to those ac - tive here ( Schultz and Dickinson , 2000 ; Tremblay and Schultz , 2000 ) .”
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536
Neural basis of deciding, choosing and acting
Schall, J. D. (2001) · Nature reviews. Neuroscience · doi:10.1038/35049054 · Cited by 528
Dopamine: generalization and bonuses
Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00048-5 · Cited by 480
Differential neural responses evoked by orthonasal versus retronasal odorant perception in humans
Small, D. M., Gerber, J. C., Mak, Y. E., & Hummel, T. (2005) · Neuron · doi:10.1016/j.neuron.2005.07.022 · Cited by 463
Walton, M. E., Behrens, T. E. J., Buckley, M. J., Rudebeck, P. H., & Rushworth, M. F. S. (2010) · Neuron · doi:10.1016/j.neuron.2010.02.027 · Cited by 397
Bouret, S., & Sara, S. J. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03526.x · Cited by 377
Finger, E. C., Marsh, A. A., Mitchell, D. G., Reid, M. E., Sims, C., Budhani, S., Kosson, D. S., Chen, G., Towbin, K. E., Leibenluft, E., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archpsyc.65.5.586 · Cited by 365
Pathophysiology of obsessive–compulsive disorder
Aouizerate, B., Guehl, D., Cuny, E., Rougier, A., Bioulac, B., Tignol, J., & Burbaud, P. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.02.004 · Cited by 341
Roesch, M. R., & Olson, C. R. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00019.2003 · Cited by 306
Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1864 · Cited by 285
Self-citationFunctional Heterogeneity within Rat Orbitofrontal Cortex in Reward Learning and Decision Making
Izquierdo, A. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1678-17.2017 · Cited by 258
Representation of Spatial Goals in Rat Orbitofrontal Cortex
Feierstein, C. E., Quirk, M. C., Uchida, N., Sosulski, D. L., & Mainen, Z. F. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.032 · Cited by 252
Monetary Incentives Enhance Processing in Brain Regions Mediating Top-down Control of Attention
Small, D. M., Gitelman, D., Simmons, K., Bloise, S. M., Parrish, T., & Mesulam, M.-M. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi063 · Cited by 242
Does the orbitofrontal cortex signal value?
Schoenbaum, G., Takahashi, Y., Liu, T., & McDannald, M. A. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06210.x · Cited by 232
Human neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209
Self-citationNeural Components Underlying Behavioral Flexibility in Human Reversal Learning
Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., & Poldrack, R. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp247 · Cited by 180
Izquierdo, A., Suda, R. K., & Murray, E. A. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1232-05.2005 · Cited by 186
Perry, J. L., Joseph, J. E., Jiang, Y., Zimmerman, R. S., Kelly, T. H., Darna, M., Huettl, P., Dwoskin, L. P., & Bardo, M. T. (2011) · Brain Research Reviews · doi:10.1016/j.brainresrev.2010.09.001 · Cited by 180
Face-selective and auditory neurons in the primate orbitofrontal cortex
Rolls, E. T., Critchley, H. D., Browning, A. S., & Inoue, K. (2006) · Experimental Brain Research · doi:10.1007/s00221-005-0191-y · Cited by 151
Machado, C. J., & Bachevalier, J. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05525.x · Cited by 120
Extended LATER model can account for trial-by-trial variability of both pre- and post-processes
Nakahara, H., Nakamura, K., & Hikosaka, O. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.07.001 · Cited by 45
Satiety-responsive neurons in the medial orbitofrontal cortex of the macaque.
Pritchard, T. C., Nedderman, E. N., Edwards, E. M., Petticoffer, A. C., Schwartz, G. J., & Scott, T. R. (2008) · Behavioral Neuroscience · doi:10.1037/0735-7044.122.1.174 · Cited by 40
Metadata
- Authors
- Tremblay, L., & Schultz, W.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2000-04-01
- Volume
- 83
- Issue
- 4
- Pages
- 1877-1885
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2394660237
- Cited by
- 168
- References
- 10
- FWCI
- 4.77
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.