The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Orbitofrontal Cortex
Abstract
This study investigated how neuronal activity in orbitofrontal cortex related to the expectation of reward changed while monkeys repeatedly learned to associate new instruction pictures with known behavioral reactions and reinforcers. In a delayed go-nogo task with several trial types, an initial picture instructed the animal to execute or withhold a reaching movement and to expect a liquid reward or a conditioned auditory reinforcer. When novel instruction pictures were presented, animals learned according to a trial-and-error strategy. After experience with a large number of novel pictures, learning occurred in a few trials, and correct performance usually exceeded 70% in the first 60–90 trials. About 150 task-related neurons in orbitofrontal cortex were studied in both familiar and learning conditions and showed two major forms of changes during learning. Quantitative changes of responses to the initial instruction were seen as appearance of new responses, increase of existing responses, or decrease or complete disappearance of responses. The changes usually outlasted initial learning trials and persisted during subsequent consolidation. They often modified the trial selectivities of activations. Increases might reflect the increased attention during learning and induce neuronal changes underlying the behavioral adaptations. Decreases might be related to the unreliable reward-predicting value of frequently changing learning instructions. The second form of changes reflected the adaptation of reward expectations during learning. In initial learning trials, animals reacted as if they expected liquid reward in every trial type, although only two of the three trial types were rewarded with liquid. In close correspondence, neuronal activations related to the expectation of reward occurred initially in every trial type. The behavioral indices for reward expectation and their neuronal correlates adapted in parallel during the course of learning and became restricted to rewarded trials. In conclusion, these data support the notion that neurons in orbitofrontal cortex code reward information in a flexible and adaptive manner during behavioral changes after novel stimuli.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The formation of learning sets.
Harlow, H. F. (1949) · Psychological Review · doi:10.1037/h0062474 · Cited by 1,959
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527
Attentional modulation of visual motion processing in cortical areas MT and MST
Treue, S., & Maunsell, J. H. R. (1996) · Nature · doi:10.1038/382539a0 · Cited by 1,025
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995
The Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836
Orbitofrontal cortex neurons: role in olfactory and visual association learning
Rolls, E. T., Critchley, H. D., Mason, R., & Wakeman, E. A. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.5.1970 · Cited by 398
Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380
Self-citationNeuronal activity in monkey striatum related to the expectation of predictable environmental events
Apicella, P., Scarnati, E., Ljungberg, T., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.945 · Cited by 305
Self-citation
Cited by
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Self-citationBehavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637
Self-citationMultiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415
Self-citationRidderinkhof, K. R., van den Wildenberg, W. P. M., Segalowitz, S. J., & Carter, C. S. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.09.016 · Cited by 1,407
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
Self-citation
Metadata
- Authors
- Tremblay, L., & Schultz, W.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2000-04-01
- Volume
- 83
- Issue
- 4
- Pages
- 1877-1885
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2394660237
- Cited by
- 168
- References
- 9
- FWCI
- 4.77
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.