The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Abstract
Tremblay, Léon, Jeffrey R. Hollerman, and Wolfram Schultz. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J. Neurophysiol. 80: 964–977, 1998. This study investigated neuronal activity in the anterior striatum while monkeys repeatedly learned to associate new instruction stimuli with known behavioral reactions and reinforcers. In a delayed go-nogo task with several trial types, an initial picture instructed the animal to execute or withhold a reaching movement and to expect a liquid reward or not. During learning, new instruction pictures were presented, and animals guessed and performed one of the trial types according to a trial-and-error strategy. Learning of a large number of pictures resulted in a learning set in which learning took place in a few trials and correct performance exceeded 80% in the first 60–90 trials. About 200 task-related striatal neurons studied in both familiar and learning conditions showed three forms of changes during learning. Activations related to the preparation and execution of behavioral reactions and the expectation of reward were maintained in many neurons but occurred in inappropriate trial types when behavioral errors were made. The activations became appropriate for individual trial types when the animals' behavior adapted to the new task contingencies. In particular, reward expectation-related activations occurred initially in both rewarded and unrewarded movement trials and became subsequently restricted to rewarded trials. These changes occurred in parallel with the visible adaptation of reward expectations by the animals. The second learning change consisted in decreases of task-related activations that were either restricted to the initial trials of new learning problems or persisted during the subsequent consolidation phase. They probably reflected reductions in the expectation and preparation of upcoming task events, including reward. The third learning change consisted in transient or sustained increases of activations. These might reflect the increased attention accompanying learning and serve to induce synaptic changes underlying the behavioral adaptations. Both decreases and increases often induced changes in the trial selective occurrence of activations. In conclusion, neurons in anterior striatum showed changes related to adaptations or reductions of expectations in new task situations and displayed activations that might serve to induce structural changes during learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Plum, F. (1960) · Archives of Neurology · doi:10.1001/archneur.1960.03840090124020 · Cited by 10,364
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,461
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationTaussig, M. (2012) · Routledge eBooks · doi:10.4324/9780203397244 · Cited by 2,532
The formation of learning sets.
Harlow, H. F. (1949) · Psychological Review · doi:10.1037/h0062474 · Cited by 1,959
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Self-citationNeuroleptics and operant behavior: The anhedonia hypothesis
Wise, R. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00010372 · Cited by 1,016
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Self-citationPackard, M., Hirsh, R., & White, N. (1989) · The Journal of Neuroscience · doi:10.1523/jneurosci.09-05-01465.1989 · Cited by 971
Contemporary Animal Learning Theory
LoLordo, V. M., & Dickinson, A. (1982) · The American Journal of Psychology · doi:10.2307/1422669 · Cited by 888
Cited by
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Self-citationA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637
Self-citationThe primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479
“Consistent with input from the OMPFC, physiological and imaging studies demonstrate the important role of the ventral striatum in the development of reward-based learning and in mental health diseases ( Apicella et al., 1991; Breier et al., 1992; Kalivas et al., 1993; Bowman et al., 1996; Tremblay et al., 1998; Wise,…”
BackgroundNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
Self-citationMultiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415
“…spontaneous movements (Romo & Schultz 1992, Schultz & Romo 1992), and the lack of its disappearance with reward omission may correspond with reward expectation activity in striatal and orbitofrontal neurons during initial unrewarded learning trials (Tremblay et al. 1998, Tremblay & Schultz 2000b).”
BackgroundSelf-citationThe Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
Self-citationGoal-directed and habitual control in the basal ganglia: implications for Parkinson's disease
Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M. C., Lehericy, S., Bergman, H., Agid, Y., DeLong, M. R., & Obeso, J. A. (2010) · Nature reviews. Neuroscience · doi:10.1038/nrn2915 · Cited by 1,134
“Functional divisions of the basal ganglia Micro-stimulation and micro-recording investigations in behaving monkey”
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Self-citationReward processing in primate orbitofrontal cortex and basal ganglia
Schultz, W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.272 · Cited by 942
Self-citationCellular and Synaptic Adaptations Mediating Opioid Dependence
Williams, J. T., Christie, M. J., & Manzoni, O. (2001) · Physiological Reviews · doi:10.1152/physrev.2001.81.1.299 · Cited by 848
Building neural representations of habits.
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501
It could be habit forming: drugs of abuse and striatal synaptic plasticity
Gerdeman, G. L., Partridge, J. G., Lupica, C. R., & Lovinger, D. M. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00065-1 · Cited by 480
Haruno, M., & Kawato, M. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00382.2005 · Cited by 433
Value Representations in the Primate Striatum during Matching Behavior
Lau, B., & Glimcher, P. W. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.021 · Cited by 409
The Roles of the Caudate Nucleus in Human Classification Learning
Seger, C. A., & Cincotta, C. M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3401-04.2005 · Cited by 407
Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus
Singer, A. C., & Frank, L. M. (2009) · Neuron · doi:10.1016/j.neuron.2009.11.016 · Cited by 385
Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380
Self-citationBasal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377
Reward Encoding in the Monkey Anterior Cingulate Cortex
Amiez, C., Joseph, J. P., & Procyk, E. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj046 · Cited by 351
Redish, A. D., Jensen, S., Johnson, A., & Kurth-Nelson, Z. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.784 · Cited by 346
Pathophysiology of obsessive–compulsive disorder
Aouizerate, B., Guehl, D., Cuny, E., Rougier, A., Bioulac, B., Tignol, J., & Burbaud, P. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.02.004 · Cited by 341
Frontal Cortex and the Discovery of Abstract Action Rules
Badre, D., Kayser, A. S., & D'Esposito, M. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.025 · Cited by 329
Carelli, R. M., Ijames, S. G., & Crumling, A. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04255.2000 · Cited by 310
Roesch, M. R., & Olson, C. R. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00019.2003 · Cited by 306
Neural computations underlying action-based decision making in the human brain
Wunderlich, K., Rangel, A., & O'Doherty, J. P. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0901077106 · Cited by 301
Neural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284
Arbitrary associations between antecedents and actions
Wise, S. P., & Murray, E. A. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01570-8 · Cited by 279
Specialisation within the prefrontal cortex: the ventral prefrontal cortex and associative learning
Passingham, R. E., Toni, I., & Rushworth, M. F. S. (2000) · Experimental Brain Research · doi:10.1007/s002210000405 · Cited by 268
Wen, C., Ogura, Y., & Matsushima, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00476 · Cited by 259
Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum
Hassani, O. K., Cromwell, H. C., & Schultz, W. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.6.2477 · Cited by 257
Self-citationLearning arbitrary visuomotor associations: temporal dynamic of brain activity
Toni, I., Ramnani, N., Josephs, O., Ashburner, J., & Passingham, R. E. (2001) · NeuroImage · doi:10.1006/nimg.2001.0894 · Cited by 210
Wörgötter, F., & Porr, B. (2005) · Neural Computation · doi:10.1162/0899766053011555 · Cited by 203
Preferential Reactivation of Motivationally Relevant Information in the Ventral Striatum
Lansink, C. S., Goltstein, P. M., Lankelma, J. V., Joosten, R. N. J. M. A., McNaughton, B. L., & Pennartz, C. M. A. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1054-08.2008 · Cited by 168
Changes of Cortico-striatal Effective Connectivity during Visuomotor Learning
Toni, I. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.10.1040 · Cited by 163
Krawczyk, D. C., Gazzaley, A., & D'Esposito, M. (2007) · Brain Research · doi:10.1016/j.brainres.2007.01.052 · Cited by 156
The plausibility of sugar addiction and its role in obesity and eating disorders
Benton, D. (2010) · Clinical Nutrition · doi:10.1016/j.clnu.2009.12.001 · Cited by 144
Han, S., Huettel, S. A., Raposo, A., Adcock, R. A., & Dobbins, I. G. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3077-09.2010 · Cited by 106
Asaad, W. F., & Eskandar, E. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3793-11.2011 · Cited by 105
Neural mechanisms of social influence
Mason, M. F., Dyer, R., & Norton, M. I. (2009) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2009.04.001 · Cited by 93
Stimulus-response and response-outcome learning mechanisms in the striatum
Horvitz, J. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.014 · Cited by 58
Perineuronal Nets Play a Role in Regulating Striatal Function in the Mouse
Lee, H., Leamey, C. A., & Sawatari, A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032747 · Cited by 47
“important in motor control and associative learning [1,2,3,4,5].”
BackgroundExtended LATER model can account for trial-by-trial variability of both pre- and post-processes
Nakahara, H., Nakamura, K., & Hikosaka, O. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.07.001 · Cited by 45
Cortico-spinal modularity in the parieto-frontal system: A new perspective on action control
Bufacchi, R. J., Battaglia-Mayer, A., Iannetti, G. D., & Caminiti, R. (2023) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2023.102537 · Cited by 22
Metadata
- Authors
- Tremblay, L., Hollerman, J. R., & Schultz, W.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 1998-08-01
- Volume
- 80
- Issue
- 2
- Pages
- 964-977
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2122942667
- Cited by
- 268
- References
- 61
- FWCI
- 6.32
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.