The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Abstract
Tremblay, Léon, Jeffrey R. Hollerman, and Wolfram Schultz. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J. Neurophysiol. 80: 964–977, 1998. This study investigated neuronal activity in the anterior striatum while monkeys repeatedly learned to associate new instruction stimuli with known behavioral reactions and reinforcers. In a delayed go-nogo task with several trial types, an initial picture instructed the animal to execute or withhold a reaching movement and to expect a liquid reward or not. During learning, new instruction pictures were presented, and animals guessed and performed one of the trial types according to a trial-and-error strategy. Learning of a large number of pictures resulted in a learning set in which learning took place in a few trials and correct performance exceeded 80% in the first 60–90 trials. About 200 task-related striatal neurons studied in both familiar and learning conditions showed three forms of changes during learning. Activations related to the preparation and execution of behavioral reactions and the expectation of reward were maintained in many neurons but occurred in inappropriate trial types when behavioral errors were made. The activations became appropriate for individual trial types when the animals' behavior adapted to the new task contingencies. In particular, reward expectation-related activations occurred initially in both rewarded and unrewarded movement trials and became subsequently restricted to rewarded trials. These changes occurred in parallel with the visible adaptation of reward expectations by the animals. The second learning change consisted in decreases of task-related activations that were either restricted to the initial trials of new learning problems or persisted during the subsequent consolidation phase. They probably reflected reductions in the expectation and preparation of upcoming task events, including reward. The third learning change consisted in transient or sustained increases of activations. These might reflect the increased attention accompanying learning and serve to induce synaptic changes underlying the behavioral adaptations. Both decreases and increases often induced changes in the trial selective occurrence of activations. In conclusion, neurons in anterior striatum showed changes related to adaptations or reductions of expectations in new task situations and displayed activations that might serve to induce structural changes during learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Plum, F. (1960) · Archives of Neurology · doi:10.1001/archneur.1960.03840090124020 · Cited by 10,364
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,462
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationTaussig, M. (2012) · Routledge eBooks · doi:10.4324/9780203397244 · Cited by 2,532
The formation of learning sets.
Harlow, H. F. (1949) · Psychological Review · doi:10.1037/h0062474 · Cited by 1,959
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Self-citationNeuroleptics and operant behavior: The anhedonia hypothesis
Wise, R. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00010372 · Cited by 1,016
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Self-citationPackard, M., Hirsh, R., & White, N. (1989) · The Journal of Neuroscience · doi:10.1523/jneurosci.09-05-01465.1989 · Cited by 971
Contemporary Animal Learning Theory
LoLordo, V. M., & Dickinson, A. (1982) · The American Journal of Psychology · doi:10.2307/1422669 · Cited by 888
The role of dopamine in locomotor activity and learning
Beninger, R. J. (1983) · Brain Research Reviews · doi:10.1016/0165-0173(83)90038-3 · Cited by 848
Diamond from the Dabie Shan Metamorphic Rocks and Its Implication for Tectonic Setting
Shutong, X., Wen, S., Yican, L., Laili, J., Shouyuan, J., Okay, A. I., & Sengör, A. M. C. (1992) · Science · doi:10.1126/science.256.5053.80 · Cited by 843
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836
Bushnell, M. C., Goldberg, M. E., & Robinson, D. L. (1981) · Journal of Neurophysiology · doi:10.1152/jn.1981.46.4.755 · Cited by 769
Neuronal activity in monkey ventral striatum related to the expectation of reward
Schultz, W., Apicella, P., Scarnati, E., & Ljungberg, T. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04595.1992 · Cited by 741
Self-citationAlexander, G. E., & Crutcher, M. D. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.64.1.133 · Cited by 698
Aosaki, T., Tsubokawa, H., Ishida, A., Watanabe, K., Graybiel, A., & Kimura, M. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-06-03969.1994 · Cited by 599
Mishkin, M., & Appenzeller, T. (1987) · Scientific American · doi:10.1038/scientificamerican0687-80 · Cited by 588
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.814 · Cited by 579
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 569
Self-citationBehavioral effects of selective ablation of the caudate nucleus.
Divac, I., Rosvold, H. E., & Szwarcbart, M. K. (1967) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0024348 · Cited by 562
Building action repertoires: memory and learning functions of the basal ganglia
Graybiel, A. M. (1995) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(95)80100-6 · Cited by 559
PROCEDURAL LEARNING AND NEOSTYRIAL DYSFUNCTION IN MAN
SAINT-CYR, J. A., TAYLOR, A. E., & LANG, A. E. (1988) · Brain · doi:10.1093/brain/111.4.941 · Cited by 526
Calabresi, P., Pisani, A., Mercuri, N. B., & Bernardi, G. (1992) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1992.tb00119.x · Cited by 419
Orbitofrontal cortex neurons: role in olfactory and visual association learning
Rolls, E. T., Critchley, H. D., Mason, R., & Wakeman, E. A. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.5.1970 · Cited by 398
Mitz, A., Godschalk, M., & Wise, S. (1991) · The Journal of Neuroscience · doi:10.1523/jneurosci.11-06-01855.1991 · Cited by 385
Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380
Self-citationProcedural learning is impaired in Huntington's disease: Evidence from the serial reaction time task
Knopman, D., & Nissen, M. J. (1991) · Neuropsychologia · doi:10.1016/0028-3932(91)90085-m · Cited by 377
Functions of dopamine in the dorsal and ventral striatum
Robbins, T. W., & Everitt, B. J. (1992) · Seminars in Neuroscience · doi:10.1016/1044-5765(92)90010-y · Cited by 348
Mountcastle, V., Andersen, R., & Motter, B. (1981) · The Journal of Neuroscience · doi:10.1523/jneurosci.01-11-01218.1981 · Cited by 343
Seitz, R. J., & Roland, P. E. (1992) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1992.tb00862.x · Cited by 321
Neuronal activity in monkey striatum related to the expectation of predictable environmental events
Apicella, P., Scarnati, E., Ljungberg, T., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.945 · Cited by 305
Self-citationWickens, J. R., Begg, A. J., & Arbuthnott, G. W. (1996) · Neuroscience · doi:10.1016/0306-4522(95)00436-m · Cited by 290
Butters, N., Wolfe, J., Martone, M., Granholm, E., & Cermak, L. S. (1985) · Neuropsychologia · doi:10.1016/0028-3932(85)90080-6 · Cited by 267
Whishaw, I. Q., Mittleman, G., Bunch, S. T., & Dunnett, S. B. (1987) · Behavioural Brain Research · doi:10.1016/0166-4328(87)90250-6 · Cited by 256
Chen, L. L., & Wise, S. P. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.3.1101 · Cited by 249
Battig, K., Rosvold, H. E., & Mishkin, M. (1960) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0047392 · Cited by 236
Hippocampal ensemble activity during spatial delayed-nonmatch-to-sample performance in rats
Deadwyler, S., Bunn, T., & Hampson, R. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-01-00354.1996 · Cited by 234
Procedural memory in Parkinson's disease: Impaired motor but not visuoperceptual learning
Harrington, D. L., Haaland, K. Y., Yeo, R. A., & Marder, E. (1990) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/01688639008400978 · Cited by 221
Sakata, H., Shibutani, H., & Kawano, K. (1983) · Journal of Neurophysiology · doi:10.1152/jn.1983.49.6.1364 · Cited by 214
Reward, Motivation, Cognition: Psychobiology of Mesotelencephalic Dopamine Systems
Fibiger, H. C., & Phillips, A. G. (1986) · Comprehensive Physiology · doi:10.1002/cphy.cp010412 · Cited by 203
Learning of sequential movements in the monkey: process of learning and retention of memory
Hikosaka, O., Rand, M. K., Miyachi, S., & Miyashita, K. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.74.4.1652 · Cited by 181
Synaptic Plasticity in an In Vitro Slice Preparation of the Rat Nucleus Accumbens
Pennartz, C. M. A., Ameerun, R. F., Groenewegen, H. J., & Lopes da Silva, F. H. (1993) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1993.tb00475.x · Cited by 178
Aizawa, H., Inase, M., Mushiake, H., Shima, K., & Tanji, J. (1991) · Experimental Brain Research · doi:10.1007/bf00230980 · Cited by 161
Chen, L. L., & Wise, S. P. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.3.1122 · Cited by 161
Prefrontal unit activity during associative learning in the monkey
Watanabe, M. (1990) · Experimental Brain Research · doi:10.1007/bf00228157 · Cited by 155
The performance on learning tasks of patients in the early stages of Parkinson's disease
Canavan, A. G. M., Passingham, R. E., Marsden, C. D., Quinn, N., Wyke, M., & Polkey, C. E. (1989) · Neuropsychologia · doi:10.1016/0028-3932(89)90167-x · Cited by 133 · cited 1×
“Neurons in premotor cortex et al. 1985; Canavan et al. 1989; Harrington et al. 1990; and supplementary and frontal eye fields showed decreased, Knopman and Nissen 1991; Saint-Cyr et al. 1988; Vriezen increased, or even new task-related activations, as well as and Moscovitch 1990).”
BackgroundResponses of striatal neurons in the behaving monkey. 2. Visual processing in the caudal neostriatum
Caan, W., Perrett, D. I., & Rolls, E. T. (1984) · Brain Research · doi:10.1016/0006-8993(84)90735-2 · Cited by 127
Memory for temporal order and conditional associative-learning in patients with Parkinson's disease
Vriezen, E. R., & Moscovitch, M. (1990) · Neuropsychologia · doi:10.1016/0028-3932(90)90044-o · Cited by 125
Intrinsic regulatory systems of the brain
Mountcastle, V. B., & Bloom, F. E. (1986) · American Physiological Society eBooks · Cited by 119
Cognition and the Basal Ganglia: A Possible Substrate for Procedural Knowledge
Phillips, A. G., & Carr, G. D. (1987) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/s031716710003777x · Cited by 116
Gaffan, E. A., Gaffan, D., & Harrison, S. (1988) · Journal of Neuroscience · doi:10.1523/jneurosci.08-09-03144.1988 · Cited by 114
Chen, L. L., & Wise, S. P. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-09-03067.1996 · Cited by 112
Cahusac, P., Rolls, E. T., Miyashita, Y., & Niki, H. (1993) · Hippocampus · doi:10.1002/hipo.450030104 · Cited by 109
Responses of cells in the tail of the caudate nucleus during visual discrimination learning
Brown, V. J., Desimone, R., & Mishkin, M. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.74.3.1083 · Cited by 90
Canavan, A. G. M., Passingham, R. E., MARSDEN, C. D., Quinn, N. P., Wyke, M., & Polkey, C. E. (1989) · Neuropsychologia · doi:10.1016/0028-3932(89)90003-1 · Cited by 82
Boeijinga, P. H., Mulder, A. B., Pennartz, C. M. A., Manshanden, I., & Lopes, F. H. D. S. (1993) · Neuroscience · doi:10.1016/0306-4522(93)90488-2 · Cited by 67
Kubota, K., & Komatsu, H. (1985) · Neuroscience Research · doi:10.1016/0168-0102(85)90025-2 · Cited by 63
The role of the basal ganglia in procedural memory
Wise, S. P. (1996) · Seminars in Neuroscience · doi:10.1006/smns.1996.0006 · Cited by 41
Germain, L., & Lamarre, Y. (1993) · Brain Research · doi:10.1016/0006-8993(93)91792-q · Cited by 40
Memory, action and the corpus striatum: current developments in the memory-habit distinction
Gaffan, D. (1996) · Seminars in Neuroscience · doi:10.1006/smns.1996.0005 · Cited by 36
Cited by
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Self-citationA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637
Self-citation
Metadata
- Authors
- Tremblay, L., Hollerman, J. R., & Schultz, W.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 1998-08-01
- Volume
- 80
- Issue
- 2
- Pages
- 964-977
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2122942667
- Cited by
- 268
- References
- 61
- FWCI
- 6.32
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.