Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Abstract
Hollerman, Jeffrey R., Léon Tremblay, and Wolfram Schultz. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80: 947–963, 1998. Rewards constitute important goals for voluntary behavior. This study aimed to investigate how expected rewards influence behavior-related neuronal activity in the anterior striatum. In a delayed go-nogo task, monkeys executed or withheld a reaching movement and obtained liquid or sound as reinforcement. An initial instruction picture indicated the behavioral reaction to be performed and the reinforcer to be obtained after a subsequent trigger stimulus. Movements varied according to the reinforcers predicted by the instructions, suggesting that animals differentially expected the two outcomes. About 250 of nearly 1,500 neurons in anterior parts of caudate nucleus, putamen, and ventral striatum showed typical task-related activations that reflected the expectation of instructions and trigger, and the preparation, initiation, and execution of behavioral reactions. Strikingly, most task-related activations occurred only when liquid reward was delivered at trial end, rather than the reinforcing sound. Activations close to the time of reward showed similar preferences for liquid reward over the reinforcing sound, suggesting a relationship to the expectation or detection of the motivational outcome of the trial rather than to a “correct” or “end-of-trial” signal. By contrast, relatively few activations in the present task occurred irrespective of the type of reinforcement. In conclusion, many of the behavior-related neurons investigated in the anterior striatum were influenced by an upcoming primary liquid reward and did not appear to code behavioral acts in a motivationally neutral manner. Rather, these neurons incorporated information about the expected outcome into their behavior-related activity. The activations influenced by reward several seconds before its occurrence may constitute a neuronal basis for the retrograde effects of rewards on behavioral reactions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Dopamine neurons contrast strongly with non-dopamine neurons in the striatum and frontal cortex, which show wide varieties of activations and depressions at different time points before and after different stimuli and behavioural events.
“In this respect, dopamine neurons contrast strongly with non-dopamine neurons in the striatum and frontal cortex, which show wide varieties of activations and depressions at different time points before and after different stimuli and behavioural events114,147–149.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [149]
Cites
Plum, F. (1960) · Archives of Neurology · doi:10.1001/archneur.1960.03840090124020 · Cited by 10,388 · see citing works
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527 · see citing works
Taussig, M. (1991) · Routledge eBooks · doi:10.4324/9780203397244 · Cited by 2,403 · see citing works
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291 · see citing works
Self-citationLongitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey
Selemon, L. D., & Goldman-Rakic, P. S. (1985) · Journal of Neuroscience · doi:10.1523/jneurosci.05-03-00776.1985 · Cited by 1,074 · see citing works
Neuroleptics and operant behavior: The anhedonia hypothesis
Wise, R. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00010372 · Cited by 1,022 · see citing works
Fuster, J. M. (1973) · Journal of Neurophysiology · doi:10.1152/jn.1973.36.1.61 · Cited by 995 · see citing works
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · see citing works
Contemporary Animal Learning Theory
LoLordo, V. M., & Dickinson, A. (1982) · The American Journal of Psychology · doi:10.2307/1422669 · Cited by 891 · see citing works
The role of dopamine in locomotor activity and learning
Beninger, R. J. (1983) · Brain Research Reviews · doi:10.1016/0165-0173(83)90038-3 · Cited by 848 · see citing works
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836 · see citing works
Alexander, G. E., & Crutcher, M. D. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.64.1.133 · Cited by 750 · see citing works
Neuronal activity in monkey ventral striatum related to the expectation of reward
Schultz, W., Apicella, P., Scarnati, E., & Ljungberg, T. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04595.1992 · Cited by 744 · see citing works
Self-citationKünzle, H. (1975) · Brain Research · doi:10.1016/0006-8993(75)90384-4 · Cited by 714 · see citing works
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · cited 1× · see citing works
“Allrelated sustained activity in a spatial delayed response task (Watanabe 1996).”
BackgroundThe premotor cortex of the monkey
Weinrich, M., & Wise, S. P. (1982) · Journal of Neuroscience · doi:10.1523/jneurosci.02-09-01329.1982 · Cited by 618 · see citing works
The orbital and medial prefrontal circuit through the primate basal ganglia
Haber, S., Kunishio, K., Mizobuchi, M., & Lynd-Balta, E. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-07-04851.1995 · Cited by 605 · see citing works
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.814 · Cited by 579 · see citing works
Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.780 · Cited by 533 · see citing works
Prefrontal and cingulate unit activity during timing behavior in the monkey
Niki, H., & Watanabe, M. (1979) · Brain Research · doi:10.1016/0006-8993(79)90328-7 · Cited by 507 · see citing works
Visuospatial coding in primate prefrontal neurons revealed by oculomotor paradigms
Funahashi, S., Bruce, C. J., & Goldman‐Rakic, P. S. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.4.814 · Cited by 443 · see citing works
The amygdalostriatal projections in the monkey. An anterograde tracing study
Russchen, F. T., Bakst, I., Amaral, D. G., & Price, J. L. (1985) · Brain Research · doi:10.1016/0006-8993(85)90530-x · Cited by 395 · see citing works
Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey
Eblen, F., & Graybiel, A. M. (1995) · Journal of Neuroscience · doi:10.1523/jneurosci.15-09-05999.1995 · Cited by 391 · see citing works
Single cell studies of the primate putamen
Crutcher, M. D., & DeLong, M. R. (1984) · Experimental Brain Research · doi:10.1007/bf00238153 · Cited by 379 · see citing works
Responses to reward in monkey dorsal and ventral striatum
Apicella, P., Ljungberg, T., Scarnati, E., & Schultz, W. (1991) · Experimental Brain Research · doi:10.1007/bf00231732 · Cited by 369 · see citing works
Self-citationParthasarathy, H. B., Schall, J. D., & Graybiel, A. M. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-11-04468.1992 · Cited by 353 · see citing works
Prefrontostriatal connections in relation to cortical architectonic organization in rhesus monkeys
Yeterian, E. H., & Pandya, D. N. (1991) · Journal of Comparative Neurology · doi:10.1002/cne.903120105 · Cited by 351 · see citing works
Functions of dopamine in the dorsal and ventral striatum
Robbins, T. W., & Everitt, B. J. (1992) · Seminars in Neuroscience · doi:10.1016/1044-5765(92)90010-y · Cited by 348 · see citing works
Schultz, W., & Romo, R. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.607 · Cited by 334 · see citing works
Self-citationNishijo, H., Ono, T., & Nishino, H. (1988) · Journal of Neuroscience · doi:10.1523/jneurosci.08-10-03570.1988 · Cited by 333 · see citing works
Functional properties of monkey caudate neurons. II. Visual and auditory responses
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.799 · Cited by 319 · see citing works
Are expectancies based upon different positive reinforcing events discriminably different
Trapold, M. A. (1970) · Learning and Motivation · doi:10.1016/0023-9690(70)90079-2 · Cited by 314 · see citing works
Neuronal activity in monkey striatum related to the expectation of predictable environmental events
Apicella, P., Scarnati, E., Ljungberg, T., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.945 · Cited by 305 · see citing works
Self-citationSingle cell studies of the primate putamen
Crutcher, M. D., & DeLong, M. R. (1984) · Experimental Brain Research · doi:10.1007/bf00238154 · Cited by 283 · see citing works
Role of primate basal ganglia and frontal cortex in the internal generation of movements
Romo, R., & Schultz, W. (1992) · Experimental Brain Research · doi:10.1007/bf00227836 · Cited by 271 · see citing works
Self-citationModifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Tremblay, L., Hollerman, J. R., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.964 · Cited by 267 · see citing works
Self-citationRole of primate basal ganglia and frontal cortex in the internal generation of movements
Romo, R., Scarnati, E., & Schultz, W. (1992) · Experimental Brain Research · doi:10.1007/bf00227835 · Cited by 266 · see citing works
Self-citationResponses of striatal neurons in the behaving monkey. 1. Head of the caudate nucleus
Rolls, E. T., Thorpe, S. J., & Maddison, S. P. (1983) · Behavioural Brain Research · doi:10.1016/0166-4328(83)90191-2 · Cited by 256 · see citing works
Single cell activity in ventral prefrontal cortex of behaving monkeys
Rosenkilde, C. E., Bauer, R. H., & Fuster, J. M. (1981) · Brain Research · doi:10.1016/0006-8993(81)90160-8 · Cited by 233 · see citing works
Percheron, G., Yelnik, J., & François, C. (1984) · The Journal of Comparative Neurology · doi:10.1002/cne.902270207 · Cited by 226 · see citing works
Reward, Motivation, Cognition: Psychobiology of Mesotelencephalic Dopamine Systems
Fibiger, H. C., & Phillips, A. G. (1986) · Comprehensive physiology · doi:10.1002/cphy.cp010412 · Cited by 204 · see citing works
Role of primate basal ganglia and frontal cortex in the internal generation of movements
Schultz, W., & Romo, R. (1992) · Experimental Brain Research · doi:10.1007/bf00227834 · Cited by 179 · see citing works
Self-citationPetrides, M. (1986) · Journal of Neuroscience · doi:10.1523/jneurosci.06-07-02054.1986 · Cited by 172 · see citing works
Visuokinetic activities of primate prefrontal neurons during delayed-response performance.
Kubota, K., Iwamoto, T., & Suzuki, H. (1974) · Journal of Neurophysiology · doi:10.1152/jn.1974.37.6.1197 · Cited by 162 · see citing works
Watanabe, M. (1986) · Brain Research · doi:10.1016/0006-8993(86)90104-6 · Cited by 152 · see citing works
Sakagami, M., & Niki, H. (1994) · Experimental Brain Research · doi:10.1007/bf00241536 · Cited by 152 · see citing works
Prefrontal unit activity during associative learning in the monkey
Watanabe, M. (1990) · Experimental Brain Research · doi:10.1007/bf00228157 · Cited by 149 · see citing works
Activity of single neurons in the monkey amygdala during performance of a visual discrimination task
Nakamura, K., Mikami, A., & Kubota, K. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.6.1447 · Cited by 135 · see citing works
Watanabe, M. (1986) · Brain Research · doi:10.1016/0006-8993(86)90105-8 · Cited by 132 · see citing works
Output architecture of the primate putamen
Flaherty, A. W., & Graybiel, A. M. (1993) · Journal of Neuroscience · doi:10.1523/jneurosci.13-08-03222.1993 · Cited by 126 · see citing works
Frontal units of the monkey coding the associative significance of visual and auditory stimuli
Watanabe, M. (1992) · Experimental Brain Research · doi:10.1007/bf00228241 · Cited by 123 · see citing works
Intrinsic regulatory systems of the brain
Mountcastle, V. B., & Bloom, F. E. (1986) · American Physiological Society eBooks · Cited by 119 · see citing works
Arikuni, T., & Kubota, K. (1986) · The Journal of Comparative Neurology · doi:10.1002/cne.902440407 · Cited by 113 · see citing works
Hellweg, F.-C., Schultz, W., & Creutzfeldt, O. D. (1977) · Journal of Neurophysiology · doi:10.1152/jn.1977.40.3.463 · Cited by 112 · see citing works
Self-citationResponses of cells in the tail of the caudate nucleus during visual discrimination learning
Brown, V. J., Desimone, R., & Mishkin, M. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.74.3.1083 · Cited by 90 · see citing works
The role of the basal ganglia in controlling a movement initiated by a visually presented cue
Aldridge, J. W., Anderson, R. J., & Murphy, J. T. (1980) · Brain Research · doi:10.1016/0006-8993(80)91003-3 · Cited by 83 · see citing works
Kubota, K., & Komatsu, H. (1985) · Neuroscience Research · doi:10.1016/0168-0102(85)90025-2 · Cited by 63 · see citing works
Elements of the Intrinsic Organization and Information Processing in the Neostriatum
Groves, P. M., Garcia-Munoz, M., Linder, J. C., Manley, M. S., Martone, M. E., & Young, S. J. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0007 · Cited by 59 · see citing works
The striatum and motor cortex in motor initiation and execution
Montgomery, E. B., & Buchholz, S. R. (1991) · Brain Research · doi:10.1016/0006-8993(91)90461-4 · Cited by 58 · see citing works
Gardiner, T. W., & Nelson, R. J. (1992) · Experimental Brain Research · doi:10.1007/bf00230379 · Cited by 48 · see citing works
Johnstone, S., & Rolls, E. T. (1990) · Brain Research · doi:10.1016/0006-8993(90)91591-4 · Cited by 46 · see citing works
Komatsu, H. (1982) · Brain Research · doi:10.1016/0006-8993(82)90085-3 · Cited by 43 · see citing works
Functional involvement of catecholamines in reward-related neuronal activity of the monkey amygdala
Nakano, Y., Lénárd, L., Oomura, Y., Nishino, H., Aou, S., & Yamamoto, T. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.72 · Cited by 38 · see citing works
Reward related neurons in cat association cortex
Markowitsch, H. J., & Pritzel, M. (1976) · Brain Research · doi:10.1016/0006-8993(76)91061-1 · Cited by 17 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Bardo, M. T., & Hammer, R. P. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90226-e · Cited by 3,229 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
Self-citationThe Neural Basis of Altruistic Punishment
de Quervain, D. J.-F., Fischbacher, U., Treyer, V., Schellhammer, M., Schnyder, U., Buck, A., & Fehr, E. (2004) · Science · doi:10.1126/science.1100735 · Cited by 1,768 · see citing works
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · see citing works
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · see citing works
Self-citationFunctional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404 · see citing works
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Self-citationRole of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements
Hikosaka, O., Takikawa, Y., & Kawagoe, R. (2000) · Physiological Reviews · doi:10.1152/physrev.2000.80.3.953 · Cited by 1,287 · see citing works
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303 · see citing works
Self-citationApathy and the Functional Anatomy of the Prefrontal Cortex–Basal Ganglia Circuits
Levy, R., & Dubois, B. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj043 · Cited by 1,285 · see citing works
Putting a spin on the dorsal-ventral divide of the striatum
Voorn, P., Vanderschuren, L. J. M. J., Groenewegen, H. J., Robbins, T. W., & Pennartz, C. M. A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.06.006 · Cited by 1,188 · see citing works
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Self-citationDopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036 · see citing works
Self-citationReward processing in primate orbitofrontal cortex and basal ganglia
Schultz, W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.272 · Cited by 942 · see citing works
Self-citationCellular and Synaptic Adaptations Mediating Opioid Dependence
Williams, J. T., Christie, M. J., & Manzoni, O. J. (2001) · Physiological Reviews · doi:10.1152/physrev.2001.81.1.299 · Cited by 852 · see citing works
Autism as a disorder of prediction
Sinha, P., Kjelgaard, M. M., Gandhi, T. K., Tsourides, K., Cardinaux, A. L., Pantazis, D., Diamond, S. P., & Held, R. M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1416797111 · Cited by 563 · see citing works
Schultz, W. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.017 · Cited by 517 · see citing works
Self-citationAmbroggi, F., Ishikawa, A., Fields, H. L., & Nicola, S. M. (2008) · Neuron · doi:10.1016/j.neuron.2008.07.004 · Cited by 488 · see citing works
Neural Circuitry of Reward Prediction Error
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437 · see citing works
Leon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449 · see citing works
Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations
DELGADO, M. R., LOCKE, H. M., STENGER, V. A., & FIEZ, J. A. (2003) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.3.1.27 · Cited by 431 · see citing works
Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06422.x · Cited by 416 · see citing works
Neuronal representations of cognitive state: reward or attention?
Maunsell, J. H. R. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.04.003 · Cited by 404 · see citing works
Prefrontal Cortical Networks Related to Visceral Function and Mood
Price, J. L. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09278.x · Cited by 397 · see citing works
Computational perspectives on dopamine function in prefrontal cortex
Cohen, J. D., Braver, T. S., & Brown, J. W. (2002) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(02)00314-8 · Cited by 386 · see citing works
Basal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377 · see citing works
The nucleus accumbens as part of a basal ganglia action selection circuit
Nicola, S. M. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0510-4 · Cited by 360 · see citing works
Effects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum
Cromwell, H. C., & Schultz, W. (2003) · Journal of Neurophysiology · doi:10.1152/jn.01014.2002 · Cited by 357 · see citing works
Self-citationVoon, V., Fernagut, P., Wickens, J. R., Baunez, C., Rodríguez‐Oroz, M., Pavon, N., Juncos, J. L., Obeso, J. A., & Bézard, E. (2009) · The Lancet Neurology · doi:10.1016/s1474-4422(09)70287-x · Cited by 352 · see citing works
Interval timing and the encoding of signal duration by ensembles of cortical and striatal neurons.
Matell, M. S., Meck, W. H., & Nicolelis, M. A. L. (2003) · Behavioral Neuroscience · doi:10.1037/0735-7044.117.4.760 · Cited by 352 · see citing works
Book Review: Reward Signaling by Dopamine Neurons
Schultz, W. (2001) · The Neuroscientist · doi:10.1177/107385840100700406 · Cited by 343 · see citing works
Self-citationPathophysiology of obsessive–compulsive disorder
Aouizerate, B., Guehl, D., Cuny, E., Rougier, A., Bioulac, B., Tignol, J., & Burbaud, P. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.02.004 · Cited by 341 · see citing works
Reassessing Models of Basal Ganglia Function and Dysfunction
Nelson, A., & Kreitzer, A. C. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071013-013916 · Cited by 338 · see citing works
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · see citing works
The role of the striatum in social behavior
Báez-Mendoza, R., & Schultz, W. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00233 · Cited by 312 · see citing works
Self-citationCarelli, R. M., Ijames, S. G., & Crumling, A. J. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04255.2000 · Cited by 310 · see citing works
Roesch, M. R., & Olson, C. R. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00019.2003 · Cited by 309 · see citing works
The role of mesolimbic dopamine in the development and maintenance of ethanol reinforcement
Gonzales, R. A., Job, M. O., & Doyon, W. M. (2004) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2004.06.002 · Cited by 297 · see citing works
Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1864 · Cited by 287 · see citing works
Self-citationModifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Tremblay, L., Hollerman, J. R., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.964 · Cited by 267 · see citing works
Self-citationInfluence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum
Hassani, O. K., Cromwell, H. C., & Schultz, W. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.6.2477 · Cited by 257 · see citing works
Self-citationReward functions of the basal ganglia
Schultz, W. (2016) · Journal of Neural Transmission · doi:10.1007/s00702-016-1510-0 · Cited by 248 · see citing works
Self-citationMotor control in basal ganglia circuits using fMRI and brain atlas approaches
Lehéricy, S., Bardinet, É., Tremblay, L., de Moortele, P. V., Pochon, J.-B. F., Dormont, D., Kim, D., Yelnik, J., & Uǧurbil, K. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi089 · Cited by 251 · see citing works
Self-citationEmmert, K., Kopel, R., Sulzer, J., Brühl, A. B., Berman, B. D., Linden, D. E. J., Horovitz, S. G., Breimhorst, M., Caria, A., Frank, S., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.09.042 · Cited by 245 · see citing works
The dopamine imbalance hypothesis of fatigue in multiple sclerosis and other neurological disorders
Dobryakova, E., Genova, H. M., DeLuca, J., & Wylie, G. R. (2015) · Frontiers in Neurology · doi:10.3389/fneur.2015.00052 · Cited by 242 · see citing works
Yun, I. A., Wakabayashi, K. T., Fields, H. L., & Nicola, S. M. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.5282-03.2004 · Cited by 238 · see citing works
Selective enhancement of associative learning by microstimulation of the anterior caudate
Williams, Z. M., & Eskandar, E. N. (2006) · Nature Neuroscience · doi:10.1038/nn1662 · Cited by 235 · see citing works
From ventral-medial to dorsal-lateral striatum: neural correlates of reward-guided decision-making
Burton, A. C., Nakamura, K., & Roesch, M. R. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.05.003 · Cited by 238 · see citing works
From prediction error to psychosis: Ketamine as a pharmacological model of delusions
Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2007) · Journal of Psychopharmacology · doi:10.1177/0269881107077716 · Cited by 227 · see citing works
Changes in behavior-related neuronal activity in the striatum during learning
Schultz, W. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00122-x · Cited by 225 · see citing works
Self-citationStriatal mechanisms underlying movement, reinforcement, and punishment
Kravitz, A. V., & Kreitzer, A. C. (2012) · Physiology · doi:10.1152/physiol.00004.2012 · Cited by 224 · see citing works
Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making
Tobias Kalenscher, A., & Pennartz, C. M. A. (2007) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2007.11.004 · Cited by 222 · see citing works
The subthalamic nucleus exerts opposite control on cocaine and 'natural' rewards
Baunez, C., Dias, C., Cador, M., & Amalric, M. (2005) · Nature Neuroscience · doi:10.1038/nn1429 · Cited by 223 · see citing works
Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior
Hollerman, J. R., Tremblay, L., & Schultz, W. (2000) · Progress in brain research · doi:10.1016/s0079-6123(00)26015-9 · Cited by 219 · see citing works
Self-citationTaha, S. A., & Fields, H. L. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.3975-04.2005 · Cited by 217 · see citing works
Selective dysfunction of basal ganglia subterritories: From movement to behavioral disorders
Tremblay, L., Worbe, Y., Thobois, S., Sgambato, V., & Féger, J. (2015) · Movement Disorders · doi:10.1002/mds.26199 · Cited by 212 · see citing works
Self-citationWörgötter, F., & Porr, B. (2005) · Neural Computation · doi:10.1162/0899766053011555 · Cited by 203 · see citing works
Toni, I., & Passingham, R. E. (1999) · Experimental Brain Research · doi:10.1007/s002210050770 · Cited by 203 · see citing works
Frontal-striatal circuit functions: Context, sequence, and consequence
Saint‐Cyr, J. A. (2003) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617703910125 · Cited by 203 · see citing works
Horvitz, J. C. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00285-1 · Cited by 201 · see citing works
Ainslie, G. W. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000117 · Cited by 202 · see citing works
Biswas, D., & Szocs, C. (2019) · Journal of Marketing Research · doi:10.1177/0022243718820585 · Cited by 200 · see citing works
Nicola, S. M., Yun, I. A., Wakabayashi, K. T., & Fields, H. L. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00657.2003 · Cited by 196 · see citing works
Reappraising striatal D1- and D2-neurons in reward and aversion
Soares‐Cunha, C., Coimbra, B., Sousa, N., & Rodrigues, A. J. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.05.021 · Cited by 190 · see citing works
Computational Models of Performance Monitoring and Cognitive Control
Alexander, W. H., & Brown, J. W. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01085.x · Cited by 193 · see citing works
Appetitive conditioning: Neural bases and implications for psychopathology
Martin-Söelch, C., Linthicum, J., & Monique Ernst, D. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2006.11.002 · Cited by 185 · see citing works
Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. ‘natural’ reinforcement
Carelli, R. M. (2002) · Physiology & Behavior · doi:10.1016/s0031-9384(02)00760-6 · Cited by 183 · see citing works
Structural brain abnormalities in the frontostriatal system and cerebellum in pedophilia
Schiffer, B., Peschel, T., Paul, T., Gizewski, E. R., Forsting, M., Leygraf, N., Schedlowski, M., & Krueger, T. H. C. (2006) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2006.06.003 · Cited by 180 · see citing works
The significance of action potential bursting in the brain reward circuit
Cooper, D. (2002) · Neurochemistry International · doi:10.1016/s0197-0186(02)00068-2 · Cited by 178 · see citing works
Action and Outcome Encoding in the Primate Caudate Nucleus
Lau, B., & Glimcher, P. W. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.3060-07.2007 · Cited by 177 · see citing works
Neural Correlates of Cognitive Fatigue: Cortico-Striatal Circuitry and Effort–Reward Imbalance
Dobryakova, E., DeLuca, J., Genova, H. M., & Wylie, G. R. (2013) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617713000684 · Cited by 174 · see citing works
GABAergic output of the basal ganglia
Hikosaka, O. (2007) · Progress in brain research · doi:10.1016/s0079-6123(06)60012-5 · Cited by 171 · see citing works
Comparison of learning‐related neuronal activity in the dorsal premotor cortex and striatum
Brasted, P. J., & Wise, S. P. (2004) · European Journal of Neuroscience · doi:10.1111/j.0953-816x.2003.03181.x · Cited by 171 · see citing works
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1877 · Cited by 167 · see citing works
Self-citationTemporal Difference Model Reproduces Anticipatory Neural Activity
Suri, R. E., & Schultz, W. (2001) · Neural Computation · doi:10.1162/089976601300014376 · Cited by 166 · see citing works
Self-citationWICKENS, J. R., BUDD, C. S., HYLAND, B. I., & ARBUTHNOTT, G. W. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.016 · Cited by 165 · see citing works
Schultz, W., Stauffer, W. R., & Lak, A. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.03.013 · Cited by 164 · see citing works
Self-citationvan Eimeren, T., Ballanger, B., Pellecchia, G., Miyasaki, J. M., Lang, A. E., & Strafella, A. P. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2009.124 · Cited by 162 · see citing works
Action Selection and Action Value in Frontal-Striatal Circuits
Seo, M., Lee, E., & Averbeck, B. B. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.037 · Cited by 161 · see citing works
Efficient coding and the neural representation of value
Louie, K., & Glimcher, P. W. (2012) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2012.06496.x · Cited by 159 · see citing works
Basal Ganglia Mechanisms of Reward‐Oriented Eye Movement
Hikosaka, O. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.012 · Cited by 155 · see citing works
Krawczyk, D. C., Gazzaley, A., & D'Esposito, M. (2007) · Brain Research · doi:10.1016/j.brainres.2007.01.052 · Cited by 156 · see citing works
Martin-Soelch, C., Leenders, K., Chevalley, A., Missimer, J., Kunig, G., Magyar, S., Miño, A., & Schultz, W. W. (2001) · Brain research. Brain research reviews · doi:10.1016/s0165-0173(01)00089-3 · Cited by 162 · see citing works
Self-citationCortico–Basal Ganglia Circuit Function in Psychiatric Disease
Gunaydin, L. A., & Kreitzer, A. C. (2015) · Annual Review of Physiology · doi:10.1146/annurev-physiol-021115-105355 · Cited by 147 · see citing works
Dennison, M., Rosen, M. L., Sambrook, K., Jenness, J. L., Sheridan, M. A., & McLaughlin, K. A. (2017) · Child Development · doi:10.1111/cdev.13011 · Cited by 149 · see citing works
Shaping of Motor Responses by Incentive Values through the Basal Ganglia
Pasquereau, B., Nadjar, A., Arkadir, D., Bézard, E., Goillandeau, M., Bioulac, B. H., Gross, C. E., & Boraud, T. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.3745-06.2007 · Cited by 146 · see citing works
Nicola, S. M., Yun, I. A., Wakabayashi, K. T., & Fields, H. L. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00658.2003 · Cited by 131 · see citing works
Ito, M., & Doya, K. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.04.001 · Cited by 131 · see citing works
Relative reward processing in primate striatum
Cromwell, H. C., Hassani, O. K., & Schultz, W. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2223-z · Cited by 129 · see citing works
Self-citationPrediction error for free monetary reward in the human prefrontal cortex
Ramnani, N., Elliott, R., Athwal, B. S., & Passingham, R. E. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.028 · Cited by 130 · see citing works
Reward-Predicting and Reward-Detecting Neuronal Activity in the Primate Supplementary Eye Field
Amador, N., Schlag-Rey, M., & Schlag, J. D. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.4.2166 · Cited by 128 · see citing works
Lévy, R., & Czernecki, V. (2006) · Journal of Neurology · doi:10.1007/s00415-006-7012-5 · Cited by 128 · see citing works
Neuronal Correlates of Obsessions in the Caudate Nucleus
Guehl, D., Benazzouz, A., Aouizerate, B., Cuny, E., Rotgé, J., Rougier, A., Tignol, J., Bioulac, B. H., & Burbaud, P. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.06.023 · Cited by 124 · see citing works
Monitoring and switching of cortico-basal ganglia loop functions by the thalamo-striatal system
Kimura, M., Minamimoto, T., Matsumoto, N., & Hori, Y. (2004) · Neuroscience Research · doi:10.1016/j.neures.2003.12.002 · Cited by 124 · see citing works
Ravel, S., Legallet, E., & Apicella, P. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-24-08489.2003 · Cited by 116 · see citing works
Behavioral reactions reflecting differential reward expectations in monkeys
Watanabe, M., Cromwell, H. C., Tremblay, L., Hollerman, J. R., Hikosaka, K., & Schultz, W. (2001) · Experimental Brain Research · doi:10.1007/s002210100856 · Cited by 116 · see citing works
Self-citationLévy, R. (2012) · Revue Neurologique · doi:10.1016/j.neurol.2012.05.003 · Cited by 116 · see citing works
Synaptic plasticity in the basal ganglia
Wickens, J. R. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.030 · Cited by 113 · see citing works
A Network Representation of Response Probability in the Striatum
Blázquez, P. M., Fujii, N., Kojima, J., & Graybiel, A. M. (2002) · Neuron · doi:10.1016/s0896-6273(02)00627-x · Cited by 114 · see citing works
- Authors
- Hollerman, J. R., Tremblay, L., & Schultz, W.
- Affiliations
- University of Fribourg (CH)
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 1998-08-01
- Volume
- 80
- Issue
- 2
- Pages
- 947-963
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W1924016629
- Cited by
- 380
- References
- 64
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 8 · 2023: 5 · 2022: 7 · 2021: 7 · 2020: 7 · 2019: 7 · 2018: 14 · 2017: 9 · 2016: 23 · 2015: 24 · 2014: 17 · 2013: 9 · 2012: 18
- FWCI
- 7.30
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Neurophysiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1f32mh010282-01x1)
- National Institute of Mental Health (MH-10282)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Keywords
- reward anticipation, caudate nucleus, putamen, ventral striatum, single-unit activity, go/no-go task, reaching movements, motivation
- MeSH terms
- Animals, Behavior, Animal, Conditioning, Psychological, Corpus Striatum, Electrophysiology, Eye Movements, Macaca fascicularis, Male, Movement, Neurons, Photic Stimulation, Psychomotor Performance, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review