Behavioral dopamine signals.

Schultz, Wolfram

doi:10.1016/j.tins.2007.03.007

Cited by 1,028Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesNeuroscience and Neuropharmacology Research

Behavioral dopamine signals.

Schultz, Wolfram·2007·Trends in Neurosciences

DOI 10.1016/j.tins.2007.03.007

Open this paper in CoChat — free account

Abstract

Lesioning and psychopharmacological studies suggest a wide range of behavioral functions for ascending midbrain dopaminergic systems. However, electrophysiological and neurochemical studies during specific behavioral tasks demonstrate a more restricted spectrum of dopamine-mediated changes. Substantial increases in dopamine-mediated activity, as measured by electrophysiology or voltammetry, are related to rewards and reward-predicting stimuli. A somewhat slower, distinct electrophysiological response encodes the uncertainty associated with rewards. Aversive events produce different, mostly slower, electrophysiological dopamine responses that consist predominantly of depressions. Additionally, more modest dopamine concentration fluctuations, related to punishment and movement, are seen at 200-18,000 times longer time courses using voltammetry and microdialysis in vivo. Using these responses, dopamine neurotransmission provides differential and heterogeneous information to subcortical and cortical brain structures about essential outcome components for approach behavior, learning and economic decision-making.

Integrity signals

Registry

Crossref · 10.1016/j.tins.2007.03.007

Cites

72 of 72 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

DA neurotransmission is essential for diverse behavioral outputs, including motivation, cognition, reward learning, decision making, salience attribution, and voluntary motor control.
“DA neurotransmission is essential for diverse behavioral outputs, including motivation, cognition, reward learning, decision making, salience attribution, and voluntary motor control [121–127].”
From Adolescent nicotine exposure and persistent neurocircuitry changes: unveiling lifelong psychiatric risks (2025) · cites this paper as [122]
Both associative and instrumental reward learning are dependent on the ventral striatum, which signals reward prediction errors via the dopamine system.
“Both associative and instrumental reward learning are dependent on the ventral striatum, which signals reward prediction errors via the dopamine system (Schultz et al., 1997; Schultz, 2007).”
From Top-Down Dysregulation—From ADHD to Emotional Instability (2016) · cites this paper as Schultz, 2007
Changes in DAergic activity can signal punishment, aversion, or lack of expected reward, not only hedonic effects.
“Although it was originally postulated that the DA released from the VTA only mediates the hedonic or pleasurable effects of natural reinforcers, it is now clear that changes in DAergic activity can also signal punishment, aversion, or lack of expected reward [53–58].”
From Mechanistic insights into nicotine withdrawal (2011) · cites this paper as [57]

Theory of games and economic behavior
Garcia, S. R., & Miller, S. J. (2019) · American Mathematical Society eBooks · doi:10.1090/mbk/121/32 · Cited by 16,799 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Self-citation
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Self-citation
Reinforcement learning
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
Self-citation
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia
Grace, A. A. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90196-u · Cited by 1,831 · see citing works
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777 · see citing works
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · see citing works
Self-citation
Subsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113 · see citing works
Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex
Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., & Zigmond, M. J. (1989) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1989.tb09224.x · Cited by 1,106 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
Self-citation
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Self-citation
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Self-citation
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967 · see citing works
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879 · see citing works
Foundations for Financial Economics.
Connor, G., Huang, C.-F., & Litzenberger, R. H. (1989) · The Journal of Finance · doi:10.2307/2328606 · Cited by 858 · see citing works
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works
Self-citation
Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782 · see citing works
Dopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718 · see citing works
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692 · see citing works
Food reward and cocaine increase extracellular dopamine in the nucleus accumbens as measured by microdialysis
Hernandez, L., & Hoebel, B. G. (1988) · Life Sciences · doi:10.1016/0024-3205(88)90036-7 · Cited by 627 · see citing works
The involvement of nucleus accumbens dopamine in appetitive and aversive motivation
Salamone, J. D. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90153-8 · Cited by 584 · see citing works
Presynaptic regulation of neurotransmitter release in the brain: Facts and hypothesis
Chesselet, M.-F. (1984) · Neuroscience · doi:10.1016/0306-4522(84)90058-7 · Cited by 577 · see citing works
Cortical remodelling induced by activity of ventral tegmental dopamine neurons
Bao, S., Chan, V. T., & Merzenich, M. M. (2001) · Nature · doi:10.1038/35083586 · Cited by 569 · see citing works
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · see citing works
D1Receptor Activation Enhances Evoked Discharge in Neostriatal Medium Spiny Neurons by Modulating an L-Type Ca2+Conductance
Hernández‐López, S., Bargas, J., Surmeier, D. J., Reyes, A., & Galarraga, E. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-09-03334.1997 · Cited by 495 · see citing works
Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems
Tobler, P. N., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00745.2006 · Cited by 472 · see citing works
Self-citation
Anatomical and affinity state comparisons between dopamine D1 and D2 receptors in the rat central nervous system
Richfield, E. K., Penney, J. B., & Young, A. B. (1989) · Neuroscience · doi:10.1016/0306-4522(89)90168-1 · Cited by 448 · see citing works
Differential responsiveness of dopamine transmission to food-stimuli in nucleus accumbens shell/core compartments.
Bassareo, V., & Chiara, G. D. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00583-1 · Cited by 433 · see citing works
Dissociation of hippocampus and caudate nucleus memory systems by posttraining intracerebral injection of dopamine agonists.
Packard, M. G., & White, N. M. (1991) · Behavioral Neuroscience · doi:10.1037//0735-7044.105.2.295 · Cited by 407 · see citing works
Selective activation of dopamine transmission in the shell of the nucleus accumbens by stress
Kalivas, P. W., & Duffy, P. (1995) · Brain Research · doi:10.1016/0006-8993(95)00013-g · Cited by 395 · see citing works
Dissociation of hippocampus and caudate nucleus memory systems by posttraining intracerebral injection of dopamine agonists.
Packard, M. G., & White, N. M. (1991) · Behavioral Neuroscience · doi:10.1037/0735-7044.105.2.295 · Cited by 334 · see citing works
Bee foraging in uncertain environments using predictive hebbian learning
Montague, P. R., Dayan, P., Person, C., & Sejnowski, T. J. (1995) · Nature · doi:10.1038/377725a0 · Cited by 311 · see citing works
Prolonged and Extrasynaptic Excitatory Action of Dopamine Mediated by D1 Receptors in the Rat StriatumIn Vivo
Gonon, F. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-15-05972.1997 · Cited by 301 · see citing works
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300 · see citing works
Self-citation
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294 · see citing works
Self-citation
Frequency of dopamine concentration transients increases in dorsal and ventral striatum of male rats during introduction of conspecifics
Robinson, D. L., Heien, M. L. A. V., & Wightman, R. M. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-23-10477.2002 · Cited by 290 · see citing works
Selective association and conditioning
Kamin, L. J. (1969) · Medical Entomology and Zoology · Cited by 285 · see citing works
Transient changes in mesolimbic dopamine and their association with ‘reward’
Wightman, R. M., & Robinson, D. L. (2002) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.2002.01005.x · Cited by 282 · see citing works
Dopamine Neurons Can Represent Context-Dependent Prediction Error
Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Neuron · doi:10.1016/s0896-6273(03)00869-9 · Cited by 276 · see citing works
Repeated stressful experiences differently affect limbic dopamine release during and following stress
Imperato, A., Angelucci, L., Casolini, P., Zocchi, A., & Puglisi-Allegra, S. (1992) · Brain Research · doi:10.1016/0006-8993(92)90274-d · Cited by 256 · see citing works
Relations between movement and single cell discharge in the substantia nigra of the behaving monkey
DeLong, M., Crutcher, M., & Georgopoulos, A. (1983) · The Journal of Neuroscience · doi:10.1523/jneurosci.03-08-01599.1983 · Cited by 247 · see citing works
Increase of Extracellular Dopamine in Primate Prefrontal Cortex During a Working Memory Task
Watanabe, M., Kodama, T., & Hikosaka, K. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.5.2795 · Cited by 236 · see citing works
Genetic evidence for the bidirectional modulation of synaptic plasticity in the prefrontal cortex by D1 receptors
Huang, Y.-Y., Simpson, E., Kellendonk, C., & Kandel, E. R. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0308280101 · Cited by 231 · see citing works
An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit
Guarraci, F. A., & Kapp, B. S. (1999) · Behavioural Brain Research · doi:10.1016/s0166-4328(98)00102-8 · Cited by 201 · see citing works
Transient increases in catecholaminergic activity in medial prefrontal cortex and nucleus accumbens shell during novelty
Rebec, G. V., Grabner, C. P., Johnson, M., Pierce, R. C., & Bardo, M. T. (1996) · Neuroscience · doi:10.1016/s0306-4522(96)00382-x · Cited by 184 · see citing works
Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey
Schultz, W., & Romo, R. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.201 · Cited by 184 · see citing works
Self-citation
Differential reactivity of dopaminergic neurons in the nucleus accumbens in response to different behavioral situations. An in vivo voltammetric study in free moving rats
Louilot, A., Moal, M. L., & Simon, H. (1986) · Brain Research · doi:10.1016/0006-8993(86)90646-3 · Cited by 168 · see citing works
Extinction of Cocaine Self-Administration Reveals Functionally and Temporally Distinct Dopaminergic Signals in the Nucleus Accumbens
Stuber, G. D., Wightman, R. M., & Carelli, R. M. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.036 · Cited by 168 · see citing works
Behavior-Relevant Changes in Nucleus Accumbens Dopamine Transmission Elicited by Food Reinforcement: An Electrochemical Study in Rat
Richardson, N. R., & Gratton, A. P. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-24-08160.1996 · Cited by 160 · see citing works
Electrochemical monitoring of extracellular dopamine in nucleus accumbens of rats lever-pressing for food
Kiyatkin, E. A., & Gratton, A. P. (1994) · Brain Research · doi:10.1016/0006-8993(94)90231-3 · Cited by 143 · see citing works
Dopamine and noradrenaline efflux in the prefrontal cortex in the light and dark period: effects of novelty and handling and comparison to the nucleus accumbens
Feenstra, M. G. P., Botterblom, M. H. A., & Mastenbroek, S. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00319-5 · Cited by 138 · see citing works
The activity of pars compacta neurons of the monkey substantia nigra in relation to motor activation
Schultz, W., Ruffieux, A., & Aebischer, P. (1983) · Experimental Brain Research · doi:10.1007/bf00237874 · Cited by 136 · see citing works
Self-citation
The performance on learning tasks of patients in the early stages of Parkinson's disease
Canavan, A. G. M., Passingham, R. E., Marsden, C. D., Quinn, N., Wyke, M., & Polkey, C. E. (1989) · Neuropsychologia · doi:10.1016/0028-3932(89)90167-x · Cited by 133 · see citing works
Dissociations in dopamine release in medial prefrontal cortex and ventral striatum during the acquisition and extinction of classical aversive conditioning in the rat
Wilkinson, L. S., Humby, T., Killcross, S., Torres, E. M., Everitt, B. J., & Robbins, T. W. (1998) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.1998.00119.x · Cited by 132 · see citing works
Memory for temporal order and conditional associative-learning in patients with Parkinson's disease
Vriezen, E. R., & Moscovitch, M. (1990) · Neuropsychologia · doi:10.1016/0028-3932(90)90044-o · Cited by 124 · see citing works
Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: studies using 1 min microdialysis in rats
Young, A. M. J. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2004.03.003 · Cited by 123 · see citing works
The interpretation of the measurement of nucleus accumbens dopamine by in vivo dialysis: the kick, the craving or the cognition?
Joseph, M. H., Datla, K. P., & Young, A. M. J. (2003) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2003.09.001 · Cited by 118 · see citing works
High-speed chronoamperometric measurements of mesolimbic and nigrostriatal dopamine release associated with repeated daily stress
Doherty, M. D., & Gratton, A. P. (1992) · Brain Research · doi:10.1016/0006-8993(92)91639-v · Cited by 108 · see citing works
Environmental stimuli but not homeostatic challenges produce apparent increases in dopaminergic activity in the striatum: An analysis by in vivo voltammetry
Keller, R. W., Stricker, E. M., & Zigmond, M. J. (1983) · Brain Research · doi:10.1016/0006-8993(83)90174-9 · Cited by 95 · see citing works
Conditioned dopamine release: Dependence uponN-methyl-d-aspartate receptors
Saulskaya, N. B., & Marsden, C. A. (1995) · Neuroscience · doi:10.1016/0306-4522(95)00007-6 · Cited by 87 · see citing works
The role of dopamine in conditioning and latent inhibition: What, when, where and how?
Young, A. M. J., Moran, P. M., & Joseph, M. H. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.02.004 · Cited by 79 · see citing works
In vivo regulation of extracellular dopamine in the neostriatum: influence of impulse activity and local excitatory amino acids
Keefe, K. A., Zigmond, M. J., & Abercrombie, E. D. (1993) · Journal of Neural Transmission · doi:10.1007/bf01245233 · Cited by 78 · see citing works
Associative learning in degenerative neostriatal disorders: Contrasts in explicit and implicit remembering between Parkinson's and huntington's diseases
Sprengelmeyer, R., Canavan, A. G. M., Lange, H. W., & Hömberg, V. (1995) · Movement Disorders · doi:10.1002/mds.870100110 · Cited by 72 · see citing works
Reciprocal influences of activating and immobilizing stimuli on the activity of nigrostriatal dopamine neurons
Chiodo, L. A., Caggiula, A. R., Antelman, S. M., et al. (1979) · Brain Research · doi:10.1016/0006-8993(79)90994-6 · Cited by 71 · see citing works
Dopamine efflux in nucleus accumbens shell and core in response to appetitive classical conditioning
Cheng, J., de Bruin, J. P. C., & Feenstra, M. G. P. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02849.x · Cited by 62 · see citing works
Effect of sensory stimuli on the activity of dopaminergic neurons: Involvement of non-dopaminergic nigral neurons and striato-nigral pathways
Hommer, D. W., & Bunney, B. S. (1980) · Life Sciences · doi:10.1016/0024-3205(80)90185-x · Cited by 59 · see citing works
Frontal and parietal premovement slow brain potentials in Parkinson's disease and aging
Bötzel, K., Mayer, M., Oertel, W. H., & Paulus, W. (1995) · Movement Disorders · doi:10.1002/mds.870100114 · Cited by 22 · see citing works
Effects of low and high doses of l-Dopa on the tetrabenazine or ?-methyltyrosine-induced suppression of behaviour in a successive discrimination task
Ahlénius, S. (1974) · Psychopharmacology · doi:10.1007/bf00421027 · Cited by 19 · see citing works

Flagged first, then by citations

Sorted by citations

Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378 · see citing works
Reward Processing by the Opioid System in the Brain
Le Merrer, J., Becker, J. A. J., Befort, K., & Kieffer, B. L. (2009) · Physiological Reviews · doi:10.1152/physrev.00005.2009 · Cited by 1,013 · see citing works
Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system
Lammel, S., Hetzel, A., Häckel, O., Jones, I., Liss, B., & Roeper, J. (2008) · Neuron · doi:10.1016/j.neuron.2008.01.022 · Cited by 976 · see citing works
Cortico-Basal Ganglia Reward Network: Microcircuitry
Sesack, S. R., & Grace, A. A. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.93 · Cited by 985 · see citing works
Major depressive disorder: new clinical, neurobiological, and treatment perspectives
Kupfer, D. J., Frank, E., & Phillips, M. L. (2012) · The Lancet · doi:10.1016/s0140-6736(11)60602-8 · Cited by 894 · see citing works
Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task
Pizzagalli, D. A., Iosifescu, D., Hallett, L. A., Ratner, K. G., & Fava, M. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2008.03.001 · Cited by 780 · see citing works
Worth the ‘EEfRT’? The Effort Expenditure for Rewards Task as an Objective Measure of Motivation and Anhedonia
Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006598 · Cited by 769 · see citing works
Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli
Lammel, S., Ion, D. I., Roeper, J., & Malenka, R. C. (2011) · Neuron · doi:10.1016/j.neuron.2011.03.025 · Cited by 766 · see citing works
Distinct Roles of Synaptic Transmission in Direct and Indirect Striatal Pathways to Reward and Aversive Behavior
Hikida, T., Kimura, K., Wada, N., Funabiki, K., & Nakanishi, S. (2010) · Neuron · doi:10.1016/j.neuron.2010.05.011 · Cited by 592 · see citing works
<scp>N</scp> icotine and the adolescent brain
Yuan, M., Cross, S. J., Loughlin, S. E., & Leslie, F. M. (2015) · The Journal of Physiology · doi:10.1113/jp270492 · Cited by 582 · see citing works
The Emerging Neuroscience of Intrinsic Motivation: A New Frontier in Self-Determination Research
Di Domenico, S. I., & Ryan, R. M. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00145 · Cited by 542 · see citing works
Physiology and pharmacology of striatal neurons
Kreitzer, A. C. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135422 · Cited by 530 · see citing works
Factors modulating neural reactivity to drug cues in addiction: a survey of human neuroimaging studies
Jasinska, A. J., Stein, E. A., Kaiser, J., Naumer, M. J., & Yalachkov, Y. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.10.013 · Cited by 513 · see citing works
Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction
Belin, D., Jonkman, S., Dickinson, A., Robbins, T. W., & Everitt, B. J. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.027 · Cited by 520 · see citing works
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456 · see citing works
Dopaminergic mechanisms of individual differences in human effort-based decision-making
Treadway, M. T., Buckholtz, J. W., Cowan, R. L., Woodward, N. D., Li, R., Ansari, M. S., Baldwin, R. M., Schwartzman, A. N., Kessler, R. M., & Zald, D. H. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6459-11.2012 · Cited by 385 · see citing works
Dopaminergic Projections from Midbrain to Primary Motor Cortex Mediate Motor Skill Learning
Hosp, J. A., Pekanovic, A., Rioult-Pedotti, M. S., & Luft, A. R. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5411-10.2011 · Cited by 354 · see citing works
Reward, addiction, withdrawal to nicotine
De Biasi, M., & Dani, J. A. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113734 · Cited by 366 · see citing works
“For example, phasic burst firing is induced by unpredicted reward or unanticipated cues that have been conditioned to a known reward (Schultz 2007b, Schultz et al. 1997).”
Background
Rewards teach visual selective attention
Chelazzi, L., Perlato, A., Santandrea, E., & Della Libera, C. (2013) · Vision Research · doi:10.1016/j.visres.2012.12.005 · Cited by 354 · see citing works
The mesoaccumbens dopamine in coping with stress
Cabib, S., & Puglisi-Allegra, S. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.04.012 · Cited by 329 · see citing works
Dysfunctions of decision‐making and cognitive control as transdiagnostic mechanisms of mental disorders: advances, gaps, and needs in current research
Goschke, T. (2014) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1410 · Cited by 293 · see citing works
Biased Oxytocinergic Modulation of Midbrain Dopamine Systems
Xiao, L., Priest, M. F., Nasenbeny, J., Lu, T., & Kozorovitskiy, Y. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.003 · Cited by 292 · see citing works
Dopamine, behavioral economics, and effort
Salamone, J. D. (2009) · Frontiers in Behavioral Neuroscience · doi:10.3389/neuro.08.013.2009 · Cited by 277 · see citing works
Dopamine and Memory: Modulation of the Persistence of Memory for Novel Hippocampal NMDA Receptor-Dependent Paired Associates
Bethus, I., Tse, D., & Morris, R. G. M. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2721-09.2010 · Cited by 270 · see citing works
Striatal dysfunction during reversal learning in unmedicated schizophrenia patients
Schlagenhauf, F., Huys, Q. J. M., Deserno, L., Rapp, M. A., Beck, A., Heinze, H.-J., Dolan, R., & Heinz, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.034 · Cited by 253 · see citing works
Adolescents, adults and rewards: Comparing motivational neurocircuitry recruitment using fMRI
Bjork, J. M., Smith, A. R., Chen, G., & Hommer, D. W. (2010) · PLoS ONE · doi:10.1371/journal.pone.0011440 · Cited by 271 · see citing works
Reward and aversion
Hu, H. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-014106 · Cited by 253 · see citing works
NOW vs LATER brain circuits: implications for obesity and addiction
Volkow, N. D., & Baler, R. D. (2015) · Trends in Neurosciences · doi:10.1016/j.tins.2015.04.002 · Cited by 237 · see citing works
Single dose of a dopamine agonist impairs reinforcement learning in humans: Behavioral evidence from a laboratory-based measure of reward responsiveness
Pizzagalli, D. A., Evins, A. E., Schetter, E. C., Frank, M. J., Pajtas, P. E., Santesso, D. L., & Culhane, M. (2008) · Psychopharmacology · doi:10.1007/s00213-007-0957-y · Cited by 219 · see citing works
Multiple roles for orexin/hypocretin in addiction
Mahler, S. V., Smith, R. J., Moorman, D. E., Sartor, G. C., & Aston-Jones, G. (2012) · Progress in Brain Research · doi:10.1016/b978-0-444-59489-1.00007-0 · Cited by 215 · see citing works
Relief as a reward: hedonic and neural responses to safety from pain
Leknes, S., Lee, M., Berna, C., Andersson, J., & Tracey, I. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017870 · Cited by 207 · see citing works
Reward feedback alterations in unmedicated schizophrenia patients: Relevance for delusions
Schlagenhauf, F., Sterzer, P., Schmack, K., Ballmaier, M., Rapp, M., Wrase, J., Juckel, G., Gallinat, J., & Heinz, A. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.12.016 · Cited by 195 · see citing works
Mesolimbic dopamine in desire and dread: enabling motivation to be generated by localized glutamate disruptions in nucleus accumbens
Faure, A., Reynolds, S. M., Richard, J. M., & Berridge, K. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4961-07.2008 · Cited by 193 · see citing works
Memory trace replay: The shaping of memory consolidation by neuromodulation
Atherton, L. A., Dupret, D., & Mellor, J. R. (2015) · Trends in Neurosciences · doi:10.1016/j.tins.2015.07.004 · Cited by 180 · see citing works
Social and monetary reward processing in autism spectrum disorders
Delmonte, S., Balsters, J. H., McGrath, J., Fitzgerald, J., Brennan, S., Fagan, A. J., & Gallagher, L. (2012) · Molecular Autism · doi:10.1186/2040-2392-3-7 · Cited by 180 · see citing works
Regulation of synaptic transmission and plasticity by neuronal nicotinic acetylcholine receptors
McKay, B. E., Placzek, A. N., & Dani, J. A. (2007) · Biochemical Pharmacology · doi:10.1016/j.bcp.2007.07.001 · Cited by 181 · see citing works
Top-Down Dysregulation—From ADHD to Emotional Instability
Petrovic, P., & Castellanos, F. X. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00070 · Cited by 179 · see citing works
“Both associative and instrumental reward learning are dependent on the ventral striatum, which signals reward prediction errors via the dopamine system (Schultz et al., 1997; Schultz, 2007).”
Background
Distorted expectancy coding in problem gambling: is the addictive in the anticipation?
van Holst, R. J., Veltman, D. J., Büchel, C., van den Brink, W., & Goudriaan, A. E. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.12.030 · Cited by 155 · see citing works
Striatal sensitivity to reward deliveries and omissions in substance dependent patients
Bjork, J. M., Smith, A. R., & Hommer, D. W. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.06.035 · Cited by 154 · see citing works
Functional connectivity of reward processing in the brain
Camara, E. (2008) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.019.2008 · Cited by 141 · see citing works
Structural correlates of heterogeneous in vivo activity of midbrain dopaminergic neurons
Henny, P., Brown, M. T. C., Northrop, A., Faunes, M., Ungless, M. A., Magill, P. J., & Bolam, J. P. (2012) · Nature Neuroscience · doi:10.1038/nn.3048 · Cited by 139 · see citing works
Neural Mechanisms of Reward in Insects
Perry, C. J., & Barron, A. B. (2013) · Annual Review of Entomology · doi:10.1146/annurev-ento-120811-153631 · Cited by 135 · see citing works
Mesocorticolimbic Dopamine Pathways Across Adolescence: Diversity in Development
Reynolds, L. M., & Flores, C. (2021) · Frontiers in Neural Circuits · doi:10.3389/fncir.2021.735625 · Cited by 137 · see citing works
Dopamine-modulated dynamic cell assemblies generated by the GABAergic striatal microcircuit
Humphries, M. D., Wood, R., & Gurney, K. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.07.018 · Cited by 129 · see citing works
Restoration of dopamine release deficits during object recognition memory acquisition attenuates cognitive impairment in a triple transgenic mice model of Alzheimer’s disease
Guzmán-Ramos, K., Moreno-Castilla, P., Castro-Cruz, M., McGaugh, J. L., Martínez-Coria, H., LaFerla, F. M., & Bermúdez-Rattoni, F. (2012) · Learning & Memory · doi:10.1101/lm.026070.112 · Cited by 127 · see citing works
Molecular mechanisms of stress-induced prefrontal cortical impairment: Implications for mental illness
Hains, A. B., & Arnsten, A. F. T. (2008) · Learning & Memory · doi:10.1101/lm.921708 · Cited by 127 · see citing works
Modelling ADHD: A review of ADHD theories through their predictions for computational models of decision-making and reinforcement learning
Ziegler, S., Pedersen, M. L., Mowinckel, A. M., & Biele, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.002 · Cited by 110 · see citing works
Dorsal tegmental dopamine neurons gate associative learning of fear
Groessl, F., Munsch, T., Meis, S., Griessner, J., Kaczanowska, J., Pliota, P., Kargl, D., Badurek, S., Kraitsy, K., Rassoulpour, A., et al. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0174-5 · Cited by 118 · see citing works
Origins of altered reinforcement effects in ADHD
Johansen, E., Killeen, P. R., Russell, V. A., Tripp, G., Wickens, J. R., Tannock, R., Williams, J., & Sagvolden, T. (2009) · Behavioral and Brain Functions · doi:10.1186/1744-9081-5-7 · Cited by 108 · see citing works
Sources of input to the rostromedial tegmental nucleus, ventral tegmental area, and lateral habenula compared: A study in rat
Yetnikoff, L., Cheng, A. Y., Lavezzi, H. N., Parsley, K. P., & Zahm, D. S. (2015) · Journal of Comparative Neurology · doi:10.1002/cne.23797 · Cited by 101 · see citing works
Choking on the money: reward-based performance decrements are associated with midbrain activity
Mobbs, D., Hassabis, D., Seymour, B., Marchant, J. L., Weiskopf, N., Dolan, R. J., & Frith, C. D. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02399.x · Cited by 103 · see citing works
Locus Coeruleus and Dopamine-Dependent Memory Consolidation
Yamasaki, M., & Takeuchi, T. (2017) · Neural Plasticity · doi:10.1155/2017/8602690 · Cited by 91 · see citing works
Progress in understanding mood disorders: optogenetic dissection of neural circuits
Lammel, S., Tye, K. M., & Warden, M. R. (2014) · Genes, Brain and Behavior · doi:10.1111/gbb.12049 · Cited by 98 · see citing works
Disrupted prediction errors index social deficits in autism spectrum disorder
Balsters, J. H., Apps, M. A. J., Bolis, D., Lehner, R., Gallagher, L., & Wenderoth, N. (2017) · Brain · doi:10.1093/brain/aww287 · Cited by 85 · see citing works
Chronic cocaine self-administration in rhesus monkeys: impact on associative learning, cognitive control, and working memory
Porter, J. N., Olsen, A. S., Gurnsey, K., Dugan, B. P., Jedema, H. P., & Bradberry, C. W. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5426-10.2011 · Cited by 97 · see citing works
Peroxisome Proliferator-Activated Receptors-Alpha Modulate Dopamine Cell Activity Through Nicotinic Receptors
Melis, M., Carta, S., Fattore, L., Tolu, S., Yasar, S., Goldberg, S. R., Fratta, W., Maskos, U., & Pistis, M. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.04.016 · Cited by 89 · see citing works
Better than expected or as bad as you thought? The neurocognitive development of probabilistic feedback processing
van den Bos, W. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.052.2009 · Cited by 89 · see citing works
Impulsive action: emotional impulses and their control
Frijda, N. H., Ridderinkhof, K. R., & Rietveld, E. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00518 · Cited by 79 · see citing works
“…as the capacity to energize motive states and subsequent action (Robbins and Everitt, 2007), and to invest perceived objects or events with incentive value, the power to want them (Berridge, 2007), or to learn that given stimuli predict that rewards or punishments will follow (Schultz, 2007).”
Background
Adult-born neurons boost odor-reward association
Grelat, A., Benoit, L., Wagner, S., Moigneu, C., Lledo, P.-M., & Alonso, M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1716400115 · Cited by 72 · see citing works
Hippocampal release of dopamine and norepinephrine encodes novel contextual information
Moreno‐Castilla, P., Pérez‐Ortega, R., Violante‐Soria, V., Balderas, I., & Bermúdez‐Rattoni, F. (2017) · Hippocampus · doi:10.1002/hipo.22711 · Cited by 67 · see citing works
Mechanistic insights into nicotine withdrawal
Paolini, M., & De Biasi, M. (2011) · Biochemical Pharmacology · doi:10.1016/j.bcp.2011.07.075 · Cited by 66 · see citing works
“Reward omission induces phasic inhibition of VTA neurons [56,57]”
Neural systems that facilitate the representation of social rank
Dwortz, M. F., Curley, J. P., Tye, K. M., & Padilla-Coreano, N. (2022) · Philosophical Transactions of the Royal Society B · doi:10.1098/rstb.2020.0444 · Cited by 64 · see citing works
Behavioral specifications of reward-associated long-term memory enhancement in humans
Wittmann, B. C., Dolan, R. J., & Düzel, E. (2011) · Learning & Memory · doi:10.1101/lm.1996811 · Cited by 62 · see citing works
Stimulus-response and response-outcome learning mechanisms in the striatum
Horvitz, J. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.014 · Cited by 58 · see citing works
Dopamine-related striatal neurophysiology is associated with specialization of frontostriatal reward circuitry through adolescence
Parr, A. C., Calabro, F., Larsen, B., Tervo-Clemmens, B., Elliot, S., Foran, W., Olafsson, V., & Luna, B. (2021) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2021.101997 · Cited by 60 · see citing works
Reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder
Marsh, R., Tau, G. Z., Wang, Z., Huo, Y., Liu, G., Hao, X., Packard, M. G., Peterson, B. S., & Simpson, H. B. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.13121700 · Cited by 53 · see citing works
HCN Channel Targets for Novel Antidepressant Treatment
Ku, S. M., & Han, M.-H. (2017) · Neurotherapeutics · doi:10.1007/s13311-017-0538-7 · Cited by 54 · see citing works
Anticipation of peer evaluation in anxious adolescents: Divergence in neural activation and maturation
Spielberg, J. M., Jarcho, J. M., Dahl, R. E., Pine, D. S., Ernst, M., & Nelson, E. E. (2015) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu165 · Cited by 52 · see citing works
Electrical stimulation of the medial forebrain bundle in pre-clinical studies of psychiatric disorders
Döbrössy, M. D., Furlanetti, L. L., & Coenen, V. A. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.11.018 · Cited by 47 · see citing works
Voluntary Nicotine Consumption Triggers<i>In Vivo</i>Potentiation of Cortical Excitatory Drives to Midbrain Dopaminergic Neurons
Caillé, S., Guillem, K., Cador, M., Manzoni, O., & Georges, F. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2950-09.2009 · Cited by 43 · see citing works
Dopamine and the Neural “Now”: Essay and Review of <i>Addiction: A Disorder of Choice</i>
Lewis, M. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611400235 · Cited by 42 · see citing works
Are Motivation Deficits Underestimated in Patients With ADHD? A Review of the Literature
Modesto-Lowe, V., Chaplin, M., Soovajian, V., & Meyer, A. (2013) · Postgraduate Medicine · doi:10.3810/pgm.2013.07.2677 · Cited by 41 · see citing works
Dopaminergic foundations of personality and individual differences
Smillie, L. D., & Wacker, J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00874 · Cited by 38 · see citing works
A neurocomputational account of reward and novelty processing and effects of psychostimulants in attention deficit hyperactivity disorder
Sethi, A., Voon, V., Critchley, H. D., Cercignani, M., & Harrison, N. A. (2018) · Brain · doi:10.1093/brain/awy048 · Cited by 36 · see citing works
Mesolimbic Dopamine and Habenulo-Interpeduncular Pathways in Nicotine Withdrawal
Dani, J. A., & De Biasi, M. (2013) · Cold Spring Harbor Perspectives in Medicine · doi:10.1101/cshperspect.a012138 · Cited by 34 · see citing works
Persistent gene expression changes in ventral tegmental area of adolescent but not adult rats in response to chronic nicotine
Doura, M. B., Luu, T. V., Lee, N. H., & Perry, D. C. (2010) · Neuroscience · doi:10.1016/j.neuroscience.2010.06.071 · Cited by 24 · see citing works
Adolescent nicotine exposure and persistent neurocircuitry changes: unveiling lifelong psychiatric risks
Reynolds, L. M., Faure, P., & Barik, J. (2025) · Molecular Psychiatry · doi:10.1038/s41380-025-03110-0 · Cited by 26 · see citing works
Modulation of corticospinal excitability by reward depends on task framing
Mooshagian, E., Keisler, A., Zimmermann, T., Schweickert, J. M., & Wassermann, E. M. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.12.021 · Cited by 24 · see citing works
Route of nicotine administration influences in vivo dopamine neuron activity: habituation, needle injection, and cannula infusion
Dong, Y., Zhang, T., Li, W., Doyon, W., & Dani, J. A. (2010) · Journal of Molecular Neuroscience · doi:10.1007/s12031-009-9231-6 · Cited by 23 · see citing works

Chronic cocaine alters limbic extracellular dopamine. Neurochemical basis for addiction
Impérato, A., Mele, A., Scrocco, M. G., & Puglisi‐Allegra, S. (1992) · European Journal of Pharmacology · doi:10.1016/0014-2999(92)90349-9 · Cited by 97 · see citing works
Electroanalytical techniques for probing neurochemical mechanisms
Kita, J. M. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/0t4k-3a39
Effect of ?-phenylethylamine on dopaminergic systems of the rat brain
Zharikov, S. I., Zharikova, A. D., & Budantsev, A. Y. (1980) · Neurophysiology · doi:10.1007/bf01062839
Midbrain dopamine neurons encode internal effort signalPreprint
Wang, D. V. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.03.04.976969
JMJD3 Deficiency in Midbrain Dopamine Neurons Disturbs Dopamine Synthesis and Aggravates Chronic Inflammatory PainPreprint
He, X., Guo, F., Zhang, W., Le, W., Zheng, Y., Ma, Y., Lee, S., Wang, H., Wu, Y., & Zhou, Q. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.12.01.518657

Authors: Schultz, W.
Affiliations: University of Cambridge (GB)
Corresponding author: Schultz, Wolfram
ORCID: Schultz, Wolfram
Venue: Trends in Neurosciences
Publisher: Elsevier BV
Published: 2007-05
Volume: 30
Issue: 5
Pages: 203-210
ISSN: 0166-2236 (ISSN-L)
DOI: 10.1016/j.tins.2007.03.007
OpenAlex: W2146545384
Cited by: 1,028
References: 72
Citations by year: 2026: 18 · 2025: 39 · 2024: 27 · 2023: 34 · 2022: 40 · 2021: 47 · 2020: 40 · 2019: 49 · 2018: 39 · 2017: 48 · 2016: 62 · 2015: 66 · 2014: 75 · 2013: 73 · 2012: 85
FWCI: 5.77
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Trends in Neurosciences (publishedVersion)
PubMed (publishedVersion)
Funders: Wellcome Trust (095495)
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neuropharmacology Research
Keywords: dopamine signaling, midbrain dopaminergic system, reward, reward prediction, uncertainty, aversive stimuli, punishment, approach behavior, learning, economic decision-making
MeSH terms: Animals, Behavior, Behavior, Animal, Brain, Dopamine, Humans, Learning, Neural Pathways, Reward

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Behavioral dopamine signals.

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks