The DOI matches its Crossref record; 284 of the 284 references it cites were found in a registry or an index.
Predictive Reward Signal of Dopamine Neurons
Abstract
The effects of lesions, receptor blocking, electrical self-stimulation, and drugs of abuse suggest that midbrain dopamine systems are involved in processing reward information and learning approach behavior. Most dopamine neurons show phasic activations after primary liquid and food rewards and conditioned, reward-predicting visual and auditory stimuli. They show biphasic, activation-depression responses after stimuli that resemble reward-predicting stimuli or are novel or particularly salient. However, only few phasic activations follow aversive stimuli. Thus dopamine neurons label environmental stimuli with appetitive value, predict and detect rewards and signal alerting and motivating events. By failing to discriminate between different rewards, dopamine neurons appear to emit an alerting message about the surprising presence or absence of rewards. All responses to rewards and reward-predicting stimuli depend on event predictability. Dopamine neurons are activated by rewarding events that are better than predicted, remain uninfluenced by events that are as good as predicted, and are depressed by events that are worse than predicted. By signaling rewards according to a prediction error, dopamine responses have the formal characteristics of a teaching signal postulated by reinforcement learning theories. Dopamine responses transfer during learning from primary rewards to reward-predicting stimuli. This may contribute to neuronal mechanisms underlying the retrograde action of rewards, one of the main puzzles in reinforcement learning. The impulse response releases a short pulse of dopamine onto many dendrites, thus broadcasting a rather global reinforcement signal to postsynaptic neurons. This signal may improve approach behavior by providing advance reward information before the behavior occurs, and may contribute to learning by modifying synaptic transmission. The dopamine reward signal is supplemented by activity in neurons in striatum, frontal cortex, and amygdala, which process specific reward information but do not emit a global reward prediction error signal. A cooperation between the different reward signals may assure the use of specific rewards for selectively reinforcing behaviors. Among the other projection systems, noradrenaline neurons predominantly serve attentional mechanisms and nucleus basalis neurons code rewards heterogeneously. Cerebellar climbing fibers signal errors in motor performance or errors in the prediction of aversive events to cerebellar Purkinje cells. Most deficits following dopamine-depleting lesions are not easily explained by a defective reward signal but may reflect the absence of a general enabling function of tonic levels of extracellular dopamine. Thus dopamine systems may have two functions, the phasic transmission of reward information and the tonic enabling of postsynaptic neurons.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, AL is, according to all definitions, “predictive.” Because the CS (e.g., the sound of a buzzer) repeatedly precedes the US (e.g., the smell of food), it comes to “predict” the response (salivation). The extent to which the organism anticipates the reinforcement when the CS occurs influences the strength of learning. Only unanticipated events lead to learning. The greater the difference”
From The Transition to Minimal Consciousness through the Evolution of Associative Learning (2016) · cites this paper as Schultz, 1998
In the citing paper
“Previous literature suggests that dopaminergic neuron firing (Schultz, 1998) and dopamine release in the medial NAc core (Kutlu et al., 2022) in response to novel sensory events habituates as the stimulus becomes familiar.”
From Ventral striatum dopamine release encodes unique properties of visual stimuli in mice (2023) · cites this paper as Schultz, 1998
In the citing paper
“Although it was originally postulated that the DA released from the VTA only mediates the hedonic or pleasurable effects of natural reinforcers, it is now clear that changes in DAergic activity can also signal punishment, aversion, or lack of expected reward [53–58].”
From Mechanistic insights into nicotine withdrawal (2011) · cites this paper as [53]
In the citing paper
“With repeated exposure, the DA neurons stop firing when receiving the food and fire instead when exposed to the stimulus that predicts food delivery (33).”
From The Addictive Dimensionality of Obesity (2013) · cites this paper as [33]
In the citing paper
“These responses constitute biological implementations of the crucial error term for reinforcement learning according to the Rescorla–Wagner model and temporal difference reinforcement models73; such a signal is appropriate for mediating learning and updating of reward predictions for approach behaviour and economic decisions4.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [4]
In the citing paper
“Experiments with monkeys and humans have shown that these neurons encode a prediction error, the difference between the reinforcer expected and the reinforcer obtained within a trial (O'Doherty et al., 2004; Schultz, 1998).”
From DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS (2005) · cites this paper as Schultz, 1998
In the citing paper
“A seminal finding was that phasic activity of dopamine neurons in the ventral tegmental area (VTA) encodes a reward prediction error (the difference between the expected and actual reward) (Schultz et al., 1997; Schultz, 1998; Roesch et al., 2007).”
From Decision Making in Recurrent Neuronal Circuits (2008) · cites this paper as Schultz, 1998
In the citing paper
“Fast phasic events occur in response to reward-related events, which may serve as important teaching signals for error detection and modulate behavioral changes in response to the environment (Schultz 1998).”
From Developmental imaging genetics: Linking dopamine function to adolescent behavior (2014) · cites this paper as Schultz 1998
In the citing paper
“Slow changes in tonic levels of DA may be a preparatory mechanism for an organism to respond to environmental cues associated with reward (Schultz 1998).”
From Developmental imaging genetics: Linking dopamine function to adolescent behavior (2014) · cites this paper as Schultz 1998
In the citing paper
“Most dopaminergic neurons within the core reward circuitry, particularly in the VS, show short bursts of phasic activation in response to reward and, after learning, in response to conditioned cues that signal a potential reward [13].”
From Social “wanting” dysfunction in autism: neurobiological underpinnings and treatment implications (2012) · cites this paper as [13]
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationParallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
The neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346
Model predictive control: Theory and practice—A survey
García, C. E., Prett, D. M., & Morari, M. (1989) · Automatica · doi:10.1016/0005-1098(89)90002-2 · Cited by 5,392
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
(1991) · Springer eBooks · doi:10.1007/978-3-7091-2840-4 · Cited by 5,092
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,061
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Research works printed but not linked: 8
- Contreras-Vidal J. L., 1996, Soc. Neurosci. Abstr., 22, 2029
- Hollerman J. R., 1996, Soc. Neurosci. Abstr., 22, 1388
- Hollerman J. R., 1994, Soc. Neurosci. Abstr., 20, 780
- Linden A., 1990, J. Psychophysiol., 4, 145
- 10.1037/0735-7044.105.2.295 · DOI
- Stein L., 1964, Federation Proc., 23, 836
- Suri R. E., 1996, Soc. Neurosci. Abstr., 22, 1389
- Tremblay L., 1995, Soc. Neurosci. Abstr., 21, 952
Cited by
Sorted by citations
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120
The adolescent brain and age-related behavioral manifestations
Spear, L. P. (2000) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(00)00014-2 · Cited by 5,433
The reorienting system of the human brain: from environment to theory of mind
Corbetta, M., Patel, G., & Shulman, G. L. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.017 · Cited by 3,889
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764
The Neural Basis of Addiction: A Pathology of Motivation and Choice
Kalivas, P. W., & Volkow, N. D. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.8.1403 · Cited by 2,757
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Self-citationDopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
Self-citationThe prefontral cortex and cognitive control
Miller, E. K. (2000) · Nature Reviews Neuroscience · doi:10.1038/35036228 · Cited by 2,016
The free-energy principle: a rough guide to the brain?
Friston, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.04.005 · Cited by 1,831
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775
The locus coeruleus and noradrenergic modulation of cognition
Sara, S. J. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2573 · Cited by 1,848
The principal features and mechanisms of dopamine modulation in the prefrontal cortex
Seamans, J. K., & Yang, C. R. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.05.006 · Cited by 1,592
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Robinson, T. E., & Berridge, K. C. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145237 · Cited by 1,509
Ikemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477
Assessment of positive emotions in animals to improve their welfare
Boissy, A., Manteuffel, G., Jensen, M. B., Moe, R. O., Spruijt, B., Keeling, L. J., Winckler, C., Forkman, B., Dimitrov, I., Langbein, J., et al. (2007) · Physiology & Behavior · doi:10.1016/j.physbeh.2007.02.003 · Cited by 1,486
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
A neural basis for social cooperation
Rilling, J. K., Gutman, D. A., Zeh, T. R., Pagnoni, G., Berns, G. S., & Kilts, C. D. (2002) · Neuron · doi:10.1016/s0896-6273(02)00755-9 · Cited by 1,451
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
Self-citationReward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
Multiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415
Self-citationTwo types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276
Self-citationMultiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
Self-citationLateral habenula as a source of negative reward signals in dopamine neurons
Matsumoto, M., & Hikosaka, O. (2007) · Nature · doi:10.1038/nature05860 · Cited by 1,292
Dichotomous dopaminergic control of striatal synaptic plasticity
Shen, W., Flajolet, M., Greengard, P., & Surmeier, D. J. (2008) · Science · doi:10.1126/science.1160575 · Cited by 1,190
Wulf, G., & Lewthwaite, R. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0999-9 · Cited by 1,238
The role of dopamine in the pathophysiology of depression
Dunlop, B. W., & Nemeroff, C. B. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.3.327 · Cited by 1,244
Intermediate phenotypes and genetic mechanisms of psychiatric disorders
Meyer-Lindenberg, A., & Weinberger, D. R. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1993 · Cited by 1,216
Affective consciousness: core emotional feelings in animals and humans.
Panksepp, J. (2005) · Consciousness and Cognition · doi:10.1016/j.concog.2004.10.004 · Cited by 1,217
Event perception: a mind-brain perspective
Zacks, J. M., Speer, N. K., Swallow, K. M., Braver, T. S., & Reynolds, J. R. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.2.273 · Cited by 1,148
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Self-citationGläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
The neurobiology of anhedonia and other reward-related deficits
Der-Avakian, A., & Markou, A. (2012) · Trends in Neurosciences · doi:10.1016/j.tins.2011.11.005 · Cited by 1,130
Depression, Stress, and Anhedonia: Toward a Synthesis and Integrated Model
Pizzagalli, D. A. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185606 · Cited by 1,155
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133
Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorder
Dawson, G. (2008) · Development and Psychopathology · doi:10.1017/s0954579408000370 · Cited by 1,138
Saper, C. B., Chou, T. C., & Elmquist, J. K. (2002) · Neuron · doi:10.1016/s0896-6273(02)00969-8 · Cited by 1,120
Subsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113
Floresco, S. B., West, A. R., Ash, B., Moore, H., & Grace, A. A. (2003) · Nature Neuroscience · doi:10.1038/nn1103 · Cited by 1,106
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
Dopamine: Functions, Signaling, and Association with Neurological Diseases
Klein, M. O., Battagello, D. S., Cardoso, A. R., Hauser, D. N., Bittencourt, J. C., & Correa, R. G. (2019) · Cellular and Molecular Neurobiology · doi:10.1007/s10571-018-0632-3 · Cited by 1,073
Regulation of firing of dopaminergic neurons and control of goal-directed behaviors
Grace, A. A., Floresco, S. B., Goto, Y., & Lodge, D. J. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.003 · Cited by 1,034
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Self-citationDopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036
Self-citationThe psychology and neurobiology of addiction: an incentive–sensitization view
Robinson, T. E., & Berridge, K. C. (2000) · Addiction · doi:10.1046/j.1360-0443.95.8s2.19.x · Cited by 1,507
Schultz, W. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.007 · Cited by 1,028
Self-citationsagvolden, T., johansen, E. B., aase, H., & russell, V. A. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000075 · Cited by 1,035
Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval
Carr, M. F., Jadhav, S. P., & Frank, L. M. (2011) · Nature Neuroscience · doi:10.1038/nn.2732 · Cited by 958
Nucleus accumbens shell and core dopamine: differential role in behavior and addiction
Di Chiara, G. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00286-3 · Cited by 996
The habenula: from stress evasion to value-based decision-making
Hikosaka, O. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2866 · Cited by 955
Addiction: A Disease of Learning and Memory
Hyman, S. E. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.8.1414 · Cited by 980
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967
Dawson, G., Webb, S. J., & McPartland, J. (2005) · Developmental Neuropsychology · doi:10.1207/s15326942dn2703_6 · Cited by 989
The Nucleus Accumbens: An Interface Between Cognition, Emotion, and Action
Floresco, S. B. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115159 · Cited by 938
The Vertebrate mesolimbic reward system and social behavior network: A comparative synthesis
O'Connell, L. A., & Hofmann, H. A. (2011) · Journal of Comparative Neurology · doi:10.1002/cne.22735 · Cited by 986
Cortico-Basal Ganglia Reward Network: Microcircuitry
Sesack, S. R., & Grace, A. A. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.93 · Cited by 985
Reward-motivated learning: mesolimbic activation precedes memory formation
Adcock, R. A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., & Gabrieli, J. D. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.036 · Cited by 977
The dopamine motive system: implications for drug and food addiction
Volkow, N. D., Wise, R. A., & Baler, R. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2017.130 · Cited by 939
Sonuga-Barke, E. J. S. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.09.008 · Cited by 962
Complementary roles of basal ganglia and cerebellum in learning and motor control
Doya, K. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00153-7 · Cited by 964
Motivation and cognitive control: from behavior to neural mechanism
Botvinick, M., & Braver, T. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015044 · Cited by 909
Haber, S. N. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/shaber · Cited by 922
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966
Reward processing in primate orbitofrontal cortex and basal ganglia
Schultz, W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.272 · Cited by 942
Self-citationDopamine and drug addiction: the nucleus accumbens shell connection
Di Chiara, G., Bassareo, V., Fenu, S., De Luca, M. A., Spina, L., Cadoni, C., Acquas, E., Carboni, E., Valentini, V., & Lecca, D. (2004) · Neuropharmacology · doi:10.1016/j.neuropharm.2004.06.032 · Cited by 935
Behavioral and Neural Analysis of Extinction
Myers, K. M., & Davis, M. (2002) · Neuron · doi:10.1016/s0896-6273(02)01064-4 · Cited by 918
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking
Stuber, G. D., Sparta, D. R., Stamatakis, A. M., van Leeuwen, W. A., Hardjoprajitno, J. E., Cho, S., Tye, K. M., Kempadoo, K. A., Zhang, F., Deisseroth, K., et al. (2011) · Nature · doi:10.1038/nature10194 · Cited by 878
Psychological heterogeneity in AD/HD—a dual pathway model of behaviour and cognition
Sonuga-Barke, E. J. S. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00432-6 · Cited by 901
Berke, J. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0152-y · Cited by 904
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Matsuda, W., Furuta, T., Nakamura, K. C., Hioki, H., Fujiyama, F., Arai, R., & Kaneko, T. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4029-08.2009 · Cited by 865
The Neuroscience of Drug Reward and Addiction
Volkow, N. D., Michaelides, M., & Baler, R. (2019) · Physiological Reviews · doi:10.1152/physrev.00014.2018 · Cited by 863
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Building neural representations of habits.
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834
The dual pathway model of AD/HD: an elaboration of neuro-developmental characteristics
Sonuga-Barke, E. J. S. (2003) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2003.08.005 · Cited by 816
EEG delta oscillations as a correlate of basic homeostatic and motivational processes
Knyazev, G. G. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.10.002 · Cited by 776
The Neuroscience of Social Decision-Making
Rilling, J. K., & Sanfey, A. G. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.121208.131647 · Cited by 775
Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli
Lammel, S., Ion, D. I., Roeper, J., & Malenka, R. C. (2011) · Neuron · doi:10.1016/j.neuron.2011.03.025 · Cited by 766
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762
Dopamine system dysregulation in major depressive disorders
Belujon, P., & Grace, A. A. (2017) · International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyx056 · Cited by 754
How unrealistic optimism is maintained in the face of reality
Sharot, T., Korn, C. W., & Dolan, R. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2949 · Cited by 729
Dopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718
Predictability modulates human brain response to reward
Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02793.2001 · Cited by 711
Pruessner, J. C., Champagne, F., Meaney, M. J., & Dagher, A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3422-03.2004 · Cited by 709
Wittmann, B. C., Schott, B. H., Guderian, S., Frey, J. U., Heinze, H.-J., & Düzel, E. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.010 · Cited by 698
From prediction error to incentive salience: mesolimbic computation of reward motivation.
Berridge, K. C. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.07990.x · Cited by 700
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679
Updating dopamine reward signals
Schultz, W. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.012 · Cited by 651
Self-citationPrefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653
Self-citationA critical time window for dopamine actions on the structural plasticity of dendritic spines
Yagishita, S., Hayashi-Takagi, A., Ellis-Davies, G. C. R., Urakubo, H., Ishii, S., & Kasai, H. (2014) · Science · doi:10.1126/science.1255514 · Cited by 614
Metadata
- Authors
- Schultz, W.
- Affiliations
- University of Fribourg (CH)
- Corresponding author
- Schultz, Wolfram
- ORCID
- Schultz, Wolfram
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 1998-07-01
- Volume
- 80
- Issue
- 1
- Pages
- 1-27
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2109059823
- Cited by
- 4,564
- References
- 284
- Citations by year
- 2026: 115 · 2025: 132 · 2024: 156 · 2023: 136 · 2022: 164 · 2021: 165 · 2020: 231 · 2019: 167 · 2018: 168 · 2017: 162 · 2016: 223 · 2015: 208 · 2014: 228 · 2013: 205 · 2012: 223
- FWCI
- 20.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Neurophysiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- dopaminergic neurons, reward prediction error, midbrain dopamine system, reinforcement learning, approach behavior, tonic dopamine, norepinephrine, nucleus basalis of Meynert, climbing fibers, aversive stimuli
- MeSH terms
- Animals, Brain, Dopamine, Humans, Learning, Models, Neurological, Neurons, Reward, Signal Transduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
