The DOI matches its Crossref record; 284 of the 284 references it cites were found in a registry or an index.
Predictive Reward Signal of Dopamine Neurons
Abstract
The effects of lesions, receptor blocking, electrical self-stimulation, and drugs of abuse suggest that midbrain dopamine systems are involved in processing reward information and learning approach behavior. Most dopamine neurons show phasic activations after primary liquid and food rewards and conditioned, reward-predicting visual and auditory stimuli. They show biphasic, activation-depression responses after stimuli that resemble reward-predicting stimuli or are novel or particularly salient. However, only few phasic activations follow aversive stimuli. Thus dopamine neurons label environmental stimuli with appetitive value, predict and detect rewards and signal alerting and motivating events. By failing to discriminate between different rewards, dopamine neurons appear to emit an alerting message about the surprising presence or absence of rewards. All responses to rewards and reward-predicting stimuli depend on event predictability. Dopamine neurons are activated by rewarding events that are better than predicted, remain uninfluenced by events that are as good as predicted, and are depressed by events that are worse than predicted. By signaling rewards according to a prediction error, dopamine responses have the formal characteristics of a teaching signal postulated by reinforcement learning theories. Dopamine responses transfer during learning from primary rewards to reward-predicting stimuli. This may contribute to neuronal mechanisms underlying the retrograde action of rewards, one of the main puzzles in reinforcement learning. The impulse response releases a short pulse of dopamine onto many dendrites, thus broadcasting a rather global reinforcement signal to postsynaptic neurons. This signal may improve approach behavior by providing advance reward information before the behavior occurs, and may contribute to learning by modifying synaptic transmission. The dopamine reward signal is supplemented by activity in neurons in striatum, frontal cortex, and amygdala, which process specific reward information but do not emit a global reward prediction error signal. A cooperation between the different reward signals may assure the use of specific rewards for selectively reinforcing behaviors. Among the other projection systems, noradrenaline neurons predominantly serve attentional mechanisms and nucleus basalis neurons code rewards heterogeneously. Cerebellar climbing fibers signal errors in motor performance or errors in the prediction of aversive events to cerebellar Purkinje cells. Most deficits following dopamine-depleting lesions are not easily explained by a defective reward signal but may reflect the absence of a general enabling function of tonic levels of extracellular dopamine. Thus dopamine systems may have two functions, the phasic transmission of reward information and the tonic enabling of postsynaptic neurons.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, AL is, according to all definitions, “predictive.” Because the CS (e.g., the sound of a buzzer) repeatedly precedes the US (e.g., the smell of food), it comes to “predict” the response (salivation). The extent to which the organism anticipates the reinforcement when the CS occurs influences the strength of learning. Only unanticipated events lead to learning. The greater the difference”
From The Transition to Minimal Consciousness through the Evolution of Associative Learning (2016) · cites this paper as Schultz, 1998
In the citing paper
“Previous literature suggests that dopaminergic neuron firing (Schultz, 1998) and dopamine release in the medial NAc core (Kutlu et al., 2022) in response to novel sensory events habituates as the stimulus becomes familiar.”
From Ventral striatum dopamine release encodes unique properties of visual stimuli in mice (2023) · cites this paper as Schultz, 1998
In the citing paper
“Although it was originally postulated that the DA released from the VTA only mediates the hedonic or pleasurable effects of natural reinforcers, it is now clear that changes in DAergic activity can also signal punishment, aversion, or lack of expected reward [53–58].”
From Mechanistic insights into nicotine withdrawal (2011) · cites this paper as [53]
In the citing paper
“With repeated exposure, the DA neurons stop firing when receiving the food and fire instead when exposed to the stimulus that predicts food delivery (33).”
From The Addictive Dimensionality of Obesity (2013) · cites this paper as [33]
In the citing paper
“These responses constitute biological implementations of the crucial error term for reinforcement learning according to the Rescorla–Wagner model and temporal difference reinforcement models73; such a signal is appropriate for mediating learning and updating of reward predictions for approach behaviour and economic decisions4.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [4]
In the citing paper
“Experiments with monkeys and humans have shown that these neurons encode a prediction error, the difference between the reinforcer expected and the reinforcer obtained within a trial (O'Doherty et al., 2004; Schultz, 1998).”
From DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS (2005) · cites this paper as Schultz, 1998
In the citing paper
“A seminal finding was that phasic activity of dopamine neurons in the ventral tegmental area (VTA) encodes a reward prediction error (the difference between the expected and actual reward) (Schultz et al., 1997; Schultz, 1998; Roesch et al., 2007).”
From Decision Making in Recurrent Neuronal Circuits (2008) · cites this paper as Schultz, 1998
In the citing paper
“Fast phasic events occur in response to reward-related events, which may serve as important teaching signals for error detection and modulate behavioral changes in response to the environment (Schultz 1998).”
From Developmental imaging genetics: Linking dopamine function to adolescent behavior (2014) · cites this paper as Schultz 1998
In the citing paper
“Slow changes in tonic levels of DA may be a preparatory mechanism for an organism to respond to environmental cues associated with reward (Schultz 1998).”
From Developmental imaging genetics: Linking dopamine function to adolescent behavior (2014) · cites this paper as Schultz 1998
In the citing paper
“Most dopaminergic neurons within the core reward circuitry, particularly in the VS, show short bursts of phasic activation in response to reward and, after learning, in response to conditioned cues that signal a potential reward [13].”
From Social “wanting” dysfunction in autism: neurobiological underpinnings and treatment implications (2012) · cites this paper as [13]
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationParallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
The neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346
Model predictive control: Theory and practice—A survey
García, C. E., Prett, D. M., & Morari, M. (1989) · Automatica · doi:10.1016/0005-1098(89)90002-2 · Cited by 5,392
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
(1991) · Springer eBooks · doi:10.1007/978-3-7091-2840-4 · Cited by 5,092
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,061
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Research works printed but not linked: 8
- Contreras-Vidal J. L., 1996, Soc. Neurosci. Abstr., 22, 2029
- Hollerman J. R., 1996, Soc. Neurosci. Abstr., 22, 1388
- Hollerman J. R., 1994, Soc. Neurosci. Abstr., 20, 780
- Linden A., 1990, J. Psychophysiol., 4, 145
- 10.1037/0735-7044.105.2.295 · DOI
- Stein L., 1964, Federation Proc., 23, 836
- Suri R. E., 1996, Soc. Neurosci. Abstr., 22, 1389
- Tremblay L., 1995, Soc. Neurosci. Abstr., 21, 952
Cited by
Sorted by citations
Items 101–200 of 407
Pizzagalli, D., Pascual-Marqui, R. D., Nitschke, J. B., Oakes, T. R., Larson, C. L., Abercrombie, H. C., Schaefer, S. M., Koger, J. V., Benca, R. M., & Davidson, R. J. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.3.405 · Cited by 630
Small, D. M., Jones-Gotman, M., & Dagher, A. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00253-2 · Cited by 632
Dopamine reward prediction error coding
Schultz, W. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/wschultz · Cited by 597
Bridging emotion theory and neurobiology through dynamic systems modeling
Lewis, M. D. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0500004x · Cited by 618
Karbach, J., & Verhaeghen, P. (2014) · Psychological Science · doi:10.1177/0956797614548725 · Cited by 589
Assessing anhedonia in depression: potentials and pitfalls
Rizvi, S. J., Pizzagalli, D. A., Sproule, B. A., & Kennedy, S. H. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.03.004 · Cited by 571
Why Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation
Mazzoni, P., Hristova, A., & Krakauer, J. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0264-07.2007 · Cited by 557
Dopaminergic neurons inhibit striatal output through non-canonical release of GABA
Tritsch, N. X., Ding, J. B., & Sabatini, B. L. (2012) · Nature · doi:10.1038/nature11466 · Cited by 576
Dopamine and reward: The anhedonia hypothesis 30 years on
Wise, R. A. (2008) · Neurotoxicity Research · doi:10.1007/bf03033808 · Cited by 580
Representation of negative motivational value in the primate lateral habenula
Matsumoto, M., & Hikosaka, O. (2009) · Nature Neuroscience · doi:10.1038/nn.2233 · Cited by 547
Dopamine and Cognitive Control in Prefrontal Cortex
Ott, T., & Nieder, A. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.006 · Cited by 530
More attention must be paid: The neurobiology of attentional effort
Sarter, M., Gehring, W. J., & Kozak, R. (2006) · Brain Research Reviews · doi:10.1016/j.brainresrev.2005.11.002 · Cited by 552
How prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512
Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA
Bunzeck, N., & Düzel, E. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.021 · Cited by 503
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536
Reward Processing in Schizophrenia: A Deficit in the Representation of Value
Gold, J. M., Waltz, J. A., Prentice, K. J., Morris, S. E., & Heerey, E. A. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn068 · Cited by 521
Prefrontal cortical regulation of brainwide circuit dynamics and reward-related behavior
Ferenczi, E. A., Zalocusky, K. A., Liston, C., Grosenick, L., Warden, M. R., Amatya, D., Katovich, K., Mehta, H., Patenaude, B., Ramakrishnan, C., et al. (2016) · Science · doi:10.1126/science.aac9698 · Cited by 535
Belin, D., Jonkman, S., Dickinson, A., Robbins, T. W., & Everitt, B. J. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.027 · Cited by 520
Schultz, W. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.017 · Cited by 517
Self-citationRoles for nigrostriatal—not just mesocorticolimbic—dopamine in reward and addiction
Wise, R. A. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2009.06.004 · Cited by 500
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506
Schott, B. H., Minuzzi, L., Krebs, R. M., Elmenhorst, D., Lang, M., Winz, O. H., Seidenbecher, C. I., Coenen, H. H., Heinze, H.-J., Zilles, K., et al. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2058-08.2008 · Cited by 496
Assessment of positive welfare: a review
Yeates, J. W., & Main, D. C. J. (2008) · The Veterinary Journal · doi:10.1016/j.tvjl.2007.05.009 · Cited by 504
Actor–critic models of the basal ganglia: new anatomical and computational perspectives
Joel, D., Niv, Y., & Ruppin, E. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00047-3 · Cited by 500
Consciousness and the brainstem
Parvizi, J. (2001) · Cognition · doi:10.1016/s0010-0277(00)00127-x · Cited by 503
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501
Expected value and prediction error abnormalities in depression and schizophrenia
Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D. (2011) · Brain · doi:10.1093/brain/awr059 · Cited by 485
Frank, M. J., & O'Reilly, R. C. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.3.497 · Cited by 472
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485
Neural Circuitry of Reward Prediction Error
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437
Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats
Heien, M. L. A. V., Khan, A. S., Ariansen, J. L., Cheer, J. F., Phillips, P. E. M., Wassum, K. M., & Wightman, R. M. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504657102 · Cited by 482
Leyton, M. (2002) · Neuropsychopharmacology · doi:10.1016/s0893-133x(02)00366-4 · Cited by 476
Reward processing by the lateral habenula in normal and depressive behaviors
Proulx, C. D., Hikosaka, O., & Malinow, R. (2014) · Nature Neuroscience · doi:10.1038/nn.3779 · Cited by 461
Reward value of attractiveness and gaze
Kampe, K. K. W., Frith, C. D., Dolan, R. J., & Frith, U. (2001) · Nature · doi:10.1038/35098149 · Cited by 475
Ito, R., Dalley, J. W., Robbins, T. W., & Everitt, B. J. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-14-06247.2002 · Cited by 463
Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455
Habenula: crossroad between the basal ganglia and the limbic system
Hikosaka, O., Sesack, S. R., Lecourtier, L., & Shepard, P. D. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3463-08.2008 · Cited by 432
Leon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449
Hedonic Hot Spots in the Brain
Peciña, S., Smith, K. S., & Berridge, K. C. (2006) · The Neuroscientist · doi:10.1177/1073858406293154 · Cited by 441
Rodent Models of Attention-Deficit/Hyperactivity Disorder
Sagvolden, T., Russell, V. A., Aase, H., Johansen, E. B., & Farshbaf, M. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.02.002 · Cited by 448
Reinforcement learning or active inference?
Friston, K. J., Daunizeau, J., & Kiebel, S. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006421 · Cited by 443
Wyvell, C. L., & Berridge, K. C. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07831.2001 · Cited by 436
Zweifel, L. S., Parker, J. G., Lobb, C. J., Rainwater, A., Wall, V. Z., Fadok, J. P., Darvas, M., Kim, M. J., Mizumori, S. J. Y., Paladini, C. A., et al. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0813415106 · Cited by 426
Pan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429
Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06422.x · Cited by 416
Spreckelmeyer, K. N., Krach, S., Kohls, G., Rademacher, L., Irmak, A., Konrad, K., Kircher, T., & Gründer, G. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsn051 · Cited by 425
Robinson, T. E., & Flagel, S. B. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.09.006 · Cited by 416
Wacker, J., Dillon, D. G., & Pizzagalli, D. A. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.01.058 · Cited by 405
Toward a neurobiology of delusions
Corlett, P. R., Taylor, J. R., Wang, X.-J., Fletcher, P. C., & Krystal, J. H. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.06.007 · Cited by 394
The Role of Hippocampal Replay in Memory and Planning
Ólafsdóttir, H. F., Bush, D., & Barry, C. (2018) · Current Biology · doi:10.1016/j.cub.2017.10.073 · Cited by 413
Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder
Remijnse, P. L., Nielen, M. M. A., van Balkom, A. J. L. M., Cath, D. C., van Oppen, P., Uylings, H. B. M., & Veltman, D. J. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.11.1225 · Cited by 408
Immaturities in reward processing and its influence on inhibitory control in adolescence.
Geier, C. F., Terwilliger, R., Teslovich, T., Velanova, K., & Luna, B. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp225 · Cited by 396
Barto, A., Mirolli, M., & Baldassarre, G. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00907 · Cited by 397
Précis of The brain and emotion
Rolls, E. T. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00002429 · Cited by 397
A Dedicated Population for Reward Coding in the Hippocampus
Gauthier, J. L., & Tank, D. W. (2018) · Neuron · doi:10.1016/j.neuron.2018.06.008 · Cited by 394
From drugs to deprivation: A Bayesian framework for understanding models of psychosis
Corlett, P. R., Frith, C. D., & Fletcher, P. C. (2009) · Psychopharmacology · doi:10.1007/s00213-009-1561-0 · Cited by 367
Basal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377
Episodic memory in normal aging and Alzheimer disease: Insights from imaging and behavioral studies
Tromp, D., Dufour, A., Lithfous, S., Pebayle, T., & Després, O. (2015) · Ageing Research Reviews · doi:10.1016/j.arr.2015.08.006 · Cited by 390
Banishing the homunculus: Making working memory work
Hazy, T. E., Frank, M. J., & O’Reilly, R. C. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2005.04.067 · Cited by 385
Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning
Iglesias, S., Mathys, C., Brodersen, K. H., Kasper, L., Piccirelli, M., den Ouden, H. E. M., & Stephan, K. E. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.009 · Cited by 342
Afferents of the ventral tegmental area in the rat-anatomical substratum for integrative functions
Geisler, S., & Zahm, D. S. (2005) · The Journal of Comparative Neurology · doi:10.1002/cne.20668 · Cited by 379
The Addictive Dimensionality of Obesity
Volkow, N. D., Wang, G.-J., Tomasi, D., & Baler, R. D. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.12.020 · Cited by 380
Orbitofrontal cortex tracks positive mood in mothers viewing pictures of their newborn infants
Nitschke, J. B., Nelson, E. E., Rusch, B. D., Fox, A. S., Oakes, T. R., & Davidson, R. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.10.005 · Cited by 371
Oxytocin, motivation and the role of dopamine
Love, T. M. (2014) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2013.06.011 · Cited by 369
A connectome of a learning and memory center in the adult Drosophila brain
Takemura, S.-Y., Aso, Y., Hige, T., Wong, A., Lu, Z., Xu, C. S., Rivlin, P. K., Hess, H., Zhao, T., Parag, T., et al. (2017) · eLife · doi:10.7554/elife.26975 · Cited by 367
Hippocampal dysregulation of dopamine system function and the pathophysiology of schizophrenia
Lodge, D. J., & Grace, A. A. (2011) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2011.05.001 · Cited by 349
Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation
Dayan, P., & Berridge, K. C. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0277-8 · Cited by 357
“Liking” and “wanting” in eating and food reward: Brain mechanisms and clinical implications
Morales, I., & Berridge, K. C. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.113152 · Cited by 346
Speed/accuracy trade-off between the habitual and the goal-directed processes
Keramati, M., Dezfouli, A., & Piray, P. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002055 · Cited by 346
Dopamine Production in the Caudate Putamen Restores Feeding in Dopamine-Deficient Mice
Szczypka, M. S., Kwok, K., Brot, M. D., Marck, B. T., Matsumoto, A. M., Donahue, B. A., & Palmiter, R. D. (2001) · Neuron · doi:10.1016/s0896-6273(01)00319-1 · Cited by 354
Plassmann, H., O'Doherty, J. P., & Rangel, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0788-10.2010 · Cited by 356
Cannabinoids Enhance Subsecond Dopamine Release in the Nucleus Accumbens of Awake Rats
Cheer, J. F., Wassum, K. M., Heien, M. L. A. V., Phillips, P. E. M., & Wightman, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0529-04.2004 · Cited by 343
Dissociation of neural networks for anticipation and consumption of monetary and social rewards
Rademacher, L., Krach, S., Kohls, G., Irmak, A., Gründer, G., & Spreckelmeyer, K. N. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.089 · Cited by 347
Tripp, G., & Wickens, J. R. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01851.x · Cited by 368
Combined Social and Spatial Coding in a Descending Projection from the Prefrontal Cortex
Murugan, M., Jang, H. J., Park, M., Miller, E. M., Cox, J., Taliaferro, J. P., Parker, N. F., Bhave, V., Hur, H., Liang, Y., et al. (2017) · Cell · doi:10.1016/j.cell.2017.11.002 · Cited by 311
Tremblay, L. K., Naranjo, C. A., Graham, S. J., Herrmann, N., Mayberg, H. S., Hevenor, S., & Busto, U. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.11.1228 · Cited by 340
Bassareo, V., De Luca, M. A., & Di Chiara, G. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-11-04709.2002 · Cited by 339
Pathophysiology of obsessive–compulsive disorder
Aouizerate, B., Guehl, D., Cuny, E., Rougier, A., Bioulac, B., Tignol, J., & Burbaud, P. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.02.004 · Cited by 341
A Dual Role for Prediction Error in Associative Learning
den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn161 · Cited by 306
Neural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray
Johansen, J. P., Tarpley, J. W., LeDoux, J. E., & Blair, H. T. (2010) · Nature Neuroscience · doi:10.1038/nn.2594 · Cited by 312
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324
O'Doherty, J. P., Buchanan, T. W., Seymour, B., & Dolan, R. J. (2006) · Neuron · doi:10.1016/j.neuron.2005.11.014 · Cited by 322
Volkow, N. D., Wang, G., Fowler, J. S., Logan, J., Franceschi, D., Maynard, L., Ding, Y., Gatley, S. J., Gifford, A., Zhu, W., et al. (2002) · Synapse · doi:10.1002/syn.10038 · Cited by 321
Oscillations and hippocampal-prefrontal synchrony
Colgin, L. L. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.04.006 · Cited by 299
Reward learning: reinforcement, incentives, and expectations
Berridge, K. C. (2000) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(00)80022-5 · Cited by 318
Anorexia nervosa and obesity are associated with opposite brain reward response
Frank, G. K. W., Reynolds, J. R., Shott, M. E., Jappe, L., Yang, T. T., Tregellas, J. R., & O'Reilly, R. C. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2012.51 · Cited by 311
The temporal precision of reward prediction in dopamine neurons
Fiorillo, C. D., Newsome, W. T., & Schultz, W. (2008) · Nature Neuroscience · doi:10.1038/nn.2159 · Cited by 310
Self-citationThe basolateral amygdala in reward learning and addiction
Wassum, K. M., & Izquierdo, A. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.017 · Cited by 306
Neural population code for fine perceptual decisions in area MT
Purushothaman, G., & Bradley, D. C. (2005) · Nature Neuroscience · doi:10.1038/nn1373 · Cited by 309
Bay-Richter, C., Linderholm, K. R., Lim, C. K., Samuelsson, M., Träskman-Bendz, L., Guillemin, G. J., Erhardt, S., & Brundin, L. (2015) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2014.07.012 · Cited by 304
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300
Self-citationCorrelated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298
Neurobiological mechanisms of anhedonia
Gorwood, P. (2008) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2008.10.3/pgorwood · Cited by 285
A direct projection from superior colliculus to substantia nigra for detecting salient visual events
Comoli, E., Coizet, V., Boyes, J., Bolam, J. P., Canteras, N. S., Quirk, R. H., Overton, P. G., & Redgrave, P. (2003) · Nature Neuroscience · doi:10.1038/nn1113 · Cited by 295
Robinson, D. L., Heien, M. L. A. V., & Wightman, R. M. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-23-10477.2002 · Cited by 290
The hippocampal-striatal axis in learning, prediction and goal-directed behavior
Pennartz, C. M. A., Ito, R., Verschure, P. F. M. J., Battaglia, F. P., & Robbins, T. W. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.08.001 · Cited by 287
The anatomy of choice: dopamine and decision-making.
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0481 · Cited by 289
A neurobiological theory of automaticity in perceptual categorization
Ashby, F. G., Ennis, J. M., & Spiering, B. J. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.632 · Cited by 286
Lodge, D. J., & Grace, A. A. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300963 · Cited by 280
Joshua, M., Adler, A., Mitelman, R., Vaadia, E., & Bergman, H. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3839-08.2008 · Cited by 273
Metadata
- Authors
- Schultz, W.
- Affiliations
- University of Fribourg (CH)
- Corresponding author
- Schultz, Wolfram
- ORCID
- Schultz, Wolfram
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 1998-07-01
- Volume
- 80
- Issue
- 1
- Pages
- 1-27
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2109059823
- Cited by
- 4,564
- References
- 284
- Citations by year
- 2026: 115 · 2025: 132 · 2024: 156 · 2023: 136 · 2022: 164 · 2021: 165 · 2020: 231 · 2019: 167 · 2018: 168 · 2017: 162 · 2016: 223 · 2015: 208 · 2014: 228 · 2013: 205 · 2012: 223
- FWCI
- 20.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Neurophysiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- dopaminergic neurons, reward prediction error, midbrain dopamine system, reinforcement learning, approach behavior, tonic dopamine, norepinephrine, nucleus basalis of Meynert, climbing fibers, aversive stimuli
- MeSH terms
- Animals, Brain, Dopamine, Humans, Learning, Models, Neurological, Neurons, Reward, Signal Transduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
