Multiple reward signals in the brain
Abstract
The fundamental biological importance of rewards has created an increasing interest in the neuronal processing of reward information. The suggestion that the mechanisms underlying drug addiction might involve natural reward systems has also stimulated interest. This article focuses on recent neurophysiological studies in primates that have revealed that neurons in a limited number of brain structures carry specific signals about past and future rewards. This research provides the first step towards an understanding of how rewards influence behaviour before they are received and how the brain might use reward information to control learning and goal-directed behaviour.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Anticipation of reward or reward prediction error places enhanced expectancies within the theory's consideration.
“That is, it is the anticipation of reward (broadly defined) or reward prediction error (Schultz, 2000(Schultz, , 2013) ) that places this form of enhanced expectancies within our consideration here.”
From Optimizing performance through intrinsic motivation and attention for learning: The OPTIMAL theory of motor learning (2016) · cites this paper as Schultz, 2000
Rewards exert their effects via expectation rather than receipt.
“Importantly, rewards appear to exert their effects via expectation rather than receipt.”
From Optimizing performance through intrinsic motivation and attention for learning: The OPTIMAL theory of motor learning (2016) · cites this paper as Schultz, 2000
Adolescents generally activate a similar set of subcortical structures as adults when processing reward-relevant contexts.
“This analysis confirms that adolescents generally activate a similar set of subcortical structures as adults when processing reward-relevant contexts.”
From Neural networks involved in adolescent reward processing: an activation likelihood estimation meta-analysis of functional neuroimaging studies (2015) · cites this paper as Schultz, 2000
The findings are consistent with different functions associated with distinct regions of the striatum: afferent projections to dorsal striatum are crucial for learning correct actions to maximize reward, whereas projections to ventral striatum including nucleus accumbens have a key function in reward prediction and pavlovian learning.
“These findings are consistent with the different functions associated with distinct regions of the striatum: afferent projections to dorsal striatum are thought to be crucial for learning correct actions so as to maximize reward, whereas projections to ventral striatum, including nucleus accumbens, have a key function in reward prediction and pavlovian learning18-20,23,24.”
From Empathic neural responses are modulated by the perceived fairness of others (2006) · cites this paper as [20]
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Self-citationThe neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Self-citationClassical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · see citing works
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · see citing works
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · see citing works
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · see citing works
Self-citationRelative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Self-citationNeurobehavioural mechanisms of reward and motivation
Robbins, T. W., & Everitt, B. J. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80077-8 · Cited by 1,187 · see citing works
Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., & Zigmond, M. J. (1989) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1989.tb09224.x · Cited by 1,106 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
Self-citationMotivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · see citing works
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Self-citationMesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967 · see citing works
Rogers, R. D., Owen, A. M., Middleton, H. C., Williams, E., Pickard, J. D., Sahakian, B. J., & Robbins, T. W. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-20-09029.1999 · Cited by 865 · see citing works
Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning
Schoenbaum, G. M., Chiba, A. A., & Gallagher, M. (1998) · Nature Neuroscience · doi:10.1038/407 · Cited by 849 · see citing works
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836 · see citing works
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works
Self-citationTD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play
Tesauro, G. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.215 · Cited by 803 · see citing works
Neuronal activity in monkey ventral striatum related to the expectation of reward
Schultz, W., Apicella, P., Scarnati, E., & Ljungberg, T. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04595.1992 · Cited by 744 · see citing works
Self-citationDissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740 · see citing works
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · see citing works
Long-term synaptic depression in the striatum: physiological and pharmacological characterization
Calabresi, P., Maj, R., Pisani, A., Mercuri, N. B., & Bernardi, G. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-11-04224.1992 · Cited by 673 · see citing works
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 653 · see citing works
Expectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 632 · see citing works
Aosaki, T., Tsubokawa, H., Ishida, A., Watanabe, K., Graybiel, A. M., & Kimura, M. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-06-03969.1994 · Cited by 600 · see citing works
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.814 · Cited by 579 · see citing works
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 544 · see citing works
Self-citationPrefrontal and cingulate unit activity during timing behavior in the monkey
Niki, H., & Watanabe, M. (1979) · Brain Research · doi:10.1016/0006-8993(79)90328-7 · Cited by 507 · see citing works
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506 · see citing works
Rolls, E. T., Sienkiewicz, Z. J., & Yaxley, S. (1989) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1989.tb00774.x · Cited by 466 · see citing works
Leon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449 · see citing works
Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey
Schultz, W. (1986) · Journal of Neurophysiology · doi:10.1152/jn.1986.56.5.1439 · Cited by 390 · see citing works
Self-citationInfluence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380 · see citing works
Self-citationOtmakhova, N. A., & Lisman, J. E. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-23-07478.1996 · Cited by 377 · see citing works
Responses to reward in monkey dorsal and ventral striatum
Apicella, P., Ljungberg, T., Scarnati, E., & Schultz, W. (1991) · Experimental Brain Research · doi:10.1007/bf00231732 · Cited by 369 · see citing works
Self-citationRomo, R., & Schultz, W. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.592 · Cited by 353 · see citing works
Self-citationHikosaka, K. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.263 · Cited by 345 · see citing works
Schultz, W., & Romo, R. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.607 · Cited by 334 · see citing works
Self-citationNishijo, H., Ono, T., & Nishino, H. (1988) · Journal of Neuroscience · doi:10.1523/jneurosci.08-10-03570.1988 · Cited by 333 · see citing works
Carelli, R. M., Ijames, S. G., & Crumling, A. J. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04255.2000 · Cited by 310 · see citing works
Neuronal activity in monkey striatum related to the expectation of predictable environmental events
Apicella, P., Scarnati, E., Ljungberg, T., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.945 · Cited by 305 · see citing works
Self-citationDopaminergic correlates of motivated behavior: importance of drive
Wilson, C., Nomikos, G., Collu, M., & Fibiger, H. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-07-05169.1995 · Cited by 294 · see citing works
Wickens, J. R., Begg, A., & Arbuthnott, G. W. (1996) · Neuroscience · doi:10.1016/0306-4522(95)00436-m · Cited by 294 · see citing works
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294 · see citing works
Self-citationAbnormal Synaptic Plasticity in the Striatum of Mice Lacking Dopamine D2 Receptors
Calabresi, P., Saiardi, A., Pisani, A., Baik, J., Centonze, D., Mercuri, N. B., Bernardi, G., & Borrelli, E. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-12-04536.1997 · Cited by 287 · see citing works
Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1864 · Cited by 287 · see citing works
Self-citationLocalization of drug reward mechanisms by intracranial injections
Wise, R. A., & Hoffman, D. C. (1992) · Synapse · doi:10.1002/syn.890100307 · Cited by 276 · see citing works
Activation of the human brain by monetary reward
Thut, G., Schultz, W., Roelcke, U., Nienhusmeier, M., Missimer, J. H., Maguire, R. P., & Leenders, K. L. (1997) · Neuroreport · doi:10.1097/00001756-199703240-00033 · Cited by 273 · see citing works
Self-citationModifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Tremblay, L., Hollerman, J. R., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.964 · Cited by 267 · see citing works
Self-citationVisual and oculomotor functions of monkey subthalamic nucleus
Matsumura, M., Kojima, J., Gardiner, T. W., & Hikosaka, O. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.6.1615 · Cited by 265 · see citing works
Burton, M. J., Rolls, E. T., & Mora, F. (1976) · Experimental Neurology · doi:10.1016/0014-4886(76)90189-8 · Cited by 252 · see citing works
Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards
Bowman, E. M., Aigner, T. G., & Richmond, B. J. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.3.1061 · Cited by 246 · see citing works
Single cell activity in ventral prefrontal cortex of behaving monkeys
Rosenkilde, C. E., Bauer, R. H., & Fuster, J. M. (1981) · Brain Research · doi:10.1016/0006-8993(81)90160-8 · Cited by 233 · see citing works
Dynamic changes in nucleus accumbens dopamine efflux during the Coolidge effect in male rats
Fiorino, D. F., Coury, A., & Phillips, A. G. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-12-04849.1997 · Cited by 226 · see citing works
Shidara, M., Aigner, T. G., & Richmond, B. J. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-07-02613.1998 · Cited by 205 · see citing works
Okano, K., & Tanji, J. (1987) · Experimental Brain Research · doi:10.1007/bf00236211 · Cited by 203 · see citing works
Guarraci, F. A., & Kapp, B. S. (1999) · Behavioural Brain Research · doi:10.1016/s0166-4328(98)00102-8 · Cited by 201 · see citing works
Learning of sequential movements by neural network model with dopamine-like reinforcement signal
Suri, R. E., & Schultz, W. (1998) · Experimental Brain Research · doi:10.1007/s002210050467 · Cited by 198 · see citing works
Self-citationFunctional Specificity of Ventral Striatal Compartments in Appetitive Behaviors
KELLEY, A. E. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09262.x · Cited by 198 · see citing works
Spatial, movement- and reward-sensitive discharge by medial ventral striatum neurons of rats
Lavoie, A. M., & Mizumori, S. J. Y. (1994) · Brain Research · doi:10.1016/0006-8993(94)90645-9 · Cited by 185 · see citing works
Schultz, W., & Romo, R. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.201 · Cited by 184 · see citing works
Self-citationTonically discharging neurons of monkey striatum respond to preparatory and rewarding stimuli
Apicella, P., Scarnati, E., & Schultz, W. (1991) · Experimental Brain Research · doi:10.1007/bf00230981 · Cited by 183 · see citing works
Self-citationCarelli, R. M., & Deadwyler, S. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-12-07735.1994 · Cited by 180 · see citing works
Rolls, E. T., Murzi, E., Yaxley, S., Thorpe, S. J., & Simpson, S. J. (1986) · Brain Research · doi:10.1016/0006-8993(86)91044-9 · Cited by 180 · see citing works
Activity of dopamine neurons in the behaving primate
Schultz, W. (1992) · Seminars in Neuroscience · doi:10.1016/1044-5765(92)90011-p · Cited by 178 · see citing works
Self-citationChang, J., Sawyer, S. F., Lee, R., & Woodward, D. J. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-03-01224.1994 · Cited by 177 · see citing works
Neuronal activity in the monkey striatum during the initiation of movements
Schultz, W., & Romo, R. (1988) · Experimental Brain Research · doi:10.1007/bf00247503 · Cited by 171 · see citing works
Self-citationLouilot, A., Moal, M. L., & Simon, H. (1986) · Brain Research · doi:10.1016/0006-8993(86)90646-3 · Cited by 168 · see citing works
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1877 · Cited by 167 · see citing works
Self-citationRolls, E. T., Scott, T. R., Sienkiewicz, Z. J., & Yaxley, S. (1988) · The Journal of Physiology · doi:10.1113/jphysiol.1988.sp016984 · Cited by 165 · see citing works
Apicella, P., Legallet, E., & Trouche, E. (1997) · Experimental Brain Research · doi:10.1007/pl00005773 · Cited by 162 · see citing works
Kurata, K., & Wise, S. P. (1988) · Experimental Brain Research · doi:10.1007/bf00250247 · Cited by 157 · see citing works
Romo, R., & Schultz, W. (1987) · Experimental Brain Research · doi:10.1007/bf00247297 · Cited by 155 · see citing works
Self-citationChang, J.-Y., Janak, P. H., & Woodward, D. J. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-08-03098.1998 · Cited by 151 · see citing works
Peoples, L. L., & West, M. O. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-10-03459.1996 · Cited by 149 · see citing works
Detecting behaviorally relevant changes in extracellular dopamine with microdialysis
Church, W. H., Justice, J. B., & Neill, D. B. (1987) · Brain Research · doi:10.1016/0006-8993(87)91150-4 · Cited by 148 · see citing works
Neuronal responses in the ventral striatum of the behaving macaque
WILLIAMS, G., ROLLS, E., LEONARD, C., & STERN, C. (1993) · Behavioural Brain Research · doi:10.1016/0166-4328(93)90120-f · Cited by 146 · see citing works
Activity of single neurons in the monkey amygdala during performance of a visual discrimination task
Nakamura, K., Mikami, A., & Kubota, K. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.6.1447 · Cited by 135 · see citing works
Liu, Z., & Richmond, B. J. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.3.1677 · Cited by 134 · see citing works
Schultz, W. (1986) · Journal of Neurophysiology · doi:10.1152/jn.1986.55.4.660 · Cited by 133 · see citing works
Self-citationFiring patterns of nucleus accumbens neurons during cocaine self-administration in rats
Carelli, R. M., King, V. C., Hampson, R. E., & Deadwyler, S. A. (1993) · Brain Research · doi:10.1016/0006-8993(93)90557-4 · Cited by 129 · see citing works
Cingulate unit activity and delayed response
Niki, H., & Watanabe, M. (1976) · Brain Research · doi:10.1016/0006-8993(76)90412-1 · Cited by 120 · see citing works
Strecker, R., & Jacobs, B. (1985) · Brain Research · doi:10.1016/0006-8993(85)91304-6 · Cited by 115 · see citing works
Young, A. M. J., Joseph, M. H., & Gray, J. A. (1992) · Neuroscience · doi:10.1016/0306-4522(92)90275-7 · Cited by 111 · see citing works
Pratt, W. E., & Mizumori, S. J. Y. (1998) · Behavioral Neuroscience · doi:10.1037//0735-7044.112.3.554 · Cited by 91 · see citing works
Peoples, L. L., Uzwiak, A. J., Gee, F., & West, M. O. (1997) · Brain Research · doi:10.1016/s0006-8993(97)00299-0 · Cited by 80 · see citing works
Peoples, L. L., Gee, F., Bibi, R., & West, M. O. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-18-07588.1998 · Cited by 76 · see citing works
Pratt, W. E., & Mizumori, S. J. Y. (1998) · Behavioral Neuroscience · doi:10.1037/0735-7044.112.3.554 · Cited by 76 · see citing works
Niki, H., Sakai, M., & Kubota, K. (1972) · Brain Research · doi:10.1016/0006-8993(72)90717-2 · Cited by 66 · see citing works
The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units
Watanabe, M. (1989) · Neuroscience Letters · doi:10.1016/0304-3940(89)90450-3 · Cited by 64 · see citing works
Influence of Predictive Information on Responses of Tonically Active Neurons in the Monkey Striatum
Apicella, P., Ravel, S., Sardo, P., & Legallet, E. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.6.3341 · Cited by 63 · see citing works
Influence of Spatial Information on Responses of Tonically Active Neurons in the Monkey Striatum
Ravel, S., Sardo, P., Legallet, E., & Apicella, P. (2006) · Journal of Neurophysiology · doi:10.1152/jn.01113.2005 · Cited by 62 · see citing works
Chang, J., Paris, J. M., Sawyer, S. F., Kirillov, A. B., & Woodward, D. J. (1996) · Neuroscience · doi:10.1016/0306-4522(96)00144-3 · Cited by 38 · see citing works
Low-dose amphetamine elevates movement-related firing of rat striatal neurons
West, M. O., Peoples, L. L., Michael, A. J., Chapin, J. K., & Woodward, D. J. (1997) · Brain Research · doi:10.1016/s0006-8993(96)01215-2 · Cited by 33 · see citing works
Apicella, P., Legallet, E., & Trouche, E. (1996) · Neuroscience Letters · doi:10.1016/0304-3940(96)12328-4 · Cited by 32 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718 · see citing works
Dynamic predictions: Oscillations and synchrony in top–down processing
Engel, A. K., Fries, P., & Singer, W. (2001) · Nature Reviews Neuroscience · doi:10.1038/35094565 · Cited by 3,454 · see citing works
Nestler, E. J., Barrot, M., DiLeone, R. J., Eisch, A. J., Gold, S. J., & Monteggia, L. M. (2002) · Neuron · doi:10.1016/s0896-6273(02)00653-0 · Cited by 3,217 · see citing works
On the relationship between emotion and cognition
Pessoa, L. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2317 · Cited by 2,350 · see citing works
What makes us tick? Functional and neural mechanisms of interval timing
Buhusi, C. V., & Meck, W. H. (2005) · Nature reviews. Neuroscience · doi:10.1038/nrn1764 · Cited by 2,074 · see citing works
The hippocampal-VTA loop: controlling the entry of information into long-term memory
Lisman, J. E., & Grace, A. A. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.002 · Cited by 1,983 · see citing works
The Neural Basis of Altruistic Punishment
de Quervain, D. J.-F., Fischbacher, U., Treyer, V., Schellhammer, M., Schnyder, U., Buck, A., & Fehr, E. (2004) · Science · doi:10.1126/science.1100735 · Cited by 1,768 · see citing works
Empathic neural responses are modulated by the perceived fairness of others
Singer, T., Seymour, B., O'Doherty, J. P., Stephan, K. E., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature04271 · Cited by 1,726 · see citing works
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · see citing works
Robinson, T. E., & Berridge, K. C. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145237 · Cited by 1,509 · see citing works
A taxonomy of external and internal attention.
Chun, M. M., Golomb, J. D., & Turk-Browne, N. B. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100427 · Cited by 1,472 · see citing works
The Neuroscience of Natural Rewards: Relevance to Addictive Drugs
Kelley, A. E., & Berridge, K. C. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-09-03306.2002 · Cited by 1,465 · see citing works
A new look at social support: A theoretical perspective on thriving through relationships
Feeney, B. C., & Collins, N. L. (2015) · Personality and Social Psychology Review · doi:10.1177/1088868314544222 · Cited by 1,521 · see citing works
The neural correlates of maternal and romantic love
Bartels, A., & Zeki, S. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.11.003 · Cited by 1,448 · see citing works
Neural systems responding to degrees of uncertainty in human decision-making
Hsu, M., Bhatt, M., Adolphs, R., Tranel, D., & Camerer, C. F. (2005) · Science · doi:10.1126/science.1115327 · Cited by 1,411 · see citing works
Eye movements in natural behavior
Hayhoe, M., & Ballard, D. H. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.02.009 · Cited by 1,321 · see citing works
How do emotion and motivation direct executive control?
Pessoa, L. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.01.006 · Cited by 1,286 · see citing works
Wulf, G., & Lewthwaite, R. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0999-9 · Cited by 1,238 · see citing works
Pizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., Dougherty, D. D., Iosifescu, D. V., Rauch, S. L., & Fava, M. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08081201 · Cited by 1,232 · see citing works
Affective consciousness: core emotional feelings in animals and humans.
Panksepp, J. (2005) · Consciousness and Cognition · doi:10.1016/j.concog.2004.10.004 · Cited by 1,217 · see citing works
Putting a spin on the dorsal-ventral divide of the striatum
Voorn, P., Vanderschuren, L. J. M. J., Groenewegen, H. J., Robbins, T. W., & Pennartz, C. M. A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.06.006 · Cited by 1,188 · see citing works
Dorsal anterior cingulate cortex: A role in reward-based decision making
Bush, G., Vogt, B. A., Holmes, J., Dale, A. M., Greve, D., Jenike, M. A., & Rosen, B. R. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.012470999 · Cited by 1,096 · see citing works
The Vertebrate mesolimbic reward system and social behavior network: A comparative synthesis
O'Connell, L. A., & Hofmann, H. A. (2011) · Journal of Comparative Neurology · doi:10.1002/cne.22735 · Cited by 986 · see citing works
Reward, Motivation, and Emotion Systems Associated With Early-Stage Intense Romantic Love
Aron, A., Fisher, H., Mashek, D. J., Strong, G., Li, H., & Brown, L. L. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00838.2004 · Cited by 963 · see citing works
Constructivist and Ecological Rationality in Economics
Smith, V. L. S. (2003) · American Economic Review · doi:10.1257/000282803322156954 · Cited by 950 · see citing works
A Large-Scale Model of the Functioning Brain
Eliasmith, C., Stewart, T. C., Choo, X., Bekolay, T., DeWolf, T., Tang, Y., & Rasmussen, D. (2012) · Science · doi:10.1126/science.1225266 · Cited by 934 · see citing works
Kelley, A. E. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2003.11.015 · Cited by 942 · see citing works
Cools, R. (2006) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.03.024 · Cited by 903 · see citing works
Remembering the Details: Effects of Emotion
Kensinger, E. (2009) · Emotion Review · doi:10.1177/1754073908100432 · Cited by 886 · see citing works
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879 · see citing works
The Neurobiology of Human Attachments
Feldman, R. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.11.007 · Cited by 839 · see citing works
Processing of Social and Monetary Rewards in the Human Striatum
Izuma, K., Saito, D. N., & Sadato, N. (2008) · Neuron · doi:10.1016/j.neuron.2008.03.020 · Cited by 855 · see citing works
Hein, G., Silani, G., Preuschoff, K., Batson, C. D., & Singer, T. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.003 · Cited by 821 · see citing works
Sescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.002 · Cited by 782 · see citing works
Bernhardt, B. C., & Singer, T. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150536 · Cited by 952 · see citing works
The Economics of Fairness, Reciprocity and Altruism - Experimental Evidence and New TheoriesPreprint
Fehr, E., & Schmidt, K. M. (2005) · RePEc: Research Papers in Economics · doi:10.5282/ubm/epub.726 · Cited by 843 · see citing works
Dreisbach, G., & Goschke, T. (2004) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.30.2.343 · Cited by 775 · see citing works
Eye guidance in natural vision: reinterpreting salience
Tatler, B. W., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011) · Journal of Vision · doi:10.1167/11.5.5 · Cited by 775 · see citing works
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762 · see citing works
Reward‐Related Responses in the Human Striatum
DELGADO, M. R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.002 · Cited by 736 · see citing works
Nociception, pain, negative moods, and behavior selection
Baliki, M. N., & Apkarian, A. V. (2015) · Neuron · doi:10.1016/j.neuron.2015.06.005 · Cited by 731 · see citing works
Addiction and Cue-Triggered Decision Processes
Bernheim, B. D., & Rangel, A. (2004) · American Economic Review · doi:10.1257/0002828043052222 · Cited by 733 · see citing works
Fehr, E., & Schmidt, K. M. (2006) · Handbook on the economics of giving, reciprocity and altruism · doi:10.1016/s1574-0714(06)01008-6 · Cited by 725 · see citing works
Cognitive Control Signals for Neural Prosthetics
Musallam, S., Corneil, B. D., Greger, B., Scherberger, H., & Andersen, R. A. (2004) · Science · doi:10.1126/science.1097938 · Cited by 663 · see citing works
Interest: A unique motivational variable
Hidi, S. E. (2006) · Educational Research Review · doi:10.1016/j.edurev.2006.09.001 · Cited by 661 · see citing works
Mental fatigue, motivation and action monitoring
Boksem, M. A. S., Meijman, T. F., & Lorist, M. M. (2005) · Biological Psychology · doi:10.1016/j.biopsycho.2005.08.007 · Cited by 645 · see citing works
Distinct basal ganglia territories are engaged in early and advanced motor sequence learning
Lehéricy, S., Benali, H., Van de Moortele, P.-F., Pélégrini-Issac, M., Waechter, T., Ugurbil, K., & Doyon, J. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502762102 · Cited by 634 · see citing works
Mirror neurons: from origin to function
Cook, R., Bird, G., Catmur, C., Press, C., & Heyes, C. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13000903 · Cited by 632 · see citing works
Wallis, J. D., & Miller, E. K. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02922.x · Cited by 628 · see citing works
The IMAGEN study: reinforcement-related behaviour in normal brain function and psychopathology
Schumann, G., Loth, E., Banaschewski, T., Barbot, A., Barker, G. J., Büchel, C., Conrod, P., Dalley, J. W., Flor, H., Gallinat, J., et al. (2010) · Molecular Psychiatry · doi:10.1038/mp.2010.4 · Cited by 618 · see citing works
The Neural Signature of Social Norm Compliance
Spitzer, M., Fischbacher, U., Herrnberger, B., Grön, G., & Fehr, E. (2007) · Neuron · doi:10.1016/j.neuron.2007.09.011 · Cited by 584 · see citing works
Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty
Li, S., Cullen, W. K., Anwyl, R., & Rowan, M. J. (2003) · Nature Neuroscience · doi:10.1038/nn1049 · Cited by 568 · see citing works
Zilverstand, A., Huang, A., Nelly Alia-klein, A., & Goldstein, R. Z. (2018) · Neuron · doi:10.1016/j.neuron.2018.03.048 · Cited by 570 · see citing works
Stuttering and the basal ganglia circuits: a critical review of possible relations
Alm, P. A. (2004) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2004.03.001 · Cited by 560 · see citing works
Gold, J. I., & Shadlen, M. N. (2002) · Neuron · doi:10.1016/s0896-6273(02)00971-6 · Cited by 547 · see citing works
Perceptual Learning Directs Auditory Cortical Map Reorganization through Top-Down Influences
Polley, D. B., Steinberg, E. E., & Merzenich, M. M. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.3771-05.2006 · Cited by 551 · see citing works
Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards
Bromberg-Martin, E. S., & Hikosaka, O. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.009 · Cited by 548 · see citing works
Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex
Roesch, M. R., & Olson, C. R. (2004) · Science · doi:10.1126/science.1093223 · Cited by 535 · see citing works
Diffusion tensor fiber tracking shows distinct corticostriatal circuits in humans
Lehéricy, S., Ducros, M., Van De Moortele, P., Francois, C., Thivard, L., Poupon, C., Swindale, N., Ugurbil, K., & Kim, D. (2004) · Annals of Neurology · doi:10.1002/ana.20030 · Cited by 542 · see citing works
The impact of reinforcement contingencies on AD/HD: A review and theoretical appraisal
Luman, M., Oosterlaan, J., & Sergeant, J. A. (2005) · Clinical Psychology Review · doi:10.1016/j.cpr.2004.11.001 · Cited by 541 · see citing works
Dopamine-dependent plasticity of corticostriatal synapses
Reynolds, J. N. J., & Wickens, J. R. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00045-x · Cited by 528 · see citing works
Neural basis of deciding, choosing and acting
Schall, J. D. (2001) · Nature reviews. Neuroscience · doi:10.1038/35049054 · Cited by 528 · see citing works
Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making
Preuschoff, K. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00115 · Cited by 538 · see citing works
Functional and Neural Mechanisms of Interval Timing
Meck, W. H. (2003) · CRC Press eBooks · doi:10.1201/9780203009574 · Cited by 522 · see citing works
Dopamine: 50 years in perspective
Iversen, S. D., & Iversen, L. L. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.002 · Cited by 514 · see citing works
Elliott, R., Newman, J. L., Longe, O. A., & Deakin, J. F. W. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-01-00303.2003 · Cited by 515 · see citing works
A review of systems and networks of the limbic forebrain/limbic midbrain
Morgane, P. J., Galler, J. R., & Mokler, D. J. (2005) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2005.01.001 · Cited by 497 · see citing works
Tripp, G., & Wickens, J. R. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2009.07.026 · Cited by 492 · see citing works
Ullsperger, M., & von Cramon, D. Y. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-10-04308.2003 · Cited by 484 · see citing works
Aragona, B. J., Liu, Y., Yu, Y. J., Curtis, J. T., Detwiler, J. M., Insel, T. R., & Wang, Z. (2006) · Nature Neuroscience · doi:10.1038/nn1613 · Cited by 473 · see citing works
Differential neural responses evoked by orthonasal versus retronasal odorant perception in humans
Small, D. M., Gerber, J. C., Mak, Y. E., & Hummel, T. (2005) · Neuron · doi:10.1016/j.neuron.2005.07.022 · Cited by 463 · see citing works
Role of the lateral prefrontal cortex in executive behavioral control.
Tanji, J., & Hoshi, E. (2008) · Physiological Reviews · doi:10.1152/physrev.00014.2007 · Cited by 495 · see citing works
A functional MRI study of happy and sad affective states induced by classical music
Mitterschiffthaler, M. T., Fu, C. H. Y., Dalton, J. A., Andrew, C. M., & Williams, S. (2007) · Human Brain Mapping · doi:10.1002/hbm.20337 · Cited by 445 · see citing works
Medial prefrontal cell activity signaling prediction errors of action values
Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007) · Nature Neuroscience · doi:10.1038/nn1890 · Cited by 440 · see citing works
Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations
DELGADO, M. R., LOCKE, H. M., STENGER, V. A., & FIEZ, J. A. (2003) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.3.1.27 · Cited by 431 · see citing works
The neural system that bridges reward and cognition in humans: An fMRI study
Pochon, J.-B., Lévy, R., Fossati, P., Lehéricy, S., Poline, J.-B., Pillon, B., Bihan, D. L., & Dubois, B. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.082111099 · Cited by 431 · see citing works
Decision Making and Sequential Sampling from Memory
Shadlen, M. N., & Shohamy, D. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.036 · Cited by 412 · see citing works
The Structure of Social Cognition: In(ter)dependence of Sociocognitive Processes
Happe, F. G. E., Cook, J. L., & Bird, G. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044046 · Cited by 424 · see citing works
Eye movements and perception: A selective review
Schütz, A. C., Braun, D. I., & Gegenfurtner, K. R. (2011) · Journal of Vision · doi:10.1167/11.5.9 · Cited by 409 · see citing works
Romantic love: a mammalian brain system for mate choice
Fisher, H. E., Aron, A., & Brown, L. L. (2006) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2006.1938 · Cited by 411 · see citing works
Brain Responses to the Acquired Moral Status of Faces
Singer, T., Kiebel, S. J., Winston, J. S., Dolan, R. J., & Frith, C. (2004) · Neuron · doi:10.1016/s0896-6273(04)00014-5 · Cited by 410 · see citing works
S., M., S., B., M.-Y., H., C., B., E., S., J., D., & I., A. (2002) · Psychopharmacology · doi:10.1007/s00213-001-0983-0 · Cited by 409 · see citing works
Value Representations in the Primate Striatum during Matching Behavior
Lau, B., & Glimcher, P. W. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.021 · Cited by 411 · see citing works
Neuronal representations of cognitive state: reward or attention?
Maunsell, J. H. R. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.04.003 · Cited by 404 · see citing works
Immaturities in reward processing and its influence on inhibitory control in adolescence.
Geier, C. F., Terwilliger, R., Teslovich, T., Velanova, K., & Luna, B. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp225 · Cited by 396 · see citing works
Romantic love: an fMRI study of a neural mechanism for mate choice.
Fisher, H., Aron, A., & Brown, L. L. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20772 · Cited by 396 · see citing works
The brain on art: intense aesthetic experience activates the default mode network
Vessel, E. A., Starr, G. G., & Rubin, N. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00066 · Cited by 392 · see citing works
Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus
Singer, A. C., & Frank, L. M. (2009) · Neuron · doi:10.1016/j.neuron.2009.11.016 · Cited by 385 · see citing works
Davey, C. G., Yücel, M., & Allen, N. B. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.04.016 · Cited by 377 · see citing works
Prediction error as a linear function of reward probability is coded in human nucleus accumbens
Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.001 · Cited by 376 · see citing works
IMAGING VALUATION MODELS IN HUMAN CHOICE
Montague, P. R., King‐Casas, B., & Cohen, J. D. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112903 · Cited by 371 · see citing works
Neural Systems for Error Monitoring: Recent Findings and Theoretical Perspectives
Taylor, S. F., Stern, E. R., & Gehring, W. J. (2007) · The Neuroscientist · doi:10.1177/1073858406298184 · Cited by 368 · see citing works
Task and context determine where you look
Rothkopf, C. A., Ballard, D. H., & Hayhoe, M. M. (2016) · Journal of Vision · doi:10.1167/7.14.16 · Cited by 366 · see citing works
Visual Selective Attention and the Effects of Monetary Rewards
Libera, C. D., & Chelazzi, L. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01689.x · Cited by 365 · see citing works
The Right and the Good: Distributive Justice and Neural Encoding of Equity and Efficiency
Hsu, M., Anen, C., & Quartz, S. R. (2008) · Science · doi:10.1126/science.1153651 · Cited by 354 · see citing works
Beyond the FRN: Broadening the time-course of EEG and ERP components implicated in reward processing
Glazer, J. E., Kelley, N. J., Pornpattananangkul, N., Mittal, V. A., & Nusslock, R. (2018) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2018.02.002 · Cited by 362 · see citing works
Reward Reduces Conflict by Enhancing Attentional Control and Biasing Visual Cortical Processing
Padmala, S., & Pessoa, L. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00011 · Cited by 362 · see citing works
A unified model for perceptual learning
Seitz, A. R., & Watanabe, T. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.05.010 · Cited by 357 · see citing works
Rosati, A. G., Stevens, J. R., Hare, B. A., & HAUSER, M. D. (2007) · Current Biology · doi:10.1016/j.cub.2007.08.033 · Cited by 357 · see citing works
Role of dopamine in the motivational and cognitive control of behavior
Cools, R. (2008) · The Neuroscientist · doi:10.1177/1073858408317009 · Cited by 352 · see citing works
- Authors
- Schultz, W.
- Affiliations
- University of Fribourg (CH)
- Corresponding author
- Schultz, Wolfram
- ORCID
- Schultz, Wolfram
- Venue
- Nature Reviews Neuroscience
- Published
- 2000-12
- Volume
- 1
- Issue
- 3
- Pages
- 199-207
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W2126449078
- Cited by
- 1,303
- References
- 99
- Citations by year
- 2026: 34 · 2025: 28 · 2024: 19 · 2023: 30 · 2022: 34 · 2021: 48 · 2020: 37 · 2019: 45 · 2018: 52 · 2017: 42 · 2016: 63 · 2015: 55 · 2014: 62 · 2013: 61 · 2012: 72
- FWCI
- 4.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- reward signals, reward processing, drug addiction, primate neurophysiology, goal-directed behavior, learning
- MeSH terms
- Animals, Behavior, Animal, Brain, Emotions, Humans, Reward, Signal Transduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
