Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology
Abstract
Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Midbrain DA neurons in the SN/VTA respond to both novelty and reward.
“As midbrain DA neurons in the SN/VTA respond to both novelty and reward62–64, we contrasted new and rewarding stimuli against familiar and nonrewarding stimuli.”
From Acute social isolation evokes midbrain craving responses similar to hunger (2020) · cites this paper as [64]
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Self-citationEvolution and the theory of games
Smith, J. M. (1976) · Springer eBooks · doi:10.1007/978-1-4684-7862-4_22 · Cited by 7,369 · see citing works
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Evolution and the Theory of Games
Smith, J. M. (1982) · Cambridge University Press eBooks · doi:10.1017/cbo9780511806292 · Cited by 6,918 · see citing works
Kahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544 · see citing works
Kahneman, D. J., & Tversky, A. (2013) · World Scientific handbook in financial economic series · doi:10.1142/9789814417358_0016 · Cited by 5,372 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Self-citationClassical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · see citing works
Exposition of a New Theory on the Measurement of Risk
Bernoulli, D. (1954) · Econometrica · doi:10.2307/1909829 · Cited by 2,779 · see citing works
Herrnstein, R. J. (1961) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1961.4-267 · Cited by 2,281 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
Self-citationNeural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · see citing works
Brosnan, S. F., & de Waal, F. Β. Μ. (2003) · Nature · doi:10.1038/nature01963 · Cited by 1,584 · see citing works
Experience-weighted Attraction Learning in Normal Form Games
Camerer, C. F., & Ho, T. (1999) · Econometrica · doi:10.1111/1468-0262.00054 · Cited by 1,486 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Self-citationNeuronal correlates of a perceptual decision
Newsome, W. T., Britten, K. H., & Movshon, J. A. (1989) · Nature · doi:10.1038/341052a0 · Cited by 1,177 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Self-citationMotivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · see citing works
Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque
Kim, J.-N., & Shadlen, M. N. (1999) · Nature Neuroscience · doi:10.1038/5739 · Cited by 950 · see citing works
Wise, R. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)00965-0 · Cited by 881 · see citing works
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836 · see citing works
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · cited 2× · see citing works
“After the pioneering study by Watanabe [21] on reward-discriminating prefrontal activity, this work makes the next step by investigating the actual gain in neural information derived from the expectation of reward.”
BackgroundExpectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 632 · see citing works
Wallis, J. D., & Miller, E. K. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02922.x · Cited by 628 · see citing works
Representation of Time by Neurons in the Posterior Parietal Cortex of the Macaque
Leon, M. I., & Shadlen, M. N. (2003) · Neuron · doi:10.1016/s0896-6273(03)00185-5 · Cited by 601 · see citing works
Aosaki, T., Tsubokawa, H., Ishida, A., Watanabe, K., Graybiel, A. M., & Kimura, M. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-06-03969.1994 · Cited by 600 · see citing works
Performance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581 · see citing works
Gold, J. I., & Shadlen, M. N. (2002) · Neuron · doi:10.1016/s0896-6273(02)00971-6 · Cited by 547 · see citing works
Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy
Shidara, M., & Richmond, B. J. (2002) · Science · doi:10.1126/science.1069504 · Cited by 515 · see citing works
Leon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449 · see citing works
Evolution and the theory of games
Lewontin, R. C. (1961) · Journal of Theoretical Biology · doi:10.1016/0022-5193(61)90038-8 · Cited by 419 · see citing works
A neural correlate of response bias in monkey caudate nucleus
Lauwereyns, J., Watanabe, K., Coe, B. C., & Hikosaka, O. (2002) · Nature · doi:10.1038/nature00892 · Cited by 415 · see citing works
Saccadic Probability Influences Motor Preparation Signals and Time to Saccadic Initiation
Dorris, M. C., & Munoz, D. P. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-17-07015.1998 · Cited by 399 · see citing works
Neuronal correlates of decision-making in secondary somatosensory cortex
Romo, R., Hernández, A., Zainos, A., Lemus, L., & Brody, C. D. (2002) · Nature Neuroscience · doi:10.1038/nn950 · Cited by 387 · see citing works
Neuronal correlates of goal-based motor selection in the prefrontal cortex.
Matsumoto, K., Suzuki, W., & Tanaka, K. (2003) · Science · doi:10.1126/science.1084204 · Cited by 384 · see citing works
Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380 · see citing works
Self-citationEffects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum
Cromwell, H. C., & Schultz, W. (2003) · Journal of Neurophysiology · doi:10.1152/jn.01014.2002 · Cited by 357 · see citing works
Self-citationHikosaka, K. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.263 · Cited by 345 · see citing works
Modulation of neuronal activity by target uncertainty
Basso, M. A., & Wurtz, R. H. (1997) · Nature · doi:10.1038/37975 · Cited by 335 · see citing works
Nishijo, H., Ono, T., & Nishino, H. (1988) · Journal of Neuroscience · doi:10.1523/jneurosci.08-10-03570.1988 · Cited by 333 · see citing works
Roesch, M. R., & Olson, C. R. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00019.2003 · Cited by 309 · see citing works
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300 · see citing works
Self-citationCorrelated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1864 · Cited by 287 · see citing works
Self-citationGustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey
Rolls, E. T., Yaxley, S., & Sienkiewicz, Z. J. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.64.4.1055 · Cited by 282 · see citing works
Monitoring and Control of Action by the Frontal Lobes
Schall, J. D., Stuphorn, V., & Brown, J. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00964-9 · Cited by 280 · see citing works
Responses to the Sensory Properties of Fat of Neurons in the Primate Orbitofrontal Cortex
Rolls, E. T., Critchley, H. D., Browning, A. S., Hernadi, I., & Lenard, L. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-04-01532.1999 · Cited by 278 · see citing works
Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum
Hassani, O. K., Cromwell, H. C., & Schultz, W. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.6.2477 · Cited by 257 · see citing works
Self-citationNeural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards
Bowman, E. M., Aigner, T. G., & Richmond, B. J. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.3.1061 · Cited by 246 · see citing works
Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus
Ikeda, T., & Hikosaka, O. (2003) · Neuron · doi:10.1016/s0896-6273(03)00464-1 · Cited by 233 · see citing works
Ho, M., Mobini, S., Chiang, T.-J., Bradshaw, C., & Szabadi, E. (1999) · Psychopharmacology · doi:10.1007/pl00005482 · Cited by 221 · see citing works
Influence of Reward Expectation on Visuospatial Processing in Macaque Lateral Prefrontal Cortex
Kobayashi, S., Lauwereyns, J., Koizumi, M., Sakagami, M., & Hikosaka, O. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00472.2001 · Cited by 206 · see citing works
Shidara, M., Aigner, T. G., & Richmond, B. J. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-07-02613.1998 · Cited by 205 · see citing works
Role of Primate Substantia Nigra Pars Reticulata in Reward-Oriented Saccadic Eye Movement
Sato, M., & Hikosaka, O. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-06-02363.2002 · Cited by 191 · see citing works
Apicella, P., Legallet, E., & Trouche, E. (1997) · Experimental Brain Research · doi:10.1007/pl00005773 · Cited by 162 · see citing works
Coding and Monitoring of Motivational Context in the Primate Prefrontal Cortex
Watanabe, M., Hikosaka, K., Sakagami, M., & Shirakawa, S. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-06-02391.2002 · Cited by 159 · see citing works
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00721.2003 · Cited by 158 · see citing works
Neuronal Activity in Substantia Nigra Pars Reticulata during Target Selection
Basso, M. A., & Wurtz, R. H. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-05-01883.2002 · Cited by 140 · see citing works
Activity of single neurons in the monkey amygdala during performance of a visual discrimination task
Nakamura, K., Mikami, A., & Kubota, K. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.6.1447 · Cited by 135 · see citing works
Liu, Z., & Richmond, B. J. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.3.1677 · Cited by 134 · see citing works
Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus
Watanabe, K., Lauwereyns, J., & Hikosaka, O. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-31-10052.2003 · Cited by 118 · see citing works
Role of Tonically Active Neurons in Primate Caudate in Reward-Oriented Saccadic Eye Movement
Shimo, Y., & Hikosaka, O. (2001) · Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07804.2001 · Cited by 97 · see citing works
Tonically active neurons in the monkey striatum do not preferentially respond to appetitive stimuli
Ravel, S., Legallet, E., & Apicella, P. (1999) · Experimental Brain Research · doi:10.1007/s002210050876 · Cited by 93 · see citing works
The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units
Watanabe, M. (1989) · Neuroscience Letters · doi:10.1016/0304-3940(89)90450-3 · Cited by 64 · see citing works
Role of tonically active neurons in primate caudate in reward-oriented saccadic eye movement
下, 泰. (2002) · Medical Entomology and Zoology · Cited by 8 · see citing works
A representation of the hazard function of elapsed time by neurons in macaque area LIP
Janssen, P., & Shadlen, M. N. (2003) · Online · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764 · see citing works
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · see citing works
Prefrontal-Subcortical Pathways Mediating Successful Emotion Regulation
Wager, T. D., Davidson, M. L., Hughes, B. L., Lindquist, M. A., & Ochsner, K. N. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.006 · Cited by 1,761 · see citing works
“These regions have been consistently implicated in reward learning (McClure et al., 2003; Schultz, 2004), reward expectancies (Breiter et al.”
Neural Mechanisms for Interacting with a World Full of Action Choices
Cisek, P., & Kalaska, J. F. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135409 · Cited by 1,543 · see citing works
Barrett, L. F., Mesquita, B., Ochsner, K. N., & Gross, J. J. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085709 · Cited by 1,425 · see citing works
Deep Brain Stimulation to Reward Circuitry Alleviates Anhedonia in Refractory Major Depression
Schlaepfer, T. E., Cohen, M. X., Frick, C., Kosel, M., Brodesser, D., Axmacher, N., Joe, A. Y., Kreft, M., Lenartz, D., & Sturm, V. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301408 · Cited by 1,027 · see citing works
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030 · see citing works
New insights into symptoms and neurocircuit function of anorexia nervosa
Kaye, W. H., Fudge, J. L., & Paulus, M. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2682 · Cited by 843 · see citing works
Human insula activation reflects risk prediction errors as well as risk
Preuschoff, K., Quartz, S. R., & Bossaerts, P. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4286-07.2008 · Cited by 784 · see citing works
Functional magnetic resonance imaging of reward prediction
Knutson, B., & Cooper, J. C. (2005) · Current Opinion in Neurology · doi:10.1097/01.wco.0000173463.24758.f6 · Cited by 736 · see citing works
Triadic model of the neurobiology of motivated behavior in adolescence.
ERNST, M., PINE, D. S., & HARDIN, M. (2006) · Psychological Medicine · doi:10.1017/s0033291705005891 · Cited by 718 · see citing works
Neurobiology of anorexia and bulimia nervosa
Kaye, W. (2008) · Physiology & Behavior · doi:10.1016/j.physbeh.2007.11.037 · Cited by 625 · see citing works
Lewis, F. L., & Vamvoudakis, K. G. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2043839 · Cited by 544 · see citing works
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536 · see citing works
Masten, C. L., Eisenberger, N. I., Borofsky, L. A., Pfeifer, J. H., McNealy, K., Mazziotta, J. C., & Dapretto, M. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp007 · Cited by 529 · see citing works
de Gelder, B., Snyder, J., Greve, D., Gerard, G., & Hadjikhani, N. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0407042101 · Cited by 511 · see citing works
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485 · see citing works
Psychological processing in chronic pain: a neural systems approach
Simons, L. E., Elman, I., & Borsook, D. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.12.006 · Cited by 359 · see citing works
Implications for neurobiological research of cognitive models of psychosis: a theoretical paper
GARETY, P. A., BEBBINGTON, P., FOWLER, D., FREEMAN, D., & KUIPERS, E. (2007) · Psychological Medicine · doi:10.1017/s003329170700013x · Cited by 347 · see citing works
Altered Reward Processing in Women Recovered From Anorexia Nervosa
Wagner, A., Aizenstein, H., Venkatraman, V. K., Fudge, J., May, J. C., Mazurkewicz, L., Frank, G. K., Bailer, U. F., Fischer, L., Nguyen, V., et al. (2007) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.07040575 · Cited by 342 · see citing works
Tripp, G., & Wickens, J. R. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01851.x · Cited by 346 · see citing works
Cisek, P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.5605-05.2006 · Cited by 344 · see citing works
Monk, C. S., Klein, R. G., Telzer, E. H., Schroth, E. A., Mannuzza, S., Moulton, J. L., Guardino, M., Masten, C. L., McClure-Tone, E. B., Fromm, S., et al. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.06111917 · Cited by 335 · see citing works
Genetics of Human Social Behavior
Ebstein, R. P., Israel, S., Chew, S. H., Zhong, S., & Knafo, A. (2010) · Neuron · doi:10.1016/j.neuron.2010.02.020 · Cited by 323 · see citing works
Decision theory: what “should” the nervous system do?
Körding, K. (2007) · Science · doi:10.1126/science.1142998 · Cited by 313 · see citing works
Enhanced Striatal Dopamine Release During Food Stimulation in Binge Eating Disorder
Wang, G., Geliebter, A., Volkow, N. D., Telang, F. W., Logan, J., Jayne, M. C., Galanti, K., Selig, P. A., Han, H., Zhu, W., et al. (2011) · Obesity · doi:10.1038/oby.2011.27 · Cited by 313 · see citing works
The role of the striatum in social behavior
Báez-Mendoza, R., & Schultz, W. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00233 · Cited by 312 · see citing works
Self-citationAcute social isolation evokes midbrain craving responses similar to hunger
Tomova, L., Wang, K. L., Thompson, T., Matthews, G. A., Takahashi, A., Tye, K. M., & Saxe, R. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-00742-z · Cited by 283 · see citing works
Düzel, E., Bunzeck, N., Guitart-Masip, M., & Düzel, S. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.08.006 · Cited by 249 · see citing works
Dopamine Dysregulation Syndrome: An Overview of its Epidemiology, Mechanisms and Management
OʼSullivan, S. S., Evans, A. H., & Lees, A. J. (2009) · CNS Drugs · doi:10.2165/00023210-200923020-00005 · Cited by 265 · see citing works
The maturation of incentive processing and cognitive control
Geier, C., & Luna, B. (2009) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2009.01.021 · Cited by 225 · see citing works
Barch, D. M., Pagliaccio, D., & Luking, K. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_376 · Cited by 218 · see citing works
Fairness and Cooperation Are Rewarding: Evidence from Social Cognitive Neuroscience
TABIBNIA, G., & LIEBERMAN, M. D. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1412.001 · Cited by 211 · see citing works
Wierenga, C. E., Ely, A., Bischoff-Grethe, A., Bailer, U. F., Simmons, A. N., & Kaye, W. H. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00410 · Cited by 195 · see citing works
The Neurobiology of Reference-Dependent Value Computation
De Martino, B., Kumaran, D., Holt, B., & Dolan, R. J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4832-08.2009 · Cited by 174 · see citing works
Stuber, G. D., Wightman, R. M., & Carelli, R. M. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.036 · Cited by 168 · see citing works
Reinforcement learning and decision making in monkeys during a competitive game
Lee, D., Conroy, M. L., McGreevy, B. P., & Barraclough, D. J. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.07.007 · Cited by 156 · see citing works
Kohls, G., Peltzer, J., Herpertz‐Dahlmann, B., & Konrad, K. (2009) · Developmental Science · doi:10.1111/j.1467-7687.2009.00816.x · Cited by 145 · see citing works
Krebs, R. M., Heipertz, D., Schuetze, H., & Duzel, E. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.038 · Cited by 135 · see citing works
Adding prediction risk to the theory of reward learning
PREUSCHOFF, K., & BOSSAERTS, P. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.005 · Cited by 133 · see citing works
The development of emotion-related neural circuitry in health and psychopathology
Monk, C. S. (2008) · Development and Psychopathology · doi:10.1017/s095457940800059x · Cited by 124 · see citing works
Sexual differentiation of motivation: a novel mechanism?
Becker, J. B. (2009) · Hormones and Behavior · doi:10.1016/j.yhbeh.2009.03.014 · Cited by 115 · see citing works
Adolescent Maturation of Cortical Dopamine
O’Donnell, P. (2010) · Neurotoxicity Research · doi:10.1007/s12640-010-9157-3 · Cited by 107 · see citing works
Altered striatal response to reward in bulimia nervosa after recovery
Wagner, A., Aizenstein, H., Venkatraman, V. K., Bischoff‐Grethe, A., Fudge, J., May, J. C., Frank, G. K., Bailer, U. F., Fischer, L., Putnam, K., et al. (2010) · International Journal of Eating Disorders · doi:10.1002/eat.20699 · Cited by 93 · see citing works
Radulescu, A., Shin, Y. S., & Niv, Y. (2021) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092920-120559 · Cited by 63 · see citing works
A dimensional approach to modeling symptoms of neuropsychiatric disorders in the marmoset monkey
Oikonomidis, L., Santangelo, A. M., Shiba, Y., Clarke, F. H., Robbins, T. W., & Roberts, A. C. (2017) · Developmental Neurobiology · doi:10.1002/dneu.22446 · Cited by 54 · see citing works
Bezzina, G., Body, S., Cheung, T. H. C., Hampson, C. L., Bradshaw, C. M., Szabadi, E., Anderson, I. M., & Deakin, J. F. W. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.03.041 · Cited by 37 · see citing works
Day, N. F., Saxon, D., Robbins, A., Harris, L., Nee, E., Shroff-Mehta, N., Stout, K., Sun, J., Lillie, N., Burns, M., et al. (2019) · Journal of Experimental Biology · doi:10.1242/jeb.191510 · Cited by 27 · see citing works
- Authors
- Schultz, W.
- Affiliations
- University of Cambridge (GB)
- Corresponding author
- Schultz, Wolfram
- ORCID
- Schultz, Wolfram
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2004-04
- Volume
- 14
- Issue
- 2
- Pages
- 139-147
- ISSN
- 0959-4388 (ISSN-L)
- OpenAlex
- W2105808200
- Cited by
- 517
- References
- 67
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 6 · 2023: 3 · 2022: 6 · 2021: 9 · 2020: 16 · 2019: 15 · 2018: 17 · 2017: 12 · 2016: 34 · 2015: 15 · 2014: 24 · 2013: 26 · 2012: 28
- FWCI
- 3.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Current Opinion in Neurobiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust (095495)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- reward coding, reward prediction, dopaminergic neurons, nucleus accumbens, orbitofrontal cortex, amygdala, dorsolateral prefrontal cortex, decision-making, approach behavior, behavioral ecology, game theory, microeconomics, neural correlates of reward
- MeSH terms
- Animals, Behavior, Animal, Brain, Decision Making, Economics, Game Theory, Humans, Learning, Neurons, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review