Choosing the greater of two goods: neural currencies for valuation and decision making
Abstract
To make adaptive decisions, animals must evaluate the costs and benefits of available options. The nascent field of neuroeconomics has set itself the ambitious goal of understanding the brain mechanisms that are responsible for these evaluative processes. A series of recent neurophysiological studies in monkeys has begun to address this challenge using novel methods to manipulate and measure an animal's internal valuation of competing alternatives. By emphasizing the behavioural mechanisms and neural signals that mediate decision making under conditions of uncertainty, these studies might lay the foundation for an emerging neurobiology of choice behaviour.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Actor-critic models operate within the evaluation system.
“Actor-critic models145-147 operate within the evaluation system”
From Resolving the neural circuits of anxiety (2015) · cites this paper as [147]
Dopamine inputs to the striatum push the animal toward obtaining maximum reward, a process that must take into account possible dangers.
“dopamine inputs to the striatum push the animal toward obtaining maximum reward, a process that must take into account possible dangers.”
From Resolving the neural circuits of anxiety (2015) · cites this paper as [147]
Difference in value (DV) is a reliable predictor of participants' choices, with the slope of the logistic regression being a measure of choice accuracy, or noise in the choice process.
“In line with previous studies we show DV is a reliable predictor of participants’ choices2,19 with the slope of the logistic regression being a measure of choice accuracy, or noise in the choice process20.”
From Confidence in value-based choice (2013) · cites this paper as [20]
The signal of target selection is not stereotyped but increases as a function of the relative desirability of alternative options.
“A consistent outcome revealed by these studies (which have been typically carried out in the lateral intraparietal area) is that the signal of target selection is not stereotyped but increases as a function of the relative desirability of the alternative options (Kable and Glimcher, 2009; Sugrue et al., 2005).”
From Attention, learning, and the value of information (2012) · cites this paper as Sugrue et al., 2005
An integrated account of learning and decision formation holds that value representations are maintained in cortical and sensorimotor structures and are dynamically updated based on feedback from dopaminergic cells.
“They suggest an integrated account of learning and decision formation, whereby value representations are maintained in cortical and sensorimotor structures and are dynamically updated based on feedback from dopaminergic cells (Kable and Glimcher, 2009; Sugrue et al., 2005).”
From Attention, learning, and the value of information (2012) · cites this paper as Sugrue et al., 2005
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Equilibrium points in <i>n</i> -person games
Nash, J. F. (1950) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.36.1.48 · Cited by 7,560 · see citing works
Rizzolatti, G., & Craighero, L. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144230 · Cited by 7,433 · see citing works
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127 · see citing works
Deciding advantageously before knowing the advantageous strategy
Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997) · Science · doi:10.1126/science.275.5304.1293 · Cited by 3,547 · see citing works
Olds, J., & Milner, P. (1954) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0058775 · Cited by 3,176 · see citing works
(2000) · doi:10.1017/cbo9780511803475 · Cited by 2,987 · see citing works
A psychomotor stimulant theory of addiction.
Wise, R. A., & Bozarth, M. A. (1987) · Psychological Review · doi:10.1037/0033-295x.94.4.469 · Cited by 2,747 · see citing works
Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex
Funahashi, S., Bruce, C. J., & Goldman-Rakic, P. S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.2.331 · Cited by 2,685 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
Herrnstein, R. J. (1961) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1961.4-267 · Cited by 2,281 · see citing works
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00233-9 · Cited by 1,869 · see citing works
Neural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755 · see citing works
Self-citationNeural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · see citing works
SPACE AND ATTENTION IN PARIETAL CORTEX
Colby, C. L., & Goldberg, M. E. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.319 · Cited by 1,710 · see citing works
The Orbitofrontal Cortex and Reward
Rolls, E. T. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.284 · Cited by 1,595 · see citing works
Roitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 1× · see citing works
“Additional support for this proposal comes from recent demonstrations that the profile of LIP activity in a reaction time version of this task predicts not only what the animal decides, but also when that decision has been reache”
BackgroundRizzolatti, G., & Luppino, G. (2001) · Neuron · doi:10.1016/s0896-6273(01)00423-8 · Cited by 1,356 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Addiction and the brain: The neurobiology of compulsion and its persistence
Hyman, S. E., & Malenka, R. C. (2001) · Nature reviews. Neuroscience · doi:10.1038/35094560 · Cited by 1,297 · see citing works
Intentional Maps in Posterior Parietal Cortex
Andersen, R. A., & Buneo, C. A. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142922 · Cited by 1,294 · see citing works
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291 · see citing works
Gallistel, C. R., & Gibbon, J. (2000) · Psychological Review · doi:10.1037/0033-295x.107.2.289 · Cited by 1,122 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex
Essen, D. C. V., Drury, H. A., Dickson, J., Harwell, J., Hanlon, D., & Anderson, C. H. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080443 · Cited by 1,100 · see citing works
The representation of visual salience in monkey parietal cortex
Gottlieb, J. P., Kusunoki, M., & Goldberg, M. E. (1998) · Nature · doi:10.1038/35135 · Cited by 1,078 · see citing works
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030 · see citing works
Self-citationMemory related motor planning activity in posterior parietal cortex of macaque
Gnadt, J. W., & Andersen, R. A. (1988) · Experimental Brain Research · doi:10.1007/bf00271862 · Cited by 998 · see citing works
Neural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994 · see citing works
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966 · see citing works
Graham, N. (1989) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195051544.001.0001 · Cited by 959 · see citing works
Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque
Kim, J.-N., & Shadlen, M. N. (1999) · Nature Neuroscience · doi:10.1038/5739 · Cited by 950 · see citing works
Neural computations that underlie decisions about sensory stimuli
Gold, J. I., & Shadlen, M. N. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01567-9 · Cited by 881 · see citing works
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855 · see citing works
Neuronal correlates of parametric working memory in the prefrontal cortex
Romo, R., Brody, C. D., Hernández, A., & Lemus, L. (1999) · Nature · doi:10.1038/20939 · Cited by 822 · see citing works
Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention
Bisley, J. W., & Goldberg, M. E. (2003) · Science · doi:10.1126/science.1077395 · Cited by 821 · see citing works
SENSE AND THE SINGLE NEURON: Probing the Physiology of Perception
Parker, A. J., & Newsome, W. T. (1998) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.21.1.227 · Cited by 801 · see citing works
Self-citationKelley, A. E. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.016 · Cited by 773 · see citing works
Iversen, S., & Mishkin, M. (1970) · Experimental Brain Research · doi:10.1007/bf00237911 · Cited by 765 · see citing works
Neuroeconomics: The Consilience of Brain and Decision
Glimcher, P. W., & Rustichini, A. (2004) · Science · doi:10.1126/science.1102566 · Cited by 725 · see citing works
Motion perception: seeing and deciding.
Shadlen, M. N., & Newsome, W. T. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.2.628 · Cited by 723 · see citing works
Self-citationReward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · see citing works
Prefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678 · see citing works
Cognitive Control Signals for Neural Prosthetics
Musallam, S., Corneil, B. D., Greger, B., Scherberger, H., & Andersen, R. A. (2004) · Science · doi:10.1126/science.1097938 · Cited by 663 · see citing works
Expectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 632 · see citing works
Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area
Colby, C. L., Duhamel, J. R., & Goldberg, M. E. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.5.2841 · Cited by 631 · see citing works
Wallis, J. D., & Miller, E. K. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02922.x · Cited by 628 · see citing works
Representation of a perceptual decision in developing oculomotor commands
Gold, J. I., & Shadlen, M. N. (2000) · Nature · doi:10.1038/35006062 · Cited by 616 · see citing works
Performance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581 · see citing works
Flutter Discrimination: neural codes, perception, memory and decision making
Romo, R., & Salinas, E. (2003) · Nature reviews. Neuroscience · doi:10.1038/nrn1058 · Cited by 580 · see citing works
Hyperdopaminergic mutant mice have higher "wanting" but not "liking" for sweet rewards
Peciña, S., Cagniard, B., Berridge, K. C., Aldridge, J. W., & Zhuang, X. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-28-09395.2003 · Cited by 551 · see citing works
Gold, J. I., & Shadlen, M. N. (2002) · Neuron · doi:10.1016/s0896-6273(02)00971-6 · Cited by 547 · see citing works
Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex
Roesch, M. R., & Olson, C. R. (2004) · Science · doi:10.1126/science.1093223 · Cited by 535 · see citing works
Neural basis of deciding, choosing and acting
Schall, J. D. (2001) · Nature reviews. Neuroscience · doi:10.1038/35049054 · Cited by 528 · see citing works
Schultz, W. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.017 · Cited by 517 · see citing works
Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy
Shidara, M., & Richmond, B. J. (2002) · Science · doi:10.1126/science.1069504 · Cited by 515 · see citing works
Leon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449 · see citing works
Functional properties of corticotectal neurons in the monkey's frontal eye field
Segraves, M. A., & Goldberg, M. E. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.58.6.1387 · Cited by 428 · see citing works
Barash, S., Bracewell, R. M., Fogassi, L., Gnadt, J., & Andersen, R. A. (1991) · Journal of Neurophysiology · doi:10.1152/jn.1991.66.3.1095 · Cited by 428 · see citing works
Dorris, M. C., & Glimcher, P. W. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.009 · Cited by 428 · see citing works
A computational substrate for incentive salience
McClure, S. M., Daw, N. D., & Montague, P. R. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00177-2 · Cited by 416 · see citing works
A neural correlate of response bias in monkey caudate nucleus
Lauwereyns, J., Watanabe, K., Coe, B. C., & Hikosaka, O. (2002) · Nature · doi:10.1038/nature00892 · Cited by 415 · see citing works
Neuronal representations of cognitive state: reward or attention?
Maunsell, J. H. R. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.04.003 · Cited by 404 · see citing works
Orbitofrontal cortex neurons: role in olfactory and visual association learning
Rolls, E. T., Critchley, H. D., Mason, R., & Wakeman, E. A. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.5.1970 · Cited by 398 · see citing works
Neuronal correlates of decision-making in secondary somatosensory cortex
Romo, R., Hernández, A., Zainos, A., Lemus, L., & Brody, C. D. (2002) · Nature Neuroscience · doi:10.1038/nn950 · Cited by 387 · see citing works
The Cortical Control of Movement Revisited
Graziano, M. S. A., Taylor, C. S. R., Moore, T., & Cooke, D. F. (2002) · Neuron · doi:10.1016/s0896-6273(02)01003-6 · Cited by 364 · see citing works
Microstimulation of macaque area LIP affects decision-making in a motion discrimination task
Hanks, T. D., Ditterich, J., & Shadlen, M. N. (2006) · Nature Neuroscience · doi:10.1038/nn1683 · Cited by 360 · see citing works
Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation
Garris, P. A., Kilpatrick, M., Bunin, M. A., Michael, D., Walker, Q. D., & Wightman, R. M. (1999) · Nature · doi:10.1038/18019 · Cited by 327 · see citing works
Bee foraging in uncertain environments using predictive hebbian learning
Montague, P. R., Dayan, P., Person, C., & Sejnowski, T. J. (1995) · Nature · doi:10.1038/377725a0 · Cited by 311 · see citing works
Roesch, M. R., & Olson, C. R. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00019.2003 · Cited by 309 · see citing works
The Nash equilibrium: A perspective
Holt, C. A., & Roth, A. E. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0308738101 · Cited by 298 · see citing works
T HE N EUROBIOLOGY OF V ISUAL -S ACCADIC D ECISION M AKING
Glimcher, P. W. (2003) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.26.010302.081134 · Cited by 291 · see citing works
Physiological utility theory and the neuroeconomics of choice
Glimcher, P. W., Dorris, M. C., & Bayer, H. M. (2004) · Games and Economic Behavior · doi:10.1016/j.geb.2004.06.011 · Cited by 283 · see citing works
Dopamine Neurons Can Represent Context-Dependent Prediction Error
Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Neuron · doi:10.1016/s0896-6273(03)00869-9 · Cited by 276 · see citing works
Touch and Go: Decision-Making Mechanisms in Somatosensation
Romo, R., & Salinas, E. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.107 · Cited by 259 · see citing works
OPTIMIZATION AND THE MATCHING LAW AS ACCOUNTS OF INSTRUMENTAL BEHAVIOR
Baum, W. M. (1981) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1981.36-387 · Cited by 249 · see citing works
Influence of Reward Expectation on Visuospatial Processing in Macaque Lateral Prefrontal Cortex
Kobayashi, S., Lauwereyns, J., Koizumi, M., Sakagami, M., & Hikosaka, O. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00472.2001 · Cited by 206 · see citing works
Dickinson, A. (1994) · Animal Learning and Cognition · doi:10.1016/b978-0-08-057169-0.50009-7 · Cited by 200 · see citing works
Saccade Reward Signals in Posterior Cingulate Cortex
McCoy, A. N., Crowley, J. C., Haghighian, G., Dean, H. L., & Platt, M. L. (2003) · Neuron · doi:10.1016/s0896-6273(03)00719-0 · Cited by 193 · see citing works
Neural basis of utility estimation
Shizgal, P. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80008-6 · Cited by 192 · see citing works
Neural aspects of cognitive motor control
Georgopoulos, A. P. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00072-6 · Cited by 192 · see citing works
Horwitz, G. D., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.5.2543 · Cited by 168 · see citing works
Self-citationTremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1877 · Cited by 167 · see citing works
Instrumental responding remains sensitive to reinforcer devaluation after extensive training
Colwill, R., & Rescorla, R. (1985) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.11.4.520 · Cited by 166 · see citing works
Representation of an Abstract Perceptual Decision in Macaque Superior Colliculus
Horwitz, G. D., Batista, A. P., & Newsome, W. T. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00872.2003 · Cited by 151 · see citing works
Self-citationHeyman, G. M. (1979) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1979.31-41 · Cited by 122 · see citing works
Making choices: the neurophysiology of visual-saccadic decision making
Glimcher, P. W. (2001) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01932-9 · Cited by 99 · see citing works
Response fields of intraparietal neurons quantified with multiple saccadic targets
Platt, M. L., & Glimcher, P. W. (1998) · Experimental Brain Research · doi:10.1007/s002210050438 · Cited by 86 · see citing works
Liu, Z., Richmond, B. J., Murray, E. A., Saunders, R. C., Steenrod, S. C., Stubblefield, B. K., Montague, D. M., & Ginns, E. I. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0403639101 · Cited by 77 · see citing works
Exploring the Neurophysiology of Decisions
Leon, M. I., & Shadlen, M. N. (1998) · Neuron · doi:10.1016/s0896-6273(00)80584-x · Cited by 63 · see citing works
Linking reward expectation to behavior in the basal ganglia
Gold, J. I. (2002) · Trends in Neurosciences · doi:10.1016/s0166-2236(02)00002-4 · Cited by 36 · see citing works
ANALYZING THORNDIKE'S LAW OF EFFECT: THE QUESTION OF STIMULUS—RESPONSE BONDS
Nevin, J. A. (1999) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1999.72-447 · Cited by 35 · see citing works
Shadlen, M. N. (2002) · Nature Neuroscience · doi:10.1038/nn0902-819 · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764 · see citing works
The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · see citing works
How brains beware: neural mechanisms of emotional attention
Vuilleumier, P. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.10.011 · Cited by 2,162 · see citing works
A Recurrent Network Mechanism of Time Integration in Perceptual Decisions
Wong, K.-F., & Wang, X.-J. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3733-05.2006 · Cited by 1,029 · see citing works
Liu, X., Hairston, J., Schrier, M., & Fan, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.012 · Cited by 916 · see citing works
Resolving the neural circuits of anxiety
Calhoon, G. G., & Tye, K. M. (2015) · Nature Neuroscience · doi:10.1038/nn.4101 · Cited by 766 · see citing works
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762 · see citing works
Changes of mind in decision-making
Resulaj, A., Kiani, R., Wolpert, D. M., & Shadlen, M. N. (2009) · Nature · doi:10.1038/nature08275 · Cited by 678 · see citing works
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679 · see citing works
“One challenge is thus toelucidate how various dimensions of valuation are represented in the brain (Sugrue et al., 2005; Rushworth and Behrens, 2008).”
BackgroundInfluentialREVIEW: Behavioural assessment of drug reinforcement and addictive features in rodents: an overview
Sanchis‐Segura, C., & Spanagel, R. (2006) · Addiction Biology · doi:10.1111/j.1369-1600.2006.00012.x · Cited by 629 · see citing works
Confidence in value-based choice
De Martino, B., Fleming, S. M., Garrett, N., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3279 · Cited by 534 · see citing works
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · see citing works
An automatic valuation system in the human brain: Evidence from functional neuroimaging
Lebreton, M., Jorge, S., Michel, V., Thirion, B., & Pessiglione, M. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.040 · Cited by 455 · see citing works
Dopamine controls persistence of long-term memory storage
Rossato, J. I., Bevilaqua, L. R. M., Izquierdo, I., Medina, J. H., & Cammarota, M. (2009) · Science · doi:10.1126/science.1172545 · Cited by 486 · see citing works
Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value
Tai, L.-H., Lee, A. M., Benavidez, N., Bonci, A., & Wilbrecht, L. (2012) · Nature Neuroscience · doi:10.1038/nn.3188 · Cited by 399 · see citing works
Neurocomputational mechanisms underlying subjective valuation of effort costs
Chong, T. T.-J., Apps, M., Giehl, K., Sillence, A., Grima, L. L., & Husain, M. (2017) · PLOS Biology · doi:10.1371/journal.pbio.1002598 · Cited by 415 · see citing works
Basal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377 · see citing works
Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., & Rushworth, M. F. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012246107 · Cited by 340 · see citing works
Rewards teach visual selective attention
Chelazzi, L., Perlato, A., Santandrea, E., & Della Libera, C. (2013) · Vision Research · doi:10.1016/j.visres.2012.12.005 · Cited by 354 · see citing works
The Architecture of Reward Value Coding in the Human Orbitofrontal Cortex
Sescousse, G., Redouté, J., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3501-10.2010 · Cited by 353 · see citing works
Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala
Belova, M. A., Paton, J. J., Morrison, S. E., & Salzman, C. D. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.004 · Cited by 349 · see citing works
A computational framework for the study of confidence in humans and animals
Kepecs, A., & Mainen, Z. F. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0037 · Cited by 305 · see citing works
Decision theory: what “should” the nervous system do?
Körding, K. (2007) · Science · doi:10.1126/science.1142998 · Cited by 313 · see citing works
Neural computations underlying action-based decision making in the human brain
Wunderlich, K., Rangel, A., & O'Doherty, J. P. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0901077106 · Cited by 301 · see citing works
Reward value comparison via mutual inhibition in ventromedial prefrontal cortex
Strait, C. E., Blanchard, T. C., & Hayden, B. Y. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.032 · Cited by 294 · see citing works
Hutchinson, J. B., Uncapher, M. R., & Wagner, A. D. (2009) · Learning & Memory · doi:10.1101/lm.919109 · Cited by 277 · see citing works
Attention, learning, and the value of information
Gottlieb, J. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.034 · Cited by 241 · see citing works
“…revealed by these investigations (which have been typically carried out in the lateral intraparietal area) is that the signal of target selection is not stereotyped but increases as a function of the relative desirability of the alternative options (Kable and Glimcher, 2009; Sugrue et al., 2005).”
BackgroundIL-6 knockout mice exhibit resistance to stress-induced development of depression-like behaviors
Chourbaji, S., Urani, A., Inta, I., Sanchis-Segura, C., Brandwein, C., Zink, M., Schwaninger, M., & Gass, P. (2006) · Neurobiology of Disease · doi:10.1016/j.nbd.2006.05.001 · Cited by 241 · see citing works
Hutcherson, C. A., Plassmann, H., Gross, J. J., & Rangel, A. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6387-11.2012 · Cited by 227 · see citing works
Reward modulates attention independently of action value in posterior parietal cortex
Peck, C. J., Jangraw, D. C., Suzuki, M., Efem, R., & Gottlieb, J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1929-09.2009 · Cited by 219 · see citing works
LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS
Corrado, G. S., Sugrue, L. P., Seung, H. S., & Newsome, W. T. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.23-05 · Cited by 206 · see citing works
Self-citationSummerfield, C., & Tsetsos, K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00070 · Cited by 167 · see citing works
Attention, Reward, and Information Seeking
Gottlieb, J., Hayhoe, M., Hikosaka, O., & Rangel, A. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3270-14.2014 · Cited by 168 · see citing works
Choice, difficulty, and confidence in the brain
Rolls, E. T., Grabenhorst, F., & Deco, G. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.073 · Cited by 148 · see citing works
Motor effort alters changes of mind in sensorimotor decision making
Burk, D., Ingram, J. N., Franklin, D. W., Shadlen, M. N., & Wolpert, D. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0092681 · Cited by 117 · see citing works
The primate amygdala combines information about space and value
Peck, C. J., Lau, B., & Salzman, C. D. (2013) · Nature Neuroscience · doi:10.1038/nn.3328 · Cited by 115 · see citing works
The case against economic values in the orbitofrontal cortex (or anywhere else in the brain).
Hayden, B. Y., & Niv, Y. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000448 · Cited by 127 · see citing works
Developmental differences in posterior mesofrontal cortex recruitment by risky rewards
Bjork, J. M., Smith, A. R., Danube, C. L., & Hommer, D. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5469-06.2007 · Cited by 90 · see citing works
Neural mechanism for stochastic behaviour during a competitive game
Soltani, A., Lee, D., & Wang, X.-J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.05.044 · Cited by 77 · see citing works
Fouragnan, E., Queirazza, F., Retzler, C., Mullinger, K. J., & Philiastides, M. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-04507-w · Cited by 61 · see citing works
Pharmacological enhancement of memory or cognition in normal subjects
Lynch, G. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00090 · Cited by 46 · see citing works
A corticoamygdalar pathway controls reward devaluation and depression using dynamic inhibition code
Yuan, Z., Qi, Z., Wang, R., Cui, Y., An, S., Wu, G., Feng, Q., Lin, R., Dai, R., Li, A., et al. (2023) · Neuron · doi:10.1016/j.neuron.2023.08.022 · Cited by 45 · see citing works
Lee, A. M., Tai, L.-H., Zador, A., & Wilbrecht, L. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2014.12.042 · Cited by 37 · see citing works
Comparing brain connections in different species using diffusion weighted imaging
Rushworth, M. F. S., Boorman, E., & Mars, R. B. (2009) · Diffusion MRI · doi:10.1016/b978-0-12-374709-9.00020-1 · Cited by 5 · see citing works
- Authors
- Sugrue, L. P., Corrado, G. S., & Newsome, W. T.
- Affiliations
- Howard Hughes Medical Institute (US)
- Corresponding author
- Sugrue, Leo P.
- Newsome, William T.
- Venue
- Nature Reviews Neuroscience
- Published
- 2005-04-15
- Volume
- 6
- Issue
- 5
- Pages
- 363-375
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W15832198
- Semantic Scholar
- a8fbb09a1f823bdd9498426f48a1af0831310d24
- Cited by
- 536
- References
- 95
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 3 · 2023: 11 · 2022: 14 · 2021: 16 · 2020: 20 · 2019: 41 · 2018: 22 · 2017: 23 · 2016: 18 · 2015: 33 · 2014: 38 · 2013: 31 · 2012: 49
- FWCI
- 5.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- 日本教育心理学会総会発表論文集
- Funders
- Howard Hughes Medical Institute
- Johns Hopkins University
- National Eye Institute
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- valuation, decision-making, neuroeconomics, choice behavior, uncertainty, cost-benefit analysis, neural signals, monkeys
- MeSH terms
- Animals, Choice Behavior, Decision Making, Humans, Nerve Net, Social Values
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
