Neural computations underlying action-based decision making in the human brain
Open accessThe DOI matches its Crossref record; 105 of the 106 references it cites were found in a registry or an index.
Abstract
Action-based decision making involves choices between different physical actions to obtain rewards. To make such decisions the brain needs to assign a value to each action and then compare them to make a choice. Using fMRI in human subjects, we found evidence for action-value signals in supplementary motor cortex. Separate brain regions, most prominently ventromedial prefrontal cortex, were involved in encoding the expected value of the action that was ultimately taken. These findings differentiate two main forms of value signals in the human brain: those relating to the value of each available action, likely reflecting signals that are a precursor of choice, and those corresponding to the expected value of the action that is subsequently chosen, and therefore reflecting the consequence of the decision process. Furthermore, we also found signals in the dorsomedial frontal cortex that resemble the output of a decision comparator, which implicates this region in the computation of the decision itself.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“decisions between reinforcers available at different costs result in elevated levels of activation in the executive system [48, 49].”
From The behavioral economics and neuroeconomics of reinforcer pathologies: implications for etiology and treatment of addiction (2011) · cites this paper as [49]
In the citing paper
“For example, lateral and ventromedial prefrontal cortices, which both encode the value of expected outcomes [67–68, 37] do show reduced activation with extended training [69–70].”
From Cortical and basal ganglia contributions to habit learning and automaticity (2010) · cites this paper as [68]
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900 · cited 1×
“edness inventory (62)] with no history of neurological or psychiatric illness par-”
BackgroundReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 2×
“Reinforcement learning theory stipulates that updating of action values occurs via a prediction error, which computes the difference between actual and expected outcomes (2, 39, 40).”
BackgroundReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Theory of games and economic behavior
(2019) · 100 Years of Math Milestones · doi:10.1090/mbk/121/32 · Cited by 16,632
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“Reinforcement learning theory stipulates that updating of action values occurs via a prediction error, which computes the difference between actual and expected outcomes (2, 39, 40).”
BackgroundTheory of Games and Economic Behavior
Hawkins, D. (1945) · Philosophy of Science · doi:10.1086/286866 · Cited by 3,887
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273 · cited 1×
“An important question is the relationship between our suggested role for dmFC/ACC in the decision comparison process and prior findings implicating this area in error monitoring (35).”
ResultAnterior Cingulate Conflict Monitoring and Adjustments in Control
Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004) · Science · doi:10.1126/science.1089910 · Cited by 2,891 · cited 1×
“Another pertinent issue is the extent to which the activity in dmFC/ACC is related to conflict monitoring, another cognitive function that has been attributed to this area (36).”
BackgroundUnconscious cerebral initiative and the role of conscious will in voluntary action
Libet, B. (1985) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00044903 · Cited by 2,623
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · cited 4×
“The model also assumed that action selection in every trial followed a soft-max probability rule based on the difference of the estimated action values (8).”
BackgroundResultInfluentialSelf-citationA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · cited 1×
“This raises two fundamental questions in decision neuroscience: (1) where in the brain are the values of different types of actions encoded? and (2) how and where does the brain compare those values to generate a choice? An emerging theme in decision neuroscience is that organisms need to make a number of value-relate…”
BackgroundSelf-citationThe time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Self-citationA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 1×
“Reinforcement learning theory stipulates that updating of action values occurs via a prediction error, which computes the difference between actual and expected outcomes (2, 39, 40).”
BackgroundAbstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Self-citationNeural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755 · cited 1×
“However, it is worth noting that while there is now considerable evidence concerning the applicability of the DDM model to the neural mechanisms underlying decision making in the perceptual domain (56, 57), to our knowledge very little evidence exists regarding the applicability of such a model to value-based decision…”
BackgroundNeural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Dissociation of reward anticipation and outcome with event-related fMRI
Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00016 · Cited by 1,300 · cited 1×
“It is notable that the two signals required to compute a prediction error, namely the actual outcome and the expected outcome (of the chosen action) are both represented in ventromedial prefrontal cortex (8, 9, 41, 42).”
BackgroundYin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226 · cited 1×
“Dorsal striatum has been implicated in both goal-directed and habitual instrumental responding for reward in rodents (29, 30).”
BackgroundEncoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165 · cited 1×
“For example, a number of chosen value signals have been found in the orbital and medial prefrontal cortex (8, 9) and amygdala (10, 11).”
BackgroundSelf-citationThe role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099 · cited 1×
“Dorsal striatum has been implicated in both goal-directed and habitual instrumental responding for reward in rodents (29, 30).”
BackgroundChklovskii, D. (2002) · Neuron · doi:10.1016/s0896-6273(02)00703-1 · Cited by 1,064
Psychology and neurobiology of simple decisions
Smith, P. L., & Ratcliff, R. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.01.006 · Cited by 1,051
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030 · cited 1×
“For similar reasons, the value signals that have been found in lateral intraparietal cortex (LIP) during saccadic actionbased choice (12, 13) are also not pure action values since they are strongly modulated by whether an action is subsequently taken.”
BackgroundOptimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
The neural systems that mediate human perceptual decision making
Heekeren, H. R., Marrett, S., & Ungerleider, L. G. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2374 · Cited by 875 · cited 1×
“(50, 51) [see also (52)] have used fMRI to look for regions that might be involved in computing perceptual decisions.”
BackgroundOrbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855
Self-citationShadlen, M., Britten, K., Newsome, W., & Movshon, J. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-04-01486.1996 · Cited by 824 · cited 1×
“However, it is worth noting that while there is now considerable evidence concerning the applicability of the DDM model to the neural mechanisms underlying decision making in the perceptual domain (56, 57), to our knowledge very little evidence exists regarding the applicability of such a model to value-based decision…”
BackgroundCorticocortical connections of area F3 (SMA‐proper) and area F6 (pre‐SMA) in the macaque monkey
Luppino, G., Matelli, M., Camarda, R., & Rizzolatti, G. (1993) · Journal of Comparative Neurology · doi:10.1002/cne.903380109 · Cited by 798
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792
Self-citationReward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684
Prefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 650 · cited 1×
“Another study suggests that this region plays a part in processing the reward information for motor selection (48).”
BackgroundThompson, K. G., Hanes, D. P., Bichot, N. P., & Schall, J. D. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.6.4040 · Cited by 617
O'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611
Self-citationEvidence for a supplementary eye field
Schlag, J., & Schlag-Rey, M. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.179 · Cited by 602
Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597 · cited 1×
“Therefore this region is ideally placed to facilitate computation of the prediction error signal that could then be transferred on to dopaminergic neurons in the midbrain for subsequent broadcast (43, 44).”
BackgroundModulation of Caudate Activity by Action Contingency
Tricomi, E. M., Delgado, M. R., & Fiez, J. A. (2004) · Neuron · doi:10.1016/s0896-6273(03)00848-1 · Cited by 574
Luppino, G., Matelli, M., Camarda, R. M., Gallese, V., & Rizzolatti, G. (1991) · Journal of Comparative Neurology · doi:10.1002/cne.903110403 · Cited by 544
Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex
Roesch, M. R., & Olson, C. R. (2004) · Science · doi:10.1126/science.1093223 · Cited by 542
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536 · cited 1×
“For similar reasons, the value signals that have been found in lateral intraparietal cortex (LIP) during saccadic actionbased choice (12, 13) are also not pure action values since they are strongly modulated by whether an action is subsequently taken.”
BackgroundAnterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy
Shidara, M., & Richmond, B. J. (2002) · Science · doi:10.1126/science.1069504 · Cited by 518
Matsuzaka, Y., Aizawa, H., & Tanji, J. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.653 · Cited by 500
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · cited 3×
“It is notable that the two signals required to compute a prediction error, namely the actual outcome and the expected outcome (of the chosen action) are both represented in ventromedial prefrontal cortex (8, 9, 41, 42).”
BackgroundResultSelf-citationFries, W. (1984) · Journal of Comparative Neurology · doi:10.1002/cne.902300106 · Cited by 475
Interactions between decision making and performance monitoring within prefrontal cortex
Walton, M. E., Devlin, J. T., & Rushworth, M. F. S. (2004) · Nature Neuroscience · doi:10.1038/nn1339 · Cited by 438 · cited 2×
“ACC has been previously implicated in action-based choice, both in the context of a human imaging study reporting activity in this area during a task involving choices between different actions compared to a situation involving responses guided by instruction (27), and in a monkey lesion study where ACC lesions produc…”
BackgroundMuscle representation in the macaque motor cortex: An anatomical perspective
Rathelot, J.-A., & Strick, P. L. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0602933103 · Cited by 430 · cited 1×
“This finding supports the hypothesis that during decisions involving motor actions, action-value signals are encoded in brain regions directly connected with, and involved in, the generation of motor output (38).”
ResultNeuronal representations of cognitive state: reward or attention?
Maunsell, J. H. R. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.04.003 · Cited by 404
Performance monitoring by the supplementary eye field
Stuphorn, V., Taylor, T. L., & Schall, J. D. (2000) · Nature · doi:10.1038/35048576 · Cited by 392
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · cited 1×
“These findings provide evidence that values of different types of movement might be represented separately within vmPFC, adding further support to the suggestion that this region plays a role in encoding the value of chosen actions as well as possibly contributing to encoding stimulusvalues (45).”
BackgroundSelf-citationNeuronal correlates of goal-based motor selection in the prefrontal cortex.
Matsumoto, K., Suzuki, W., & Tanaka, K. (2003) · Science · doi:10.1126/science.1084204 · Cited by 384 · cited 1×
“Interestingly, this area has been previously implicated in action-based choice: in the context of a human neuroimaging study reporting activity in this area during a task involving choices between different actions compared to a situation involving responses guided by instruction (27) and single neuron recordings have…”
BackgroundHeekeren, H. R., Marrett, S., Ruff, D. A., Bandettini, P. A., & Ungerleider, L. G. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0603949103 · Cited by 374 · cited 1×
“(50, 51) [see also (52)] have used fMRI to look for regions that might be involved in computing perceptual decisions.”
BackgroundEffects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum
Cromwell, H. C., & Schultz, W. (2003) · Journal of Neurophysiology · doi:10.1152/jn.01014.2002 · Cited by 362
To Do or Not to Do: The Neural Signature of Self-Control
Brass, M., & Haggard, P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0924-07.2007 · Cited by 359 · cited 1×
“Interestingly, our activation pattern looks very similar to one found in a study of volitional motor inhibition (58).”
ResultParthasarathy, H., Schall, J., & Graybiel, A. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-11-04468.1992 · Cited by 353
Shima, K., & Tanji, J. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.4.2148 · Cited by 351
Hikosaka, K. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.263 · Cited by 345
Neuronal Correlates of a Perceptual Decision in Ventral Premotor Cortex
Romo, R., Hernández, A., & Zainos, A. (2004) · Neuron · doi:10.1016/s0896-6273(03)00817-1 · Cited by 340
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · cited 4×
“Consistent with our findings, Seo and Lee (22) found neural signals resembling the difference between action values in this region.”
BackgroundResultInfluentialHuman Medial Frontal Cortex Mediates Unconscious Inhibition of Voluntary Action
Sumner, P., Nachev, P., Morris, P., Peters, A. M., Jackson, S. R., Kennard, C., & Husain, M. (2007) · Neuron · doi:10.1016/j.neuron.2007.05.016 · Cited by 309 · cited 1×
“Although we cannot distinguish between excitatory and inhibitory processes based on the measured BOLD (59), our hypothesis resonates with previous findings that preinnervation and inhibition play an important role in motor execution and volitional action initiation (60, 61).”
ResultRoesch, M. R., & Olson, C. R. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00019.2003 · Cited by 306
The Human Brain: Surface, Blood Supply, and Three-Dimensional Sectional Anatomy
Preul, M. C. (2001) · Neurosurgery · doi:10.1097/00006123-200104000-00067 · Cited by 305
Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., & Kawato, M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3417-03.2004 · Cited by 300
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294
The somatotopic organization of the supplementary motor area: intracortical microstimulation mapping
Mitz, A., & Wise, S. (1987) · The Journal of Neuroscience · doi:10.1523/jneurosci.07-04-01010.1987 · Cited by 292
Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1864 · Cited by 285
Gold, J. I., & Shadlen, M. N. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-02-00632.2003 · Cited by 281 · cited 1×
“For example, two studies (25, 26) have found monkey medial premotor cortex involved in the entire discrimination process between haptic stimuli, and the findings of another study (24) suggest that formation of the decision and formation of the behavioral response share a common level of neural organization.”
ResultModifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Tremblay, L., Hollerman, J. R., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.964 · Cited by 268
Neuronal Activity in Medial Frontal Cortex During Learning of Sequential Procedures
Nakamura, K., Sakai, K., & Hikosaka, O. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.5.2671 · Cited by 262
Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum
Hassani, O. K., Cromwell, H. C., & Schultz, W. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.6.2477 · Cited by 257
Temporal Evolution of a Decision-Making Process in Medial Premotor Cortex
Hernández, A., Zainos, A., & Romo, R. (2002) · Neuron · doi:10.1016/s0896-6273(02)00613-x · Cited by 257
Chen, L. L., & Wise, S. P. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.3.1101 · Cited by 249
Posterior Parietal Cortex Encodes Autonomously Selected Motor Plans
Cui, H., & Andersen, R. A. (2007) · Neuron · doi:10.1016/j.neuron.2007.09.031 · Cited by 240 · cited 1×
“In addition to a whole brain screening for the presence of action-value signals, we specifically looked for them in areas known to be involved in the planning of motor actions, including supplementary motor cortex (18–21) and lateral parietal cortex (22, 23).”
BackgroundReward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus
Ikeda, T., & Hikosaka, O. (2003) · Neuron · doi:10.1016/s0896-6273(03)00464-1 · Cited by 233
Hanes, D., Thompson, K., & Schall, J. (1995) · Experimental Brain Research · doi:10.1007/bf00241967 · Cited by 223
Willed action and attention to the selection of action
Lau, H. C., Rogers, R. D., Ramnani, N., & Passingham, R. E. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.10.034 · Cited by 219
Influence of Reward Expectation on Visuospatial Processing in Macaque Lateral Prefrontal Cortex
Kobayashi, S., Lauwereyns, J., Koizumi, M., Sakagami, M., & Hikosaka, O. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00472.2001 · Cited by 206
The Anterior Cingulate and Reward-Guided Selection of Actions
Hadland, K. A., Rushworth, M. F. S., Gaffan, D., & Passingham, R. E. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00634.2002 · Cited by 202 · cited 1×
“In addition, ACC lesions have been shown to produce an impairment in action outcome-based choice, but not in mediating changes in responses following errors (28, 49).”
BackgroundThe functions of the medial premotor cortex: I. Simple learned movements
Thaler, D., Chen, Y.-C., Nixon, P. D., Stern, C. E., & Passingham, R. E. (1995) · Experimental Brain Research · doi:10.1007/bf00230649 · Cited by 193
Hoshi, E., & Tanji, J. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00547.2004 · Cited by 184 · cited 1×
“We found neural correlates for action values in supplementary motor cortex, an area traditionally associated with motor planning (37).”
BackgroundAction and Outcome Encoding in the Primate Caudate Nucleus
Lau, B., & Glimcher, P. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3060-07.2007 · Cited by 177
Computational Models of Decision Making
Busemeyer, J. R., & Johnson, J. G. (2004) · Blackwell Handbook of Judgment and Decision Making · doi:10.1002/9780470752937.ch7 · Cited by 147
Dynamic Signals Related to Choices and Outcomes in the Dorsolateral Prefrontal Cortex
Seo, H., Barraclough, D. J., & Lee, D. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm064 · Cited by 143
Matsuzaka, Y., & Tanji, J. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.4.2327 · Cited by 142
Foot, Hand, Face and Eye Representation in the Human Striatum
Gerardin, E. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.2.162 · Cited by 140 · cited 1×
“The apparent topographical arrangement of action modality specific value signals within vmPFC may relate to distinct cortico-striatal loops concerned with processing hand and eye movements (46).”
BackgroundReward-Predicting and Reward-Detecting Neuronal Activity in the Primate Supplementary Eye Field
Amador, N., Schlag-Rey, M., & Schlag, J. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.4.2166 · Cited by 128
Conditional task-related responses in monkey dorsomedial frontal cortex
Mann, S., Thau, R., & Schiller, P. H. (1988) · Experimental Brain Research · doi:10.1007/bf00247300 · Cited by 128
Russo, G. S., & Bruce, C. J. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.69.3.800 · Cited by 119
Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus
Watanabe, K., Lauwereyns, J., & Hikosaka, O. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-31-10052.2003 · Cited by 118
Fujii, N., Mushiake, H., & Tanji, J. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00867.2001 · Cited by 117 · cited 1×
“This design allowed us to exploit the fact that different regions of the cortex are involved in the planning of eye and hand movements (17).”
BackgroundUnit activity related to spontaneous saccades in frontal dorsomedial cortex of monkey
Schlag, J., & Schlag-Rey, M. (1985) · Experimental Brain Research · doi:10.1007/bf00238971 · Cited by 110
Schall, J. D., Morel, A., & Kaas, J. H. (1993) · Visual Neuroscience · doi:10.1017/s0952523800003771 · Cited by 105
The ins and outs of fMRI signals
Logothetis, N. K. (2007) · Nature Neuroscience · doi:10.1038/nn1007-1230 · Cited by 97
Mazzoni, P., Andersen, R. A., & Jordan, M. I. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.4.293 · Cited by 82
A general mechanism for decision-making in the human brain?
Rorie, A. E., & Newsome, W. T. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.12.007 · Cited by 80 · cited 1×
“(50, 51) [see also (52)] have used fMRI to look for regions that might be involved in computing perceptual decisions.”
BackgroundAmygdalar Recruitment during Anticipation of Monetary Rewards: An Event‐Related fMRI Study
Hommer, D. W., Knutson, B. D., Fong, G., Bennett, S. M., ADAMS, C. M., & VARNERA, J. L. (2003) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2003.tb07103.x · Cited by 74 · cited 1×
“For example, a number of chosen value signals have been found in the orbital and medial prefrontal cortex (8, 9) and amygdala (10, 11).”
BackgroundSupplementary Motor Area Encodes Reward Expectancy in Eye-Movement Tasks
Campos, M., Breznen, B., Bernheim, K., & Andersen, R. A. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00022.2005 · Cited by 59
Reversible inactivation of macaque dorsomedial frontal cortex: effects on saccades and fixations
Sommer, M. A., & Tehovnik, E. J. (1999) · Experimental Brain Research · doi:10.1007/s002210050639 · Cited by 53
Microstimulation of the supplementary eye field during saccade preparation
Fujii, N., Mushiake, H., Tamai, M., & Tanji, J. (1995) · Neuroreport · doi:10.1097/00001756-199512150-00028 · Cited by 38
Tehovnik, E. J., & Sommer, M. A. (1996) · Brain Research · doi:10.1016/0006-8993(96)00475-1 · Cited by 14
Action value in the striatum and reinforcement-learning model of cortico-basal ganglia network
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2007) · Neuroscience Research · doi:10.1016/j.neures.2007.06.127 · Cited by 2
Cited by
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
“…in dACC was found to closely track the extent to which the mean value of the alternative options was greater than that of the current options, and to correlate with the decision to switch option sets in such cases (see also Boorman et al., 2013; Rushworth et al., 2012;Wunderlich et al., 2009).”
Value, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766
Informatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706
Self-citationNeurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 546
Metadata
- Authors
- Wunderlich, K., Rangel, A., & O'Doherty, J. P.
- Affiliations
- California Institute of Technology (US)
- Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA;
- Corresponding author
- Wunderlich, Klaus
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2009-10-06
- Volume
- 106
- Issue
- 40
- Pages
- 17199-17204
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC2761331
- OpenAlex
- W2117402031
- Cited by
- 301
- References
- 106
- Citations by year
- 2026: 7 · 2025: 12 · 2024: 39 · 2023: 12 · 2022: 10 · 2021: 17 · 2020: 14 · 2019: 10 · 2018: 15 · 2017: 12 · 2016: 19 · 2015: 15 · 2014: 31 · 2013: 22 · 2012: 25
- FWCI
- 10.65
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- CaltechAUTHORS (California Institute of Technology) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- action value, supplementary motor area, ventromedial prefrontal cortex, dorsomedial prefrontal cortex, expected value, reward
- MeSH terms
- Adolescent, Adult, Brain, Brain Mapping, Choice Behavior, Decision Making, Eye Movements, Female, Humans, Magnetic Resonance Imaging, Male, Models, Neurological, Photic Stimulation, Psychomotor Performance, Reward, Task Performance and Analysis, Prefrontal Cortex, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.