Neural computations underlying action-based decision making in the human brain
Open accessThe DOI matches its Crossref record; 105 of the 106 references it cites were found in a registry or an index.
Abstract
Action-based decision making involves choices between different physical actions to obtain rewards. To make such decisions the brain needs to assign a value to each action and then compare them to make a choice. Using fMRI in human subjects, we found evidence for action-value signals in supplementary motor cortex. Separate brain regions, most prominently ventromedial prefrontal cortex, were involved in encoding the expected value of the action that was ultimately taken. These findings differentiate two main forms of value signals in the human brain: those relating to the value of each available action, likely reflecting signals that are a precursor of choice, and those corresponding to the expected value of the action that is subsequently chosen, and therefore reflecting the consequence of the decision process. Furthermore, we also found signals in the dorsomedial frontal cortex that resemble the output of a decision comparator, which implicates this region in the computation of the decision itself.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“decisions between reinforcers available at different costs result in elevated levels of activation in the executive system [48, 49].”
From The behavioral economics and neuroeconomics of reinforcer pathologies: implications for etiology and treatment of addiction (2011) · cites this paper as [49]
In the citing paper
“For example, lateral and ventromedial prefrontal cortices, which both encode the value of expected outcomes [67–68, 37] do show reduced activation with extended training [69–70].”
From Cortical and basal ganglia contributions to habit learning and automaticity (2010) · cites this paper as [68]
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900 · cited 1×
“edness inventory (62)] with no history of neurological or psychiatric illness par-”
BackgroundReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 2×
“Reinforcement learning theory stipulates that updating of action values occurs via a prediction error, which computes the difference between actual and expected outcomes (2, 39, 40).”
BackgroundReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Theory of games and economic behavior
(2019) · 100 Years of Math Milestones · doi:10.1090/mbk/121/32 · Cited by 16,632
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“Reinforcement learning theory stipulates that updating of action values occurs via a prediction error, which computes the difference between actual and expected outcomes (2, 39, 40).”
BackgroundTheory of Games and Economic Behavior
Hawkins, D. (1945) · Philosophy of Science · doi:10.1086/286866 · Cited by 3,887
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273 · cited 1×
“An important question is the relationship between our suggested role for dmFC/ACC in the decision comparison process and prior findings implicating this area in error monitoring (35).”
ResultAnterior Cingulate Conflict Monitoring and Adjustments in Control
Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004) · Science · doi:10.1126/science.1089910 · Cited by 2,891 · cited 1×
“Another pertinent issue is the extent to which the activity in dmFC/ACC is related to conflict monitoring, another cognitive function that has been attributed to this area (36).”
BackgroundUnconscious cerebral initiative and the role of conscious will in voluntary action
Libet, B. (1985) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00044903 · Cited by 2,623
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · cited 4×
“The model also assumed that action selection in every trial followed a soft-max probability rule based on the difference of the estimated action values (8).”
BackgroundResultInfluentialSelf-citation
Cited by
Items 101–200 of 303
Time scales of representation in the human brain: weighing past information to predict future events
Harrison, L. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00037 · Cited by 43
Determinants and modulators of human social decisions
Terenzi, D., Liu, L., Bellucci, G., & Park, S. Q. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.06.041 · Cited by 45
“Results showed that a decision to trust a human (but not computer) counterpart recruits the mPFC––a region with a central role in inferences of others’ personality traits (see Section 3) (Derks et al., 2015; Fouragnan et al., 2013; Krueger et al., 2007; McCabe et al., 2003; Wunderlich et al., 2009).”
BackgroundLarsen, T., & O’Doherty, J. P. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0473 · Cited by 52
“These regions have been found to encode value signals for decision options and actions [6–8], as well as signals corresponding to the difference in value between actions and/or options that are ultimately chosen versus those that are not [9–11].”
BackgroundMethodResultInfluentialSelf-citationMapping emotions through time: How affective trajectories inform the language of emotion.
Kirkland, T., & Cunningham, W. A. (2012) · Emotion · doi:10.1037/a0024218 · Cited by 53
Hedging Your Bets by Learning Reward Correlations in the Human Brain
Wunderlich, K., Symmonds, M., Bossaerts, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.07.025 · Cited by 40
“…inputs to the decision process such as action or goal values, and representations of expected outcome after a choice (Hampton et al., 2006; Knutson et al., 2005; Lau and Glimcher, 2007; Padoa-Schioppa and Assad, 2006; Plassmann et al., 2007; Samejima et al., 2005; Wunderlich et al., 2009, 2010).”
Self-citationMechanisms of Choice Behavior Shift Using Cue-approach Training
Bakkour, A., Leuker, C., Hover, A. M., Giles, N., Poldrack, R. A., & Schönberg, T. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00421 · Cited by 45
“It is possible that cue-approach training modulates value signals of possible actions at the supplemental motor area (SMA)/pre-SMA level (Wunderlich et al., 2009), but does not perturb the Go items’ intrinsic value at a higher level.”
BackgroundMethodDopamine Modulates the Neural Representation of Subjective Value of Food in Hungry Subjects
Medic, N., Ziauddeen, H., Vestergaard, M. D., Henning, E., Schultz, W., Farooqi, I. S., & Fletcher, P. C. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2051-14.2014 · Cited by 38
“…in humans and nonhuman primates, including the ventromedial prefrontal cortex (vmPFC), ventral striatum, pos- terior parietal, and supplementary motor cortex (Platt and Glimcher, 1999; Wunderlich et al., 2009; O’Doherty, 2011; Hunt et al., 2012; Bartra et al., 2013; Clithero and Rangel, 2014).”
BackgroundDistinct neurocomputational mechanisms support informational and socially normative conformity
Mahmoodi, A., Nili, H., Bang, D., Mehring, C., & Bahrami, B. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001565 · Cited by 52
Libet’s legacy: A primer to the neuroscience of volition
Dominik, T., Mele, A. R., Schurger, A., & Maoz, U. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105503 · Cited by 55
The human prefrontal cortex mediates integration of potential causes behind observed outcomes
Wunderlich, K., Beierholm, U. R., Bossaerts, P., & O'Doherty, J. P. (2011) · Journal of Neurophysiology · doi:10.1152/jn.01051.2010 · Cited by 37
Self-citationPrefrontal and Striatal Activity Related to Values of Objects and Locations
Kim, S., Cai, X., Hwang, J., & Lee, D. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00108 · Cited by 35
“However, value signals identified in neuroimaging studies were largely related to the values of the reward chosen by the subjects, although some studies demonstrated that the values associated with different types of movements can be localized to different brain areas (Wunderlich et al., 2009).”
BackgroundBorst, J. P., Taatgen, N. A., & van Rijn, H. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.084 · Cited by 33
“This method has proven to be very successful in locating brain areas involved in reinforcement learning (e.g., Daw et al., 2006; Hampton et al., 2006; Haruno and Kawato, 2006; Kim et al., 2006; Wunderlich et al., 2009).”
How initial confirmatory experience potentiates the detrimental influence of bad advice
Staudinger, M. R., & Büchel, C. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.074 · Cited by 42
The neural correlates of beauty comparison
Kedia, G., Mussweiler, T., Mullins, P. G., & Linden, D. E. J. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst026 · Cited by 39
“Abundant literature indeed suggests that the main comparator in the brain for numbers, simple nonsocial magnitudes and rewards is located in a frontoparietal network encompassing the intraparietal sulcus (IPS) and medial prefrontal areas rather than in regions associated with primary reward (Pinel et al., 2001, 2004;…”
BackgroundInfluentialMennella, R., Vilarem, E., & Grèzes, J. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117253 · Cited by 36
Neurons in human pre-supplementary motor area encode key computations for value-based choice
Aquino, T. G., Cockburn, J., Mamelak, A. N., Rutishauser, U., & O’Doherty, J. P. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01548-2 · Cited by 43
Self-citationHarris, A. M., & Lim, S.-L. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.4016-15.2016 · Cited by 38
“With activity correlated with net value (stimulus value minus effort cost) and rich connectivity to motor control systems (Paus, 2001), these areas may contribute to translating cognitive representations of value into specific actions (Wunderlich et al., 2009).”
BackgroundMultiple Systems for the Motivational Control of Behavior and Associated Neural Substrates in Humans
O’Doherty, J. P. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_386 · Cited by 35
Self-citationCognitive-Emotion Interactions
Armony, J. L., & Vuilleumier, P. O. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9780511843716.018 · Cited by 33
The role of supplementary eye field in goal-directed behavior
Stuphorn, V. (2015) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2015.02.002 · Cited by 36
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript value signals are of central importance in selecting an appropriate action during value-based decision-making (Kable and Glimcher, 2009; Rangel et al., 2008; Uchida et al., 2007) and have also been reported in the human SEF and SMA (Wunder…”
BackgroundLudvig, E. A., Bellemare, M. G., & Pearson, K. G. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-021-1.ch006 · Cited by 46
Jacobson, A., Green, E., Haase, L., Szajer, J., & Murphy, C. (2019) · Nutrients · doi:10.3390/nu11040926 · Cited by 32
Grèzes, J., Erblang, M., Vilarem, E., Quiquempoix, M., Beers, P. V., Guillard, M., Sauvet, F., Mennella, R., & Rabat, A. (2021) · SLEEP · doi:10.1093/sleep/zsab186 · Cited by 29
“Decisions between competing targets for action rest upon the valuation and comparison of available options to generate a choice [79, 80]; a mechanism characterized as evidence accumulation.”
Will I Regret It? Anticipated Negative Emotions Modulate Choices in Moral Dilemmas
Pletti, C., Lotto, L., Tasso, A., & Sarlo, M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01918 · Cited by 40
Anggraini, D., Glasauer, S., & Wunderlich, K. (2018) · Scientific Reports · doi:10.1038/s41598-018-28241-z · Cited by 36
Self-citationLiu, Z., Liu, S., Li, S., Li, L., Zheng, L., Weng, X., Guo, X., Lu, Y., Men, W., Gao, J., et al. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab471 · Cited by 30
Multiple brain networks contribute to the acquisition of bias in perceptual decision-making
Chen, M.-Y., Jimura, K., White, C. N., Maddox, W. T., & Poldrack, R. A. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00063 · Cited by 33
Clairis, N., & Pessiglione, M. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1795-21.2022 · Cited by 38
Medial Frontal Cortex Activity Predicts Information Sampling in Economic Choice
Kaanders, P., Nili, H., O'Reilly, J. X., & Hunt, L. (2021) · The Journal of Neuroscience · doi:10.1523/jneurosci.0392-21.2021 · Cited by 27
“…minus that of the chosen option) is highest, and choice difficulty itself has also previously been associated with activity in the MFC BOLD fMRI signal (Grinband et al., 2006; Pochon et al., 2008; Fitzgerald et al., 2009; Wunderlich et al., 2009; Klein-Flugge et al., 2016; Pisauro et al., 2017).”
Semi-orthogonal subspaces for value mediate a binding and generalization trade-off
Johnston, W. J., Fine, J. M., Yoo, S. B. M., Ebitz, R. B., & Hayden, B. Y. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01758-5 · Cited by 40
The human amygdala encodes value and space during decision making
Ousdal, O. T., Specht, K., Server, A., Andreassen, O. A., Dolan, R. J., & Jensen, J. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.07.055 · Cited by 31
“Finally, we note that previous studies have failed to demonstrate an action value signal in the amygdala, at leastwith the spatial selectivity presented here (Croxson et al., 2009; FitzGerald et al., 2012; Wunderlich et al., 2009).”
Veretennikoff, K., Walker, D., Biggs, V., & Robinson, G. A. (2017) · Brain Sciences · doi:10.3390/brainsci7100122 · Cited by 29
“The difficulties in selecting an option were thought to be linked to impaired calculation of a selected action’s value [98], which can lead to an individual choosing more exploitative choices [99].”
BackgroundMinati, L., Grisoli, M., Franceschetti, S., Epifani, F., Granvillano, A., Medford, N., Harrison, N. A., Piacentini, S. H. M. J., & Critchley, H. (2011) · Brain Topography · doi:10.1007/s10548-011-0210-1 · Cited by 31
“…magnitude hkWIN, kLOSEi, our findings inform this question lending support to the view that the BOLD responses in the medial PFC follow the output expected for a comparator operator acting on the positive and negative terms of the value equation (Venkatraman et al. 2009; Wunderlich et al. 2009).”
ResultIto, M., & Doya, K. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004540 · Cited by 34
“estimated information based on the FQ-learning: QL(t) and QR(t), action values estimated by the FQ-learning model with varying parameters [4,5,7,9,11,12,23]; Qc(t) Qa(t)(t), the action value for the selected action (chosen value) [7,23,25]; V(t) PL:Q(t)QL(t) + (1 – PL: Q(t))QR(t), the state value as defined by the ave…”
BackgroundMethodInfluentialBody dynamics of gait affect value-based decisions
Grießbach, E., Incagli, F., Herbort, O., & Cañal‐Bruland, R. (2021) · Scientific Reports · doi:10.1038/s41598-021-91285-1 · Cited by 29
Kobza, S., & Bellebaum, C. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.10.036 · Cited by 24
“On the other hand, many brain regions are involved in processing of outcome PEs for both active and observational learning, with decreased activity of parts of the ‘classical’ reward system in observational as compared to active learning (Bellebaum et al., 2010, 2012; Yu and Zhou, 2006).”
Ventromedial Prefrontal Cortex Tracks Multiple Environmental Variables during Search
Mehta, P. S., Tu, J. C., LoConte, G. A., Pesce, M. C., & Hayden, B. Y. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.2365-18.2019 · Cited by 27
“An important foragingrelated region is the ventromedial PFC (vmPFC), which appears to assign values to available options (Boorman et al., 2009, 2013; Kable and Glimcher, 2009; Wunderlich et al., 2009; Lim et al., 2011; Kolling et al., 2012).”
BackgroundImpaired value-based decision-making in Parkinson’s disease apathy
Gilmour, W., Mackenzie, G. M., Feile, M., Tayler-Grint, L., Suveges, S., Macfarlane, J. A., Macleod, A. D., Marshall, V. L., Grunwald, I. Q., Steele, J. D., et al. (2024) · Brain · doi:10.1093/brain/awae025 · Cited by 26
Integrating fMRI with psychophysiological measurements in the study of decision making.
Wong, S. W. H., Xue, G., & Bechara, A. (2011) · Journal of Neuroscience Psychology and Economics · doi:10.1037/a0023525 · Cited by 25
Bridging across functional models: The OFC as a value-making neural network.
Pessiglione, M., & Daunizeau, J. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000464 · Cited by 26
“Many different combinations of option values have been reported in these situations, with a predominance for the value of the chosen option, which generally happens to also be the option that is most attended and/or that corresponds to prior preference (Hunt et al., 2012; Ian Krajbich et al., 2010; Lopez-Persem et al.…”
BackgroundHierarchical dynamics of informational patterns and decision-making
Varona, P., & Rabinovich, M. I. (2016) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.0475 · Cited by 29
“As we mentioned earlier, the motor cortex is involved in corresponding DM modes and realizes the decision directly (see also [45]).”
BackgroundPletti, C., Sarlo, M., Palomba, D., Rumiati, R., & Lotto, L. (2015) · Brain and Cognition · doi:10.1016/j.bandc.2015.01.004 · Cited by 28
From the Reward Circuit to the Valuation System: How the Brain Motivates Behavior
Pessiglione, M., & Lebreton, M. P. (2014) · Springer eBooks · doi:10.1007/978-1-4939-1236-0_11 · Cited by 28
The Adaptive Markets Hypothesis: An Evolutionary Approach to Understanding Financial System Dynamics
Lo, A. W., & Zhang, R. (2024) · doi:10.1093/oso/9780199681143.001.0001 · Cited by 38
Neural and computational underpinnings of biased confidence in human reinforcement learning
Ting, C.-C., Salem-Garcia, N., Palminteri, S., Engelmann, J. B., & Lebreton, M. P. (2023) · Nature Communications · doi:10.1038/s41467-023-42589-5 · Cited by 27
“This pattern could be consistent with the idea that value comparison is effectuated in these more dorsal prefrontal regions 73 – 76 , and could provide an estimate of the value of control or of information 77,78 .”
The Role of Intelligence in Social Learning
Vostroknutov, A., Polonio, L., & Coricelli, G. (2018) · Scientific Reports · doi:10.1038/s41598-018-25289-9 · Cited by 29
Suriya-Arunroj, L., & Gail, A. (2019) · eLife · doi:10.7554/elife.47581 · Cited by 24
“Stimulus-based (‘perceptual’) and actionbased decisions might involve different brain circuitry (Wunderlich et al., 2009; Camille et al., 2011).”
BackgroundRomantic love, pair-bonding, and the dopaminergic reward system.
Acevedo, B. P., & Aron, A. P. (2013) · American Psychological Association eBooks · doi:10.1037/14250-004 · Cited by 21
Kahnt, T., & Tobler, P. N. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805308-9.00009-9 · Cited by 28
Dual-System Learning Models and Drugs of Abuse
Simon, D. A., & Daw, N. D. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0751-5_5 · Cited by 25
“There is also evidence for representation of state-action values in other areas of the brain, including prefrontal cortex, striatum, and parietal regions (Delgado et al. 2000; Arkadir et al. 2004; Tanaka et al. 2004; Samejima et al. 2005; Plassmann et al. 2007; Tom et al. 2007; Kable and Glimcher 2007; Hare et al. 200…”
BackgroundPettine, W. W., Louie, K., Murray, J. D., & Wang, X. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008791 · Cited by 22
Clairis, N., & Pessiglione, M. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.1176-23.2024 · Cited by 32
Neyedli, H. F., & Welsh, T. N. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00163.2013 · Cited by 21
Klein-Flügge, M. C., Kennerley, S. W., Friston, K. J., & Bestmann, S. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/064105 · Cited by 19
Action selection in multi-effector decision making
Madlon‐Kay, S., Pesaran, B., & Daw, N. D. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.12.001 · Cited by 18
“These considerations may also explain why in the present task we fi nd effector-speci fi c value correlates in medial motor regions (see also Wunderlich et al. (2009)), whereas in Gershman et al. (2009) we found similar effects in the parietal lobe.”
BackgroundMethodResultInfluentialNeural Bases of Performance Monitoring
Ullsperger, M. (2017) · Wiley eBooks · doi:10.1002/9781118920497.ch17 · Cited by 18
Jacobson, A., Green, E., Haase, L., Szajer, J., & Murphy, C. (2017) · Perception · doi:10.1177/0301006616686097 · Cited by 20
Bomyea, J. A., Sweet, A. M., Davey, D. K., Boland, M., Paulus, M. P., Stein, M. B., & Taylor, C. T. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.12.054 · Cited by 19
Value-based decisions involve sequential sampling from memoryPreprint
Bakkour, A., Zylberberg, A., Shadlen, M. N., & Shohamy, D. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/269290 · Cited by 18
Dezfouli, A., Morris, R. W., Ramos, F., Dayan, P., & Balleine, B. W. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/328849 · Cited by 23
The Role of Conscious Attention in Perception: Immanuel Kant, Alonzo Church, and Neuroscience
Burchard, H. G. W. (2010) · Foundations of Science · doi:10.1007/s10699-010-9201-z · Cited by 21
Harlé, K. M., Ho, T. C., Connolly, C. G., Simmons, A. N., & Yang, T. T. (2023) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2023.01.024 · Cited by 22
Eich, T. S., & Smith, E. E. (2011) · Oxford University Press eBooks · doi:10.1093/obo/9780199828340-0015 · Cited by 15
Exploring Feature Dimensions to Learn a New Policy in an Uninformed Reinforcement Learning Task
Choung, O.-H., Lee, S. W., & Jeong, Y. (2017) · Scientific Reports · doi:10.1038/s41598-017-17687-2 · Cited by 14
“We identified signals encoding the participant’s internal value for the choice of a given stimulus in intraparietal sulcus (IPS, [ − 21 − 36 60], 671 voxels, FWE corr. p < 0.05) 1,3,28,29 , which is widely known to encode value signals in motion-related learning processes.”
BackgroundInfluentialKaiser, L. F., Gruendler, T. O. J., Speck, O., Luettgau, L., & Jocham, G. (2021) · Nature Communications · doi:10.1038/s41467-020-20875-w · Cited by 15
Geurts, D. E. M., van den Heuvel, T. J., Huys, Q. J. M., Verkes, R. J., & Cools, R. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.938403 · Cited by 18
“interest, covaries with instrumental action value (O’Doherty, 2004; Valentin et al., 2007; Wunderlich et al., 2009; Smith et al., 2010; Jocham et al., 2011; see for meta-analysis, Chase et al., 2015).”
BackgroundContribution of sensorimotor beta oscillations during value-based action selection
Chen, X., McCarthy, M., & Kwak, Y. (2019) · Behavioural Brain Research · doi:10.1016/j.bbr.2019.111907 · Cited by 16
Cortical alpha activity predicts the confidence in an impending action
Kubanek, J., Hill, N. J., Snyder, L. H., & Schalk, G. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00243 · Cited by 16
“…and Newsome, 2001; Heekeren et al., 2004, 2008; Gold and Shadlen, 2007; Wang, 2008; Andersen and Cui, 2009; Ho et al., 2009; Kable and Glimcher, 2009; Ratcliff et al., 2009; Tosoni et al., 2008; Wunderlich et al., 2009; O’Connell et al., 2012) may reflect a subject’s confidence in their choice.”
BackgroundInfluentialDemanuele, C., Kirsch, P., Esslinger, C., Zink, M., Meyer‐Lindenberg, A., & Durstewitz, D. (2015) · PLoS ONE · doi:10.1371/journal.pone.0135424 · Cited by 17
“The prefrontal cortex (PFC) plays a major role in behavioral organization and decision making [1–3], and both animal work [4–6] and human neuroimaging studies [7,8] have provided evidence for a differential role of the various subdivisions of the PFC in these processes: The dorsolateral prefrontal cortex (DLPFC) is pr…”
BackgroundThe neural correlates of internal and external comparisons: an fMRI study
Wen, X., Xiang, Y., Cant, J. S., Wang, T., Cupchik, G. C., Huang, R., & Mo, L. (2016) · Brain Structure and Function · doi:10.1007/s00429-016-1234-9 · Cited by 14
“Moreover, the IPS is also recruited by other comparison tasks, such as those regarding beverage taste, time and monetary reward (Rao et al. 2001; Hare et al. 2011; Wunderlich et al. 2009).”
BackgroundInfluentialInstrumental Divergence and Goal-Directed Choice
Liljeholm, M. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-812098-9.00002-4 · Cited by 13
Task‐dependent uncertainty modulation of perceptual decisions in the human brain
Li, S., & Yang, F. (2012) · European Journal of Neuroscience · doi:10.1111/ejn.12006 · Cited by 15
“Second, brain areas that are commonly modulated by uncertainty (e.g. the pMFC, DLPFC, and IPS) fit the criteria for ‘comparator’ areas identified in decision-making experiments (Heekeren et al., 2006; Wunderlich et al., 2009; Hare et al., 2011).”
BackgroundBarbasso, L., Tardivo, G., Viassone, M., & Serravalle, F. (2018) · Palgrave studies in cross-disciplinary business research, in association with EuroMed Academy of Business · doi:10.1007/978-3-319-90945-5_2 · Cited by 13
Ludwiczak, A., Jahanshahi, M., & Osman, M. (2014) · Neurodegenerative Disease Management · doi:10.2217/nmt.14.23 · Cited by 13
Aberg, K. C., Doell, K. C., & Schwartz, S. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2016.05.023 · Cited by 12
“Another interpretation of the links between spatial learning biases and hemisphere-specific reinforcement learning mechanisms, as we report here, can be derived from research on multieffector action reinforcement which posits that different actions are learned and associated to the effectors performing them (Daw, 2014…”
InfluentialThe Rostrolateral Prefrontal Cortex Mediates a Preference for High-Agency Environments
Norton, K. G., & Liljeholm, M. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.2463-19.2020 · Cited by 11
“, 2012) or unchosen-chosen (Wunderlich et al., 2009), because we were looking for a predecision signal, reflecting a contrast of available options rather than of decisions and their counterfactuals.”
BackgroundMethodDecomposing the neural pathways in a simple, value-based choice
Koscik, T. R., Man, V. Y., Jahn, A., Lee, C. H., & Cunningham, W. A. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116764 · Cited by 10
Reward and expectancy effects on neural signals of motor preparation and execution
Chen, X., van den Berg, B., & Kwak, Y. (2022) · Cortex · doi:10.1016/j.cortex.2022.01.018 · Cited by 10
Evolutionary Perspectives on Mind, Brain, and Education
Howard‐Jones, P. A. (2014) · Mind Brain and Education · doi:10.1111/mbe.12041 · Cited by 20
Chen, X., & Kwak, Y. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119300 · Cited by 11
“4 computations in the motor cortex (Alamia et al. 2019; Bijleveld et al. 2014; Chen et al. 2019; Gluth et al. 2013; Hare et al. 2011; Kapogiannis et al. 2008; Pastor-Bernier & Cisek 2011; Roesch & Olson 2003; Sul et al. 2011; Wunderlich et al. 2009), modulation of corticospinal excitability by the relevant decision in…”
BackgroundMotor System-Dependent Effects of Amygdala and Ventral Striatum Lesions on Explore–Exploit Behaviors
Giarrocco, F., Costa, V. D., Basile, B. M., Pujara, M. S., Murray, E. A., & Averbeck, B. B. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.1206-23.2023 · Cited by 9
Geurts, D. E. M., von Borries, K., Huys, Q. J. M., Bulten, B. H., Verkes, R., & Cools, R. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.963776 · Cited by 11
“Animal and human studies consistently implicate frontostriatal brain regions in instrumental action, especially the dorsomedial (caudate nucleus) and dorsolateral (putamen) parts of the striatum and the ventromedial regions of the prefrontal cortex (Tricomi et al., 2004; Valentin et al., 2007; Balleine and O’Doherty,…”
BackgroundMethodPütten, A. M. R.-V. D., & Hoefinghoff, J. (2017) · International Journal of Social Robotics · doi:10.1007/s12369-017-0445-4 · Cited by 9
“Humans are able to make future decisions based on received (or expected) rewards [22,23].”
BackgroundHe, Q., Liu, J. L., Eschapasse, L., Zagora, A. K., & Brown, T. I. (2023) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2023.108758 · Cited by 8
The Value of Success: Acquiring Gains, Avoiding Losses, and Simply Being Successful
Mowrer, S. M., Jahn, A., Abduljalil, A., & Cunningham, W. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025307 · Cited by 9
“[20]).”
Colas, J. T., O’Doherty, J. P., & Grafton, S. T. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011950 · Cited by 6
Self-citationSubstantial Heritability Underlies Fairness Norm Adaptation Capability and its Neural Basis
Jin, Y., Zheng, D., Gu, R., Fan, Q., Dietz, M. J., Wang, C., Li, X., Chen, J., Hu, Y., & Zhou, Y. (2024) · Advanced Science · doi:10.1002/advs.202411070 · Cited by 6
The Neural Correlates of Intelligence Comparison
Wen, X., Cant, J. S., Xiang, Y., Huang, R., & Mo, L. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx329 · Cited by 7
Hierarchical Dynamical Model for Multiple Cortical Neural Decoding
Liu, X., Shen, X., Chen, S., Zhang, X., Huang, Y., Wang, Y., & Wang, Y. (2021) · Neural Computation · doi:10.1162/neco_a_01380 · Cited by 7
Tzagarakis, C., West, S. L., & Pellizzer, G. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.679408 · Cited by 6
“, 2019) and is implicated in the selection and control of motor responses (Ikeda et al., 1999; Dum and Strick, 2002; Wunderlich et al., 2009).”
BackgroundMiao, Q., Zhang, G., Yan, W., & Liu, B. (2018) · Neuroscience · doi:10.1016/j.neuroscience.2018.07.030 · Cited by 5
Iyer, E. S., Kairiss, M. A., Liu, A., Otto, A. R., & Bagot, R. C. (2020) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2020.108777 · Cited by 6
The temporal derivative of expected utility: A neural mechanism for dynamic decision-making
Zhang, X., & Joy Hirsch, C. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.08.063 · Cited by 5
“…single unit recordings, where the activity of SMA and motor cortex was enhanced when the primate either anticipated a short delay or experienced a long elapsed delay (Roesch and Olson, 2005; Watanabe, 1986) and similar findings were also reported in a human fMRI study (Wunderlich et al., 2009).”
Pettine, W. W., Louie, K., Murray, J. D., & Wang, X. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.01.28.923649 · Cited by 5
Generalized encoding of the relative subjective value of cognitive effort in dorsal ACC
Crawford, J. L., Brough, R. E., Eisenstein, S. A., Peelle, J. E., & Braver, T. S. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.0367-24.2024 · Cited by 9
The role of attention in multi attribute decision making
Sampson, A. L., Yang, Y.-P., Usher, M., Levy, D. J., Niebur, E., & Stuphorn, V. (2025) · Nature Communications · doi:10.1038/s41467-025-66579-x · Cited by 6
“This suggests a parallel, comparative decision mechanism similar to what has been described in other cortical areas 17,18,20,32 .”
The neural correlates of moral comparison
Wen, X., Xie, J., Cant, J. S., Xiang, Y., Xu, F., Lin, J., Huang, R., & Mo, L. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107662 · Cited by 6
Marmoset monkeys overcome dyadic social dilemmas while avoiding mutual defection
Sánchez-Amaro, A., Burkart, J. M., & Rossano, F. (2021) · Animal Behaviour · doi:10.1016/j.anbehav.2020.12.020 · Cited by 4
Queirazza, F., Steele, J. D., Krishnadas, R., Cavanagh, J., & Philiastides, M. G. (2023) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_02062 · Cited by 5
Computational Neuroscience for Advancing Artificial Intelligence: Models, Methods and Applications
Alonso, E., & Mondragón, E. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-021-1 · Cited by 14
Metadata
- Authors
- Wunderlich, K., Rangel, A., & O'Doherty, J. P.
- Affiliations
- California Institute of Technology (US)
- Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA;
- Corresponding author
- Wunderlich, Klaus
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2009-10-06
- Volume
- 106
- Issue
- 40
- Pages
- 17199-17204
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC2761331
- OpenAlex
- W2117402031
- Cited by
- 301
- References
- 106
- Citations by year
- 2026: 7 · 2025: 12 · 2024: 39 · 2023: 12 · 2022: 10 · 2021: 17 · 2020: 14 · 2019: 10 · 2018: 15 · 2017: 12 · 2016: 19 · 2015: 15 · 2014: 31 · 2013: 22 · 2012: 25
- FWCI
- 10.65
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- CaltechAUTHORS (California Institute of Technology) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- action value, supplementary motor area, ventromedial prefrontal cortex, dorsomedial prefrontal cortex, expected value, reward
- MeSH terms
- Adolescent, Adult, Brain, Brain Mapping, Choice Behavior, Decision Making, Eye Movements, Female, Humans, Magnetic Resonance Imaging, Male, Models, Neurological, Photic Stimulation, Psychomotor Performance, Reward, Task Performance and Analysis, Prefrontal Cortex, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.