Neural computations underlying action-based decision making in the human brain
Open accessThe DOI matches its Crossref record; 105 of the 106 references it cites were found in a registry or an index.
Abstract
Action-based decision making involves choices between different physical actions to obtain rewards. To make such decisions the brain needs to assign a value to each action and then compare them to make a choice. Using fMRI in human subjects, we found evidence for action-value signals in supplementary motor cortex. Separate brain regions, most prominently ventromedial prefrontal cortex, were involved in encoding the expected value of the action that was ultimately taken. These findings differentiate two main forms of value signals in the human brain: those relating to the value of each available action, likely reflecting signals that are a precursor of choice, and those corresponding to the expected value of the action that is subsequently chosen, and therefore reflecting the consequence of the decision process. Furthermore, we also found signals in the dorsomedial frontal cortex that resemble the output of a decision comparator, which implicates this region in the computation of the decision itself.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“decisions between reinforcers available at different costs result in elevated levels of activation in the executive system [48, 49].”
From The behavioral economics and neuroeconomics of reinforcer pathologies: implications for etiology and treatment of addiction (2011) · cites this paper as [49]
In the citing paper
“For example, lateral and ventromedial prefrontal cortices, which both encode the value of expected outcomes [67–68, 37] do show reduced activation with extended training [69–70].”
From Cortical and basal ganglia contributions to habit learning and automaticity (2010) · cites this paper as [68]
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900 · cited 1×
“edness inventory (62)] with no history of neurological or psychiatric illness par-”
BackgroundReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 2×
“Reinforcement learning theory stipulates that updating of action values occurs via a prediction error, which computes the difference between actual and expected outcomes (2, 39, 40).”
BackgroundReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Theory of games and economic behavior
(2019) · 100 Years of Math Milestones · doi:10.1090/mbk/121/32 · Cited by 16,632
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“Reinforcement learning theory stipulates that updating of action values occurs via a prediction error, which computes the difference between actual and expected outcomes (2, 39, 40).”
BackgroundTheory of Games and Economic Behavior
Hawkins, D. (1945) · Philosophy of Science · doi:10.1086/286866 · Cited by 3,887
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273 · cited 1×
“An important question is the relationship between our suggested role for dmFC/ACC in the decision comparison process and prior findings implicating this area in error monitoring (35).”
ResultAnterior Cingulate Conflict Monitoring and Adjustments in Control
Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004) · Science · doi:10.1126/science.1089910 · Cited by 2,891 · cited 1×
“Another pertinent issue is the extent to which the activity in dmFC/ACC is related to conflict monitoring, another cognitive function that has been attributed to this area (36).”
BackgroundUnconscious cerebral initiative and the role of conscious will in voluntary action
Libet, B. (1985) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00044903 · Cited by 2,623
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · cited 4×
“The model also assumed that action selection in every trial followed a soft-max probability rule based on the difference of the estimated action values (8).”
BackgroundResultInfluentialSelf-citation
Cited by
Items 301–303 of 303
The role of consciousness in self-initiated action initiation
Dominik, T., Schurger, A., & Maoz, U. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-29258-3.00026-4
Anterior cingulate cortex : contributions to social cognition
Apps, M. A. J. (2012) · Royal Holloway Digital Repository (Royal Holloway University of London)
Neuronal mechanisms of the adaptation of conditional visuomotor behavior
Westendorff, S. (2011) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-3311
Metadata
- Authors
- Wunderlich, K., Rangel, A., & O'Doherty, J. P.
- Affiliations
- California Institute of Technology (US)
- Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA;
- Corresponding author
- Wunderlich, Klaus
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2009-10-06
- Volume
- 106
- Issue
- 40
- Pages
- 17199-17204
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC2761331
- OpenAlex
- W2117402031
- Cited by
- 301
- References
- 106
- Citations by year
- 2026: 7 · 2025: 12 · 2024: 39 · 2023: 12 · 2022: 10 · 2021: 17 · 2020: 14 · 2019: 10 · 2018: 15 · 2017: 12 · 2016: 19 · 2015: 15 · 2014: 31 · 2013: 22 · 2012: 25
- FWCI
- 10.65
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- CaltechAUTHORS (California Institute of Technology) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- action value, supplementary motor area, ventromedial prefrontal cortex, dorsomedial prefrontal cortex, expected value, reward
- MeSH terms
- Adolescent, Adult, Brain, Brain Mapping, Choice Behavior, Decision Making, Eye Movements, Female, Humans, Magnetic Resonance Imaging, Male, Models, Neurological, Photic Stimulation, Psychomotor Performance, Reward, Task Performance and Analysis, Prefrontal Cortex, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.