Neural computations associated with goal-directed choice

Rangel, Antonio; Hare, Todd

doi:10.1016/j.conb.2010.03.001

Cited by 532Neural and Behavioral Psychology StudiesNeurotransmitter Receptor Influence on BehaviorDecision-Making and Behavioral Economics

Neural computations associated with goal-directed choice

Rangel, Antonio, Hare, Todd·2010·Current Opinion in Neurobiology

DOI 10.1016/j.conb.2010.03.001

Open this paper in CoChat — free account

Abstract

In goal-directed decision-making, animals choose between actions that are associated with different reward outcomes (e.g., foods) and with different costs (e.g., effort). Rapid advances have been made over the past few years in our understanding of the computations associated with goal-directed choices, and of how those computations are implemented in the brain. We review some important findings, with an emphasis on computational models, human fMRI, and monkey neurophysiology studies.

Integrity signals

Registry

Crossref · 10.1016/j.conb.2010.03.001

Cites

80 of 80 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The periaqueductal gray sends monosynaptic reciprocal projections to ventromedial prefrontal cortex and to anterior mid-cingulate cortex, orbitofrontal cortex, and other areas involved in action value and defensive behavior.
“It also sends monosynaptic, reciprocal projections to the vmPFC—which is essential for value updating in the RL framework and likely for behavioral choice as well31—and to aMCC32, OFC and other areas involved in determining action value and coordinating defensive behavior18,33.”
From Representation of aversive prediction errors in the human periaqueductal gray (2014) · cites this paper as [31]
Ventromedial prefrontal cortex (VMPFC) plays a critical role in the computation of value both at decision and outcome.
“the ventromedial prefrontal cortex (VMPFC) plays a critical role in the computation of value both at decision and outcome (Rangel and Hare, 2010;Padoa-Schioppa, 2011;Levy and Glimcher, 2012).”
From Informatic parcellation of the network involved in the computation of subjective value (2014) · cites this paper as Rangel and Hare, 2010
Prior work has established that the ventromedial prefrontal cortex (vmPFC) plays a central role in computing the value of potential choice options, with activity in this region reflecting the dynamic evolution of a value comparison.
“Prior work has established that the ventromedial prefrontal cortex (vmPFC) plays a central role in computing the value of potential choice options1-5, with activity in this region reflecting the dynamic evolution of a value comparison6.”
From Confidence in value-based choice (2013) · cites this paper as [1]
The striatum signals not only the presence or absence of a reward, but also the value of the reward.
“That is, the striatum (along with other components of the reward system such as ventromedial prefrontal cortex discussed elsewhere 31) signals not only the presence or absence of a reward, but also the value of the reward.”
From The social brain and reward: Social information processing in the human striatum (2014) · cites this paper as [31]

Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524 · see citing works
Prospect theory: An analysis of decision under risk
Kahneman, D. J., & Tversky, A. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609220.014 · Cited by 32,700 · see citing works
A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · see citing works
The Organization of Networks within the Orbital and Medial Prefrontal Cortex of Rats, Monkeys and Humans
Ongur, D. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.206 · Cited by 2,627 · see citing works
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
Mink, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,478 · see citing works
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · see citing works
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · see citing works
Self-citation
The time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152 · see citing works
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
Self-Control in Decision-Making Involves Modulation of the vmPFC Valuation System
Hare, T. A., Camerer, C. F., & Rangel, A. (2009) · Science · doi:10.1126/science.1168450 · Cited by 1,928 · see citing works
Self-citation
The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916 · see citing works
The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks.
Bogacz, R., Brown, E., Moehlis, J., Holmes, P. J., & Cohen, J. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.700 · Cited by 1,845 · see citing works
The neural basis of loss aversion in decision-making under risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007) · Science · doi:10.1126/science.1134239 · Cited by 1,733 · see citing works
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · see citing works
Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task
Roitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 2× · see citing works
“(d) Continuous version of the Newsome–Shadlen perceptual discrimination task in which a subset of otherwise randomly moving dots move coherently in some direction.”
Method
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · see citing works
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457 · see citing works
Probabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242 · see citing works
A Comparison of Sequential Sampling Models for Two-Choice Reaction Time.
Ratcliff, R., & Smith, P. L. (2004) · Psychological Review · doi:10.1037/0033-295x.111.2.333 · Cited by 1,227 · see citing works
The basal ganglia: a vertebrate solution to the selection problem?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00319-4 · Cited by 1,199 · see citing works
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Psychology and neurobiology of simple decisions
Smith, P. L., & Ratcliff, R. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.01.006 · Cited by 1,051 · see citing works
Diminishing reciprocal fairness by disrupting the right prefrontal cortex
Knoch, D., Pascual-Leone, A., Meyer, K., Treyer, V., & Fehr, E. (2006) · Science · doi:10.1126/science.1129156 · Cited by 1,024 · see citing works
Neuroeconomics: decision making and the brain
(2014) · Choice Reviews Online · doi:10.5860/choice.51-5702 · Cited by 1,020 · see citing works
Architectonic subdivision of the human orbital and medial prefrontal cortex
Öngür, D., Ferry, A. T., & Price, J. L. (2003) · Journal of Comparative Neurology · doi:10.1002/cne.10609 · Cited by 944 · see citing works
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · see citing works
Choice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866 · see citing works
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855 · see citing works
Self-citation
Neural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809 · see citing works
Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792 · see citing works
Self-citation
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679 · see citing works
Decision-making with multiple alternatives
Churchland, A. K., Kiani, R., & Shadlen, M. N. (2008) · Nature Neuroscience · doi:10.1038/nn.2123 · Cited by 671 · see citing works
Neuroeconomics: Decision Making and the Brain
Rushworth, M. F. S., & Walton, M. E. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.005 · Cited by 669 · see citing works
The basal ganglia: learning new tricks and loving it
Graybiel, A. M. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.10.006 · Cited by 650 · see citing works
Probabilistic population codes for Bayesian decision making
Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., & Pouget, A. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.021 · Cited by 645 · see citing works
Evidence for a Common Representation of Decision Values for Dissimilar Goods in Human Ventromedial Prefrontal Cortex
Chib, V. S., Rangel, A., Shimojo, S., & O'Doherty, J. P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2575-09.2009 · Cited by 643 · see citing works
Self-citation
Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task
Wallis, J. D., & Miller, E. K. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02922.x · Cited by 628 · see citing works
Effort-Based Cost–Benefit Valuation and the Human Brain
Croxson, P. L., Walton, M. E., O'Reilly, J. X., Behrens, T. E. J., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4515-08.2009 · Cited by 560 · see citing works
Determining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529 · see citing works
Value computations in ventral medial prefrontal cortex during charitable decision making incorporate input from regions involved in social cognition
Hare, T. A., Camerer, C. F., Knoepfle, D. T., O'Doherty, J. P., & Rangel, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4089-09.2010 · Cited by 527 · see citing works
Self-citation
Decisions in Changing Conditions: The Urgency-Gating Model
Cisek, P., Puskas, G. A., & El-Murr, S. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1844-09.2009 · Cited by 521 · see citing works
Disruption of Right Prefrontal Cortex by Low-Frequency Repetitive Transcranial Magnetic Stimulation Induces Risk-Taking Behavior
Knoch, D., Gianotti, L. R. R., Pascual-Leone, A., Treyer, V., Regard, M., Hohmann, M., & Brugger, P. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.0804-06.2006 · Cited by 517 · see citing works
Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks
Lo, C.-C., & Wang, X.-J. (2006) · Nature Neuroscience · doi:10.1038/nn1722 · Cited by 505 · see citing works
The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · see citing works
Neural Representation of Subjective Value Under Risk and Ambiguity
Levy, I., Snell, J., Nelson, A. J., Rustichini, A., & Glimcher, P. W. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00853.2009 · Cited by 491 · see citing works
Neurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · see citing works
The Basal Ganglia and Cortex Implement Optimal Decision Making Between Alternative Actions
Bogacz, R., & GURNEY, K. N. (2007) · Neural Computation · doi:10.1162/neco.2007.19.2.442 · Cited by 417 · see citing works
Value Representations in the Primate Striatum during Matching Behavior
Lau, B., & Glimcher, P. W. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.021 · Cited by 411 · see citing works
The representation of economic value in the orbitofrontal cortex is invariant for changes of menu
Padoa‐Schioppa, C., & Assad, J. A. (2007) · Nature Neuroscience · doi:10.1038/nn2020 · Cited by 390 · see citing works
The misbehavior of value and the discipline of the will
Dayan, P., Niv, Y., Seymour, B., & Daw, N. D. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.002 · Cited by 389 · see citing works
Optimal decision-making theories: linking neurobiology with behaviour
Bogacz, R. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.12.006 · Cited by 367 · see citing works
Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making
Plassmann, H., O'Doherty, J. P., & Rangel, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0788-10.2010 · Cited by 356 · see citing works
Self-citation
Frontal cortex subregions play distinct roles in choices between actions and stimuli
Rudebeck, P. H., Behrens, T. E., Kennerley, S. W., Baxter, M. G., Buckley, M. J., Walton, M. E., & Rushworth, M. F. S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3541-08.2008 · Cited by 350 · see citing works
Integrated neural processes for defining potential actions and deciding between them: a computational model
Cisek, P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.5605-05.2006 · Cited by 344 · see citing works
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326 · see citing works
Complementary circuits connecting the orbital and medial prefrontal networks with the temporal, insular, and opercular cortex in the macaque monkey
Saleem, K. S., Kondo, H., & Price, J. L. (2008) · Journal of Comparative Neurology · doi:10.1002/cne.21577 · Cited by 315 · see citing works
Neural computations underlying action-based decision making in the human brain
Wunderlich, K., Rangel, A., & O'Doherty, J. P. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0901077106 · Cited by 301 · see citing works
Self-citation
Models of information processing in the basal ganglia
Alexander, G. E. (1996) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0921-884x(96)89703-7 · Cited by 278 · see citing works
Range-adapting representation of economic value in the orbitofrontal cortex
Padoa-Schioppa, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3751-09.2009 · Cited by 276 · see citing works
Prefrontal Coding of Temporally Discounted Values during Intertemporal Choice
Kim, S., Hwang, J., & Lee, D. (2008) · Neuron · doi:10.1016/j.neuron.2008.05.010 · Cited by 241 · see citing works
Evidence for time‐variant decision making
Ditterich, J. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.05221.x · Cited by 229 · see citing works
How Humans Integrate the Prospects of Pain and Reward during Choice
Talmi, D., Dayan, P., Kiebel, S. J., Frith, C., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2026-09.2009 · Cited by 217 · see citing works
Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables
Kennerley, S. W., & Wallis, J. D. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06743.x · Cited by 204 · see citing works
The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety
Balleine, B. W., & Dickinson, A. (1998) · Animal Learning & Behavior · doi:10.3758/bf03199161 · Cited by 187 · see citing works
The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards
Burke, K. A., Franz, T. M., Miller, D. N., & Schoenbaum, G. M. (2008) · Nature · doi:10.1038/nature06993 · Cited by 181 · see citing works
Disrupting the prefrontal cortex diminishes the human ability to build a good reputation
Knoch, D., Schneider, F., Schunk, D., Hohmann, M., & Fehr, E. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0911619106 · Cited by 162 · see citing works
Repetitive transcranial magnetic stimulation over the right dorsolateral prefrontal cortex decreases valuations during food choices
Camus, M., Halelamien, N. S., Plaßmann, H., Shinsuke Shimojo, A., O’Doherty, J. P., Camerer, C. F., & Rangel, A. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06991.x · Cited by 161 · see citing works
Self-citation
Neuronal Activity in Primate Orbitofrontal Cortex Reflects the Value of Time
Roesch, M. R., & Olson, C. R. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00373.2005 · Cited by 155 · see citing works
General mechanisms for making decisions?
Rushworth, M. F. S., Mars, R. B., & Summerfield, C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.02.005 · Cited by 119 · see citing works
Multiple Forms of Value Learning and the Function of Dopamine
Balleine, B. W., Daw, N. D., & O’Doherty, J. P. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00024-5 · Cited by 112 · see citing works
Perceptual Decisions between Multiple Directions of Visual Motion
Niwa, M., & Ditterich, J. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.5564-07.2008 · Cited by 98 · see citing works
Midline and intralaminar thalamic connections with the orbital and medial prefrontal networks in macaque monkeys
Hsu, D. T., & Price, J. L. (2007) · Journal of Comparative Neurology · doi:10.1002/cne.21440 · Cited by 97 · see citing works
Theoretical and Empirical Studies of Learning
Niv, Y., & Montague, P. R. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00022-1 · Cited by 63 · see citing works
Order-Dependent Modulation of Directional Signals in the Supplementary and Presupplementary Motor Areas
Sohn, J.-W., & Lee, D. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.2982-07.2007 · Cited by 62 · see citing works
The Misbehaviour of Value and the Discipline of the Will
Dayan, P. (2006) · Cited by 60 · see citing works
The Role of Value Systems in Decision Making
Dayan, P. (2008) · The MIT Press eBooks · doi:10.7551/mitpress/7735.003.0006 · Cited by 41 · see citing works
Better than Conscious? Implications for Performance and Institutional Analysis
Engel, C., & Singer, W. (2008) · Cited by 8 · see citing works

Flagged first, then by citations

Sorted by citations

The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321 · see citing works
The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927 · see citing works
Uncertainty and anticipation in anxiety: an integrated neurobiological and psychological perspective
Grupe, D. W., & Nitschke, J. B. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3524 · Cited by 2,007 · see citing works
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381 · see citing works
Frontal cortex and reward-guided learning and decision-making
Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.014 · Cited by 1,111 · see citing works
Ventromedial prefrontal–subcortical systems and the generation of affective meaning
Roy, M., Shohamy, D., & Wager, T. D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.01.005 · Cited by 856 · see citing works
Processing of primary and secondary rewards: A quantitative meta-analysis and review of human functional neuroimaging studies
Sescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.002 · Cited by 782 · see citing works
Value, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766 · see citing works
Informatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706 · see citing works
Self-citation
Emotion and the prefrontal cortex: an integrative review
Dixon, M. L., Thiruchselvam, R., Todd, R., & Christoff, K. (2017) · Psychological Bulletin · doi:10.1037/bul0000096 · Cited by 745 · see citing works
Functional Neural Plasticity and Associated Changes in Positive Affect After Compassion Training
Klimecki, O. M., Leiberg, S., Lamm, C., & Singer, T. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs142 · Cited by 634 · see citing works
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600 · see citing works
Focusing Attention on the Health Aspects of Foods Changes Value Signals in vmPFC and Improves Dietary Choice
Hare, T. A., Malmaud, J., & Rangel, A. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6383-10.2011 · Cited by 556 · see citing works
Self-citation
Confidence in value-based choice
De Martino, B., Fleming, S. M., Garrett, N., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3279 · Cited by 534 · see citing works
Learning, reward, and decision making
O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475 · see citing works
Neurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · see citing works
“Why Does the Cognitive Reflection Test (Sometimes) Predict Utilitarian Moral Judgment (and Other Things)?”
Baron, J., Scott, S., Fincher, K., & Emlen Metz, S. (2015) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.09.003 · Cited by 346 · see citing works
Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., & Rushworth, M. F. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012246107 · Cited by 340 · see citing works
The Development of self and identity in adolescence: neural evidence and implications for a value-based choice perspective on motivated behavior
Pfeifer, J. H., & Berkman, E. T. (2018) · Child Development Perspectives · doi:10.1111/cdep.12279 · Cited by 354 · see citing works
Social and monetary reward learning engage overlapping neural substrates
Lin, A., Adolphs, R., & Rangel, A. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr006 · Cited by 351 · see citing works
Self-citation
The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention
Lim, S.-L., O'Doherty, J. P., & Rangel, A. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1246-11.2011 · Cited by 329 · see citing works
Self-citation
GABA <sub>A</sub> Receptor Subtypes: Therapeutic Potential in Down Syndrome, Affective Disorders, Schizophrenia, and Autism
Rudolph, U., & Möhler, H. (2014) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-011613-135947 · Cited by 319 · see citing works
A Corticostriatal Path Targeting Striosomes Controls Decision-Making under Conflict
Friedman, A., Homma, D., Gibb, L. G., Amemori, K.-I., Rubin, S. J., Hood, A. S., Riad, M. H., & Graybiel, A. M. (2015) · Cell · doi:10.1016/j.cell.2015.04.049 · Cited by 309 · see citing works
Dysfunctions of decision‐making and cognitive control as transdiagnostic mechanisms of mental disorders: advances, gaps, and needs in current research
Goschke, T. (2014) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1410 · Cited by 293 · see citing works
Linking Brain Structure and Activation in Temporoparietal Junction to Explain the Neurobiology of Human Altruism
Morishima, Y., Schunk, D., Bruhin, A., Ruff, C. C., & Fehr, E. (2012) · Neuron · doi:10.1016/j.neuron.2012.05.021 · Cited by 296 · see citing works
The social brain and reward: Social information processing in the human striatum
Bhanji, J. P., & Delgado, M. R. (2014) · WIREs Cognitive Science · doi:10.1002/wcs.1266 · Cited by 256 · see citing works
Representation of aversive prediction errors in the human periaqueductal gray
Roy, M., Shohamy, D., Daw, N., Jepma, M., Wimmer, G. E., & Wager, T. D. (2014) · Nature Neuroscience · doi:10.1038/nn.3832 · Cited by 246 · see citing works
Neural systems underlying approach and avoidance in anxiety disorders
Robin L., A., & Martin, P. P. (2010) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2010.12.4/raupperle · Cited by 227 · see citing works
“Animal research suggests that the OFC plays more of a role in the former, while dorsal PFC regions play more of a role in the latter.(16,31,115,240) This distinction, however, does not seem quite as clear in human neuroimaging research, as some studies support the OFC’s role in calculating both the value of potential…”
Influential
Cognitive regulation during decision making shifts behavioral control between ventromedial and dorsolateral prefrontal value systems
Hutcherson, C. A., Plassmann, H., Gross, J. J., & Rangel, A. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6387-11.2012 · Cited by 227 · see citing works
Self-citation
Contributions of the ventromedial prefrontal cortex to goal-directed action selection
O’Doherty, J. P. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06290.x · Cited by 225 · see citing works
Neural correlates of mindfulness meditation-related anxiety relief
Zeidan, F., Martucci, K. T., Kraft, R. A., McHaffie, J. G., & Coghill, R. C. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst041 · Cited by 196 · see citing works
Pain, decisions, and actions: a motivational perspective
Wiech, K., & Tracey, I. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00046 · Cited by 188 · see citing works
Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational Mechanisms
Summerfield, C., & Tsetsos, K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00070 · Cited by 167 · see citing works
Compassion-based emotion regulation up-regulates experienced positive affect and associated neural networks
Engen, H. G., & Singer, T. (2015) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsv008 · Cited by 175 · see citing works
Decreasing ventromedial prefrontal cortex activity during sequential risk-taking: an fMRI investigation of the balloon analog risk task
Schonberg, T., Fox, C. R., Mumford, J. A., Congdon, E., Trepel, C., & Poldrack, R. A. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00080 · Cited by 162 · see citing works
Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation
Klein-Flügge, M. C., Kennerley, S. W., Saraiva, A. C., Penny, W. D., & Bestmann, S. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004116 · Cited by 163 · see citing works
Individual Differences in Premotor Brain Systems Underlie Behavioral Apathy
Bonnelle, V., Manohar, S., Behrens, T., & Husain, M. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv247 · Cited by 163 · see citing works
Separate and overlapping brain areas encode subjective value during delay and effort discounting
Massar, S. A. A., Libedinsky, C., Weiyan, C., Huettel, S. A., & Chee, M. W. L. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.06.080 · Cited by 123 · see citing works
Assessment of Eating Behavior Disturbance and Associated Neural Networks in Frontotemporal Dementia
Ahmed, R. M., Irish, M., Henning, E., Dermody, N., Bartley, L., Kiernan, M. C., Piguet, O., Farooqi, S., & Hodges, J. R. (2016) · JAMA Neurology · doi:10.1001/jamaneurol.2015.4478 · Cited by 110 · see citing works
Human VMPFC encodes early signatures of confidence in perceptual decisions
Gherman, S., & Philiastides, M. G. (2018) · eLife · doi:10.7554/elife.38293 · Cited by 107 · see citing works
Choice Coding in Frontal Cortex during Stimulus-Guided or Action-Guided Decision-Making
Luk, C.-H., & Wallis, J. D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4920-12.2013 · Cited by 96 · see citing works
The good, the bad, and the irrelevant: Neural mechanisms of learning real and hypothetical rewards and effort
Scholl, J., Kolling, N., Nelissen, N., Wittmann, M. K., Harmer, C. J., & Rushworth, M. F. S. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0396-15.2015 · Cited by 85 · see citing works
A brain network instantiating approach and avoidance motivation
Spielberg, J. M., Miller, G. A., Warren, S. L., Engels, A. S., Crocker, L. D., Banich, M. T., Sutton, B. P., & Heller, W. (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01443.x · Cited by 84 · see citing works
Extended self: spontaneous activation of medial prefrontal cortex by objects that are “mine”
Kim, K., & Johnson, M. K. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst082 · Cited by 78 · see citing works
Sleep deprivation alters valuation signals in the ventromedial prefrontal cortex
Libedinsky, C., Smith, D. V., Teng, C. S., Namburi, P., Chen, V. W., Huettel, S. A., & Chee, M. W. L. (2011) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2011.00070 · Cited by 79 · see citing works
Spatiotemporal neural characterization of prediction error valence and surprise during reward learning in humans
Fouragnan, E., Queirazza, F., Retzler, C., Mullinger, K. J., & Philiastides, M. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-04507-w · Cited by 61 · see citing works
Corticostriatal Circuits Encode the Subjective Value of Perceived Control
Wang, K. S., & Delgado, M. R. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz045 · Cited by 42 · see citing works
A neuro-computational account of procrastination behavior
Le Bouc, R., & Pessiglione, M. (2022) · Nature Communications · doi:10.1038/s41467-022-33119-w · Cited by 44 · see citing works
A habenula-insular circuit encodes the willingness to act
Khalighinejad, N., Garrett, N., Priestley, L., Lockwood, P., & Rushworth, M. F. S. (2021) · Nature Communications · doi:10.1038/s41467-021-26569-1 · Cited by 32 · see citing works
Disordered Decision Making: A Cognitive Framework for Apathy and Impulsivity in Huntington’s Disease
Morris, L., O'Callaghan, C., & Le Heron, C. (2022) · Movement Disorders · doi:10.1002/mds.29013 · Cited by 36 · see citing works

Authors: Rangel, A., & Hare, T.
Affiliations: California Institute of Technology (US)
Corresponding author: Rangel, Antonio
ORCID: Rangel, Antonio
Hare, Todd
Venue: Current Opinion in Neurobiology
Publisher: Elsevier BV
Published: 2010-04
Volume: 20
Issue: 2
Pages: 262-270
ISSN: 0959-4388 (ISSN-L)
DOI: 10.1016/j.conb.2010.03.001
OpenAlex: W2008709921
Cited by: 532
References: 80
Citations by year: 2026: 11 · 2025: 15 · 2024: 19 · 2023: 18 · 2022: 29 · 2021: 30 · 2020: 33 · 2019: 30 · 2018: 40 · 2017: 42 · 2016: 39 · 2015: 44 · 2014: 47 · 2013: 53 · 2012: 39
FWCI: 3.11
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/legal/tdmrep-license (tdm)
Locations: Current Opinion in Neurobiology (publishedVersion)
PubMed (publishedVersion)
CaltechAUTHORS (California Institute of Technology) (submittedVersion)
Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
Funders: National Science Foundation
Gordon and Betty Moore Foundation
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
Keywords: decision-making, reward, effort cost, computational model, neural computation, action selection
MeSH terms: Animals, Brain, Cognition, Computer Simulation, Decision Making, Goals, Humans, Judgment, Motivation, Primates, Models, Animal, Executive Function

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Neural computations associated with goal-directed choice

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks