How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action

Boorman, Erie D.; Behrens, Timothy E.J.; Woolrich, Mark W.; Rushworth, Matthew F.S.

doi:10.1016/j.neuron.2009.05.014

Cited by 665Neural and Behavioral Psychology StudiesNeurotransmitter Receptor Influence on BehaviorDecision-Making and Behavioral Economics

How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action

Open access

Boorman, Erie D., Behrens, Timothy E.J., Woolrich, Mark W., Rushworth, Matthew F.S.·2009·Neuron

DOI 10.1016/j.neuron.2009.05.014

Open this paper in CoChat — free account Open PDF

Abstract

Behavioral flexibility is the hallmark of goal-directed behavior. Whereas a great deal is known about the neural substrates of behavioral adjustment when it is explicitly cued by features of the external environment, little is known about how we adapt our behavior when such changes are made on the basis of uncertain evidence. Using a Bayesian reinforcement-learning model and fMRI, we show that frontopolar cortex (FPC) tracks the relative advantage in favor of switching to a foregone alternative when choices are made voluntarily. Changes in FPC functional connectivity occur when subjects finally decide to switch to the alternative behavior. Moreover, interindividual variation in the FPC signal predicts interindividual differences in effectively adapting behavior. By contrast, ventromedial prefrontal cortex (vmPFC) encodes the relative value of the current decision. Collectively, these findings reveal complementary prefrontal computations essential for promoting short- and long-term behavioral flexibility.

Integrity signals

Registry

Crossref · 10.1016/j.neuron.2009.05.014

Cites

72 of 72 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Difference in value (DV) is a reliable predictor of participants' choices, with the slope of the logistic regression being a measure of choice accuracy, or noise in the choice process.
“In line with previous studies we show DV is a reliable predictor of participants’ choices2,19 with the slope of the logistic regression being a measure of choice accuracy, or noise in the choice process20.”
From Confidence in value-based choice (2013) · cites this paper as [19]

Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630 · see citing works
Self-citation
Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images
Jenkinson, M., Bannister, P., Brady, M., & Smith, S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1132 · Cited by 11,888 · see citing works
Fast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496 · see citing works
A global optimisation method for robust affine registration of brain images
Jenkinson, M., & Smith, S. M. (2001) · Medical Image Analysis · doi:10.1016/s1361-8415(01)00036-6 · Cited by 6,805 · see citing works
Consistent resting-state networks across healthy subjects
Damoiseaux, J. S., Rombouts, S. A. R. B., Barkhof, F., Scheltens, P., Stam, C. J., Smith, S. M., & Beckmann, C. F. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601417103 · Cited by 4,326 · see citing works
Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems
Dayan, P., & Abbott, L. F. (2001) · Cited by 3,153 · see citing works
Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data
Woolrich, M. W., Ripley, B. D., Brady, M., & Smith, S. M. (2001) · NeuroImage · doi:10.1006/nimg.2001.0931 · Cited by 2,859 · see citing works
Self-citation
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · see citing works
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
Self-citation
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036 · see citing works
The Architecture of Cognitive Control in the Human Prefrontal Cortex
Koechlin, E., Ody, C., & Kouneiher, F. (2003) · Science · doi:10.1126/science.1088545 · Cited by 1,922 · see citing works
The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916 · see citing works
The neural basis of loss aversion in decision-making under risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007) · Science · doi:10.1126/science.1134239 · Cited by 1,733 · see citing works
Multilevel linear modelling for FMRI group analysis using Bayesian inference
Woolrich, M. W., Behrens, T. E. J., Beckmann, C. F., Jenkinson, M., & Smith, S. M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.12.023 · Cited by 1,719 · see citing works
Self-citation
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · see citing works
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479 · see citing works
General multilevel linear modeling for group analysis in FMRI
Beckmann, C. F., Jenkinson, M., & Smith, S. M. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00435-x · Cited by 1,464 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
An information theoretical approach to prefrontal executive function
Koechlin, E., & Summerfield, C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.04.005 · Cited by 1,183 · see citing works
Anterior prefrontal cortex: insights into function from anatomy and neuroimaging
Ramnani, N., & Owen, A. M. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1343 · Cited by 1,170 · see citing works
The role of the anterior prefrontal cortex in human cognition
Koechlin, É., Basso, G., Pietrini, P., Panzer, S., & Grafman, J. H. (1999) · Nature · doi:10.1038/20178 · Cited by 1,046 · see citing works
Distributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955 · see citing works
PREMOTOR AND PARIETAL CORTEX: Corticocortical Connectivity and Combinatorial Computations
Wise, S. P., Boussaoud, D., Johnson, P. B., & Caminiti, R. (1997) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.20.1.25 · Cited by 952 · see citing works
Associative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925 · see citing works
Self-citation
The gateway hypothesis of rostral prefrontal cortex (area 10) function.
Burgess, P., Simons, J., Dumontheil, I., & Gilbert, S. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.05.004 · Cited by 872 · see citing works
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855 · see citing works
Neural mechanisms of transient and sustained cognitive control during task switching.
Braver, T. S., Reynolds, J. R., & Donaldson, D. I. (2003) · Neuron · doi:10.1016/s0896-6273(03)00466-5 · Cited by 826 · see citing works
Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792 · see citing works
Posterior parietal cortex in rhesus monkey: I. Parcellation of areas based on distinctive limbic and sensory corticocortical connections
Cavada, C., & Goldman, P. S. (1989) · The Journal of Comparative Neurology · doi:10.1002/cne.902870402 · Cited by 791 · see citing works
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779 · see citing works
Anterior Prefrontal Function and the Limits of Human Decision-Making
Koechlin, É., & Hyafil, A. (2007) · Science · doi:10.1126/science.1142995 · Cited by 750 · see citing works
The cognitive and neuroanatomical correlates of multitasking
Burgess, P. W., Veitch, E., de Lacy Costello, A., & Shallice, T. (2000) · Neuropsychologia · doi:10.1016/s0028-3932(99)00134-7 · Cited by 708 · see citing works
Integration of diverse information in working memory within the frontal lobe
Prabhakaran, V., Narayanan, K., Zhao, Z., & Gabrieli, J. D. E. (2000) · Nature Neuroscience · doi:10.1038/71156 · Cited by 539 · see citing works
Afferent and efferent projections of the inferior area 6 in the macaque monkey
Matelli, M., Camarda, R., Glickstein, M., & Rizzolatti, G. (1986) · The Journal of Comparative Neurology · doi:10.1002/cne.902510302 · Cited by 525 · see citing works
Space and the parietal cortex
Masud Husain, B., & Nachev, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.10.011 · Cited by 515 · see citing works
Broca's area and the hierarchical organization of human behavior.
Koechlin, E., & Jubault, T. (2006) · Neuron · doi:10.1016/j.neuron.2006.05.017 · Cited by 514 · see citing works
The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · see citing works
Forward frontal fields: phylogeny and fundamental function
Wise, S. P. (2008) · Trends in Neurosciences · doi:10.1016/j.tins.2008.08.008 · Cited by 478 · see citing works
Efferent Association Pathways from the Rostral Prefrontal Cortex in the Macaque Monkey
Petrides, M., & Pandya, D. Ν. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.2419-07.2007 · Cited by 437 · see citing works
Temporary interference in human lateral premotor cortex suggests dominance for the selection of movements. A study using transcranial magnetic stimulation
Schluter, N. (1998) · Brain · doi:10.1093/brain/121.5.785 · Cited by 418 · see citing works
The role of the rostral frontal cortex (area 10) in prospective memory: a lateral versus medial dissociation
Burgess, P. W., Scott, S. K., & Frith, C. D. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00327-5 · Cited by 415 · see citing works
Value Representations in the Primate Striatum during Matching Behavior
Lau, B., & Glimcher, P. W. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.021 · Cited by 411 · see citing works
Complementary localization and lateralization of orienting and motor attention
Rushworth, M. F. S., Ellison, A., & Walsh, V. (2001) · Nature Neuroscience · doi:10.1038/88492 · Cited by 408 · see citing works
Self-citation
Active maintenance in prefrontal area 46 creates distractor-resistant memory
Sakai, K., Rowe, J. B., & Passingham, R. E. (2002) · Nature Neuroscience · doi:10.1038/nn846 · Cited by 390 · see citing works
The representation of economic value in the orbitofrontal cortex is invariant for changes of menu
Padoa‐Schioppa, C., & Assad, J. A. (2007) · Nature Neuroscience · doi:10.1038/nn2020 · Cited by 390 · see citing works
Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · see citing works
Connection Patterns Distinguish 3 Regions of Human Parietal Cortex
Rushworth, M. F. S., Behrens, T. E. J., & Johansen‐Berg, H. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj079 · Cited by 379 · see citing works
Self-citation
Strategy application disorder: the role of the frontal lobes in human multitasking
Burgess, P. W. (2000) · Psychological Research · doi:10.1007/s004269900006 · Cited by 368 · see citing works
Optimal decision-making theories: linking neurobiology with behaviour
Bogacz, R. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.12.006 · Cited by 367 · see citing works
Functional organization of the medial frontal cortex
Rushworth, M. F., Buckley, M. J., Behrens, T. E., Walton, M. E., & Bannerman, D. M. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.03.001 · Cited by 353 · see citing works
Self-citation
Analogical Reasoning and Prefrontal Cortex: Evidence for Separable Retrieval and Integration Mechanisms
Bunge, S. A. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh126 · Cited by 352 · see citing works
Dissociating the role of the medial and lateral anterior prefrontal cortex in human planning
Koechlin, É., Corrado, G., Pietrini, P., & Grafman, J. H. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.130177397 · Cited by 330 · see citing works
Comparative neurobiology of the basal ganglia
Parent, A. (1986) · Cited by 308 · see citing works
Sensorimotor Foundations of Higher Cognition
Haggard, P., Rossetti, Y., & Kawato, M. (1993) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199231447.001.0001 · Cited by 245 · see citing works
Prefrontal Coding of Temporally Discounted Values during Intertemporal Choice
Kim, S., Hwang, J., & Lee, D. (2008) · Neuron · doi:10.1016/j.neuron.2008.05.010 · Cited by 241 · see citing works
Prefrontal Set Activity Predicts Rule-Specific Neural Processing during Subsequent Cognitive Performance
Sakai, K., & Passingham, R. E. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.3887-05.2006 · Cited by 210 · see citing works
Prefrontal Cortex Activity Related to Abstract Response Strategies
Genovesio, A., Brasted, P. J., Mitz, A. R., & Wise, S. P. (2005) · Neuron · doi:10.1016/j.neuron.2005.06.006 · Cited by 205 · see citing works
Resolution of Uncertainty in Prefrontal Cortex
Yoshida, W., & Ishii, S. (2006) · Neuron · doi:10.1016/j.neuron.2006.05.006 · Cited by 196 · see citing works
“Brain Is to Thought as Stomach Is to ??”: Investigating the Role of Rostrolateral Prefrontal Cortex in Relational Reasoning
Wendelken, C., Nakhabenko, D., Donohue, S. E., Carter, C. S., & Bunge, S. A. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20055 · Cited by 183 · see citing works
Neural correlates of visuomotor associations
Toni, I., Rushworth, M. F. S., & Passingham, R. E. (2001) · Experimental Brain Research · doi:10.1007/s002210100877 · Cited by 181 · see citing works
Self-citation
Neuroscience of Rule-Guided Behavior
Stoet, G., & Snyder, L. H. (2007) · doi:10.1093/acprof:oso/9780195314274.001.0001 · Cited by 157 · see citing works
Comparative neurobiology of the basal ganglia
Bruyn, G. W. (1987) · Journal of the Neurological Sciences · doi:10.1016/0022-510x(87)90241-3 · Cited by 152 · see citing works
Cerebral Changes during Performance of Overlearned Arbitrary Visuomotor Associations
Grol, M. J., de Lange, F. P., Verstraten, F. A. J., Passingham, R. E., & Toni, I. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.2786-05.2006 · Cited by 118 · see citing works
What is special about the human brain?
Passingham, R. E. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199230136.001.0001 · Cited by 80 · see citing works
Serial Organization of Human Behavior in the Inferior Parietal Cortex
Jubault, T., Ody, C., & Koechlin, É. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.1986-07.2007 · Cited by 51 · see citing works
Rules through Recursion: How Interactions between the Frontal Cortex and Basal Ganglia May Build Abstract, Complex Rules from Concrete, Simple Ones
Miller, E. K., & Buschman, T. J. (2007) · doi:10.1093/acprof:oso/9780195314274.003.0022 · Cited by 31 · see citing works
The Neurophysiology of Abstract Response Strategies
Genovesio, A., & Wise, S. P. (2007) · doi:10.1093/acprof:oso/9780195314274.003.0006 · Cited by 19 · see citing works
Prefrontal cortical projections to the striatum in macaque monkeys: Evidence for an organization related to prefrontal networks
(2000) · doi:10.1002/1096-9861(20000925)425:3
Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys
Carmichael, S. T., & Price, J. L. (1996) · Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19960722)371:2
Untitled work
(2001) · doi:10.1002/1096-8644(200103)114:3

Flagged first, then by citations

Sorted by citations

Frontal cortex and reward-guided learning and decision-making
Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.014 · Cited by 1,111 · see citing works
Self-citation
Ventromedial prefrontal–subcortical systems and the generation of affective meaning
Roy, M., Shohamy, D., & Wager, T. D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.01.005 · Cited by 856 · see citing works
The cingulate cortex and limbic systems for emotion, action, and memory
Rolls, E. T. (2019) · Brain Structure and Function · doi:10.1007/s00429-019-01945-2 · Cited by 859 · see citing works
Value, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766 · see citing works
Informatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706 · see citing works
Emotion and the prefrontal cortex: an integrative review
Dixon, M. L., Thiruchselvam, R., Todd, R., & Christoff, K. (2017) · Psychological Bulletin · doi:10.1037/bul0000096 · Cited by 745 · see citing works
Neural mechanisms of foraging
Kolling, N., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2012) · Science · doi:10.1126/science.1216930 · Cited by 629 · see citing works
Self-citation
Neural computations underlying arbitration between model-based and model-free learning
Lee, S. W., Shimojo, S., & O’Doherty, J. P. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.028 · Cited by 642 · see citing works
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634 · see citing works
Evaluative and generative modes of thought during the creative process
Ellamil, M., Dobson, C., Beeman, M., & Christoff, K. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.08.008 · Cited by 611 · see citing works
Focusing Attention on the Health Aspects of Foods Changes Value Signals in vmPFC and Improves Dietary Choice
Hare, T. A., Malmaud, J., & Rangel, A. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6383-10.2011 · Cited by 556 · see citing works
Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making
Collins, A., & Koechlin, E. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001293 · Cited by 558 · see citing works
“The PROBE model thus predicts that frontopolar regions monitor at least the reliability of the best alternative to the actor, a prediction supported by recent neuroimaging evidence [47,57].”
Confidence in value-based choice
De Martino, B., Fleming, S. M., Garrett, N., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3279 · Cited by 534 · see citing works
Dynamic Properties of Human Brain Structure: Learning-Related Changes in Cortical Areas and Associated Fiber Connections
Taubert, M., Draganski, B., Anwander, A., Müller, K., Horstmann, A., Villringer, A., & Ragert, P. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2567-10.2010 · Cited by 514 · see citing works
Mechanisms underlying cortical activity during value-guided choice
Hunt, L. T., Kolling, N., Soltani, A., Woolrich, M. W., Rushworth, M. F. S., & Behrens, T. E. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3017 · Cited by 454 · see citing works
Self-citation
The organization of dorsal frontal cortex in humans and macaques
Sallet, J., Mars, R. B., Noonan, M. P., Neubert, F.-X., Jbabdi, S., O'Reilly, J. X., Filippini, N., Thomas, A. G., & Rushworth, M. F. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.5108-12.2013 · Cited by 416 · see citing works
Self-citation
The Orbitofrontal Oracle: Cortical Mechanisms for the Prediction and Evaluation of Specific Behavioral Outcomes
Rudebeck, P. H., & Murray, E. A. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.049 · Cited by 405 · see citing works
Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., & Rushworth, M. F. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012246107 · Cited by 340 · see citing works
Self-citation
Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation
Dayan, P., & Berridge, K. C. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0277-8 · Cited by 357 · see citing works
The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention
Lim, S.-L., O'Doherty, J. P., & Rangel, A. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1246-11.2011 · Cited by 329 · see citing works
Mapping value based planning and extensively trained choice in the human brain
Wunderlich, K., Dayan, P., & Dolan, R. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3068 · Cited by 310 · see citing works
Cortico-Striatal-Thalamic Loop Circuits of the Orbitofrontal Cortex: Promising Therapeutic Targets in Psychiatric Illness
Fettes, P., Schulze, L., & Downar, J. (2017) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2017.00025 · Cited by 299 · see citing works
Valuation and decision-making in frontal cortex: one or many serial or parallel systems?
Rushworth, M. F., Kolling, N., Sallet, J., & Mars, R. B. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.04.011 · Cited by 309 · see citing works
Self-citation
Reward value comparison via mutual inhibition in ventromedial prefrontal cortex
Strait, C. E., Blanchard, T. C., & Hayden, B. Y. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.032 · Cited by 294 · see citing works
Medial and orbital frontal cortex in decision-making and flexible behavior
Klein-Flügge, M. C., Bongioanni, A., & Rushworth, M. F. S. (2022) · Neuron · doi:10.1016/j.neuron.2022.05.022 · Cited by 244 · see citing works
Self-citation
Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans
Smittenaar, P., FitzGerald, T. H. B., Romei, V., Wright, N. D., & Dolan, R. J. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.009 · Cited by 244 · see citing works
Organization of the Human Inferior Parietal Lobule Based on Receptor Architectonics
Caspers, S., Schleicher, A., Bacha-Trams, M., Palomero-Gallagher, N., Amunts, K., & Zilles, K. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs048 · Cited by 236 · see citing works
Chronic stress exposure may affect the brain’s response to high calorie food cues and predispose to obesogenic eating habits
Tryon, M. S., Carter, C. S., DeCant, R., & Laugero, K. D. (2013) · Physiology & Behavior · doi:10.1016/j.physbeh.2013.08.010 · Cited by 191 · see citing works
A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex
Jocham, G., Hunt, L. T., Near, J., & Behrens, T. E. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3140 · Cited by 183 · see citing works
Self-citation
Specialized Representations of Value in the Orbital and Ventrolateral Prefrontal Cortex: Desirability versus Availability of Outcomes
Rudebeck, P. H., Saunders, R. C., Lundgren, D. A., & Murray, E. A. (2017) · Neuron · doi:10.1016/j.neuron.2017.07.042 · Cited by 170 · see citing works
Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational Mechanisms
Summerfield, C., & Tsetsos, K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00070 · Cited by 167 · see citing works
Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement
Noonan, M. P., Kolling, N., Walton, M. E., & Rushworth, M. F. S. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08023.x · Cited by 169 · see citing works
Self-citation
Contrasting effects of medial and lateral orbitofrontal cortex lesions on credit assignment and decision-making in humans
Noonan, M. P., Chau, B. K. H., Rushworth, M. F. S., & Fellows, L. K. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.0692-17.2017 · Cited by 167 · see citing works
Self-citation
Human Scalp Electroencephalography Reveals that Repetition Suppression Varies with Expectation
Summerfield, C., Wyart, V., Johnen, V. M., & de Gardelle, V. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00067 · Cited by 145 · see citing works
How Self-Determined Choice Facilitates Performance: A Key Role of the Ventromedial Prefrontal Cortex
Murayama, K., Matsumoto, M., Izuma, K., Sugiura, A., Ryan, R. M., Deci, E. L., & Matsumoto, K. (2015) · Cerebral Cortex · doi:10.1093/cercor/bht317 · Cited by 143 · see citing works
White matter brain and trigeminal nerve abnormalities in temporomandibular disorder
Moayedi, M., Weissman-Fogel, I., Salomons, T. V., Crawley, A. P., Goldberg, M. B., Freeman, B. V., Tenenbaum, H. C., & Davis, K. D. (2012) · Pain · doi:10.1016/j.pain.2012.04.003 · Cited by 144 · see citing works
Oxytocin Modulates Neural Reactivity to Children's Faces as a Function of Social Salience
Wittfoth-Schardt, D., Gründing, J., Wittfoth, M., Lanfermann, H., Heinrichs, M., Domes, G., Buchheim, A., Gündel, H., & Waller, C. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2012.47 · Cited by 139 · see citing works
Generalization of value in reinforcement learning by humans
Wimmer, G. E., Daw, N. D., & Shohamy, D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08017.x · Cited by 111 · see citing works
The neural system of metacognition accompanying decision-making in the prefrontal cortex
Qiu, L., Su, J., Ni, Y., Bai, Y., Zhang, X., Li, X., & Wan, X. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2004037 · Cited by 125 · see citing works
Selective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice
Stopper, C. M., Green, E. B., & Floresco, S. B. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs297 · Cited by 117 · see citing works
Human reinforcement learning subdivides structured action spaces by learning effector-specific values
Gershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118 · see citing works
Connectivity-based parcellation of the human frontal pole with diffusion tensor imaging
Liu, H., Qin, W., Li, W., Fan, L., Wang, J., Jiang, T., & Yu, C. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4882-12.2013 · Cited by 108 · see citing works
How Expert Advice Influences Decision Making
Meshi, D., Biele, G., Korn, C. W., & Heekeren, H. R. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049748 · Cited by 107 · see citing works
The good, the bad, and the irrelevant: Neural mechanisms of learning real and hypothetical rewards and effort
Scholl, J., Kolling, N., Nelissen, N., Wittmann, M. K., Harmer, C. J., & Rushworth, M. F. S. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0396-15.2015 · Cited by 85 · see citing works
Self-citation
Neural integration of risk and effort costs by the frontal pole: only upon request
Burke, C. J., Brünger, C., Kahnt, T., Park, S. Q., & Tobler, P. N. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3662-12.2013 · Cited by 87 · see citing works
Polarity of uncertainty representation during exploration and exploitation in ventromedial prefrontal cortex
Trudel, N., Scholl, J., Klein-Flügge, M. C., Fouragnan, E., Tankelevitch, L., Wittmann, M. K., & Rushworth, M. F. S. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0929-3 · Cited by 74 · see citing works
Self-citation
Action-specific value signals in reward-related regions of the human brain
FitzGerald, T. H. B., Friston, K. J., & Dolan, R. J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3254-12.2012 · Cited by 68 · see citing works
Common and Dissociable Neural Activity After Mindfulness-Based Stress Reduction and Relaxation Response Programs
Sevinc, G., Hölzel, B. K., Hashmi, J., Greenberg, J., McCallister, A., Treadway, M., Schneider, M. L., Dusek, J. A., Carmody, J., & Lazar, S. W. (2018) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000590 · Cited by 67 · see citing works
Neurocognitive Development of Risk Aversion from Early Childhood to Adulthood
Paulsen, D. J., Carter, R. M., Platt, M. L., Huettel, S. A., & Brannon, E. M. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00178 · Cited by 65 · see citing works
Identification and disruption of a neural mechanism for accumulating prospective metacognitive information prior to decision-making
Miyamoto, K., Trudel, N., Kamermans, K., Lim, M. C., Lazari, A., Verhagen, L., Wittmann, M. K., & Rushworth, M. F. S. (2021) · Neuron · doi:10.1016/j.neuron.2021.02.024 · Cited by 45 · see citing works
Self-citation
Medial prefrontal cortex: adding value to imagined scenarios
Lin, W.-J., Horner, A. J., Bisby, J. A., & Burgess, N. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00836 · Cited by 40 · see citing works
Ventromedial Frontal Cortex Is Critical for Guiding Attention to Reward-Predictive Visual Features in Humans
Vaidya, A. R., & Fellows, L. K. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1607-15.2015 · Cited by 37 · see citing works
“Schioppa and Assad, 2006; Kable and Glimcher, 2007; Boorman et al., 2009; Kennerley et al., 2011).”
Background
Anesthesia-induced Suppression of Human Dorsal Anterior Insula Responsivity at Loss of Volitional Behavioral Response
Warnaby, C. E., Seretny, M., Ní Mhuircheartaigh, R., Rogers, R., Jbabdi, S., Sleigh, J., & Tracey, I. (2016) · Anesthesiology · doi:10.1097/aln.0000000000001027 · Cited by 38 · see citing works
Medial Frontal Cortex Activity Predicts Information Sampling in Economic Choice
Kaanders, P., Nili, H., O'Reilly, J. X., & Hunt, L. (2021) · The Journal of Neuroscience · doi:10.1523/jneurosci.0392-21.2021 · Cited by 27 · see citing works
Imagining the future self through thought experiments
Miyamoto, K., Rushworth, M. F. S., & Shea, N. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.01.005 · Cited by 28 · see citing works
A neural correlate of strategic exploration at the onset of adolescence
Kayser, A. S., Op de Macks, Z., Dahl, R. E., & Frank, M. J. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00896 · Cited by 15 · see citing works
Asymmetric projection of introspection reveals a behavioural and neural mechanism for interindividual social coordination
Miyamoto, K., Harbison, C., Tanaka, S., Saito, M., Luo, S., Matsui, S., Sankhe, P., Mahmoodi, A., Lin, M., Trudel, N., et al. (2025) · Nature Communications · doi:10.1038/s41467-024-55202-0 · Cited by 4 · see citing works
Self-citation

Organizational and Cellular Mechanisms Underlying Chemical Inhibition of A Vertebrate Neuron
Korn, H., & Faber, D. S. (1983) · Progress in brain research · doi:10.1016/s0079-6123(08)60017-5 · Cited by 6 · see citing works
Synchronous oscillatory activity in sensory systems: new vistas on mechanisms
Ritz, R., & B, T. J. S. A. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80034-7 · Cited by 200 · see citing works
GABAergic and glycinergic interneuron expression during spinal cord development: Dynamic interplay between inhibition and excitation in the control of ventral network outputs
Sibilla, S., & Ballerini, L. (2009) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2009.06.001 · Cited by 50 · see citing works
Optogenetic stimulation: Understanding memory and treating deficits
Barnett, S. C., Perry, B. A. L., Dalrymple‐Alford, J. C., & Parr‐Brownlie, L. C. (2018) · Hippocampus · doi:10.1002/hipo.22960 · Cited by 21 · see citing works
Optogenetic Dissection of the Striatal Microcircuitry
Silberberg, G., & Planert, H. (2016) · Neuromethods · doi:10.1007/978-1-4939-3411-9_8 · Cited by 1 · see citing works

Authors: Boorman, E. D., Behrens, T. E. J., Woolrich, M. W., & Rushworth, M. F. S.
Affiliations: University of Oxford (GB)
Corresponding author: Boorman, Erie D.
ORCID: Boorman, Erie D.
Behrens, Timothy E.J.
Woolrich, Mark W.
Rushworth, Matthew F.S.
Venue: Neuron
Publisher: Elsevier BV
Published: 2009-06
Volume: 62
Issue: 5
Pages: 733-743
ISSN: 0896-6273 (ISSN-L)
DOI: 10.1016/j.neuron.2009.05.014
OpenAlex: W2034689767
Cited by: 665
References: 72
Citations by year: 2026: 24 · 2025: 27 · 2024: 36 · 2023: 21 · 2022: 34 · 2021: 42 · 2020: 41 · 2019: 43 · 2018: 39 · 2017: 46 · 2016: 52 · 2015: 51 · 2014: 48 · 2013: 45 · 2012: 45
FWCI: 18.24
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/open-access/userlicense/1.0/ (vor, 1538 d)
Locations: Neuron (publishedVersion)
PubMed (publishedVersion)
Funders: Wellcome Trust
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
Keywords: frontopolar cortex, behavioral flexibility, goal-directed behavior, Bayesian reinforcement learning, ventromedial prefrontal cortex, decision-making, switching behavior, individual differences, functional connectivity, uncertainty
MeSH terms: Adult, Bayes Theorem, Brain Mapping, Decision Making, Female, Frontal Lobe, Humans, Image Processing, Computer-Assisted, Functional Laterality, Magnetic Resonance Imaging, Male, Models, Neurological, Neuropsychological Tests, Oxygen, Psychomotor Performance, Regression Analysis, Reward, Signal Detection, Psychological, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks