Heterogeneous reward signals in prefrontal cortex
Open accessAbstract
Neurons encode upcoming rewards throughout frontal cortex. Recent papers have helped to determine that these signals play different roles in different frontal regions. Neurons in orbitofrontal cortex (PFo) appear to be responsible for calculating the specific value of an expected reward, information that can help efficiently guide decision-making. Similar signals are also present in the cingulate sulcus (PFcs). By contrast, reward signals in lateral prefrontal cortex (PFl) are consistent with a role in using reward to guide other cognitive processes, such as the allocation of attentional resources and using value information to guide learning other relationships in the environment such as arbitrary stimulus-response mappings. A remaining issue for future work is to specify the precise roles of PFo and PFcs. These two areas show very different patterns of connectivity with other brain areas, and it is currently unclear how this effects their contribution to decision-making.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The ACC plays a central role in processing positively valenced emotions and other rewards, and in coding value representations of anticipated rewards.
“The ACC plays a central role in processing positively valenced emotions [239] and other rewards [240], and in coding value representations of anticipated rewards [241]”
From Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings (2012) · cites this paper as [241]
Recent studies have placed more emphasis on anterior cingulate cortex's role in representing both positive and negative values.
“recent studies have placed more emphasis on its role in representing both positive and negative values19,37.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127 · see citing works
Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex
Funahashi, S., Bruce, C. J., & Goldman-Rakic, P. S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.2.331 · Cited by 2,685 · see citing works
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · see citing works
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
Self-Control in Decision-Making Involves Modulation of the vmPFC Valuation System
Hare, T. A., Camerer, C. F., & Rangel, A. (2009) · Science · doi:10.1126/science.1168450 · Cited by 1,928 · see citing works
The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916 · see citing works
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · see citing works
Severe disturbance of higher cognition after bilateral frontal lobe ablation: Patient EVR
Eslinger, P. J., & Damasio, A. R. (1985) · Neurology · doi:10.1212/wnl.35.12.1731 · Cited by 1,426 · see citing works
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · see citing works
Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys
Carmichael, S. T., & Price, J. L. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903630408 · Cited by 1,197 · see citing works
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · see citing works
Self-citationArchitectonic subdivision of the human orbital and medial prefrontal cortex
Öngür, D., Ferry, A. T., & Price, J. L. (2003) · Journal of Comparative Neurology · doi:10.1002/cne.10609 · Cited by 944 · see citing works
Orbitofrontal cortex and its contribution to decision-making.
Wallis, J. D. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.30.051606.094334 · Cited by 938 · see citing works
Self-citationThe Anatomical Connections of the Macaque Monkey Orbitofrontal Cortex. A Review
Cavada, C. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.220 · Cited by 917 · see citing works
Integration of What and Where in the Primate Prefrontal Cortex
Rao, S. C., Rainer, G., & Miller, E. K. (1997) · Science · doi:10.1126/science.276.5313.821 · Cited by 877 · see citing works
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836 · see citing works
Neural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809 · see citing works
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792 · see citing works
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · cited 1× · see citing works
“However, reward-predictive neurons, far from being specific to PFo, were subsequently found in every frontal area that neurophysiologists cared to record from, including PFl [4], PFcs [5], and motor areas such as the premotor and primary motor cortex [6].”
BackgroundSensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys
Carmichael, S. T., & Price, J. L. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903630409 · Cited by 678 · see citing works
Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey
Carmichael, S. T., & Price, J. L. (1994) · Journal of Comparative Neurology · doi:10.1002/cne.903460305 · Cited by 656 · see citing works
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 653 · see citing works
Wallis, J. D., & Miller, E. K. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02922.x · Cited by 628 · see citing works
Self-citationSeparate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580 · see citing works
Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex
Roesch, M. R., & Olson, C. R. (2004) · Science · doi:10.1126/science.1093223 · Cited by 535 · see citing works
Forward frontal fields: phylogeny and fundamental function
Wise, S. P. (2008) · Trends in Neurosciences · doi:10.1016/j.tins.2008.08.008 · Cited by 478 · cited 1× · see citing works
“Reprinted with permission from [65].”
Neurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · see citing works
Self-citationDissociable neural representations of future reward magnitude and delay during temporal discounting
Ballard, K., & Knutson, B. D. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.004 · Cited by 450 · see citing works
Medial prefrontal cell activity signaling prediction errors of action values
Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007) · Nature Neuroscience · doi:10.1038/nn1890 · Cited by 440 · see citing works
Croxson, P. L., Johansen-Berg, H., Behrens, T. E. J., Robson, M. D., Pinsk, M. A., Gross, C. G., Richter, W., Richter, M. C., Kastner, S., & Rushworth, M. F. S. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1311-05.2005 · Cited by 410 · see citing works
The representation of economic value in the orbitofrontal cortex is invariant for changes of menu
Padoa‐Schioppa, C., & Assad, J. A. (2007) · Nature Neuroscience · doi:10.1038/nn2020 · Cited by 390 · see citing works
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · see citing works
Neuronal correlates of goal-based motor selection in the prefrontal cortex.
Matsumoto, K., Suzuki, W., & Tanaka, K. (2003) · Science · doi:10.1126/science.1084204 · Cited by 384 · see citing works
Neurobiology of cingulate cortex and limbic thalamus : a comprehensive handbook
Vogt, B. A., & Gabriel, M. (1993) · Medical Entomology and Zoology · Cited by 378 · see citing works
The role of rat medial frontal cortex in effort-based decision making
Walton, M. E., Bannerman, D. M., & Rushworth, M. F. S. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10996.2002 · Cited by 364 · see citing works
Reward Encoding in the Monkey Anterior Cingulate Cortex
Amiez, C., Joseph, J., & Procyk, E. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj046 · Cited by 351 · see citing works
Frontal cortex subregions play distinct roles in choices between actions and stimuli
Rudebeck, P. H., Behrens, T. E., Kennerley, S. W., Baxter, M. G., Buckley, M. J., Walton, M. E., & Rushworth, M. F. S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3541-08.2008 · Cited by 350 · see citing works
Self-citationFellows, L. K., & Farah, M. J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl176 · Cited by 337 · see citing works
Behavioral Shifts and Action Valuation in the Anterior Cingulate Cortex
Quilodran, R., Rothé, M., & Procyk, E. (2008) · Neuron · doi:10.1016/j.neuron.2007.11.031 · Cited by 335 · see citing works
Human anterior cingulate neurons and the integration of monetary reward with motor responses
Williams, Z. M., Bush, G., Rauch, S. L., Cosgrove, G. R., & Eskandar, E. N. (2004) · Nature Neuroscience · doi:10.1038/nn1354 · Cited by 332 · see citing works
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · see citing works
Roesch, M. R., & Olson, C. R. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00019.2003 · Cited by 309 · see citing works
Williams, S. M., & Goldman-Rakic, P. S. (1993) · Cerebral Cortex · doi:10.1093/cercor/3.3.199 · Cited by 284 · see citing works
The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects
FitzGerald, T. H. B., Seymour, B., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0717-09.2009 · Cited by 279 · see citing works
Range-adapting representation of economic value in the orbitofrontal cortex
Padoa-Schioppa, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3751-09.2009 · Cited by 276 · see citing works
Anterior cingulate error‐related activity is modulated by predicted reward
Amiez, C., Joseph, J., & Procyk, E. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04170.x · Cited by 235 · see citing works
Fictive Reward Signals in the Anterior Cingulate Cortex
Hayden, B. Y., Pearson, J. M., & Platt, M. L. (2009) · Science · doi:10.1126/science.1168488 · Cited by 235 · see citing works
The convergence of information about rewarding and aversive stimuli in single neurons
Morrison, S. E., & Salzman, C. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1815-09.2009 · Cited by 206 · see citing works
Histed, M. H., Pasupathy, A., & Miller, E. K. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.019 · Cited by 188 · see citing works
Evaluating self-generated decisions in frontal pole cortex of monkeys
Tsujimoto, S., Genovesio, A., & Wise, S. P. (2010) · Nature Neuroscience · doi:10.1038/nn.2453 · Cited by 184 · see citing works
The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards
Burke, K. A., Franz, T. M., Miller, D. N., & Schoenbaum, G. M. (2008) · Nature · doi:10.1038/nature06993 · Cited by 181 · see citing works
Dum, R. P., & Strick, P. L. (1993) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4899-6704-6_15 · Cited by 165 · see citing works
Fellows, L. K. (2006) · Brain · doi:10.1093/brain/awl017 · Cited by 162 · see citing works
Neuronal Activity in Primate Orbitofrontal Cortex Reflects the Value of Time
Roesch, M. R., & Olson, C. R. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00373.2005 · Cited by 155 · see citing works
Dynamic Signals Related to Choices and Outcomes in the Dorsolateral Prefrontal Cortex
Seo, H., Barraclough, D. J., & Lee, D. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm064 · Cited by 143 · see citing works
Behavioral and Neural Changes after Gains and Losses of Conditioned Reinforcers
Seo, H., & Lee, D. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4726-08.2009 · Cited by 137 · see citing works
Expectations, gains, and losses in the anterior cingulate cortex
Sallet, J., Quilodran, R., Rothé, M., Vezoli, J., Joseph, J., & Procyk, E. (2007) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.7.4.327 · Cited by 136 · see citing works
Reward-Dependent Modulation of Working Memory in Lateral Prefrontal Cortex
Kennerley, S. W., & Wallis, J. D. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.5353-08.2009 · Cited by 132 · see citing works
Self-citationKennerley, S. W., & Wallis, J. D. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00273.2009 · Cited by 108 · see citing works
Self-citationDynamic Encoding of Responses and Outcomes by Neurons in Medial Prefrontal Cortex
Luk, C.-H., & Wallis, J. D. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0386-09.2009 · Cited by 84 · see citing works
Self-citationReward prediction based on stimulus categorization in primate lateral prefrontal cortex
Pan, X., Sawa, K., Tsuda, I., Tsukada, M., & Sakagami, M. (2008) · Nature Neuroscience · doi:10.1038/nn.2128 · Cited by 84 · see citing works
Prefrontal Neural Correlates of Memory for Sequences
Averbeck, B. B., & Lee, D. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.4483-06.2007 · Cited by 76 · see citing works
Neural representation of behavioral outcomes in the orbitofrontal cortex
Mainen, Z. F., & Kepecs, Á. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.03.010 · Cited by 76 · see citing works
The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units
Watanabe, M. (1989) · Neuroscience Letters · doi:10.1016/0304-3940(89)90450-3 · Cited by 64 · see citing works
An, X., Bandler, R., �ng�r, D., & Price, J. L. (1998) · The Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19981130)401:4
Flagged first, then by citations
Cited by
Sorted by citations
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321 · see citing works
The integration of negative affect, pain and cognitive control in the cingulate cortex
Shackman, A. J., Salomons, T. V., Slagter, H. A., Fox, A. S., Winter, J. J., & Davidson, R. J. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn2994 · Cited by 2,082 · see citing works
Impulsivity, compulsivity, and top-down cognitive control
Dalley, J. W., Everitt, B. J., & Robbins, T. W. (2011) · Neuron · doi:10.1016/j.neuron.2011.01.020 · Cited by 1,589 · see citing works
The neurobiology of rewards and values in social decision making
Ruff, C. C., & Fehr, E. (2014) · Nature reviews. Neuroscience · doi:10.1038/nrn3776 · Cited by 716 · see citing works
Informatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706 · see citing works
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 542 · see citing works
Dopamine and Cognitive Control in Prefrontal Cortex
Ott, T., & Nieder, A. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.006 · Cited by 530 · see citing works
Distinct behavioural and network correlates of two interneuron types in prefrontal cortex
Kvitsiani, D., Ranade, S., Hangya, B., Taniguchi, H., Huang, J. Z., & Kepecs, A. (2013) · Nature · doi:10.1038/nature12176 · Cited by 516 · see citing works
Neuronal basis of sequential foraging decisions in a patchy environment
Hayden, B. Y., Pearson, J. M., & Platt, M. L. (2011) · Nature Neuroscience · doi:10.1038/nn.2856 · Cited by 513 · see citing works
Voon, V., Mole, T. B., Banca, P., Porter, L., Morris, L., Mitchell, S., Lapa, T. R., Karr, J., Harrison, N. A., Potenza, M. N., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102419 · Cited by 462 · see citing works
Neurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · see citing works
Self-citationDouble dissociation of value computations in orbitofrontal and anterior cingulate neurons
Kennerley, S. W., Behrens, T. E. J., & Wallis, J. D. (2011) · Nature Neuroscience · doi:10.1038/nn.2961 · Cited by 452 · see citing works
Self-citationRudebeck, P. H., & Murray, E. A. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.049 · Cited by 405 · see citing works
Zhang, W.-N., Chang, S.-H., Guo, L.-Y., Zhang, K.-L., & Wang, J. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.039 · Cited by 355 · see citing works
Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., & Rushworth, M. F. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012246107 · Cited by 340 · see citing works
Making decisions through a distributed consensus
Cisek, P. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.05.007 · Cited by 329 · see citing works
Cell-Type-Specific Activity in Prefrontal Cortex during Goal-Directed Behavior
Pinto, L., & Dan, Y. (2015) · Neuron · doi:10.1016/j.neuron.2015.06.021 · Cited by 323 · see citing works
Williams, A. H., Kim, T. H., Wang, F. L., Vyas, S., Ryu, S. I., Shenoy, K. V., Schnitzer, M. J., Kolda, T. G., & Ganguli, S. (2018) · Neuron · doi:10.1016/j.neuron.2018.05.015 · Cited by 306 · see citing works
Dichter, G. S., Damiano, C. A., & Allen, J. A. (2012) · Journal of Neurodevelopmental Disorders · doi:10.1186/1866-1955-4-19 · Cited by 299 · see citing works
A reservoir of time constants for memory traces in cortical neurons
Bernacchia, A., Seo, H., Lee, D., & Wang, X.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2752 · Cited by 292 · see citing works
“, recent studies have placed more emphasis on its role in representing both positive and negative value”
BackgroundHayashi, T., Ko, J. H., Strafella, A. P., & Dagher, A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212185110 · Cited by 251 · see citing works
Localization of function in anterior cingulate cortex: From psychosurgery to functional neuroimaging
Gasquoine, P. G. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.01.002 · Cited by 240 · see citing works
Striatal Dopamine and the Interface between Motivation and Cognition
Aarts, E., van Holstein, M., & Cools, R. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00163 · Cited by 211 · see citing works
Neuronal Encoding of Subjective Value in Dorsal and Ventral Anterior Cingulate Cortex
Cai, X., & Padoa‐Schioppa, C. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.3864-11.2012 · Cited by 205 · see citing works
On the challenges and mechanisms of embodied decisions
Cisek, P., & Pastor‐Bernier, A. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0479 · Cited by 196 · see citing works
Surprise! Neural correlates of Pearce–Hall and Rescorla–Wagner coexist within the brain
Roesch, M. R., Esber, G. R., Li, J., Daw, N. D., & Schoenbaum, G. M. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07986.x · Cited by 186 · see citing works
Ubiquity and Specificity of Reinforcement Signals throughout the Human Brain
Vickery, T. J., Chun, M. M., & Lee, D. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.011 · Cited by 185 · see citing works
Decision Making: The Neuroethological Turn
Pearson, J. M., Watson, K. K., & Platt, M. L. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.037 · Cited by 184 · see citing works
Neurobehavioral foundation of environmental reactivity.
Moore, S. R., & Depue, R. A. (2015) · Psychological Bulletin · doi:10.1037/bul0000028 · Cited by 181 · see citing works
Kennerley, S. W., & Walton, M. E. (2011) · Behavioral Neuroscience · doi:10.1037/a0023575 · Cited by 179 · see citing works
Self-citationNeuropsychological assessment of the orbital and ventromedial prefrontal cortex
Zald, D. H., & Andreotti, C. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.08.012 · Cited by 174 · see citing works
Unconscious goal activation and the hijacking of the executive function.
Marien, H., Ruud Custers, A., Hassin, R. R., & Aarts, H. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0028955 · Cited by 173 · see citing works
Dichter, G. S., Kozink, R. V., McClernon, F. J., & Smoski, M. J. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.09.048 · Cited by 170 · see citing works
Associative Cortex Features in the First Olfactory Brain Relay Station
Doucette, W. T., Gire, D. H., Whitesell, J. D., Carmean, V., Lucero, M. T., & Restrepo, D. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.024 · Cited by 167 · see citing works
Anterior cingulate is a source of valence-specific information about value and uncertainty
Monosov, I. E. (2017) · Nature Communications · doi:10.1038/s41467-017-00072-y · Cited by 163 · see citing works
Mapping anhedonia-specific dysfunction in a transdiagnostic approach: an ALE meta-analysis
Zhang, B., Lin, P., Shi, H., Öngür, D., Auerbach, R. P., Wang, X., Yao, S., & Wang, X. (2016) · Brain Imaging and Behavior · doi:10.1007/s11682-015-9457-6 · Cited by 152 · see citing works
Attention for Learning Signals in Anterior Cingulate Cortex
Bryden, D. W., Johnson, E. E., Tobia, S. C., Kashtelyan, V., & Roesch, M. R. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.4715-11.2011 · Cited by 148 · see citing works
Value normalization in decision making: theory and evidence
Rangel, A., & Clithero, J. A. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.07.011 · Cited by 144 · see citing works
Dixon, M. L., & Kalina Christoff, A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0051637 · Cited by 140 · see citing works
Transient Inactivation of Orbitofrontal Cortex Blocks Reinforcer Devaluation in Macaques
West, E. A., DesJardin, J. T., Gale, K., & Málková, L. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3295-11.2011 · Cited by 137 · see citing works
Taking stock of value in the orbitofrontal cortex
Knudsen, E. B., & Wallis, J. D. (2022) · Nature reviews. Neuroscience · doi:10.1038/s41583-022-00589-2 · Cited by 137 · see citing works
Self-citationSingle-Neuron Mechanisms Underlying Cost-Benefit Analysis in Frontal Cortex
Hosokawa, T., Kennerley, S. W., Sloan, J., & Wallis, J. D. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.2221-13.2013 · Cited by 128 · see citing works
Self-citationReinforcement-learning in fronto-striatal circuits
Averbeck, B. B., & O’Doherty, J. P. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01108-0 · Cited by 127 · see citing works
A neural mechanism underlying failure of optimal choice with multiple alternatives
Chau, B. K. H., Kolling, N., Hunt, L. T., Walton, M. E., & Rushworth, M. F. S. (2014) · Nature Neuroscience · doi:10.1038/nn.3649 · Cited by 120 · see citing works
Mirror neurons encode the subjective value of an observed action
Caggiano, V., Fogassi, L., Rizzolatti, G., Casile, A., Giese, M. A., & Thier, P. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1205553109 · Cited by 115 · see citing works
Processing of Hedonic and Chemosensory Features of Taste in Medial Prefrontal and Insular Networks
Jezzini, A., Mazzucato, L., Camera, G. L., & Fontanini, A. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.2974-13.2013 · Cited by 111 · see citing works
A Diversity of Intrinsic Timescales Underlie Neural Computations
Cavanagh, S. E., Hunt, L. T., & Kennerley, S. W. (2020) · Frontiers in Neural Circuits · doi:10.3389/fncir.2020.615626 · Cited by 109 · see citing works
Self-citationFour core properties of the human brain valuation system demonstrated in intracranial signals
Lopez‐Persem, A., Bastin, J., Petton, M., Abitbol, R., Lehongre, K., Adam, C., Navarro, V., Rheims, S., Kahane, P., Domenech, P., et al. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0615-9 · Cited by 107 · see citing works
Dopamine reverses reward insensitivity in apathy following globus pallidus lesions
Adam, R. J., Leff, A. P., Sinha, N., Turner, C., Bays, P. M., Draganski, B., & Husain, M. (2012) · Cortex · doi:10.1016/j.cortex.2012.04.013 · Cited by 100 · see citing works
The Computation of Stimulus Values in Simple Choice
Rangel, A., & Clithero, J. A. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00008-5 · Cited by 95 · see citing works
Cell-Type-Specific Outcome Representation in the Primary Motor Cortex
Levy, S., Lavzin, M., Benisty, H., Ghanayim, A., Dubin, U., Achvat, S., Brosh, Z., Aeed, F., Mensh, B. D., Schiller, Y., et al. (2020) · Neuron · doi:10.1016/j.neuron.2020.06.006 · Cited by 88 · see citing works
Cavanagh, S. E., Wallis, J. D., Kennerley, S. W., & Hunt, L. T. (2016) · eLife · doi:10.7554/elife.18937 · Cited by 88 · see citing works
Self-citationAmygdala-Prefrontal Synchronization Underlies Resistance to Extinction of Aversive Memories
Livneh, U., & Paz, R. (2012) · Neuron · doi:10.1016/j.neuron.2012.05.016 · Cited by 87 · see citing works
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation
Song, Y., Millidge, B., Salvatori, T., Lukasiewicz, T., Xu, Z., & Bogacz, R. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01514-1 · Cited by 85 · see citing works
Decision value computation in DLPFC and VMPFC adjusts to the available decision time
Sokol‐Hessner, P., Hutcherson, C. A. C., Hare, T. A., & Rangel, A. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08076.x · Cited by 84 · see citing works
Premotor and Motor Cortices Encode Reward
Ramkumar, P., Dekleva, B. M., Cooler, S., Miller, L. E., & Kording, K. P. (2016) · PLoS ONE · doi:10.1371/journal.pone.0160851 · Cited by 82 · see citing works
Involvement of the endocannabinoid system in reward processing in the human brain
van Hell, H. H., Jager, G., Bossong, M. G., Brouwer, A., Jansma, J. M., Zuurman, L., van Gerven, J., Kahn, R. S., & Ramsey, N. F. (2012) · Psychopharmacology · doi:10.1007/s00213-011-2428-8 · Cited by 77 · see citing works
Marsh, B. T., Tarigoppula, V. S. A., Chen, C., & Francis, J. T. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.1802-14.2015 · Cited by 77 · see citing works
Bijleveld, E., Ruud Custers, A., & Aarts, H. (2012) · Journal of Experimental Psychology General · doi:10.1037/a0027615 · Cited by 77 · see citing works
Rothé, M., Quilodran, R., Sallet, J., & Procyk, E. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1016-11.2011 · Cited by 75 · see citing works
Chakraborty, S., Kolling, N., Walton, M. E., & Mitchell, A. S. (2016) · eLife · doi:10.7554/elife.13588 · Cited by 75 · see citing works
Feature-based learning improves adaptability without compromising precision
Farashahi, S. G., Rowe, K., Aslami, Z., Lee, D., & Soltani, A. (2017) · Nature Communications · doi:10.1038/s41467-017-01874-w · Cited by 71 · see citing works
Perceived stress predicts altered reward and loss feedback processing in medial prefrontal cortex
Treadway, M. T., Buckholtz, J. W., & Zald, D. H. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00180 · Cited by 68 · see citing works
Koziol, L. F., Budding, D. E., & Chidekel, D. (2010) · The Cerebellum · doi:10.1007/s12311-010-0192-7 · Cited by 65 · see citing works
Medial-lateral Organization of the Orbitofrontal Cortex
Rich, E. L., & Wallis, J. D. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00573 · Cited by 63 · see citing works
Self-citationVolatility Facilitates Value Updating in the Prefrontal Cortex
Massi, B., Donahue, C. H., & Lee, D. (2018) · Neuron · doi:10.1016/j.neuron.2018.06.033 · Cited by 61 · see citing works
Bissonette, G. B., & Roesch, M. R. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_382 · Cited by 60 · see citing works
Arco, A. D., Park, J., Wood, J. T., Kim, Y., & Moghaddam, B. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.0450-17.2017 · Cited by 59 · see citing works
Jezzini, A., Bromberg-Martin, E. S., Trambaiolli, L. R., Haber, S. N., & Monosov, I. E. (2021) · Neuron · doi:10.1016/j.neuron.2021.05.013 · Cited by 58 · see citing works
Reinforcement learning and its connections with neuroscience and psychology
Subramanian, A., Chitlangia, S., & Baths, V. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.10.003 · Cited by 57 · see citing works
Railton, P. (2017) · Emotion Review · doi:10.1177/1754073916670021 · Cited by 56 · see citing works
Cortical Signals for Rewarded Actions and Strategic Exploration
Donahue, C. H., Seo, H., & Lee, D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.040 · Cited by 56 · see citing works
Value Signals in the Prefrontal Cortex Predict Individual Preferences across Reward Categories
Gross, J., Woelbert, E., Zimmermann, J., Okamoto, S., Riedl, A. M., & Goebel, R. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.5082-13.2014 · Cited by 55 · see citing works
Distributional reinforcement learning in prefrontal cortex
Müller, T., Butler, J. L., Veselič, S., Miranda, B., Wallis, J. D., Dayan, P., Behrens, T. E. J., Kurth-Nelson, Z. L., & Kennerley, S. W. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01535-w · Cited by 53 · see citing works
Self-citationNeuropathology of the Anterior Midcingulate Cortex in Young Children With Autism
Uppal, N., Wicinski, B., Buxbaum, J. D., Heinsen, H., Schmitz, C., & Hof, P. R. (2014) · Journal of Neuropathology & Experimental Neurology · doi:10.1097/nen.0000000000000108 · Cited by 52 · see citing works
Viviani, R. (2014) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2014.00123 · Cited by 52 · see citing works
Christopoulos, V., Bonaiuto, J. J., & Andersen, R. A. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004104 · Cited by 51 · see citing works
Bijleveld, E., Ruud Custers, A., & Aarts, H. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412438463 · Cited by 48 · see citing works
Effects of α-2A adrenergic receptor agonist on time and risk preference in primates
Kim, S., Bobeica, I., Gamo, N. J., Arnsten, A. F. T., & Lee, D. (2012) · Psychopharmacology · doi:10.1007/s00213-011-2520-0 · Cited by 47 · see citing works
Temporally Dissociable Contributions of Human Medial Prefrontal Subregions to Reward-Guided Learning
Hauser, T. U., Hunt, L. T., Iannaccone, R., Walitza, S., Brandeis, D., Brem, S., & Dolan, R. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0560-15.2015 · Cited by 45 · see citing works
Decision-making under risk: A graph-based network analysis using functional MRI
Minati, L., Grisoli, M., Seth, A. K., & Critchley, H. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.048 · Cited by 45 · see citing works
Cummings, M. E. (2015) · Animal Behaviour · doi:10.1016/j.anbehav.2015.02.021 · Cited by 41 · see citing works
Donaldson, K. R., Oumeziane, B. A., Hélie, S., & Foti, D. (2016) · Physiology & Behavior · doi:10.1016/j.physbeh.2016.03.034 · Cited by 41 · see citing works
Challenges of Interpreting Frontal Neurons during Value-Based Decision-Making
Wallis, J. D., & Rich, E. L. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00124 · Cited by 40 · see citing works
Self-citationImpact of Size and Delay on Neural Activity in the Rat Limbic Corticostriatal System
Roesch, M. R., & Bryden, D. W. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00130 · Cited by 39 · see citing works
Ventral Striatum Encodes Past and Predicted Value Independent of Motor Contingencies
Goldstein, B. L., Barnett, B. R., Vásquez, G. V. M., Tobia, S. C., Kashtelyan, V., Burton, A. C., Bryden, D. W., & Roesch, M. R. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.5349-11.2012 · Cited by 39 · see citing works
Ting, C.-C., Yu, C.-C., Maloney, L. T., & Wu, S. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3161-14.2015 · Cited by 37 · see citing works
Choice-relevant information transformation along a ventrodorsal axis in the medial prefrontal cortex
Maisson, D. J.-N., Cash-Padgett, T. V., Wang, M. Z., Hayden, B. Y., Heilbronner, S. R., & Zimmermann, J. (2021) · Nature Communications · doi:10.1038/s41467-021-25219-w · Cited by 36 · see citing works
Draps, M., Sescousse, G., Potenza, M. N., Marchewka, A., Duda, A., Lew-Starowicz, M., Kopera, M., Jakubczyk, A., Wojnar, M., & Gola, M. (2020) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2020.05.007 · Cited by 34 · see citing works
Prefrontal and Striatal Activity Related to Values of Objects and Locations
Kim, S., Cai, X., Hwang, J., & Lee, D. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00108 · Cited by 34 · see citing works
Logistic analysis of choice data: A primer
Padoa‐Schioppa, C. (2022) · Neuron · doi:10.1016/j.neuron.2022.03.002 · Cited by 32 · see citing works
Walton, M. E., Chau, B. K. H., & Kennerley, S. W. (2014) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2014.10.005 · Cited by 32 · see citing works
Self-citationHélie, S., Paul, E. J., & Ashby, F. G. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.033 · Cited by 32 · see citing works
Where Actions Meet Outcomes: Medial Prefrontal Cortex, Central Thalamus, and the Basal Ganglia
Mair, R. G., Francoeur, M. J., Krell, E. M., & Gibson, B. M. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.928610 · Cited by 32 · see citing works
Simmons, J. M., Minamimoto, T., Murray, E. A., & Richmond, B. J. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.1802-10.2010 · Cited by 30 · see citing works
Hilt, P. M., Berret, B., Papaxanthis, C., Stapley, P. J., & Pozzo, T. (2016) · Scientific Reports · doi:10.1038/srep23868 · Cited by 30 · see citing works
Beta traveling waves in monkey frontal and parietal areas encode recent reward history
Zabeh, E., Foley, N. C., Jacobs, J., & Gottlieb, J. P. (2023) · Nature Communications · doi:10.1038/s41467-023-41125-9 · Cited by 28 · see citing works
Neurocomputational mechanisms of affected beliefs
Müller‐Pinzler, L., Czekalla, N., Mayer, A. V., Schröder, A., Stolz, D. S., Paulus, F. M., & Krach, S. (2022) · Communications Biology · doi:10.1038/s42003-022-04165-3 · Cited by 26 · see citing works
Ott, T., Stein, A. M., & Nieder, A. (2023) · Nature Communications · doi:10.1038/s41467-023-43271-6 · Cited by 25 · see citing works
- Authors
- Wallis, J. D., & Kennerley, S. W.
- Affiliations
- UCL Queen Square Institute of Neurology (GB)
- ORCID
- Kennerley, Steven W
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2010-04
- Volume
- 20
- Issue
- 2
- Pages
- 191-198
- ISSN
- 0959-4388 (ISSN-L)
- PMC
- PMC2862852
- OpenAlex
- W2029172539
- Cited by
- 186
- References
- 66
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 5 · 2023: 6 · 2022: 11 · 2021: 8 · 2020: 14 · 2019: 9 · 2018: 4 · 2017: 9 · 2016: 12 · 2015: 10 · 2014: 13 · 2013: 22 · 2012: 22
- FWCI
- 1.78
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Current Opinion in Neurobiology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Henan Institute of Science and Technology
- National Institutes of Health (5f32mh081521-02)
- National Institute of Mental Health (F32MH-081521)
- National Institute on Drug Abuse (R01-DA19028, R01DA019028)
- National Institute of Neurological Disorders and Stroke (P01NS040813)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- reward signals, prefrontal cortex, orbitofrontal cortex, cingulate sulcus, lateral prefrontal cortex, decision-making, attention allocation, stimulus-response learning, neuronal connectivity
- MeSH terms
- Animals, Attention, Cognition, Decision Making, Humans, Learning, Nerve Net, Neurons, Reward, Prefrontal Cortex, Executive Function
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review