Optimal decision making and the anterior cingulate cortex
Abstract
Learning the value of options in an uncertain environment is central to optimal decision making. The anterior cingulate cortex (ACC) has been implicated in using reinforcement information to control behavior. Here we demonstrate that the ACC's critical role in reinforcement-guided behavior is neither in detecting nor in correcting errors, but in guiding voluntary choices based on the history of actions and outcomes. ACC lesions did not impair the performance of monkeys (Macaca mulatta) immediately after errors, but made them unable to sustain rewarded responses in a reinforcement-guided choice task and to integrate risk and payoff in a dynamic foraging task. These data suggest that the ACC is essential for learning the value of actions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ACC is required for monitoring and prediction of an action-outcome relationship by representing reward-related information such as reward value and cost of action.
“The ACC is required for monitoring and prediction of an action-outcome relationship30,31, by representing various reward-related information, such as reward value and cost of action32–34.”
From Dissociable roles of prefrontal plasticity in decision-making strategy and execution of habitual behavior (2026) · cites this paper as [31]
The macaque anterior cingulate cortex helps in monitoring and reacting to particular forms of conflict.
“From this and related findings (Kennerley et al., 2006; Rushworth et al., 2004), it was proposed that the macaque anterior cingulate cortex helps in monitoring and reacting to particular forms of conflict”
From The cingulum bundle: Anatomy, function, and dysfunction (2018) · cites this paper as Kennerley et al., 2006
Lesions of anterior cingulate cortex, a key part of MFa, impair the use of positive feedback to stay with correct actions after action reversals.
“Kennerley et al. (96) found that lesions of the anterior cingulate cortex, a key part of MFa, impair the use of positive feedback to stay with correct actions after action reversals.”
From Localization of Dysfunction in Major Depressive Disorder: Prefrontal Cortex and Amygdala (2011) · cites this paper as [96]
A few studies have estimated the time constant of the reward filter from behavior, and assessed how past rewards affect choice selection.
“So far a few studies have estimated the time constant of this filter from behavior, and assessed how past rewards affect choice selection8-12”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [10]
A shift from an exploitive to an exploratory strategy as the environment becomes uncertain is often assessed by an increase in the learning rate.
“This is noteworthy, since a shift from an exploitive to an exploratory strategy as the environment becomes uncertain is often assessed by an increase in the learning rate10.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [10]
Cites
Conflict monitoring and cognitive control
Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.624 · Cited by 7,351 · see citing works
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472 · see citing works
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027 · see citing works
Inhibition and the right inferior frontal cortex
Aron, A. R., Robbins, T. W., & Poldrack, R. A. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.010 · Cited by 3,197 · see citing works
A neural system for error detection and compensation
Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00586.x · Cited by 2,862 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172 · see citing works
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · see citing works
Primate anterior cingulate cortex: Where motor control, drive and cognition interface
Paus, T. (2001) · Nature Reviews Neuroscience · doi:10.1038/35077500 · Cited by 1,722 · see citing works
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · see citing works
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · see citing works
Dorsal anterior cingulate cortex: A role in reward-based decision making
Bush, G., Vogt, B. A., Holmes, J., Dale, A. M., Greve, D., Jenike, M. A., & Rosen, B. R. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.012470999 · Cited by 1,096 · see citing works
The Rhesus Monkey Brain in Stereotaxic Coordinates
Paxinos, G., Huang, X., & Toga, A. W. (1999) · Research Online (University of Wollongong) · Cited by 1,070 · see citing works
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030 · see citing works
Action sets and decisions in the medial frontal cortex
RUSHWORTH, M., WALTON, M., KENNERLEY, S., & BANNERMAN, D. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.07.009 · Cited by 1,004 · see citing works
Self-citationDistributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955 · see citing works
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · see citing works
Learned predictions of error likelihood in the anterior cingulate cortex
Brown, J. W., & Braver, T. S. (2005) · Science · doi:10.1126/science.1105783 · Cited by 928 · see citing works
He, S., Dum, R. P., & Strick, P. L. (1993) · Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00952.1993 · Cited by 873 · see citing works
Prefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678 · see citing works
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 653 · see citing works
Wallis, J. D., & Miller, E. K. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02922.x · Cited by 628 · see citing works
Performance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581 · see citing works
Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex
Roesch, M. R., & Olson, C. R. (2004) · Science · doi:10.1126/science.1093223 · Cited by 535 · see citing works
Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy
Shidara, M., & Richmond, B. J. (2002) · Science · doi:10.1126/science.1069504 · Cited by 515 · see citing works
Prefrontal and cingulate unit activity during timing behavior in the monkey
Niki, H., & Watanabe, M. (1979) · Brain Research · doi:10.1016/0006-8993(79)90328-7 · Cited by 507 · see citing works
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485 · see citing works
Ullsperger, M., & von Cramon, D. Y. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-10-04308.2003 · Cited by 484 · see citing works
Widespread origin of the primate mesofrontal dopamine system.
Williams, S. M., & Goldman-Rakic, P. (1998) · Cerebral Cortex · doi:10.1093/cercor/8.4.321 · Cited by 481 · see citing works
He, S., Dum, R., & Strick, P. (1995) · Journal of Neuroscience · doi:10.1523/jneurosci.15-05-03284.1995 · Cited by 459 · see citing works
Interactions between decision making and performance monitoring within prefrontal cortex
Walton, M. E., Devlin, J. T., & Rushworth, M. F. S. (2004) · Nature Neuroscience · doi:10.1038/nn1339 · Cited by 440 · see citing works
Self-citationPrefrontal connections of medial motor areas in the rhesus monkey
Bates, J. F., & Goldman, P. S. (1993) · The Journal of Comparative Neurology · doi:10.1002/cne.903360205 · Cited by 432 · see citing works
Neuronal correlates of goal-based motor selection in the prefrontal cortex.
Matsumoto, K., Suzuki, W., & Tanaka, K. (2003) · Science · doi:10.1126/science.1084204 · Cited by 384 · see citing works
Risk-sensitive neurons in macaque posterior cingulate cortex
McCoy, A. N., & Platt, M. L. (2005) · Nature Neuroscience · doi:10.1038/nn1523 · Cited by 380 · see citing works
Reward Encoding in the Monkey Anterior Cingulate Cortex
Amiez, C., Joseph, J., & Procyk, E. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj046 · Cited by 351 · see citing works
Dissociation between conflict detection and error monitoring in the human anterior cingulate cortex
Diane Swick, A., & Turken, A. U. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.252521499 · Cited by 333 · see citing works
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
(1997) · Medical Entomology and Zoology · Cited by 289 · see citing works
Convergence of Limbic Input to the Cingulate Motor Cortex in the Rhesus Monkey
Morecraft, R. J., & Hoesen, G. W. V. (1998) · Brain Research Bulletin · doi:10.1016/s0361-9230(97)00344-4 · Cited by 280 · see citing works
Dopamine Neurons Can Represent Context-Dependent Prediction Error
Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Neuron · doi:10.1016/s0896-6273(03)00869-9 · Cited by 276 · see citing works
Is anterior cingulate cortex necessary for cognitive control?
Fellows, L. K. (2005) · Brain · doi:10.1093/brain/awh405 · Cited by 263 · see citing works
Anterior cingulate error‐related activity is modulated by predicted reward
Amiez, C., Joseph, J., & Procyk, E. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04170.x · Cited by 235 · see citing works
Role of prefrontal cortex in a network for arbitrary visuomotor mapping
Murray, E. A., Bussey, T. J., & Wise, S. P. (2000) · Experimental Brain Research · doi:10.1007/s002210000406 · Cited by 214 · see citing works
Roberts, A. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.252 · Cited by 211 · see citing works
Prefrontal Cortex Activity Related to Abstract Response Strategies
Genovesio, A., Brasted, P. J., Mitz, A. R., & Wise, S. P. (2005) · Neuron · doi:10.1016/j.neuron.2005.06.006 · Cited by 205 · see citing works
The Anterior Cingulate and Reward-Guided Selection of Actions
Hadland, K. A., Rushworth, M. F. S., Gaffan, D., & Passingham, R. E. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00634.2002 · Cited by 201 · see citing works
Self-citationEffects of fornix transection and cingulate cortical ablation on spatial memory in rhesus monkeys
Murray, E. A., Davidson, M., Gaffan, D., Olton, D. S., & Suomi, S. (1989) · Experimental Brain Research · doi:10.1007/bf00248291 · Cited by 200 · see citing works
Neuronal Activity in Macaque SEF and ACC During Performance of Tasks Involving Conflict
Nakamura, K., Roesch, M. R., & Olson, C. R. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00305.2004 · Cited by 160 · see citing works
Reinforcement learning and decision making in monkeys during a competitive game
Lee, D., Conroy, M. L., McGreevy, B. P., & Barraclough, D. J. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.07.007 · Cited by 156 · see citing works
The effect of cingulate cortex lesions on task switching and working memory
Rushworth, M. F. S., Hadland, K. A., Gaffan, D., & Passingham, R. E. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321593072 · Cited by 138 · see citing works
Self-citationDevelopment and organization of ocular dominance bands in primary visual cortex of the sable ferret
Ruthazer, E. S., Baker, G. E., & Stryker, M. P. (1999) · The Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19990503)407:2 · Cited by 46 · see citing works
Du, K.-L., & Swamy, M. N. S. (2019) · Springer eBooks · doi:10.1007/978-1-4471-7452-3_17 · Cited by 46 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Distinct brain networks for adaptive and stable task control in humans
Dosenbach, N. U. F., Fair, D. A., Miezin, F. M., Cohen, A. L., Wenger, K. K., Dosenbach, R. A. T., Fox, M. D., Snyder, A. Z., Vincent, J. L., Raichle, M. E., et al. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0704320104 · Cited by 2,632 · see citing works
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
Self-citationReconsidering anhedonia in depression: Lessons from translational neuroscience
Treadway, M. T., & Zald, D. H. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.06.006 · Cited by 1,579 · see citing works
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381 · see citing works
Pizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., Dougherty, D. D., Iosifescu, D. V., Rauch, S. L., & Fava, M. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08081201 · Cited by 1,232 · see citing works
Frontal cortex and reward-guided learning and decision-making
Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.014 · Cited by 1,111 · see citing works
Self-citationThe neurobiology of anhedonia and other reward-related deficits
Der-Avakian, A., & Markou, A. (2012) · Trends in Neurosciences · doi:10.1016/j.tins.2011.11.005 · Cited by 1,130 · see citing works
Associative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925 · see citing works
Self-citationChoice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866 · see citing works
Self-citationThe cingulate cortex and limbic systems for emotion, action, and memory
Rolls, E. T. (2019) · Brain Structure and Function · doi:10.1007/s00429-019-01945-2 · Cited by 859 · see citing works
Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task
Pizzagalli, D. A., Iosifescu, D., Hallett, L. A., Ratner, K. G., & Fava, M. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2008.03.001 · Cited by 780 · see citing works
Beckmann, M., Johansen-Berg, H., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3328-08.2009 · Cited by 789 · see citing works
Self-citationValue, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766 · see citing works
Emotion and the prefrontal cortex: an integrative review
Dixon, M. L., Thiruchselvam, R., Todd, R., & Christoff, K. (2017) · Psychological Bulletin · doi:10.1037/bul0000096 · Cited by 745 · see citing works
The cingulum bundle: Anatomy, function, and dysfunction
Bubb, E. J., Metzler-Baddeley, C., & Aggleton, J. P. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.05.008 · Cited by 740 · see citing works
“lated findings (Kennerley et al., 2006; Rushworth et al., 2004), it was proposed that the macaque anterior cingulate cortex helps in monitoring and reacting to particular forms of conflict, but that this executive control function may not always be revealed by selective lesions as this function is shared with other fr…”
Cavanagh, J. F., Cohen, M. X., & Allen, J. J. B. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4137-08.2009 · Cited by 669 · see citing works
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679 · see citing works
“For instance, neural firing in ACC of behaving monkeys has been described as a temporal filter of past rewards, on a timescale of several trials (or tens of seconds) (Kennerley et al., 2006; Seo and Lee, 2007).”
BackgroundDoya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642 · see citing works
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634 · see citing works
Motivation of extended behaviors by anterior cingulate cortex
Holroyd, C. B., & Yeung, N. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.008 · Cited by 618 · see citing works
Reinforcement Learning Signal Predicts Social Conformity
Klucharev, V., Hytönen, K., Rijpkema, M., Smidts, A., & Fernández, G. (2009) · Neuron · doi:10.1016/j.neuron.2008.11.027 · Cited by 594 · see citing works
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600 · see citing works
Motivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590 · see citing works
Effort-Based Cost–Benefit Valuation and the Human Brain
Croxson, P. L., Walton, M. E., O'Reilly, J. X., Behrens, T. E. J., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4515-08.2009 · Cited by 560 · see citing works
Self-citationConflict-induced behavioural adjustment: a clue to the executive functions of the prefrontal cortex
Mansouri, F. A., Tanaka, K., & Buckley, M. J. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2538 · Cited by 559 · see citing works
Self-citationReward Processing in Schizophrenia: A Deficit in the Representation of Value
Gold, J. M., Waltz, J. A., Prentice, K. J., Morris, S. E., & Heerey, E. A. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn068 · Cited by 521 · see citing works
Neurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · see citing works
Self-citationRubia, K. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.09.023 · Cited by 440 · see citing works
The Computation of Social Behavior
Behrens, T. E. J., Hunt, L. T., & Rushworth, M. F. S. (2009) · Science · doi:10.1126/science.1169694 · Cited by 407 · see citing works
Self-citationHayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4652-10.2011 · Cited by 379 · see citing works
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · see citing works
Gambling near-misses enhance motivation to gamble and recruit win-related brain circuitry
Clark, L., Lawrence, A. J., Astley-Jones, F., & Gray, N. (2009) · Neuron · doi:10.1016/j.neuron.2008.12.031 · Cited by 410 · see citing works
O'Connell, R. G., Dockree, P. M., Bellgrove, M. A., Kelly, S. P., Hester, R., Garavan, H., Robertson, I. H., & Foxe, J. J. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05477.x · Cited by 379 · see citing works
Frontal cortex subregions play distinct roles in choices between actions and stimuli
Rudebeck, P. H., Behrens, T. E., Kennerley, S. W., Baxter, M. G., Buckley, M. J., Walton, M. E., & Rushworth, M. F. S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3541-08.2008 · Cited by 350 · see citing works
Self-citationEvent-related potential studies of outcome processing and feedback-guided learning
San Martín, R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00304 · Cited by 354 · see citing works
Neuronal reference frames for social decisions in primate frontal cortex
Chang, S. W. C., Gariépy, J.-F., & Platt, M. L. (2013) · Nature Neuroscience · doi:10.1038/nn.3287 · Cited by 336 · see citing works
Dissociable components of rule-guided behavior depend on distinct medial and prefrontal regions
Buckley, M. J., Mansouri, F. A., Hoda, H., Mahboubi, M., Browning, P. G. F., Kwok, S. C., Phillips, A., & Tanaka, K. (2009) · Science · doi:10.1126/science.1172377 · Cited by 319 · see citing works
Self-citationSeo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · see citing works
A Role for the Macaque Anterior Cingulate Gyrus in Social Valuation
Rudebeck, P. H., Buckley, M. J., Walton, M. E., & Rushworth, M. F. S. (2006) · Science · doi:10.1126/science.1128197 · Cited by 312 · see citing works
Self-citationHoward, L. R., Javadi, A. H., Yu, Y., Mill, R. D., Morrison, L. C., Knight, R., Loftus, M. M., Staskute, L., & Spiers, H. J. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.001 · Cited by 298 · see citing works
Neural computations underlying action-based decision making in the human brain
Wunderlich, K., Rangel, A., & O'Doherty, J. P. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0901077106 · Cited by 301 · see citing works
A reservoir of time constants for memory traces in cortical neurons
Bernacchia, A., Seo, H., Lee, D., & Wang, X.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2752 · Cited by 292 · see citing works
“The epoch code g(k) was fixed by the firing rates averaged across trials, whereas the parameters of the exponential function (two parameters (A,τ) when using equation (10) and four parameters (A1,τ1, A2,τ2) when using equation (11)) were estimated using a nonlinear curve-fitting procedure, implemented by the Matlab fu…”
MethodAdaptive learning under expected and unexpected uncertainty
Soltani, A., & Izquierdo, A. (2019) · Nature reviews. Neuroscience · doi:10.1038/s41583-019-0180-y · Cited by 286 · see citing works
Lally, N., Nugent, A. C., Luckenbaugh, D. A., Ameli, R., Roiser, J. P., & Zarate, C. A. (2014) · Translational Psychiatry · doi:10.1038/tp.2014.105 · Cited by 271 · see citing works
Medial and orbital frontal cortex in decision-making and flexible behavior
Klein-Flügge, M. C., Bongioanni, A., & Rushworth, M. F. S. (2022) · Neuron · doi:10.1016/j.neuron.2022.05.022 · Cited by 244 · see citing works
Self-citationMedial frontal cortex: From self-generated action to reflection on one's own performance
Passingham, R. E., Bengtsson, S. L., & Lau, H. C. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.11.001 · Cited by 252 · see citing works
Multiple signals in anterior cingulate cortex
Kolling, N., Behrens, T., Wittmann, M., & Rushworth, M. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.12.007 · Cited by 249 · see citing works
Self-citationNeurons in anterior cingulate cortex multiplex information about reward and action
Hayden, B. Y., & Platt, M. L. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4874-09.2010 · Cited by 236 · see citing works
Yao, Y.-W., Liu, L., Ma, S.-S., Shi, X.-H., Zhou, N., Zhang, J.-T., & Potenza, M. N. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.10.029 · Cited by 242 · see citing works
Separate Neural Mechanisms Underlie Choices and Strategic Preferences in Risky Decision Making
Venkatraman, V., Payne, J. W., Bettman, J. R., Luce, M. F., & Huettel, S. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.04.007 · Cited by 222 · see citing works
Genetic origins of social networks in rhesus macaques
Brent, L. J. N., Heilbronner, S. R., Horvath, J. E., Gonzalez-Martinez, J., Ruiz-Lambides, A., Robinson, A. G., Skene, J. H. P., & Platt, M. L. (2013) · Scientific Reports · doi:10.1038/srep01042 · Cited by 220 · see citing works
Localization of Dysfunction in Major Depressive Disorder: Prefrontal Cortex and Amygdala
Murray, E. A., Wise, S. P., & Drevets, W. C. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.09.041 · Cited by 208 · see citing works
Dillon, D. G., Rosso, I. M., Pechtel, P., Killgore, W. D. S., Rauch, S. L., & Pizzagalli, D. A. (2014) · Depression and Anxiety · doi:10.1002/da.22202 · Cited by 209 · see citing works
Borsini, A., Wallis, A. S. J., Zunszain, P., Pariante, C. M., & Kempton, M. J. (2020) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-020-00804-6 · Cited by 207 · see citing works
Computational Models of Performance Monitoring and Cognitive Control
Alexander, W. H., & Brown, J. W. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01085.x · Cited by 193 · see citing works
Bush, G., Spencer, T. J., Holmes, J., Shin, L. M., Valera, E. M., Seidman, L. J., Makris, N., Surman, C., Aleardi, M., Mick, E., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2007.16 · Cited by 201 · see citing works
Fusi, S., Asaad, W. F., Miller, E. K., & Wang, X.-J. (2007) · Neuron · doi:10.1016/j.neuron.2007.03.017 · Cited by 199 · see citing works
Camille, N., Tsuchida, A., & Fellows, L. K. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3164-11.2011 · Cited by 195 · see citing works
Bayesian Prediction and Evaluation in the Anterior Cingulate Cortex
Ide, J. S., Shenoy, P., Yu, A. J., & Li, C.-S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2201-12.2013 · Cited by 185 · see citing works
Tsuchida, A., Doll, B. B., & Fellows, L. K. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1958-10.2010 · Cited by 188 · see citing works
“…studies in humans and lesion work in monkeys, it has been suggested that this region is particularly important for choices in stochastic environments in which integration of outcome history is required for behavioral adjustment (Kennerley et al., 2006; Behrens et al., 2007; Jocham et al., 2009b).”
BackgroundNicotine Dependence Is Characterized by Disordered Reward Processing in a Network Driving Motivation
Bühler, M., Vollstädt-Klein, S., Kobiella, A., Budde, H., Reed, L. J., Braus, D. F., Büchel, C., & Smolka, M. N. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.10.029 · Cited by 185 · see citing works
Motor, cognitive, and affective areas of the cerebral cortex influence the adrenal medulla
Dum, R. P., Levinthal, D. J., & Strick, P. L. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1605044113 · Cited by 188 · see citing works
Weber, M. J., Messing, S. B., Rao, H., Detre, J. A., & Thompson‐Schill, S. L. (2014) · Human Brain Mapping · doi:10.1002/hbm.22429 · Cited by 183 · see citing works
Heterogeneous reward signals in prefrontal cortex
Wallis, J. D., & Kennerley, S. W. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.009 · Cited by 186 · see citing works
Self-citationVenkatraman, V., Rosati, A. G., Taren, A. A., & Huettel, S. A. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2708-09.2009 · Cited by 186 · see citing works
Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement
Noonan, M. P., Kolling, N., Walton, M. E., & Rushworth, M. F. S. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08023.x · Cited by 169 · see citing works
Self-citationStable representations of decision variables for flexible behavior
Bari, B. A., Grossman, C. D., Lubin, E. E., Rajagopalan, A. E., Cressy, J. I., & Cohen, J. Y. (2019) · Neuron · doi:10.1016/j.neuron.2019.06.001 · Cited by 173 · see citing works
The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
Akam, T., Rodrigues-Vaz, I., Marcelo, I., Zhang, X., Pereira, M., Oliveira, R. F., Dayan, P., & Costa, R. M. (2021) · Neuron · doi:10.1016/j.neuron.2020.10.013 · Cited by 170 · see citing works
Fellows, L. K. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06229.x · Cited by 169 · see citing works
Anterior cingulate is a source of valence-specific information about value and uncertainty
Monosov, I. E. (2017) · Nature Communications · doi:10.1038/s41467-017-00072-y · Cited by 163 · see citing works
Computational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort
Vassena, E., Holroyd, C. B., & Alexander, W. H. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00316 · Cited by 140 · see citing works
Compulsivity reveals a novel dissociation between action and confidence
Vaghi, M. M., Luyckx, F., Sule, A., Fineberg, N. A., Robbins, T. W., & De Martino, B. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.006 · Cited by 145 · see citing works
Functional dissociation of the frontoinsular and anterior cingulate cortices in empathy for pain
Gu, X., Liu, X., Guise, K. G., Naidich, T. P., Hof, P. R., & Fan, J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4844-09.2010 · Cited by 150 · see citing works
TOWARDS A GENERAL MODEL OF TEMPORAL DISCOUNTING
van den Bos, W., & McClure, S. M. (2013) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.6 · Cited by 149 · see citing works
Rudebeck, P. H., & Murray, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2272-08.2008 · Cited by 148 · see citing works
Prefrontal connectomics: From anatomy to human imaging
Haber, S. N., Liu, H., Seidlitz, J., & Bullmore, E. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01156-6 · Cited by 129 · see citing works
Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game
Seo, H., Barraclough, D. J., & Lee, D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1479-09.2009 · Cited by 125 · see citing works
Griffiths, K. R., Morris, R. W., & Balleine, B. W. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00101 · Cited by 118 · see citing works
Social rewards and social networks in the human brain
Fareri, D. S., & Delgado, M. R. (2014) · The Neuroscientist · doi:10.1177/1073858414521869 · Cited by 124 · see citing works
Anterior Cingulate Cortex and the Control of Dynamic Behavior in Primates
Monosov, I. E., Haber, S. N., Leuthardt, E. C., & Jezzini, A. (2020) · Current Biology · doi:10.1016/j.cub.2020.10.009 · Cited by 118 · see citing works
Friederich, H.-C., Walther, S., Bendszus, M., Biller, A., Thomann, P., Zeigermann, S., Katus, T., Brunner, R., Zastrow, A., & Herzog, W. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.042 · Cited by 119 · see citing works
Flexible combination of reward information across primates
Farashahi, S., Donahue, C. H., Hayden, B. Y., Lee, D., & Soltani, A. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0714-3 · Cited by 112 · see citing works
Emeric, E. E., Brown, J. W., Leslie, M., Pouget, P., Stuphorn, V., & Schall, J. D. (2008) · Journal of Neurophysiology · doi:10.1152/jn.00896.2006 · Cited by 114 · see citing works
The Anterior Cingulate Gyrus Signals the Net Value of Others' Rewards
Apps, M. A. J., & Ramnani, N. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2701-13.2014 · Cited by 109 · see citing works
Kennerley, S. W., & Wallis, J. D. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00273.2009 · Cited by 108 · see citing works
Self-citationAdaptive coding of action values in the human rostral cingulate zone
Jocham, G., Neumann, J., Klein, T. A., Danielmeier, C., & Ullsperger, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0349-09.2009 · Cited by 106 · see citing works
von Rhein, D., Cools, R., Zwiers, M. P., van der Schaaf, M., Franke, B., Luman, M., Oosterlaan, J., Heslenfeld, D. J., Hoekstra, P. J., Hartman, C. A., et al. (2015) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2015.02.012 · Cited by 108 · see citing works
Anterior cingulate cortex in schema assimilation and expression
Wang, S.-H., Tse, D., & Morris, R. G. M. (2012) · Learning & Memory · doi:10.1101/lm.026336.112 · Cited by 106 · see citing works
A Basal Forebrain-Cingulate Circuit in Macaques Decides It Is Time to Act
Khalighinejad, N., Bongioanni, A., Verhagen, L., Folloni, D., Attali, D., Aubry, J.-F., Sallet, J., & Rushworth, M. F. S. (2020) · Neuron · doi:10.1016/j.neuron.2019.10.030 · Cited by 90 · see citing works
Self-citationAsaad, W. F., & Eskandar, E. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3793-11.2011 · Cited by 105 · see citing works
McCutcheon, R. A., Nour, M. M., Dahoun, T., Jauhar, S., Pepper, F., Expert, P., Veronese, M., Adams, R. A., Turkheimer, F., Mehta, M. A., et al. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.09.010 · Cited by 104 · see citing works
Hauser, T. U., Iannaccone, R., Dolan, R. J., Ball, J., Hättenschwiler, J., Drechsler, R., Rufer, M., Brandeis, D., Walitza, S., & Brem, S. (2017) · Psychological Medicine · doi:10.1017/s0033291716003305 · Cited by 86 · see citing works
Reward-Guided Learning with and without Causal Attribution
Jocham, G., Brodersen, K. H., Constantinescu, A. O., Kahn, M. C., Ianni, A. M., Walton, M. E., Rushworth, M. F. S., & Behrens, T. E. J. (2016) · Neuron · doi:10.1016/j.neuron.2016.02.018 · Cited by 92 · see citing works
Self-citationBasolateral amygdala lesions facilitate reward choices after negative feedback in rats
Izquierdo, A., Darling, C., Manos, N., Pozos, H., Kim, C., Ostrander, S., Cazares, V., Stepp, H., & Rudebeck, P. H. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4942-12.2013 · Cited by 63 · see citing works
Sun, S., Yu, H., Yu, R., & Wang, S. (2023) · Translational Psychiatry · doi:10.1038/s41398-023-02625-w · Cited by 69 · see citing works
“…(dACC) and pre-supplementary motor area (pre-SMA), plays a critical role in cognitive control, including the detection of performance errors and the monitoring of con fl ict [20 – 25], reward-based decision making and learning more generally [26], as well as emotion processing and regulation [27].”
The Role of the Parietal Cortex in the Representation of Task-Reward Associations
Wisniewski, D., Reverberi, C., Momennejad, I., Kahnt, T., & Haynes, J.-D. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4882-14.2015 · Cited by 67 · see citing works
Cocaine cue-induced dopamine release in the human prefrontal cortex
Milella, M. S., Fotros, A., Gravel, P., Casey, K. F., Larcher, K., Verhaeghe, J. A. J., Cox, S. M. L., Reader, A. J., Dagher, A., Benkelfat, C., et al. (2016) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.150207 · Cited by 56 · see citing works
Amemori, K.-I., Amemori, S., & Graybiel, A. M. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1731-14.2015 · Cited by 49 · see citing works
Jackson, S. A. W., Horst, N. K., Pears, A., Robbins, T. W., & Roberts, A. C. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw067 · Cited by 48 · see citing works
Surprise! A unifying model of dorsal anterior cingulate function?
Egner, T. (2011) · Nature Neuroscience · doi:10.1038/nn.2932 · Cited by 44 · see citing works
- Authors
- Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S.
- Affiliations
- University of Oxford (GB)
- John Radcliffe Hospital (GB)
- Corresponding author
- Kennerley, Steven W
- Venue
- Nature Neuroscience
- Published
- 2006-06-18
- Volume
- 9
- Issue
- 7
- Pages
- 940-947
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2009639618
- Cited by
- 948
- References
- 52
- Citations by year
- 2026: 38 · 2025: 43 · 2024: 41 · 2023: 47 · 2022: 33 · 2021: 37 · 2020: 28 · 2019: 41 · 2018: 35 · 2017: 57 · 2016: 58 · 2015: 51 · 2014: 49 · 2013: 58 · 2012: 55
- FWCI
- 26.05
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Wellcome Trust
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- anterior cingulate cortex, optimal decision making, reinforcement learning, value learning, error correction, error detection, voluntary choice, foraging behavior, lesion studies, macaque
- MeSH terms
- Animals, Behavior, Animal, Conditioning, Operant, Decision Making, Gyrus Cinguli, Macaca mulatta, Male, Probability Learning, Psychomotor Performance, Reinforcement, Psychology, Reinforcement Schedule
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
