Choice, uncertainty and value in prefrontal and cingulate cortex

Rushworth, Matthew F S; Behrens, Timothy E J

doi:10.1038/nn2066

Cited by 866Neural and Behavioral Psychology StudiesNeurotransmitter Receptor Influence on BehaviorDecision-Making and Behavioral Economics

Choice, uncertainty and value in prefrontal and cingulate cortex

Rushworth, Matthew F S, Behrens, Timothy E J·2008·Nature Neuroscience

DOI 10.1038/nn2066

Open this paper in CoChat — free account

Abstract

Reinforcement learning models that focus on the striatum and dopamine can predict the choices of animals and people. Representations of reward expectation and of reward prediction errors that are pertinent to decision making, however, are not confined to these regions but are also found in prefrontal and cingulate cortex. Moreover, decisions are not guided solely by the magnitude of the reward that is expected. Uncertainty in the estimate of the reward expectation, the value of information that might be gained by taking a course of action and the cost of an action all influence the manner in which decisions are made through prefrontal and cingulate cortex.

Integrity signals

Registry

Crossref · 10.1038/nn2066

Cites

104 of 104 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The aMCC tracks both the magnitude and probability of predicted rewards, increasing response when reward value is reduced or increased.
“In particular, the aMCC seems to track both the magnitude and the probability of predicted rewards (Kouneiher et al., 2009), increasing its response to a task when reward value is either reduced (Bush et al., 2002), or increased (Rushworth and Behrens, 2008).”
From Motivation in the Service of Allostasis: The Role of Anterior Mid-Cingulate Cortex (2019) · cites this paper as Rushworth and Behrens, 2008
Neural correlates of reward valuation have been observed in different studies.
“Neural correlates of reward valuation have been observed in different studies1-3”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [2]
Prefrontal cortex plays a major role in dynamic decision processes encoding and updating values.
“Prefrontal cortex plays a major role in dynamic decision processes encoding and updating values1-4.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [2]
Neural signals correlated with reward expectation have been consistently observed in the striatum, amygdala, orbitofrontal cortex, and anterior cingulate cortex in single-unit recording from behaving animals.
“On the other hand, neural signals correlated with reward expectation have been consistently observed in the striatum, amygdala, orbitofrontal cortex (OFC), and anterior cingulate cortex (ACC) in single-unit recording from behaving animals (reviewed in Rushworth and Behrens, 2008).”
From Decision Making in Recurrent Neuronal Circuits (2008) · cites this paper as Rushworth and Behrens, 2008
In reinforcement learning theory, the error signal is postulated to update the reward expectation, which in turn is used to compute the error signal.
“In reinforcement learning theory, the error signal is postulated to update the reward expectation, which in turn is used to compute the error signal (Sutton and Barto, 1998; Bayer and Glimcher, 2005; Rushworth and Behrens, 2008).”
From Decision Making in Recurrent Neuronal Circuits (2008) · cites this paper as Rushworth and Behrens, 2008

A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027 · see citing works
Meeting of minds: the medial frontal cortex and social cognition
Amodio, D. M., & Frith, C. D. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1884 · Cited by 3,782 · see citing works
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · see citing works
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · see citing works
Reinforcement learning
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
Self-citation
The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916 · see citing works
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · see citing works
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · see citing works
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · see citing works
Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange
King-Casas, B., Tomlin, D., Anen, C., Camerer, C. F., Quartz, S. R., & Montague, P. R. (2005) · Science · doi:10.1126/science.1108062 · Cited by 1,345 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · see citing works
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · see citing works
Neural Predictors of Purchases
Knutson, B., Rick, S., Wimmer, G. E., Prelec, D., & Loewenstein, G. (2007) · Neuron · doi:10.1016/j.neuron.2006.11.010 · Cited by 1,171 · see citing works
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076 · see citing works
Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring
Debener, S., Ullsperger, M., Siegel, M., Fiehler, K., von Cramon, D. Y., & Engel, A. K. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.3286-05.2005 · Cited by 1,055 · see citing works
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030 · see citing works
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Time Discounting for Primary Rewards
McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4246-06.2007 · Cited by 971 · see citing works
Distributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955 · see citing works
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · see citing works
Self-citation
Architectonic subdivision of the human orbital and medial prefrontal cortex
Öngür, D., Ferry, A. T., & Price, J. L. (2003) · Journal of Comparative Neurology · doi:10.1002/cne.10609 · Cited by 944 · see citing works
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · see citing works
Cortical areas and the selection of movement: a study with positron emission tomography
Deiber, M., Passingham, R. E., Colebatch, J. G., Friston, K. J., Nixon, P. D., & Frackowiak, R. S. J. (1991) · Experimental Brain Research · doi:10.1007/bf00231461 · Cited by 895 · see citing works
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855 · see citing works
Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning
Schoenbaum, G. M., Chiba, A. A., & Gallagher, M. (1998) · Nature Neuroscience · doi:10.1038/407 · Cited by 849 · see citing works
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779 · see citing works
Neurobiology of Cingulate Cortex and Limbic Thalamus
Vogt, B. A., & Gabriel, M. (1993) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4899-6704-6 · Cited by 772 · see citing works
Perceptions of moral character modulate the neural systems of reward during the trust game
Delgado, M. R., Frank, R. H., & Phelps, E. A. (2005) · Nature Neuroscience · doi:10.1038/nn1575 · Cited by 729 · see citing works
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692 · see citing works
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · see citing works
Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task
Wallis, J. D., & Miller, E. K. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02922.x · Cited by 628 · see citing works
Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards
Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597 · see citing works
Orbitofrontal Cortex and Representation of Incentive Value in Associative Learning
Gallagher, M., McMahan, R. W., & Schoenbaum, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-15-06610.1999 · Cited by 593 · see citing works
Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency
Izquierdo, A., Suda, R. K., & Murray, E. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-04.2004 · Cited by 588 · see citing works
Gustatory, olfactory, and visual convergence within the primate orbitofrontal cortex
Rolls, E., & Baylis, L. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-09-05437.1994 · Cited by 587 · see citing works
Control of Response Selection by Reinforcer Value Requires Interaction of Amygdala and Orbital Prefrontal Cortex
Baxter, M. G., Parker, A., Lindner, C. C. C., Izquierdo, A. D., & Murray, E. A. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04311.2000 · Cited by 582 · see citing works
Separate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580 · see citing works
Self-citation
Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy
Shidara, M., & Richmond, B. J. (2002) · Science · doi:10.1126/science.1069504 · Cited by 515 · see citing works
Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour
Rushworth, M. F. S., Behrens, T. E. J., Rudebeck, P. H., & Walton, M. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.01.004 · Cited by 507 · see citing works
Self-citation
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · see citing works
The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · see citing works
Reinforcement Learning
(1997) · The MIT Press eBooks · doi:10.7551/mitpress/3917.003.0017 · Cited by 497 · see citing works
Learning and selective attention
Dayan, P., Kakade, S., & Montague, P. R. (2000) · Nature Neuroscience · doi:10.1038/81504 · Cited by 495 · see citing works
Functional Specialization within Medial Frontal Cortex of the Anterior Cingulate for Evaluating Effort-Related Decisions
Walton, M. E., Bannerman, D. M., Alterescu, K., & Rushworth, M. F. S. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-16-06475.2003 · Cited by 495 · see citing works
Self-citation
Widespread origin of the primate mesofrontal dopamine system.
Williams, S. M., & Goldman-Rakic, P. (1998) · Cerebral Cortex · doi:10.1093/cercor/8.4.321 · Cited by 481 · see citing works
Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems
Tobler, P. N., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00745.2006 · Cited by 472 · see citing works
Hunger Modulates the Responses to Gustatory Stimuli of Single Neurons in the Caudolateral Orbitofrontal Cortex of the Macaque Monkey
Rolls, E. T., Sienkiewicz, Z. J., & Yaxley, S. (1989) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1989.tb00774.x · Cited by 466 · see citing works
Bayesian theories of conditioning in a changing world
Courville, A. C., Daw, N. D., & Touretzky, D. S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.004 · Cited by 457 · see citing works
Interactions between decision making and performance monitoring within prefrontal cortex
Walton, M. E., Devlin, J. T., & Rushworth, M. F. S. (2004) · Nature Neuroscience · doi:10.1038/nn1339 · Cited by 440 · see citing works
Self-citation
Medial prefrontal cell activity signaling prediction errors of action values
Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007) · Nature Neuroscience · doi:10.1038/nn1890 · Cited by 440 · see citing works
Different Neural Correlates of Reward Expectation and Reward Expectation Error in the Putamen and Caudate Nucleus During Stimulus-Action-Reward Association Learning
Haruno, M., & Kawato, M. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00382.2005 · Cited by 433 · see citing works
Monkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques
Deaner, R. O., Khera, A. V., & Platt, M. L. (2005) · Current Biology · doi:10.1016/j.cub.2005.01.044 · Cited by 431 · see citing works
Genetically Determined Differences in Learning from Errors
Klein, T. A., Neumann, J., Reuter, M., Hennig, J., von Cramon, D. Y., & Ullsperger, M. (2007) · Science · doi:10.1126/science.1145044 · Cited by 424 · see citing works
Spinal Cord Terminations of the Medial Wall Motor Areas in Macaque Monkeys
Dum, R. P., & Strick, P. L. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-20-06513.1996 · Cited by 421 · see citing works
Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement
S., M., S., B., M.-Y., H., C., B., E., S., J., D., & I., A. (2002) · Psychopharmacology · doi:10.1007/s00213-001-0983-0 · Cited by 409 · see citing works
Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations
Oliveira, F. T. P., McDonald, J. J., & Goodman, D. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.12.1994 · Cited by 390 · see citing works
The representation of economic value in the orbitofrontal cortex is invariant for changes of menu
Padoa‐Schioppa, C., & Assad, J. A. (2007) · Nature Neuroscience · doi:10.1038/nn2020 · Cited by 390 · see citing works
Neuronal correlates of goal-based motor selection in the prefrontal cortex.
Matsumoto, K., Suzuki, W., & Tanaka, K. (2003) · Science · doi:10.1126/science.1084204 · Cited by 384 · see citing works
The role of rat medial frontal cortex in effort-based decision making
Walton, M. E., Bannerman, D. M., & Rushworth, M. F. S. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10996.2002 · Cited by 364 · see citing works
Self-citation
Reward Encoding in the Monkey Anterior Cingulate Cortex
Amiez, C., Joseph, J., & Procyk, E. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj046 · Cited by 351 · see citing works
Reinforcement Learning Signals Predict Future Decisions
Cohen, M. X., & Charan Ranganath, A. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.4421-06.2007 · Cited by 333 · see citing works
Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · see citing works
A Role for the Macaque Anterior Cingulate Gyrus in Social Valuation
Rudebeck, P. H., Buckley, M. J., Walton, M. E., & Rushworth, M. F. S. (2006) · Science · doi:10.1126/science.1128197 · Cited by 312 · see citing works
Self-citation
Weighing up the benefits of work: Behavioral and neural analyses of effort-related decision making
Walton, M. E., Kennerley, S. W., Bannerman, D. M., Phillips, P. E. M., & Rushworth, M. F. S. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.005 · Cited by 305 · see citing works
Self-citation
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300 · see citing works
A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task
Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., & Kawato, M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3417-03.2004 · Cited by 300 · see citing works
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation
Roesch, M. R., Taylor, A. R., & Schoenbaum, G. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.027 · Cited by 297 · see citing works
Anterior cingulate activity during routine and non-routine sequential behaviors in macaques
Procyk, E., Tanaka, Y. L., & Joseph, J. (2000) · Nature Neuroscience · doi:10.1038/74880 · Cited by 293 · see citing works
Arbitrary associations between antecedents and actions
Wise, S. P., & Murray, E. A. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01570-8 · Cited by 280 · see citing works
Responses to the Sensory Properties of Fat of Neurons in the Primate Orbitofrontal Cortex
Rolls, E. T., Critchley, H. D., Browning, A. S., Hernadi, I., & Lenard, L. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-04-01532.1999 · Cited by 278 · see citing works
Connections of the Monkey Cingulate Cortex
Hoesen, G. W. V., Morecraft, R. J., & Vogt, B. A. (1993) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4899-6704-6_9 · Cited by 276 · see citing works
Activity in the lateral prefrontal cortex reflects multiple steps of future events in action plans
Mushiake, H., Saito, N., Sakamoto, K., Itoyama, Y., & Tanji, J. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.045 · Cited by 249 · see citing works
Representation of Spatial Goals in Rat Orbitofrontal Cortex
Feierstein, C. E., Quirk, M. C., Uchida, N., Sosulski, D. L., & Mainen, Z. F. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.032 · Cited by 248 · see citing works
Anterior cingulate error‐related activity is modulated by predicted reward
Amiez, C., Joseph, J., & Procyk, E. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04170.x · Cited by 235 · see citing works
Architecture and neurocytology of monkey cingulate gyrus
Vogt, B. A., Vogt, L., Farber, N. B., & Bush, G. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20512 · Cited by 223 · see citing works
Agent-Specific Responses in the Cingulate Cortex During Economic Exchanges
Tomlin, D., Kayali, M., King-Casas, B., Anen, C., Camerer, C., Quartz, S., & Montague, P. (2006) · Science · doi:10.1126/science.1125596 · Cited by 222 · see citing works
LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS
Corrado, G. S., Sugrue, L. P., Seung, H. S., & Newsome, W. T. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.23-05 · Cited by 206 · see citing works
Social status gates social attention in monkeys
Shepherd, S. V., Deaner, R. O., & Platt, M. L. (2006) · Current Biology · doi:10.1016/j.cub.2006.02.013 · Cited by 201 · see citing works
Resolution of Uncertainty in Prefrontal Cortex
Yoshida, W., & Ishii, S. (2006) · Neuron · doi:10.1016/j.neuron.2006.05.006 · Cited by 196 · see citing works
Neuronal Activity in Primate Orbitofrontal Cortex Reflects the Value of Time
Roesch, M. R., & Olson, C. R. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00373.2005 · Cited by 155 · see citing works
Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning
Haruno, M., & Kawato, M. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.06.007 · Cited by 152 · see citing works
Neural dynamics of error processing in medial frontal cortex
Mars, R. B., COLES, M. G. H., Grol, M. J., Holroyd, C. B., Nieuwenhuis, S., Hulstijn, W., & Toni, I. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.041 · Cited by 148 · see citing works
Activity in prefrontal cortex during dynamic selection of action sequences
Averbeck, B. B., Sohn, J.-W., & Lee, D. (2006) · Nature Neuroscience · doi:10.1038/nn1634 · Cited by 141 · see citing works
Distinct contributions of frontal areas to emotion and social behaviour in the rat
Rudebeck, P. H., Walton, M. E., Millette, B. H. P., Shirley, E., Rushworth, M. F. S., & Bannerman, D. M. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05844.x · Cited by 139 · see citing works
Self-citation
Voluntary Selection of Task Sets Revealed by Functional Magnetic Resonance Imaging
Forstmann, B. U., Braß, M., Koch, I., & von Cramon, D. Y. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/089892906775990589 · Cited by 135 · see citing works
Representation of Immediate and Final Behavioral Goals in the Monkey Prefrontal Cortex during an Instructed Delay Period
Saito, N., Mushiake, H., Sakamoto, K., Itoyama, Y., & Tanji, J. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi032 · Cited by 121 · see citing works
Voluntary Selection of Task Sets Revealed by Functional Magnetic Resonance Imaging
(2006) · doi:10.1162/jocn.2006.18.3.388 · Cited by 118 · see citing works
Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis
Kheramin, S., Body, S., Mobini, S., Ho, M.-Y., zquez-Martinez, D. V. X. E., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2002) · Psychopharmacology · doi:10.1007/s00213-002-1228-6 · Cited by 116 · see citing works
Representation of Future and Previous Spatial Goals by Separate Neural Populations in Prefrontal Cortex
Genovesio, A., Brasted, P. J., & Wise, S. P. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.0699-06.2006 · Cited by 115 · see citing works
Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex
Kobayashi, S., Nomoto, K., Watanabe, M., Hikosaka, O., Schultz, W., & Sakagami, M. (2006) · Neuron · doi:10.1016/j.neuron.2006.08.031 · Cited by 109 · see citing works
Integration of Cognitive and Motivational Context Information in the Primate Prefrontal Cortex
Watanabe, M., & Sakagami, M. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm067 · Cited by 107 · see citing works
The Contribution of Orbitofrontal Cortex to Action Selection
Ostlund, S. B., & Balleine, B. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.033 · Cited by 102 · see citing works
Comparison of neuronal activity in the rostral supplementary and cingulate motor areas during a task with cognitive and motor demands
Akkal, D., Bioulac, B. H., Audin, J., & Burbaud, P. (2002) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2002.01920.x · Cited by 78 · see citing works
Neurons in the Rostral Cingulate Motor Area Monitor Multiple Phases of Visuomotor Behavior With Modest Parametric Selectivity
Hoshi, E., Sawamura, H., & Tanji, J. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01201.2004 · Cited by 67 · see citing works
When goals are missed: Dealing with self-generated and externally induced failure
Ullsperger, M., Nittono, H., & von Cramon, D. Y. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.01.026 · Cited by 54 · see citing works
Classical Conditioning
Christoforou, C. (2017) · Springer eBooks · doi:10.1007/978-3-319-16999-6_1039-1 · Cited by 33 · see citing works
Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys
Carmichael, S. T., & Price, J. L. (1996) · Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19960722)371:2

Flagged first, then by citations

Sorted by citations

Frontal theta as a mechanism for cognitive control
Cavanagh, J. F., & Frank, M. J. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.012 · Cited by 2,726 · see citing works
The integration of negative affect, pain and cognitive control in the cingulate cortex
Shackman, A. J., Salomons, T. V., Slagter, H. A., Fox, A. S., Winter, J. J., & Davidson, R. J. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn2994 · Cited by 2,082 · see citing works
Reconsidering anhedonia in depression: Lessons from translational neuroscience
Treadway, M. T., & Zald, D. H. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.06.006 · Cited by 1,579 · see citing works
The neural bases of emotion regulation
Etkin, A., Büchel, C., & Gross, J. J. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn4044 · Cited by 1,244 · see citing works
The neurobiology of anhedonia and other reward-related deficits
Der-Avakian, A., & Markou, A. (2012) · Trends in Neurosciences · doi:10.1016/j.tins.2011.11.005 · Cited by 1,130 · see citing works
An Interoceptive Predictive Coding Model of Conscious Presence
Seth, A. K., Suzuki, K., & Critchley, H. D. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00395 · Cited by 950 · see citing works
“These areas have also been broadly implicated in representations of reward expectation and reward prediction errors in reinforcement learning contexts (see Disorders of Agency and Presence and Rushworth and Behrens, 2008).”
Background
Interoception in anxiety and depression
Paulus, M. P., & Stein, M. B. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0258-9 · Cited by 952 · see citing works
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928 · see citing works
Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal–mediotemporal interactions
Peters, J., & Büchel, C. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.026 · Cited by 871 · see citing works
Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization
Beckmann, M., Johansen-Berg, H., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3328-08.2009 · Cited by 789 · see citing works
Self-citation
The neurobiology of rewards and values in social decision making
Ruff, C. C., & Fehr, E. (2014) · Nature reviews. Neuroscience · doi:10.1038/nrn3776 · Cited by 716 · see citing works
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679 · see citing works
“On the other hand, neural signals correlated with reward expectation have been consistently observed in the striatum, amygdala, orbitofrontal cortex (OFC), and anterior cingulate cortex (ACC) in single-unit recording from behaving animals (reviewed in Rushworth and Behrens, 2008).”
BackgroundMethodInfluential
Motivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590 · see citing works
Neural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532 · see citing works
Conflict-induced behavioural adjustment: a clue to the executive functions of the prefrontal cortex
Mansouri, F. A., Tanaka, K., & Buckley, M. J. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2538 · Cited by 559 · see citing works
Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making
Collins, A., & Koechlin, E. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001293 · Cited by 558 · see citing works
NMDA Receptors Subserve Persistent Neuronal Firing during Working Memory in Dorsolateral Prefrontal Cortex
Wang, M., Yang, Y., Wang, C.-J., Gamo, N. J., Jin, L. E., Mazer, J. A., Morrison, J. H., Wang, X.-J., & Arnsten, A. F. T. (2013) · Neuron · doi:10.1016/j.neuron.2012.12.032 · Cited by 489 · see citing works
An automatic valuation system in the human brain: Evidence from functional neuroimaging
Lebreton, M., Jorge, S., Michel, V., Thirion, B., & Pessiglione, M. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.040 · Cited by 455 · see citing works
Lesion mapping of cognitive control and value-based decision making in the prefrontal cortex
Gläscher, J., Adolphs, R., Damasio, H., Bechara, A., Rudrauf, D., Calamia, M., Paul, L. K., & Tranel, D. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1206608109 · Cited by 476 · see citing works
Neural correlates of value, risk, and risk aversion contributing to decision making under risk
Christopoulos, G. I., Tobler, P. N., Bossaerts, P., Dolan, R. J., & Schultz, W. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2614-09.2009 · Cited by 451 · see citing works
Mechanisms underlying cortical activity during value-guided choice
Hunt, L. T., Kolling, N., Soltani, A., Woolrich, M. W., Rushworth, M. F. S., & Behrens, T. E. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3017 · Cited by 454 · see citing works
Self-citation
Neurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · see citing works
A neural mechanism mediating the impact of episodic prospection on farsighted decisions
Benoit, R. G., Gilbert, S. J., & Burgess, P. W. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6559-10.2011 · Cited by 422 · see citing works
The Computation of Social Behavior
Behrens, T. E. J., Hunt, L. T., & Rushworth, M. F. S. (2009) · Science · doi:10.1126/science.1169694 · Cited by 407 · see citing works
Self-citation
Neural processing of risk
Mohr, P. N. C., Biele, G., & Heekeren, H. R. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0003-10.2010 · Cited by 411 · see citing works
Surprise Signals in Anterior Cingulate Cortex: Neuronal Encoding of Unsigned Reward Prediction Errors Driving Adjustment in Behavior
Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4652-10.2011 · Cited by 379 · see citing works
Dopamine, affordance and active inference
Friston, K. J., Shiner, T., FitzGerald, T., Galea, J. M., Adams, R., Brown, H., Dolan, R. J., Moran, R., Stephan, K. E., & Bestmann, S. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002327 · Cited by 381 · see citing works
The anatomy of apathy: a neurocognitive framework for amotivated behaviour
Le Heron, C., Apps., M. A. J., & Husain, M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.07.003 · Cited by 380 · see citing works
“There is now a wealth of neurophysiological and neuroimaging evidence that activity in the VS and ACC signals PEs (Hayden et al., 2011a; Holroyd and Coles, 2008; Jahn et al., 2016; Jocham et al., 2009; Lockwood et al., 2016; Matsumoto et al., 2007; McClure et al., 2003; O’Doherty et al., 2003; Rushworth and Behrens, 2…”
Background
Knowing how much you don't know: a neural organization of uncertainty estimates
Bach, D. R., & Dolan, R. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3289 · Cited by 339 · see citing works
A computational framework for the study of confidence in humans and animals
Kepecs, A., & Mainen, Z. F. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0037 · Cited by 305 · see citing works
Dissociable components of rule-guided behavior depend on distinct medial and prefrontal regions
Buckley, M. J., Mansouri, F. A., Hoda, H., Mahboubi, M., Browning, P. G. F., Kwok, S. C., Phillips, A., & Tanaka, K. (2009) · Science · doi:10.1126/science.1172377 · Cited by 319 · see citing works
Your Brain on Google: Patterns of Cerebral Activation during Internet Searching
Small, G. W., Moody, T. D., Siddarth, P., & Bookheimer, S. Y. (2009) · The American Journal of Geriatric Psychiatry · doi:10.1097/jgp.0b013e3181953a02 · Cited by 306 · see citing works
Neural mechanisms underlying motivation of mental versus physical effort
Schmidt, L., Lebreton, M., Cléry-Melin, M.-L., Daunizeau, J., & Pessiglione, M. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001266 · Cited by 310 · see citing works
Functionally dissociable influences on learning rate in a dynamic environment
McGuire, J. T., Nassar, M. R., Gold, J. I., & Kable, J. W. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.013 · Cited by 299 · see citing works
Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning
van den Bos, W., Cohen, M. X., Kahnt, T., & Crone, E. A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr198 · Cited by 276 · see citing works
A reservoir of time constants for memory traces in cortical neurons
Bernacchia, A., Seo, H., Lee, D., & Wang, X.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2752 · Cited by 292 · see citing works
“Using the Bayesian Information Criterion, we found that the best fit was a single exponential for 269 neurons and double exponentials for 268 neurons, whereas the (2) remaining 144 neurons were fitted best by a model with ex(t) = 0.”
BackgroundMethod
Neural Coding of Uncertainty and Probability
Ma, W. J., & Jazayeri, M. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071013-014017 · Cited by 290 · see citing works
Adaptive learning under expected and unexpected uncertainty
Soltani, A., & Izquierdo, A. (2019) · Nature reviews. Neuroscience · doi:10.1038/s41583-019-0180-y · Cited by 286 · see citing works
The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects
FitzGerald, T. H. B., Seymour, B., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0717-09.2009 · Cited by 279 · see citing works
Risk, unexpected uncertainty, and estimation uncertainty: Bayesian learning in unstable settings
Payzan-LeNestour, E., & Bossaerts, P. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001048 · Cited by 267 · see citing works
Common medial frontal mechanisms of adaptive control in humans and rodents
Narayanan, N. S., Cavanagh, J. F., Frank, M. J., & Laubach, M. (2013) · Nature Neuroscience · doi:10.1038/nn.3549 · Cited by 267 · see citing works
Anxiety, Depression, and Decision Making: A Computational Perspective
Bishop, S. J., & Gagne, C. (2018) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-080317-062007 · Cited by 240 · see citing works
fMRI reveals language-specific predictive coding during naturalistic sentence comprehension
Shain, C., Blank, I. A., van Schijndel, M., Schuler, W., & Fedorenko, E. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107307 · Cited by 215 · see citing works
Characterizing anhedonia: A systematic review of neuroimaging across the subtypes of reward processing deficits in depression
Borsini, A., Wallis, A. S. J., Zunszain, P., Pariante, C. M., & Kempton, M. J. (2020) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-020-00804-6 · Cited by 207 · see citing works
Behavioral and Neural Properties of Social Reinforcement Learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Libby, V., Glover, G., Voss, H. U., Ballon, D. J., & Casey, B. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2972-11.2011 · Cited by 191 · see citing works
Resolving response, decision, and strategic control: evidence for a functional topography in dorsomedial prefrontal cortex.
Venkatraman, V., Rosati, A. G., Taren, A. A., & Huettel, S. A. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2708-09.2009 · Cited by 186 · see citing works
Activity in the amygdala elicited by unfair divisions predicts social value orientation
Haruno, M., & Frith, C. D. (2010) · Nature Neuroscience · doi:10.1038/nn.2468 · Cited by 180 · see citing works
Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational Mechanisms
Summerfield, C., & Tsetsos, K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00070 · Cited by 167 · see citing works
The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
Akam, T., Rodrigues-Vaz, I., Marcelo, I., Zhang, X., Pereira, M., Oliveira, R. F., Dayan, P., & Costa, R. M. (2021) · Neuron · doi:10.1016/j.neuron.2020.10.013 · Cited by 170 · see citing works
Orbitofrontal contributions to value-based decision making: evidence from humans with frontal lobe damage
Fellows, L. K. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06229.x · Cited by 169 · see citing works
Individual Differences in Premotor Brain Systems Underlie Behavioral Apathy
Bonnelle, V., Manohar, S., Behrens, T., & Husain, M. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv247 · Cited by 163 · see citing works
Self-citation
More Is Less: A Disinhibited Prefrontal Cortex Impairs Cognitive Flexibility
Gruber, A. J., Calhoon, G. G., Shusterman, I., Schoenbaum, G., Roesch, M. R., & O'Donnell, P. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4623-10.2010 · Cited by 160 · see citing works
Spatial attention, precision, and Bayesian inference: a study of saccadic response speed
Vossel, S., Mathys, C., Daunizeau, J., Bauer, M., Driver, J., Friston, K. J., & Stephan, K. E. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs418 · Cited by 146 · see citing works
Human Scalp Electroencephalography Reveals that Repetition Suppression Varies with Expectation
Summerfield, C., Wyart, V., Johnen, V. M., & de Gardelle, V. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00067 · Cited by 145 · see citing works
The role of cognitive effort in subjective reward devaluation and risky decision-making
Apps, M. A. J., Grima, L. L., Manohar, S., & Husain, M. (2015) · Scientific Reports · doi:10.1038/srep16880 · Cited by 145 · see citing works
Future planning: default network activity couples with frontoparietal control network and reward-processing regions during process and outcome simulations
Gerlach, K. D., Spreng, R. N., Madore, K. P., & Schacter, D. L. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu001 · Cited by 148 · see citing works
Novelty, conditioning and attentional bias to sexual rewards
Banca, P., Morris, L. S., Mitchell, S., Harrison, N. A., Potenza, M. N., & Voon, V. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2015.10.017 · Cited by 137 · see citing works
Girls' challenging social experiences in early adolescence predict neural response to rewards and depressive symptoms
Casement, M. D., Guyer, A. E., Hipwell, A. E., McAloon, R. L., Hoffmann, A. M., Keenan, K. E., & Forbes, E. E. (2014) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2013.12.003 · Cited by 133 · see citing works
Predictive processing, source monitoring, and psychosis
Griffin, J. D., & Fletcher, P. C. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045145 · Cited by 133 · see citing works
A neural network for information seeking
White, J. K., Bromberg-Martin, E. S., Heilbronner, S. R., Zhang, K., Pai, J., Haber, S. N., & Monosov, I. E. (2019) · Nature Communications · doi:10.1038/s41467-019-13135-z · Cited by 129 · see citing works
Fronto-cingulate effective connectivity in obsessive compulsive disorder: a study with fMRI and dynamic causal modeling
Schlösser, R. G. M., Wagner, G., Schachtzabel, C., Peikert, G., Koch, K., Reichenbach, J. R., & Sauer, H. (2010) · Human Brain Mapping · doi:10.1002/hbm.20980 · Cited by 111 · see citing works
Behavior- and Modality-General Representation of Confidence in Orbitofrontal Cortex
Masset, P., Ott, T., Lak, A., Hirokawa, J., & Kepecs, A. (2020) · Cell · doi:10.1016/j.cell.2020.05.022 · Cited by 109 · see citing works
Anterior cingulate cortex in schema assimilation and expression
Wang, S.-H., Tse, D., & Morris, R. G. M. (2012) · Learning & Memory · doi:10.1101/lm.026336.112 · Cited by 106 · see citing works
Subjective confidence reflects representation of Bayesian probability in cortex
Geurts, L. S., Cooke, J. R. H., van Bergen, R. S., & Jehee, J. F. M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-021-01247-w · Cited by 104 · see citing works
Subjecting elite athletes to inspiratory breathing load reveals behavioral and neural signatures of optimal performers in extreme environments
Paulus, M. P., Flagan, T., Simmons, A. N., Gillis, K., Kotturi, S., Thom, N., Johnson, D. C., Van Orden, K. F., Davenport, P. W., & Swain, J. L. (2012) · PLoS ONE · doi:10.1371/journal.pone.0029394 · Cited by 100 · see citing works
“Optimal performers may generate different context-dependent valuation of the interoceptive states within the orbitofrontal cortex [60] leading to altered error processing in the anterior cingulate [61] and selection of different actions [62].”
Background
Functional reorganization of neural networks during repeated exposure to the traumatic memory in posttraumatic stress disorder: an exploratory fMRI study
Cisler, J. M., Steele, J. S., Lenow, J. K., Smitherman, S., Everett, B., Messias, E., & Kilts, C. D. (2014) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2013.09.013 · Cited by 100 · see citing works
Altered functional connectivity of the insular cortex across prefrontal networks in cocaine addiction
Cisler, J. M., Elton, A., Kennedy, A. P., Young, J., Smitherman, S., Andrew James, G., & Kilts, C. D. (2013) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2013.02.007 · Cited by 99 · see citing works
“Other regions implicate the anterior insula as critical in mediating uncertainty processing and tracking variance in risk (Behrens et al., 2007; Bossaerts, 2010; Preuschoff et al., 2008; Rushworth and Behrens, 2008).”
Background
Individual differences in local gray and white matter volumes reflect differences in temperament and character: A voxel-based morphometry study in healthy young females
Van Schuerbeek, P., Baeken, C., De Raedt, R., De Mey, J., & Luypaert, R. (2011) · Brain Research · doi:10.1016/j.brainres.2010.11.073 · Cited by 94 · see citing works
Better than expected or as bad as you thought? The neurocognitive development of probabilistic feedback processing
van den Bos, W. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.052.2009 · Cited by 89 · see citing works
Confidence and psychosis: a neuro-computational account of contingency learning disruption by NMDA blockade
Vinckier, F., Gaillard, R., Palminteri, S., Rigoux, L., Salvador, A., Fornito, A., Adapa, R., Krebs, M. O., Pessiglione, M., & Fletcher, P. C. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.73 · Cited by 87 · see citing works
Amygdala-Prefrontal Synchronization Underlies Resistance to Extinction of Aversive Memories
Livneh, U., & Paz, R. (2012) · Neuron · doi:10.1016/j.neuron.2012.05.016 · Cited by 87 · see citing works
A brain network instantiating approach and avoidance motivation
Spielberg, J. M., Miller, G. A., Warren, S. L., Engels, A. S., Crocker, L. D., Banich, M. T., Sutton, B. P., & Heller, W. (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01443.x · Cited by 84 · see citing works
The dopaminergic hypothesis of attention-deficit/hyperactivity disorder needs re-examining
Gonon, F. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2008.09.010 · Cited by 79 · see citing works
Covert rapid action-memory simulation (CRAMS): a hypothesis of hippocampal-prefrontal interactions for adaptive behavior
Wang, J. X., Cohen, N. J., & Voss, J. L. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.04.003 · Cited by 75 · see citing works
Risk-Responsive Orbitofrontal Neurons Track Acquired Salience
Ogawa, M., van der Meer, M. A. A., Esber, G. R., Cerri, D. H., Stalnaker, T. A., & Schoenbaum, G. (2013) · Neuron · doi:10.1016/j.neuron.2012.11.006 · Cited by 74 · see citing works
Neurocognitive Development of Risk Aversion from Early Childhood to Adulthood
Paulsen, D. J., Carter, R. M., Platt, M. L., Huettel, S. A., & Brannon, E. M. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00178 · Cited by 65 · see citing works
Post-error recruitment of frontal sensory cortical projections promotes attention in mice
Norman, K. J., Riceberg, J. S., Koike, H., Bateh, J., McCraney, S. E., Caro, K., Kato, D., Liang, A., Yamamuro, K., Flanigan, M. E., et al. (2021) · Neuron · doi:10.1016/j.neuron.2021.02.001 · Cited by 66 · see citing works
Influence of prior beliefs on perception in early psychosis: Effects of illness stage and hierarchical level of belief.
Haarsma, J., Knolle, F., Griffin, J. D., Taverne, H., Mada, M., Goodyer, I. M., The NSPN Consortium, Fletcher, P. C., & Murray, G. K. (2020) · Journal of Abnormal Psychology · doi:10.1037/abn0000494 · Cited by 60 · see citing works
Cocaine cue-induced dopamine release in the human prefrontal cortex
Milella, M. S., Fotros, A., Gravel, P., Casey, K. F., Larcher, K., Verhaeghe, J. A. J., Cox, S. M. L., Reader, A. J., Dagher, A., Benkelfat, C., et al. (2016) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.150207 · Cited by 56 · see citing works
Studying the neural representations of uncertainty
Walker, E. Y., Pohl, S., Denison, R. N., Barack, D. L., Lee, J., Block, N., Ma, W. J., & Meyniel, F. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01444-y · Cited by 56 · see citing works
Effects of prospective thinking on intertemporal choice: the role of familiarity
Sasse, L. K., Peters, J., Büchel, C., & Brassen, S. (2015) · Human Brain Mapping · doi:10.1002/hbm.22912 · Cited by 54 · see citing works
Connectivity-based parcellation increases network detection sensitivity in resting state fMRI: an investigation into the cingulate cortex in autism
Balsters, J. H., Mantini, D., Apps, M. A. J., Eickhoff, S. B., & Wenderoth, N. (2016) · NeuroImage: Clinical · doi:10.1016/j.nicl.2016.03.016 · Cited by 50 · see citing works
Neuropathology of the Anterior Midcingulate Cortex in Young Children With Autism
Uppal, N., Wicinski, B., Buxbaum, J. D., Heinsen, H., Schmitz, C., & Hof, P. R. (2014) · Journal of Neuropathology & Experimental Neurology · doi:10.1097/nen.0000000000000108 · Cited by 52 · see citing works
Identification and disruption of a neural mechanism for accumulating prospective metacognitive information prior to decision-making
Miyamoto, K., Trudel, N., Kamermans, K., Lim, M. C., Lazari, A., Verhagen, L., Wittmann, M. K., & Rushworth, M. F. S. (2021) · Neuron · doi:10.1016/j.neuron.2021.02.024 · Cited by 45 · see citing works
Self-citation
Controlling one’s world: Identification of sub-regions of primate PFC underlying goal-directed behavior
Duan, L. Y., Horst, N. K., Cranmore, S. A. W., Horiguchi, N., Cardinal, R. N., Roberts, A. C., & Robbins, T. W. (2021) · Neuron · doi:10.1016/j.neuron.2021.06.003 · Cited by 41 · see citing works
A corticoamygdalar pathway controls reward devaluation and depression using dynamic inhibition code
Yuan, Z., Qi, Z., Wang, R., Cui, Y., An, S., Wu, G., Feng, Q., Lin, R., Dai, R., Li, A., et al. (2023) · Neuron · doi:10.1016/j.neuron.2023.08.022 · Cited by 45 · see citing works
Glutamate, obsessive–compulsive disorder, schizophrenia, and the stability of cortical attractor neuronal networks
Rolls, E. T. (2012) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2011.06.017 · Cited by 39 · see citing works
Valuation of uncertain and delayed rewards in primate prefrontal cortex
Kim, S., Hwang, J., Seo, H., & Lee, D. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.010 · Cited by 37 · see citing works
Motivation in the Service of Allostasis: The Role of Anterior Mid-Cingulate Cortex
Touroutoglou, A., Andreano, J. M., Adebayo, M., Lyons, S., & Barrett, L. F. (2019) · Advances in Motivation Science · doi:10.1016/bs.adms.2018.09.002 · Cited by 25 · see citing works
A subcortical switchboard for perseverative, exploratory and disengaged states
Ahmadlou, M., Shirazi, M. Y., Zhang, P., Rogers, I. L. M., Dziubek, J., Young, M., & Hofer, S. B. (2025) · Nature · doi:10.1038/s41586-025-08672-1 · Cited by 25 · see citing works
Cardiac afferent activity modulates early neural signature of error detection during skilled performance
Bury, G., García-Huéscar, M., Bhattacharya, J., & Ruiz, M. H. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.04.043 · Cited by 20 · see citing works
Interpretable abstractions of artificial neural networks predict behavior and neural activity during human information gathering
D’Ambrogio, S., Grohn, J., Khalighinejad, N., Mattar, M. G., Hunt, L., & Rushworth, M. F. S. (2026) · Nature Neuroscience · doi:10.1038/s41593-026-02342-9 · Cited by 1 · see citing works
Self-citation
Dissociable roles of prefrontal plasticity in decision-making strategy and execution of habitual behavior
Asaoka, N., Pagano, D., & Hayashi, Y. (2026) · Nature Communications · doi:10.1038/s41467-026-75706-1
“We focused on anterior cingulate, lateral and medial orbitofrontal cortices (ACC, LOFC and MOFC), as they have been implicated in reinforcement learning and decision-making 10,19 .”

The ventral striatum
Tremblay, L., Worbe, Y., & Hollerman, J. R. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.00003-0 · Cited by 29 · see citing works
Repression of Dlx1/2 Signaling by Nolz-1/Znf503 is Essential for Parcellation of the Striatal Complex into Dorsal and Ventral StriatumPreprint
Lu, K.-M., Chen, S.-Y., Ko, H.-A., Huang, T.-H., Hao, J. H.-J., Yan, Y., Chang, S. L., Evans, S. Μ., & Liu, F.-C. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/463398
Parcellation of the striatal complex into dorsal and ventral districts
Chen, S., Lu, K.-M., Ko, H.-A., Huang, T.-H., Hao, J. H.-J., Yan, Y., Chang, S. L., Evans, S. Μ., & Liu, F. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1921007117 · Cited by 32 · see citing works
The Concept of the Ventral Striatum in Nonhuman Primates
HABER, S. N., & McFARLAND, N. R. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09259.x · Cited by 253 · see citing works
Defining the Caudal Ventral Striatum in Primates: Cellular and Histochemical Features
Fudge, J. L., & Haber, S. N. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-23-10078.2002 · Cited by 79 · see citing works

Authors: Rushworth, M. F. S., & Behrens, T. E. J.
Affiliations: John Radcliffe Hospital (GB)
Corresponding author: Rushworth, Matthew F S
Behrens, Timothy E J
ORCID: Rushworth, Matthew F S
Behrens, Timothy E J
Venue: Nature Neuroscience
Publisher: Springer Science and Business Media LLC
Published: 2008-03-26
Volume: 11
Issue: 4
Pages: 389-397
ISSN: 1097-6256 (ISSN-L)
1546-1726
DOI: 10.1038/nn2066
OpenAlex: W1983230739
Cited by: 866
References: 104
Citations by year: 2026: 32 · 2025: 33 · 2024: 37 · 2023: 34 · 2022: 30 · 2021: 33 · 2020: 57 · 2019: 41 · 2018: 44 · 2017: 57 · 2016: 47 · 2015: 47 · 2014: 56 · 2013: 60 · 2012: 70
FWCI: 4.77
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Nature Neuroscience (publishedVersion)
PubMed (publishedVersion)
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
Keywords: decision-making, reward anticipation, reward prediction error, uncertainty, value of information, prefrontal cortex, cingulate cortex, reinforcement learning, action costs
MeSH terms: Animals, Choice Behavior, Decision Making, Gyrus Cinguli, Humans, Probability Learning, Psychological Theory, Reinforcement, Psychology, Prefrontal Cortex, Risk Assessment, Uncertainty

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Choice, uncertainty and value in prefrontal and cingulate cortex

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks