The Decision to Engage Cognitive Control Is Driven by Expected Reward-Value: Neural and Behavioral Evidence
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Cognitive control is a fundamental skill reflecting the active use of task-rules to guide behavior and suppress inappropriate automatic responses. Prior work has traditionally used paradigms in which subjects are told when to engage cognitive control. Thus, surprisingly little is known about the factors that influence individuals' initial decision of whether or not to act in a reflective, rule-based manner. To examine this, we took three classic cognitive control tasks (Stroop, Wisconsin Card Sorting Task, Go/No-Go task) and created novel 'free-choice' versions in which human subjects were free to select an automatic, pre-potent action, or an action requiring rule-based cognitive control, and earned varying amounts of money based on their choices. Our findings demonstrated that subjects' decision to engage cognitive control was driven by an explicit representation of monetary rewards expected to be obtained from rule-use. Subjects rarely engaged cognitive control when the expected outcome was of equal or lesser value as compared to the value of the automatic response, but frequently engaged cognitive control when it was expected to yield a larger monetary outcome. Additionally, we exploited fMRI-adaptation to show that the lateral prefrontal cortex (LPFC) represents associations between rules and expected reward outcomes. Together, these findings suggest that individuals are more likely to act in a reflective, rule-based manner when they expect that it will result in a desired outcome. Thus, choosing to exert cognitive control is not simply a matter of reason and willpower, but rather, conforms to standard mechanisms of value-based decision making. Finally, in contrast to current models of LPFC function, our results suggest that the LPFC plays a direct role in representing motivational incentives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · cited 4×
“Finally, recent neuroeconomic studies have revealed a direct correspondence between LPFC activity and the subjective value assigned to choice options [29], preference for temporally delayed rewards [19,26,30], decision making involving risk [31,32], tracking actionoutcome history [33], and a decision making strategy t…”
BackgroundInfluentialThe role of the medial frontal cortex in cognitive control
Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004) · Science · doi:10.1126/science.1100301 · Cited by 2,974
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“idea of a model-based learning system [56] and may operate in parallel with other (model-free) mechanisms.”
BackgroundRepetition and the brain: neural models of stimulus-specific effects
Grill-Spector, K., Henson, R., & Martin, A. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.11.006 · Cited by 2,256 · cited 2×
“represented by different brain regions [35,36].”
MethodA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · cited 1×
“value [1].”
Self-Control in Decision-Making Involves Modulation of the vmPFC Valuation System
Hare, T. A., Camerer, C. F., & Rangel, A. (2009) · Science · doi:10.1126/science.1168450 · Cited by 1,928
Impulse and Self-Control From a Dual-Systems Perspective
Hofmann, W., Friese, M., & Strack, F. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01116.x · Cited by 1,487
Self-regulation, ego depletion, and motivation
Baumeister, R. F., & Vohs, K. D. (2007) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2007.00001.x · Cited by 1,402 · cited 2×
“We follow Baumeister and Vohs [8] and Fujita [9] in suggesting that motivation is a crucial element of any decision, including those involving self-regulation and rule-based behavior.”
BackgroundInfluentialEncoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Cognitive neuroscience of self-regulation failure
Heatherton, T. F., & Wagner, D. D. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.005 · Cited by 1,033
Expectation (and attention) in visual cognition
Summerfield, C., & Egner, T. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.06.003 · Cited by 950 · cited 1×
“[52,55].”
Choice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855
On conceptualizing self-control as more than the effortful inhibition of impulses.
Fujita, K. (2011) · Personality and Social Psychology Review · doi:10.1177/1088868311411165 · Cited by 734 · cited 2×
“We follow Baumeister and Vohs [8] and Fujita [9] in suggesting that motivation is a crucial element of any decision, including those involving self-regulation and rule-based behavior.”
BackgroundInfluentialLateral prefrontal cortex and self-control in intertemporal choice
Figner, B., Knoch, D., Johnson, E. J., Krosch, A. R., Lisanby, S. H., Fehr, E., & Weber, E. U. (2010) · Nature Neuroscience · doi:10.1038/nn.2516 · Cited by 706 · cited 2×
“Finally, recent neuroeconomic studies have revealed a direct correspondence between LPFC activity and the subjective value assigned to choice options [29], preference for temporally delayed rewards [19,26,30], decision making involving risk [31,32], tracking actionoutcome history [33], and a decision making strategy t…”
BackgroundReward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · cited 2×
“Moreover, recent work has demonstrated that cognitive control related activity in the LPFC is modulated by the availability of reward incentives [10,11,14,15,17].”
BackgroundMotivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590 · cited 2×
“, [10,11], it is assumed that this reflects an amplified representation of just the task rules [16].”
BackgroundNeural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour
Rushworth, M. F. S., Behrens, T. E. J., Rudebeck, P. H., & Walton, M. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.01.004 · Cited by 507 · cited 1×
“This idea is a natural extension of work highlighting the role of the orbitofrontal cortex in representing object-outcome associations [2,3,4], and the role of the cingulate cortex in representing actionoutcome associations [60,61].”
BackgroundLeon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449 · cited 2×
“Moreover, recent work has demonstrated that cognitive control related activity in the LPFC is modulated by the availability of reward incentives [10,11,14,15,17].”
BackgroundA method for removal of global effects from fMRI time series
Macey, P. M., Macey, K. E., Kumar, R., & Harper, R. M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.12.042 · Cited by 407 · cited 1×
“Finally, a linear detrending procedure [65] was applied to remove time-series components that were correlated with global changes in the BOLD signal.”
MethodNeural representations of subjective reward value
Peters, J., & Büchel, C. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.04.031 · Cited by 405 · cited 1×
“occurrence, required effort expenditure, and delay until the reward [46,47,48,49].”
BackgroundWalton, M. E., Behrens, T. E. J., Buckley, M. J., Rudebeck, P. H., & Rushworth, M. F. S. (2010) · Neuron · doi:10.1016/j.neuron.2010.02.027 · Cited by 397
Neuronal correlates of goal-based motor selection in the prefrontal cortex.
Matsumoto, K., Suzuki, W., & Tanaka, K. (2003) · Science · doi:10.1126/science.1084204 · Cited by 384 · cited 1×
“This idea is a natural extension of work highlighting the role of the orbitofrontal cortex in representing object-outcome associations [2,3,4], and the role of the cingulate cortex in representing actionoutcome associations [60,61].”
BackgroundNeural Circuits Subserving the Retrieval and Maintenance of Abstract Rules
Bunge, S. A., Kahn, I., Wallis, J. D., Miller, E. K., & Wagner, A. D. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00910.2002 · Cited by 361 · cited 1×
“Consistent with prior work examining rule processing [41,43,44], repetition of the rules was associated with repetition Figure 1.”
ResultRepetition suppression of ventromedial prefrontal activity during judgments of self and others
Jenkins, A. C., Macrae, C. N., & Mitchell, J. P. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0708785105 · Cited by 266 · cited 2×
“Finally, our findings and several previous studies [39,40,41] highlight the feasibility of using fMRI-adaptation to examine complex cognitive and motivational processes.”
MethodResultSeparate Neural Mechanisms Underlie Choices and Strategic Preferences in Risky Decision Making
Venkatraman, V., Payne, J. W., Bettman, J. R., Luce, M. F., & Huettel, S. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.04.007 · Cited by 222
Heterogeneous reward signals in prefrontal cortex
Wallis, J. D., & Kennerley, S. W. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.009 · Cited by 186 · cited 1×
“occurrence, required effort expenditure, and delay until the reward [46,47,48,49].”
BackgroundDynamic Signals Related to Choices and Outcomes in the Dorsolateral Prefrontal Cortex
Seo, H., Barraclough, D. J., & Lee, D. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm064 · Cited by 143
Concurrent Repetition Enhancement and Suppression Responses in Extrastriate Visual Cortex
de Gardelle, V., Waszczuk, M., Egner, T., & Summerfield, C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs211 · Cited by 83
De Baene, W., Kühn, S., & Brass, M. (2012) · Human Brain Mapping · doi:10.1002/hbm.21234 · Cited by 52
Cited by
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
Scale for the Assessment of Negative Symptoms
Andreasen, N. C. (2014) · PsycTESTS Dataset · doi:10.1037/t12696-000 · Cited by 1,866
Mind-wandering as spontaneous thought: a dynamic framework
Christoff, K., Irving, Z. C., Fox, K. C. R., Spreng, R. N., & Andrews-Hanna, J. R. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.113 · Cited by 1,376
Toward a rational and mechanistic account of mental effort
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T. L., Cohen, J. D., & Botvinick, M. M. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031526 · Cited by 1,077
Motivation and cognitive control: from behavior to neural mechanism
Botvinick, M., & Braver, T. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015044 · Cited by 909
Metadata
- Authors
- Dixon, M. L., & Christoff, K.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-12-19
- Volume
- 7
- Issue
- 12
- Pages
- e51637
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2171501237
- Cited by
- 139
- References
- 31
- FWCI
- 3.07
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.