Motivation of extended behaviors by anterior cingulate cortex
Abstract
Intense research interest over the past decade has yielded diverse and often discrepant theories about the function of anterior cingulate cortex (ACC). In particular, a dichotomy has emerged between neuropsychological theories suggesting a primary role for ACC in motivating or 'energizing' behavior, and neuroimaging-inspired theories emphasizing its contribution to cognitive control and reinforcement learning. To reconcile these views, we propose that ACC supports the selection and maintenance of 'options' - extended, context-specific sequences of behavior directed toward particular goals - that are learned through a process of hierarchical reinforcement learning. This theory accounts for ACC activity in relation to learning and control while simultaneously explaining the effects of ACC damage as disrupting the motivational context supporting the production of goal-directed action sequences.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Modern theories of motivation describe motivational states as the output of a computation where expected value of an action is weighed against anticipated costs (energetic, opportunity, hedonic).
“Consequently, modern theories of motivation increasingly describe motivational states as the output of a computation (calculation), where the expected value of an action is weighed against anticipated costs. These include energetic costs, as all goal pursuit will require the expenditure of metabolic energy, opportunity costs, as the pursuit of one goal might block progress towards another, hedonic”
From Motivation in the Service of Allostasis: The Role of Anterior Mid-Cingulate Cortex (2019) · cites this paper as Holroyd and Yeung, 2012
The aMCC is a cortical structural and functional hub that could fulfill the role of integrating motor and visceromotor signals to motivate behavior.
“A number of neuroimaging studies (Holroyd and Yeung, 2012; Vassena et al., 2017; Vogt, 2016) suggest that the aMCC is a cortical structural and functional hub that could fulfill such a role of integrating motor and visceromotor signals to motivate behavior.”
From Motivation in the Service of Allostasis: The Role of Anterior Mid-Cingulate Cortex (2019) · cites this paper as Holroyd and Yeung, 2012
Anterior cingulate cortex is related to computation of prediction errors based on one's current state and expected state, resulting in motivation for approaching or avoiding stimuli to restore balance.
“Anterior cingulate cortex was related to the computation of prediction errors based on one’s current state and the expected state (Paulus et al., 2013), which resulted in the motivation of individuals for approaching or avoiding stimuli (Holroyd and Yeung, 2012) to restore balance (Khalsa and Lapidus, 2016).”
From Enhanced Resting-State Functional Connectivity With Decreased Amplitude of Low-Frequency Fluctuations of the Salience Network in Mindfulness Novices (2022) · cites this paper as Holroyd and Yeung, 2012
Cites
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027 · see citing works
Self-citationContributions of anterior cingulate cortex to behaviour
Devinsky, O., Morrell, M. J., & Vogt, B. A. (1995) · Brain · doi:10.1093/brain/118.1.279 · Cited by 3,377 · see citing works
Anterior Cingulate Conflict Monitoring and Adjustments in Control
Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004) · Science · doi:10.1126/science.1089910 · Cited by 2,891 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
A dual-networks architecture of top-down control
Dosenbach, N. U. F., Fair, D. A., Cohen, A. L., Schlaggar, B. L., & Petersen, S. E. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.01.001 · Cited by 1,931 · see citing works
The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour
Duncan, J. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.004 · Cited by 1,846 · see citing works
Multiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226 · see citing works
Dichotomous dopaminergic control of striatal synaptic plasticity
Shen, W., Flajolet, M., Greengard, P., & Surmeier, D. J. (2008) · Science · doi:10.1126/science.1160575 · Cited by 1,190 · see citing works
Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function
BOTVINICK, M. M. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.356 · Cited by 1,117 · see citing works
Medial prefrontal cortex as an action-outcome predictor
Alexander, W. H., & Brown, J. W. (2011) · Nature Neuroscience · doi:10.1038/nn.2921 · Cited by 1,000 · see citing works
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · see citing works
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 724 · see citing works
Reading Hidden Intentions in the Human Brain
Haynes, J., Sakai, K., Rees, G. E., Gilbert, S. J., Frith, C., & Passingham, R. E. (2007) · Current Biology · doi:10.1016/j.cub.2006.11.072 · Cited by 695 · see citing works
Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective
Botvinick, M. M., Niv, Y., & Barto, A. G. (2009) · Cognition · doi:10.1016/j.cognition.2008.08.011 · Cited by 646 · see citing works
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642 · see citing works
Overbeek, T. J. M., Nieuwenhuis, S., & Ridderinkhof, K. R. (2005) · Journal of Psychophysiology · doi:10.1027/0269-8803.19.4.319 · Cited by 600 · see citing works
Motivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590 · see citing works
Durstewitz, D., & Seamans, J. K. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.05.015 · Cited by 586 · see citing works
Holroyd, C. B., Pakzad-Vaezi, K. L., & Krigolson, O. E. (2008) · Psychophysiology · doi:10.1111/j.1469-8986.2008.00668.x · Cited by 581 · see citing works
Self-citationEffort-Based Cost–Benefit Valuation and the Human Brain
Croxson, P. L., Walton, M. E., O'Reilly, J. X., Behrens, T. E. J., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4515-08.2009 · Cited by 560 · see citing works
Hierarchical models of behavior and prefrontal function
Botvinick, M. M. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.02.009 · Cited by 532 · see citing works
ERP Correlates of Feedback and Reward Processing in the Presence and Absence of Response Choice
Yeung, N., Holroyd, C. B., & Cohen, J. D. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh153 · Cited by 520 · see citing works
Self-citationRole of the Human Medial Frontal Cortex in Task Switching: A Combined fMRI and TMS Study
Rushworth, M. F. S., Hadland, K. A., Paus, T., & Sipilä, P. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.87.5.2577 · Cited by 516 · see citing works
Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy
Shidara, M., & Richmond, B. J. (2002) · Science · doi:10.1126/science.1069504 · Cited by 515 · see citing works
Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour
Rushworth, M. F. S., Behrens, T. E. J., Rudebeck, P. H., & Walton, M. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.01.004 · Cited by 507 · see citing works
Carlson, J. M., Foti, D., Mujica-Parodi, L. R., Harmon‐Jones, E., & Hajcak, G. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.037 · Cited by 478 · see citing works
Biologically Based Computational Models of High-Level Cognition
O’Reilly, R. C. (2006) · Science · doi:10.1126/science.1127242 · Cited by 447 · see citing works
Cingulate Neurobiology and Disease
(2009) · doi:10.1093/oso/9780198566960.001.0001 · Cited by 446 · see citing works
Anterior cingulate activity during error and autonomic response
Critchley, H. D., Tang, J., Glaser, D., Butterworth, B., & Dolan, R. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.05.047 · Cited by 445 · see citing works
A computational substrate for incentive salience
McClure, S. M., Daw, N. D., & Montague, P. R. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00177-2 · Cited by 416 · see citing works
Task Set and Prefrontal Cortex
Sakai, K. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125642 · Cited by 390 · see citing works
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · see citing works
Computational perspectives on dopamine function in prefrontal cortex
Cohen, J. D., Braver, T. S., & Brown, J. W. (2002) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(02)00314-8 · Cited by 386 · see citing works
Multiple frontal systems controlling response speed.
Stuss, D., Alexander, M., Shallice, T., Picton, T., Binns, M., Macdonald, R., Borowiec, A., & Katz, D. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.06.010 · Cited by 351 · see citing works
Reward Encoding in the Monkey Anterior Cingulate Cortex
Amiez, C., Joseph, J., & Procyk, E. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj046 · Cited by 351 · see citing works
Durstewitz, D., Vittoz, N. M., Floresco, S., & Seamans, J. K. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.029 · Cited by 351 · see citing works
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · see citing works
Johnston, K., Levin, H., Koval, M. J., & Everling, S. (2007) · Neuron · doi:10.1016/j.neuron.2006.12.023 · Cited by 305 · see citing works
Weighing up the benefits of work: Behavioral and neural analyses of effort-related decision making
Walton, M. E., Kennerley, S. W., Bannerman, D. M., Phillips, P. E. M., & Rushworth, M. F. S. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.005 · Cited by 305 · see citing works
Denk, F., Walton, M. E., Jennings, K. A., Sharp, T., Rushworth, M. F. S., & Bannerman, D. M. (2004) · Psychopharmacology · doi:10.1007/s00213-004-2059-4 · Cited by 294 · see citing works
Human substantia nigra neurons encode unexpected financial rewards
Zaghloul, K. A., Blanco, J. A., Weidemann, C. T., McGill, K., Jaggi, J. L., Baltuch, G. H., & Kahana, M. J. (2009) · Science · doi:10.1126/science.1167342 · Cited by 264 · see citing works
A normative perspective on motivation
NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251 · see citing works
Neurocomputational models of basal ganglia function in learning, memory and choice
Cohen, M. X., & Frank, M. J. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.029 · Cited by 238 · see citing works
Effortless control: Executive attention and conscious feeling of mental effort are dissociable
Naccache, L., Dehaene, S., Cohen, L., Habert, M.-O., Guichart-Gomez, E., Galanaud, D., & Willer, J.-C. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.11.024 · Cited by 211 · see citing works
A Neural Signature of Hierarchical Reinforcement Learning
Fernandes, J. J. F. R., Solway, A., Diuk, C., McGuire, J. T., Barto, A. G., Niv, Y., & Botvinick, M. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.042 · Cited by 193 · see citing works
Impairments of attention after cingulotomy
Cohen, R. A., Kaplan, R. F., Moser, D. J., Jenkins, M. A., & Wilkinson, H. A. (1999) · Neurology · doi:10.1212/wnl.53.4.819 · Cited by 192 · see citing works
Niv, Y. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.018 · Cited by 179 · see citing works
Neuropharmacology of performance monitoring
Jocham, G., & Ullsperger, M. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2008.08.011 · Cited by 168 · see citing works
Dopamine D1 receptors in the anterior cingulate cortex regulate effort-based decision makingPreprint
Schweimer, J. V., & Hauber, W. (2006) · Learning & Memory · doi:10.1101/lm.409306 · Cited by 157 · see citing works
Evidence for a close relationship between conscious effort and anterior cingulate cortex activity
Mulert, C., Menzinger, E., Leicht, G., Pogarell, O., & Hegerl, U. (2005) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2004.10.002 · Cited by 144 · see citing works
The effect of cingulate cortex lesions on task switching and working memory
Rushworth, M. F. S., Hadland, K. A., Gaffan, D., & Passingham, R. E. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321593072 · Cited by 138 · see citing works
Pears, A., Parkinson, J. A., Hopewell, L. J., Everitt, B. J., & Roberts, A. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-35-11189.2003 · Cited by 136 · see citing works
Voluntary Selection of Task Sets Revealed by Functional Magnetic Resonance Imaging
Forstmann, B. U., Braß, M., Koch, I., & von Cramon, D. Y. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/089892906775990589 · Cited by 135 · see citing works
The role of the preSMA and the rostral cingulate zone in internally selected actions
Mueller, V. A., Brass, M., Waszak, F., & Prinz, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.018 · Cited by 135 · see citing works
Dopamine modulates neural networks involved in effort-based decision-making
Assadi, S. M., Yücel, M., & Pantelis, C. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2008.10.010 · Cited by 133 · see citing works
Neural Basis of Motivational and Cognitive Control
Mars, R., Sallet, J., Mfs., R., & Yeung, N. (2011) · The MIT Press eBooks · doi:10.7551/mitpress/9780262016438.001.0001 · Cited by 128 · see citing works
Neuropsychology of human emotion
Catalano, F. L. (1984) · Comprehensive Psychiatry · doi:10.1016/0010-440x(84)90014-2 · Cited by 126 · see citing works
Emeric, E. E., Brown, J. W., Leslie, M., Pouget, P., Stuphorn, V., & Schall, J. D. (2008) · Journal of Neurophysiology · doi:10.1152/jn.00896.2006 · Cited by 114 · see citing works
Schweimer, J. V., Saft, S., & Hauber, W. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.6.1687 · Cited by 101 · see citing works
Gorelova, N., Mulholland, P. J., Chandler, L. J., & Seamans, J. K. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr107 · Cited by 98 · see citing works
N�meth, G., Heged�s, K., & Moln�r, L. (1988) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/bf00449910 · Cited by 82 · see citing works
Attracting Dynamics of Frontal Cortex Ensembles during Memory-Guided Decision-Making
Balaguer‐Ballester, E., Lapish, C. C., Seamans, J. K., & Durstewitz, D. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002057 · Cited by 81 · see citing works
Control over Conflict during Movement Preparation: Role of Posterior Parietal Cortex
Coulthard, E. J., Nachev, P., & Masud Husain, B. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.009 · Cited by 78 · see citing works
Regions and Subregions of the Cingulate Cortex
Vogt, B. A. (2009) · doi:10.1093/oso/9780198566960.003.0001 · Cited by 71 · see citing works
Hoshi, E., Sawamura, H., & Tanji, J. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01201.2004 · Cited by 67 · see citing works
Learning by doing: an fMRI study of feedback-related brain activations
Marco‐Pallarés, J., Müller, S., & Münte, T. F. (2007) · Neuroreport · doi:10.1097/wnr.0b013e3282e9a58c · Cited by 66 · see citing works
Holroyd, C. B., & Yeung, N. (2011) · The MIT Press eBooks · doi:10.7551/mitpress/8791.003.0024 · Cited by 37 · see citing works
Self-citationVezoli, J., & Procyk, E. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4943-09.2009 · Cited by 34 · see citing works
Nachev, P. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.04.025 · Cited by 20 · see citing works
Conflict Monitoring and Cognitive Control
Yeung, N. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199988709.013.0018 · Cited by 14 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321 · see citing works
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381 · see citing works
Toward a rational and mechanistic account of mental effort
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T. L., Cohen, J. D., & Botvinick, M. M. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031526 · Cited by 1,077 · see citing works
Motivation and cognitive control: from behavior to neural mechanism
Botvinick, M., & Braver, T. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015044 · Cited by 909 · see citing works
The Effort Paradox: Effort Is Both Costly and Valued
Inzlicht, M., Shenhav, A., & Olivola, C. Y. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.007 · Cited by 689 · see citing works
Cognitive effort: A neuroeconomic approach
Westbrook, A., & Braver, T. S. (2015) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-015-0334-y · Cited by 631 · see citing works
The Anterior Cingulate Gyrus and Social Cognition: Tracking the Motivation of Others
Apps, M. A. J., Rushworth, M. F. S., & Chang, S. W. C. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.018 · Cited by 559 · see citing works
“As a result of these findings, many attempts have been made to develop domain-general models of the contributionsof this region tocognitiveprocessing (Alexander andBrown, 2011; Holroyd and McClure, 2015; Holroyd and Yeung, 2012; Silvetti et al., 2014; Verguts et al., 2015).”
InfluentialSmallwood, J. (2013) · Psychological Bulletin · doi:10.1037/a0030010 · Cited by 564 · see citing works
Dorsal anterior cingulate cortex and the value of control
Shenhav, A., Cohen, J. D., & Botvinick, M. (2016) · Nature Neuroscience · doi:10.1038/nn.4384 · Cited by 573 · see citing works
Insights into Human Behavior from Lesions to the Prefrontal Cortex
Szczepanski, S. M., & Knight, R. T. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.011 · Cited by 504 · see citing works
On the relationship between anxiety and error monitoring: a meta-analysis and conceptual framework
Moser, J. S., Moran, T. P., Schroder, H. S., Donnellan, M. B., & Yeung, N. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00466 · Cited by 445 · see citing works
Self-citationDorsal Anterior Cingulate Cortex: A Bottom-Up View
Heilbronner, S. R., & Hayden, B. Y. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-013952 · Cited by 469 · see citing works
Neurocomputational mechanisms underlying subjective valuation of effort costs
Chong, T. T.-J., Apps, M., Giehl, K., Sillence, A., Grima, L. L., & Husain, M. (2017) · PLOS Biology · doi:10.1371/journal.pbio.1002598 · Cited by 415 · see citing works
A multifaceted investigation of the link between mental fatigue and task disengagement
Hopstaken, J. F., van der Linden, D., Bakker, A. B., & Kompier, M. A. J. (2014) · Psychophysiology · doi:10.1111/psyp.12339 · Cited by 454 · see citing works
Neural mechanisms and temporal dynamics of performance monitoring
Ullsperger, M., Fischer, A. G., Nigbur, R., & Endraß, T. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.009 · Cited by 429 · see citing works
Olney, N. T., Spina, S., & Miller, B. L. (2017) · Neurologic Clinics · doi:10.1016/j.ncl.2017.01.008 · Cited by 419 · see citing works
Mechanisms of motivation–cognition interaction: challenges and opportunities
Braver, T. S., Krug, M. K., Chiew, K. S., Kool, W., Westbrook, J. A., Clement, N. J., Adcock, R. A., Barch, D. M., Botvinick, M., Carver, C. S., et al. (2014) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-014-0300-0 · Cited by 400 · see citing works
The anatomy of apathy: a neurocognitive framework for amotivated behaviour
Le Heron, C., Apps., M. A. J., & Husain, M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.07.003 · Cited by 380 · see citing works
“…these regions have in three key components of motivation: willingness to initiate an action (to work), to sustain performance (to keep working), and to learn whether actions are worth performing (what is worth working for) (Holroyd and Yeung, 2012; Kolling et al., 2016b; Salamone et al., 2016).”
BackgroundBaird, B., Smallwood, J., Gorgolewski, K. J., & Margulies, D. S. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.0786-13.2013 · Cited by 315 · see citing works
Hierarchical active inference: A theory of motivated control
Pezzulo, G., Rigoli, F., & Friston, K. J. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.009 · Cited by 334 · see citing works
Dopamine Does Double Duty in Motivating Cognitive Effort
Westbrook, A., & Braver, T. S. (2016) · Neuron · doi:10.1016/j.neuron.2015.12.029 · Cited by 313 · see citing works
Anterior cingulate cortex dysfunction underlies social deficits in Shank3 mutant mice
Guo, B., Chen, J., Chen, Q., Ren, K., Feng, D., Mao, H., Yao, H., Yang, J., Liu, H., Liu, Y., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0445-9 · Cited by 287 · see citing works
Behavioral Variability through Stochastic Choice and Its Gating by Anterior Cingulate Cortex
Tervo, D. G. R., Proskurin, M., Manakov, M., Kabra, M., Vollmer, A., Branson, K. M., & Karpova, A. Y. (2014) · Cell · doi:10.1016/j.cell.2014.08.037 · Cited by 269 · see citing works
Anterior cingulate engagement in a foraging context reflects choice difficulty, not foraging value
Shenhav, A., Straccia, M. A., Cohen, J. D., & Botvinick, M. (2014) · Nature Neuroscience · doi:10.1038/nn.3771 · Cited by 277 · see citing works
Rogers, J. P., Oldham, C. M., Fricchione, G. L., Northoff, G., Wilson, J. E., Mann, S. C., Francis, A., Wieck, A., Wachtel, L. E., Lewis, G., et al. (2023) · Journal of Psychopharmacology · doi:10.1177/02698811231158232 · Cited by 267 · see citing works
The anatomy of empathy: Vicarious experience and disorders of social cognition
Lockwood, P. L. (2016) · Behavioural Brain Research · doi:10.1016/j.bbr.2016.05.048 · Cited by 245 · see citing works
A distributed, hierarchical and recurrent framework for reward-based choice
Hunt, L. T., & Hayden, B. Y. (2017) · Nature reviews. Neuroscience · doi:10.1038/nrn.2017.7 · Cited by 237 · see citing works
Hierarchical reinforcement learning and decision making
Botvinick, M. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.05.008 · Cited by 230 · see citing works
Müller, T., & Apps, M. A. J. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.04.030 · Cited by 231 · see citing works
The Neuroscience of Growth Mindset and Intrinsic Motivation
Ng, B. (2018) · Brain Sciences · doi:10.3390/brainsci8020020 · Cited by 230 · see citing works
Dezfouli, A., & Balleine, B. W. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003364 · Cited by 221 · see citing works
Striatal Contributions to Declarative Memory Retrieval
Scimeca, J. M., & Badre, D. (2012) · Neuron · doi:10.1016/j.neuron.2012.07.014 · Cited by 195 · see citing works
Hierarchical control over effortful behavior by rodent medial frontal cortex: A computational model.
Holroyd, C. B., & McClure, S. M. (2014) · Psychological Review · doi:10.1037/a0038339 · Cited by 192 · see citing works
Self-citationComputational noise in reward-guided learning drives behavioral variability in volatile environments
Findling, C., Skvortsova, V., Dromnelle, R., Palminteri, S., & Wyart, V. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0518-9 · Cited by 196 · see citing works
The research domain criteria framework: The case for anterior cingulate cortex
Holroyd, C. B., & Umemoto, A. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.021 · Cited by 187 · see citing works
Self-citationBrain mechanisms underlying apathy
Heron, C. J. L., Holroyd, C. B., Salamone, J. D., & Masud Husain, B. (2018) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2018-318265 · Cited by 190 · see citing works
Self-citationA short review on emotion processing: a lateralized network of neuronal networks
Palomero‐Gallagher, N., & Amunts, K. (2021) · Brain Structure and Function · doi:10.1007/s00429-021-02331-7 · Cited by 187 · see citing works
Cognitive Control Predicts Use of Model-based Reinforcement Learning
Otto, A. R., Skatova, A., Madlon‐Kay, S., & Daw, N. D. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00709 · Cited by 186 · see citing works
Weinberg, A., Meyer, A., Hale‐Rude, E., Perlman, G., Kotov, R., Klein, D. N., & Hajcak, G. (2016) · Psychophysiology · doi:10.1111/psyp.12538 · Cited by 185 · see citing works
Cingulum Microstructure Predicts Cognitive Control in Older Age and Mild Cognitive Impairment
Metzler‐Baddeley, C., Jones, D. K., Steventon, J. J., Westacott, L. J., Aggleton, J. P., & O'Sullivan, M. J. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.3299-12.2012 · Cited by 174 · see citing works
Beyond self-serving bias: diffusion of responsibility reduces sense of agency and outcome monitoring
Beyer, F., Sidarus, N., Bonicalzi, S., & Haggard, P. (2016) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsw160 · Cited by 171 · see citing works
Hollocks, M. J., Lawrence, A. J., Brookes, R. L., Barrick, T. R., Morris, R. G., Husain, M., & Markus, H. S. (2015) · Brain · doi:10.1093/brain/awv304 · Cited by 166 · see citing works
Distinct effects of apathy and dopamine on effort-based decision-making in Parkinson’s disease
Heron, C. J. L., Plant, O., Manohar, S., Ang, Y., Jackson, M., Lennox, G. G., Hu, M. T., & Masud Husain, B. (2018) · Brain · doi:10.1093/brain/awy110 · Cited by 162 · see citing works
Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network
Balaguer, J., Spiers, H., Hassabis, D., & Summerfield, C. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.037 · Cited by 163 · see citing works
Individual Differences in Premotor Brain Systems Underlie Behavioral Apathy
Bonnelle, V., Manohar, S., Behrens, T., & Husain, M. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv247 · Cited by 163 · see citing works
Error-related brain activity in the age of RDoC: A review of the literature
Weinberg, A., Dieterich, R., & Riesel, A. (2015) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2015.02.029 · Cited by 179 · see citing works
Brain systems underlying the affective and social monitoring of actions: An integrative review
Koban, L., & Pourtois, G. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.02.014 · Cited by 159 · see citing works
Computational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort
Vassena, E., Holroyd, C. B., & Alexander, W. H. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00316 · Cited by 140 · see citing works
Self-citationModel-based hierarchical reinforcement learning and human action control
Botvinick, M., & Weinstein, A. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0480 · Cited by 153 · see citing works
TOWARDS A GENERAL MODEL OF TEMPORAL DISCOUNTING
van den Bos, W., & McClure, S. M. (2013) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.6 · Cited by 149 · see citing works
Cooper, P. S., Karayanidis, F., McKewen, M., McLellan-Hall, S., Wong, A. S. W., Skippen, P., & Cavanagh, J. F. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.01.022 · Cited by 150 · see citing works
Bernat, E. M., Nelson, L. D., & Baskin-sommers, A. R. (2015) · Psychophysiology · doi:10.1111/psyp.12390 · Cited by 151 · see citing works
Event-related brain potentials and the study of reward processing: Methodological considerations
Krigolson, O. E. (2017) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2017.11.007 · Cited by 145 · see citing works
The Subjective Value of Cognitive Effort is Encoded by a Domain-General Valuation Network
Westbrook, A., Lamichhane, B., & Braver, T. S. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.3071-18.2019 · Cited by 144 · see citing works
Sales, A. C., Friston, K. J., Jones, M. W., Pickering, A. E., & Moran, R. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006267 · Cited by 146 · see citing works
The Association Between Internet Gaming Disorder and Impulsivity: A Systematic Review of Literature
Şalvarlı, Ş. İ., & Griffiths, M. D. (2019) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-019-00126-w · Cited by 143 · see citing works
The behavioural variant frontotemporal dementia (bvFTD) syndrome in psychiatry
Lanata, S., & Miller, B. L. (2015) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2015-310697 · Cited by 142 · see citing works
Weinberg, A., Kotov, R., & Proudfit, G. H. (2014) · Journal of Abnormal Psychology · doi:10.1037/abn0000019 · Cited by 142 · see citing works
Altered Network Topologies and Hub Organization in Adults with Autism: A Resting-State fMRI Study
Itahashi, T., Yamada, T., Watanabe, H., Nakamura, M., Jimbo, D., Shioda, S., Toriizuka, K., Kato, N., & Hashimoto, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094115 · Cited by 139 · see citing works
The Role of the Anterior Cingulate Cortex in Prediction Error and Signaling Surprise
Alexander, W. H., & Brown, J. W. (2017) · Topics in Cognitive Science · doi:10.1111/tops.12307 · Cited by 136 · see citing works
Adaptive effort investment in cognitive and physical tasks: A neurocomputational model
Verguts, T., Vassena, E., & Silvetti, M. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00057 · Cited by 118 · see citing works
Medial prefrontal cortex predicts internally driven strategy shifts
Schuck, N. W., Gaschler, R., Wenke, D., Heinzle, J., Frensch, P., Haynes, J., & Reverberi, C. (2015) · Neuron · doi:10.1016/j.neuron.2015.03.015 · Cited by 119 · see citing works
HajiHosseini, A., & Holroyd, C. B. (2013) · Psychophysiology · doi:10.1111/psyp.12040 · Cited by 131 · see citing works
Self-citationLichenstein, S. D., Verstynen, T., & Forbes, E. E. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.07.024 · Cited by 131 · see citing works
Rational metareasoning and the plasticity of cognitive control
Lieder, F., Shenhav, A., Musslick, S., & Griffiths, T. L. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006043 · Cited by 129 · see citing works
The role of the opioid system in decision making and cognitive control: a review
van Steenbergen, H., Eikemo, M., & Leknes, S. (2019) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-019-00710-6 · Cited by 118 · see citing works
The role of the midcingulate cortex in monitoring others' decisions
Apps, M. A. J., Lockwood, P. L., & Balsters, J. H. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00251 · Cited by 126 · see citing works
A Novel Neural Prediction Error Found in Anterior Cingulate Cortex Ensembles
Hyman, J. M., Holroyd, C. B., & Seamans, J. K. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.021 · Cited by 123 · see citing works
Self-citationvan Noordt, S. J. R., & Segalowitz, S. J. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00197 · Cited by 121 · see citing works
Alexander, W. H., & Brown, J. W. (2015) · Neural Computation · doi:10.1162/neco_a_00779 · Cited by 111 · see citing works
Theta oscillations shift towards optimal frequency for cognitive control
Senoussi, M., Verbeke, P., Desender, K., Loof, E. D., Talsma, D., & Verguts, T. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01335-5 · Cited by 115 · see citing works
Silvetti, M., Alexander, W., Verguts, T., & Brown, J. W. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.003 · Cited by 114 · see citing works
Disruption and rescue of interareal theta phase coupling and adaptive behavior
Reinhart, R. M. G. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710257114 · Cited by 107 · see citing works
Neural Coding of Cognitive Control: The Representational Similarity Analysis Approach
Freund, M. C., Etzel, J. A., & Braver, T. S. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.03.011 · Cited by 113 · see citing works
Dissociating contributions of ACC and vmPFC in reward prediction, outcome, and choice
Vassena, E., Krebs, R. M., Silvetti, M., Fias, W., & Verguts, T. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.04.019 · Cited by 106 · see citing works
Meadows, C. C., Gable, P. A., Lohse, K. R., & Miller, M. W. (2016) · Biological Psychology · doi:10.1016/j.biopsycho.2016.06.002 · Cited by 102 · see citing works
Cognitive Control in Depression: Toward Clinical Models Informed by Cognitive Neuroscience
Grahek, I., Everaert, J., Krebs, R. M., & Koster, E. H. W. (2018) · Clinical Psychological Science · doi:10.1177/2167702618758969 · Cited by 101 · see citing works
Imaging volition: what the brain can tell us about the will
Braß, M., Lynn, M. T., Demanet, J., & Rigoni, D. (2013) · Experimental Brain Research · doi:10.1007/s00221-013-3472-x · Cited by 99 · see citing works
Kim, G. H., Jeon, S., Im, K., Kwon, H., Lee, B. H., Kim, G. Y., Jeong, H., Han, N. E., Seo, S. W., Cho, H., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0123251 · Cited by 101 · see citing works
Structural connectome disruption at baseline predicts 6-months post-stroke outcome
Kuceyeski, A. F., Navi, B. B., Kamel, H., Raj, A., Relkin, N. R., Toglia, J. P., Iadecola, C., & O’Dell, M. W. (2016) · Human Brain Mapping · doi:10.1002/hbm.23198 · Cited by 98 · see citing works
Difficult action decisions reduce the sense of agency: A study using the Eriksen flanker task
Sidarus, N., & Haggard, P. (2016) · Acta Psychologica · doi:10.1016/j.actpsy.2016.03.003 · Cited by 98 · see citing works
Grundy, J. G., Chung-Fat-Yim, A., Friesen, D. C., Mak, L., & Bialystok, E. (2017) · Cognition · doi:10.1016/j.cognition.2017.02.010 · Cited by 97 · see citing works
Monitor yourself! Deficient error-related brain activity predicts real-life self-control failures
Krönke, K., Wolff, M., Mohr, H., Kräplin, A., Smolka, M. N., Bühringer, G., & Goschke, T. (2018) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-018-0593-5 · Cited by 96 · see citing works
Anterior cingulate cortex is necessary for adaptation of action plans
Brockett, A. T., Tennyson, S. S., deBettencourt, C. A., Gaye, F., & Roesch, M. R. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1919303117 · Cited by 97 · see citing works
Moser, J. S., Moran, T. P., Kneip, C., Schroder, H. S., & Larson, M. J. (2016) · Psychophysiology · doi:10.1111/psyp.12509 · Cited by 96 · see citing works
A World Unto Itself: Human Communication as Active Inference
Vasil, J., Badcock, P. B., Constant, A., Friston, K. J., & Ramstead, M. J. D. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00417 · Cited by 101 · see citing works
Self-regulation of the anterior insula: Reinforcement learning using real-time fMRI neurofeedback
Lawrence, E., Su, L., Barker, G. J., Medford, N., Dalton, J., Williams, S., Birbaumer, N., Veit, R., Sitaram, R., Bodurka, J., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.10.069 · Cited by 93 · see citing works
Reward positivity: Reward prediction error or salience prediction error?
Heydari, S., & Holroyd, C. B. (2016) · Psychophysiology · doi:10.1111/psyp.12673 · Cited by 92 · see citing works
Self-citationNegative symptoms are associated with an increased subjective cost of cognitive effort.
Culbreth, A. J., Westbrook, A., & Barch, D. M. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000153 · Cited by 90 · see citing works
Shdo, S. M., Ranasinghe, K. G., Gola, K. A., Mielke, C. J., Sukhanov, P., Miller, B. L., & Rankin, K. P. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.02.010 · Cited by 93 · see citing works
Buzzell, G. A., Richards, J. E., White, L. K., Barker, T. V., Pine, D. S., & Fox, N. A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.05.045 · Cited by 86 · see citing works
Role of anterior cingulate cortex inputs to periaqueductal gray for pain avoidance
Lee, J.-Y., You, T., Lee, C.-H., Im, G. H., Seo, H., Woo, C., & Kim, S. (2022) · Current Biology · doi:10.1016/j.cub.2022.04.090 · Cited by 85 · see citing works
Palaniyappan, L., White, T., & Liddle, P. (2012) · Current Topics in Medicinal Chemistry · doi:10.2174/156802612805289881 · Cited by 81 · see citing works
Dopamine and reward: a view from the prefrontal cortex
Chau, B. K. H., Jarvis, H., Law, C.-K., & Chong, T. T. ‐. (2018) · Behavioural Pharmacology · doi:10.1097/fbp.0000000000000424 · Cited by 84 · see citing works
Cognitive Control as Cost‐Benefit Decision Making
Kool, W., Shenhav, A., & Botvinick, M. (2017) · doi:10.1002/9781118920497.ch10 · Cited by 82 · see citing works
Neural substrates underlying effort computation in schizophrenia.
Fervaha, G., Foussias, G., Agid, O., & Remington, G. (2013) · Neuroscience and Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.09.001 · Cited by 79 · see citing works
Blunted neural response to errors as a trait marker of melancholic depression
Weinberg, A., Liu, H., & Shankman, S. A. (2015) · Biological Psychology · doi:10.1016/j.biopsycho.2015.11.012 · Cited by 81 · see citing works
The Best Laid Plans: Computational Principles of Anterior Cingulate Cortex
Holroyd, C. B., & Verguts, T. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.01.008 · Cited by 84 · see citing works
Self-citationOn the pathophysiology and treatment of akinetic mutism
Arnts, H., van Erp, W. S., Lavrijsen, J. C. M., van Gaal, S., Groenewegen, H. J., & van den Munckhof, P. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.02.006 · Cited by 79 · see citing works
A Multidimensional Approach to Apathy after Traumatic Brain Injury
Arnould, A., Rochat, L., Azouvi, P., & der Linden, M. V. (2013) · Neuropsychology Review · doi:10.1007/s11065-013-9236-3 · Cited by 79 · see citing works
- Authors
- Holroyd, C. B., & Yeung, N.
- Affiliations
- University of Victoria (CA)
- University of Oxford (GB)
- Corresponding author
- Holroyd, Clay B.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2012-02
- Volume
- 16
- Issue
- 2
- Pages
- 122-128
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2057733150
- Cited by
- 618
- References
- 72
- Citations by year
- 2026: 28 · 2025: 30 · 2024: 40 · 2023: 48 · 2022: 43 · 2021: 40 · 2020: 47 · 2019: 53 · 2018: 54 · 2017: 62 · 2016: 56 · 2015: 32 · 2014: 40 · 2013: 29 · 2012: 15
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Trends in Cognitive Sciences (publishedVersion)
- PubMed (publishedVersion)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion)
- Funders
- National Institute of Mental Health (P50 MH62196, P50MH062196)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- anterior cingulate cortex, motivation, goal-directed action, hierarchical reinforcement learning, cognitive control, option selection, behavioral sequences
- MeSH terms
- Akinetic Mutism, Behavior, Dopamine, Goals, Gyrus Cinguli, Humans, Motivation, Psychomotor Performance, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review