The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Hierarchical control over effortful behavior by rodent medial frontal cortex: A computational model.
Abstract
The anterior cingulate cortex (ACC) has been the focus of intense research interest in recent years. Although separate theories relate ACC function variously to conflict monitoring, reward processing, action selection, decision making, and more, damage to the ACC mostly spares performance on tasks that exercise these functions, indicating that they are not in fact unique to the ACC. Further, most theories do not address the most salient consequence of ACC damage: impoverished action generation in the presence of normal motor ability. In this study we develop a computational model of the rodent medial prefrontal cortex that accounts for the behavioral sequelae of ACC damage, unifies many of the cognitive functions attributed to it, and provides a solution to an outstanding question in cognitive control research-how the control system determines and motivates what tasks to perform. The theory derives from recent developments in the formal study of hierarchical control and learning that highlight computational efficiencies afforded when collections of actions are represented based on their conjoint goals. According to this position, the ACC utilizes reward information to select tasks that are then accomplished through top-down control over action selection by the striatum. Computational simulations capture animal lesion data that implicate the medial prefrontal cortex in regulating physical and cognitive effort. Overall, this theory provides a unifying theoretical framework for understanding the ACC in terms of the pivotal role it plays in the hierarchical organization of effortful behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Cognitive and emotional influences in anterior cingulate cortex
Bush, G., Luu, P., & Posner, M. I. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01483-2 · Cited by 6,259
A perspective on judgment and choice: mapping bounded rationality.
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.697 · Cited by 5,540
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Self-citationThe reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119
Integration of the cognitive and the psychodynamic unconscious
Epstein, S. (1994) · American Psychologist · doi:10.1037/0003-066x.49.8.709 · Cited by 2,883
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Ego depletion and the strength model of self-control: a meta-analysis
Hagger, M. S., Wood, C., Stiff, C., & Chatzisarantis, N. L. D. (2010) · Psychological Bulletin · doi:10.1037/a0019486 · Cited by 2,265
The integration of negative affect, pain and cognitive control in the cingulate cortex
Shackman, A. J., Salomons, T. V., Slagter, H. A., Fox, A. S., Winter, J. J., & Davidson, R. J. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn2994 · Cited by 2,082
A dual-networks architecture of top-down control
Dosenbach, N. U. F., Fair, D. A., Cohen, A. L., Schlaggar, B. L., & Petersen, S. E. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.01.001 · Cited by 1,931
The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour
Duncan, J. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.004 · Cited by 1,846
A Core System for the Implementation of Task Sets
Dosenbach, N. U. F., Visscher, K. M., Palmer, E. D., Miezin, F. M., Wenger, K. K., Kang, H. C., Burgund, E. D., Grimes, A. L., Schlaggar, B. L., & Petersen, S. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.04.031 · Cited by 1,772
The principal features and mechanisms of dopamine modulation in the prefrontal cortex
Seamans, J. K., & Yang, C. R. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.05.006 · Cited by 1,592
The role of medial prefrontal cortex in memory and decision making
Euston, D. R., Gruber, A. J., & McNaughton, B. L. (2012) · Neuron · doi:10.1016/j.neuron.2012.12.002 · Cited by 1,541
Impulse and Self-Control From a Dual-Systems Perspective
Hofmann, W., Friese, M., & Strack, F. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01116.x · Cited by 1,487
Control and interference in task switching—A review
Kiesel, A., Steinhauser, M., Wendt, M., Falkenstein, M., Jost, K., Philipp, A. M., & Koch, I. (2010) · Psychological Bulletin · doi:10.1037/a0019842 · Cited by 1,485
Medial Frontal Cortex Mediates Perceptual Attentional Set Shifting in the Rat
Birrell, J. M., & Brown, V. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04320.2000 · Cited by 1,421
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381
Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates
Dalley, J. W., Cardinal, R. N., & Robbins, T. W. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.006 · Cited by 1,329
Apathy and the Functional Anatomy of the Prefrontal Cortex–Basal Ganglia Circuits
Levy, R., & Dubois, B. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj043 · Cited by 1,285
Prefrontal cortex in the rat: Projections to subcortical autonomic, motor, and limbic centers
Gabbott, P. L. A., Warner, T. A., Jays, P. R. L., Salway, P., & Busby, S. J. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20738 · Cited by 1,227
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
An information theoretical approach to prefrontal executive function
Koechlin, E., & Summerfield, C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.04.005 · Cited by 1,183
Decision making and the avoidance of cognitive demand
Kool, W., McGuire, J. T., Rosen, Z. B., & Botvinick, M. M. (2010) · Journal of Experimental Psychology: General · doi:10.1037/a0020198 · Cited by 1,141
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948
Is the rostro-caudal axis of the frontal lobe hierarchical?
Badre, D., & D'Esposito, M. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2667 · Cited by 946
Learned predictions of error likelihood in the anterior cingulate cortex
Brown, J. W., & Braver, T. S. (2005) · Science · doi:10.1126/science.1105783 · Cited by 928
Intelligence and the Frontal Lobe: The Organization of Goal-Directed Behavior
Duncan, J., Emslie, H., Williams, P., Johnson, R., & Freer, C. (1996) · Cognitive Psychology · doi:10.1006/cogp.1996.0008 · Cited by 902
Interactions between frontal cortex and basal ganglia in working memory: A computational model
FRANK, M. J., LOUGHRY, B., & O'REILLY, R. C. (2001) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.1.2.137 · Cited by 879
Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
Updating dopamine reward signals
Schultz, W. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.012 · Cited by 651
A prefrontal cortex–brainstem neuronal projection that controls response to behavioural challenge
Warden, M. R., Selimbeyoglu, A., Mirzabekov, J. J., Lo, M., Thompson, K. R., Kim, S.-Y., Adhikari, A., Tye, K. M., Frank, L. M., & Deisseroth, K. (2012) · Nature · doi:10.1038/nature11617 · Cited by 645
Kolling, N., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2012) · Science · doi:10.1126/science.1216930 · Cited by 629
Motivation of extended behaviors by anterior cingulate cortex
Holroyd, C. B., & Yeung, N. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.008 · Cited by 618
Self-citationHornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., & Polkey, C. E. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322926791 · Cited by 603
Motivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590
Durstewitz, D., & Seamans, J. K. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.05.015 · Cited by 586
Separate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580
Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior
Goto, Y., & Grace, A. A. (2005) · Nature Neuroscience · doi:10.1038/nn1471 · Cited by 576
Chudasama, Y., Passetti, F., Rhodes, S. E. V., Lopian, D., Desai, A., & Robbins, T. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.020 · Cited by 518
Separate Valuation Subsystems for Delay and Effort Decision Costs
Prévost, C., Pessiglione, M., Météreau, E., Cléry-Melin, M.-L., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2752-10.2010 · Cited by 499
RAGOZZINO, M. E. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.013 · Cited by 482
Lesion mapping of cognitive control and value-based decision making in the prefrontal cortex
Gläscher, J., Adolphs, R., Damasio, H., Bechara, A., Rudrauf, D., Calamia, M., Paul, L. K., & Tranel, D. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1206608109 · Cited by 476
Mesocortical dopamine modulation of executive functions: beyond working memory
Floresco, S. B., & Magyar, O. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0404-5 · Cited by 426
Floresco, S. B., Block, A. E., & Tse, M. T. L. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.02.008 · Cited by 405
Multiple dopamine receptor subtypes in the medial prefrontal cortex of the rat regulate set-shifting
Floresco, S. B., Magyar, O., Ghods-Sharifi, S., Vexelman, C., & Tse, M. T. L. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300825 · Cited by 395
Cytoarchitecture of mouse and rat cingulate cortex with human homologies
Vogt, B. A., & Paxinos, G. (2014) · Brain Structure and Function · doi:10.1007/s00429-012-0493-3 · Cited by 348
Speed/accuracy trade-off between the habitual and the goal-directed processes
Keramati, M., Dezfouli, A., & Piray, P. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002055 · Cited by 346
Dynamics of Population Code for Working Memory in the Prefrontal Cortex
Baeg, E. H., Kim, Y. B., Huh, K., Mook-Jung, I., Kim, H. T., & Jung, M. W. (2003) · Neuron · doi:10.1016/s0896-6273(03)00597-x · Cited by 338
Floresco, S. B. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00062 · Cited by 336
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324
Neural mechanisms underlying motivation of mental versus physical effort
Schmidt, L., Lebreton, M., Cléry-Melin, M.-L., Daunizeau, J., & Pessiglione, M. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001266 · Cited by 310
Habits, action sequences and reinforcement learning
Dezfouli, A., & Balleine, B. W. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08050.x · Cited by 297
Boulougouris, V., Dalley, J. W., & Robbins, T. W. (2007) · Behavioural Brain Research · doi:10.1016/j.bbr.2007.02.005 · Cited by 297
Dopamine, behavioral economics, and effort
Salamone, J. D. (2009) · Frontiers in Behavioral Neuroscience · doi:10.3389/neuro.08.013.2009 · Cited by 277
Common medial frontal mechanisms of adaptive control in humans and rodents
Narayanan, N. S., Cavanagh, J. F., Frank, M. J., & Laubach, M. (2013) · Nature Neuroscience · doi:10.1038/nn.3549 · Cited by 267
O'Reilly, R. C. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.3.246 · Cited by 241
Dopamine depletion impairs frontostriatal functional connectivity during a set-shifting task
Nagano-Saito, A., Leyton, M., Monchi, O., Goldberg, Y. K., He, Y., & Dagher, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3921-07.2008 · Cited by 222
Effortless control: Executive attention and conscious feeling of mental effort are dissociable
Naccache, L., Dehaene, S., Cohen, L., Habert, M.-O., Guichart-Gomez, E., Galanaud, D., & Willer, J.-C. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.11.024 · Cited by 211
Camille, N., Tsuchida, A., & Fellows, L. K. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3164-11.2011 · Cited by 195
Venkatraman, V., Rosati, A. G., Taren, A. A., & Huettel, S. A. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2708-09.2009 · Cited by 186
Ragozzino, M. E. (2002) · Learning & Memory · doi:10.1101/lm.45802 · Cited by 174
Exploring a latent cause theory of classical conditioning
Gershman, S. J., & Niv, Y. (2012) · Learning & Behavior · doi:10.3758/s13420-012-0080-8 · Cited by 149
The effect of cingulate cortex lesions on task switching and working memory
Rushworth, M. F. S., Hadland, K. A., Gaffan, D., & Passingham, R. E. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321593072 · Cited by 138
Anterior cingulate cortex in schema assimilation and expression
Wang, S.-H., Tse, D., & Morris, R. G. M. (2012) · Learning & Memory · doi:10.1101/lm.026336.112 · Cited by 106
Prefrontal Cortex Lesions Disrupt the Contextual Control of Response Conflict
Haddon, J. E., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3243-05.2006 · Cited by 101
Ostlund, S. B., Wassum, K. M., Murphy, N. P., Balleine, B. W., & Maidment, N. T. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4759-10.2011 · Cited by 94
Toward a taxonomy of attention shifting: Individual differences in fMRI during multiple shift types
WAGER, T. D., JONIDES, J., SMITH, E. E., & NICHOLS, T. E. (2005) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.5.2.127 · Cited by 86
Mulder, A. B., Nordquist, R. E., Örgüt, O., & Pennartz, C. M. A. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.016 · Cited by 84
Burke, K. A., Takahashi, Y. K., Correll, J., Leon Brown, P., & Schoenbaum, G. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06992.x · Cited by 76
Cited by
Toward a rational and mechanistic account of mental effort
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T. L., Cohen, J. D., & Botvinick, M. M. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031526 · Cited by 1,077
Cognitive effort: A neuroeconomic approach
Westbrook, A., & Braver, T. S. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-015-0334-y · Cited by 606
The Anterior Cingulate Gyrus and Social Cognition: Tracking the Motivation of Others
Apps, M. A. J., Rushworth, M. F. S., & Chang, S. W. C. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.018 · Cited by 559
“This is in stark contrast to generalized models of dACC/ACCs, of which theoretical accounts are numerous and classical accounts suggest that the ACCs may be important for conflict monitoring, error detection, learning, and decision making (Alexander and Brown, 2011; Rushworth et al., 2012; Holroyd and Yeung, 2012; She…”
InfluentialDorsal Anterior Cingulate Cortex: A Bottom-Up View
Heilbronner, S. R., & Hayden, B. Y. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-013952 · Cited by 455
The anatomy of apathy: a neurocognitive framework for amotivated behaviour
Le Heron, C., Apps., M. A. J., & Husain, M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.07.003 · Cited by 380
“We do not discuss psychiatric disorders, where there is also a body of work that examines the structural or functional basis of apathy (Foussias et al., 2014; Holroyd and Umemoto, 2016; Treadway and Zald, 2011).”
Background
Metadata
- Authors
- Holroyd, C. B., & McClure, S. M.
- Venue
- Psychological Review
- Published
- 2015
- Volume
- 122
- Issue
- 1
- Pages
- 54-83
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2147689640
- Cited by
- 198
- References
- 72
- FWCI
- 9.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.