The DOI matches its Crossref record; 118 of the 118 references it cites were found in a registry or an index.
Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system
Open accessAbstract
The prefrontal cortex (PFC) has long been thought to serve as an ‘executive’ that controls the selection of actions and cognitive functions more generally. However, the mechanistic basis of this executive function has not been clearly specified often amounting to a homunculus. This paper reviews recent attempts to deconstruct this homunculus by elucidating the precise computational and neural mechanisms underlying the executive functions of the PFC. The overall approach builds upon existing mechanistic models of the basal ganglia (BG) and frontal systems known to play a critical role in motor control and action selection, where the BG provide a ‘Go’ versus ‘NoGo’ modulation of frontal action representations. In our model, the BG modulate working memory representations in prefrontal areas to support more abstract executive functions. We have developed a computational model of this system that is capable of developing human-like performance on working memory and executive control tasks through trial-and-error learning. This learning is based on reinforcement learning mechanisms associated with the midbrain dopaminergic system and its activation via the BG and amygdala. Finally, we briefly describe various empirical tests of this framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,462
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
The magical number 4 in short-term memory: A reconsideration of mental storage capacity
Cowan, N. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003922 · Cited by 6,779
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Cited by
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775
Snyder, H. R. (2013) · Psychological Bulletin · doi:10.1037/a0028727 · Cited by 1,667
Neural Mechanisms for Interacting with a World Full of Action Choices
Cisek, P., & Kalaska, J. F. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135409 · Cited by 1,543
Cortical mechanisms of action selection: the affordance competition hypothesis
Cisek, P. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2054 · Cited by 1,083
O'Reilly, R. C., & Frank, M. J. (2006) · Neural Computation · doi:10.1162/089976606775093909 · Cited by 1,066
Self-citationCognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes
Badre, D. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.02.004 · Cited by 980
Is the rostro-caudal axis of the frontal lobe hierarchical?
Badre, D., & D'Esposito, M. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2667 · Cited by 946
The default mode network in cognition: a topographical perspective
Smallwood, J., Bernhardt, B. C., Leech, R., Bzdok, D., Jefferies, E., & Margulies, D. S. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-021-00474-4 · Cited by 935
What has fMRI told us about the Development of Cognitive Control through Adolescence?
Luna, B., Padmanabhan, A., & O’Hearn, K. (2010) · Brain and Cognition · doi:10.1016/j.bandc.2009.08.005 · Cited by 892
The Distributed Nature of Working Memory
Christophel, T. B., Klink, P. C., Spitzer, B., Roelfsema, P. R., & Haynes, J.-D. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.12.007 · Cited by 882
“Furthermore, the working memory gradient outlined above does not require a separate homunculus control mechanism [145,146,148], but can instead be produced by the underlying neural circuits themselves, similar to the idea of a Turing machine ([149], Box 3).”
MethodMontague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809
‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework
Stokes, M. G. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.05.004 · Cited by 850
Action understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665
PathNet: Evolution Channels Gradient Descent in Super Neural Networks
Fernando, C., Banarse, D., Blundell, C., Zwólš, Y., Ha, D., Rusu, A. A., Pritzel, A., & Wierstra, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08734 · Cited by 591
Wiers, R. W., Gladwin, T. E., Hofmann, W., Salemink, E., & Ridderinkhof, K. R. (2013) · Clinical Psychological Science · doi:10.1177/2167702612466547 · Cited by 486
Wessel, J. R., & Aron, A. R. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.013 · Cited by 409
Revisiting the role of persistent neural activity during working memory
Sreenivasan, K. K., Curtis, C. E., & D’Esposito, M. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.12.001 · Cited by 441
From Movement to Thought: Executive Function, Embodied Cognition, and the Cerebellum
Koziol, L. F., Budding, D. E., & Chidekel, D. (2012) · The Cerebellum · doi:10.1007/s12311-011-0321-y · Cited by 392
Developing Cognitive Control: Three Key Transitions
Munakata, Y., Snyder, H. R., & Chatham, C. H. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412436807 · Cited by 365
Adaptation by binding: a learning account of cognitive control
Verguts, T., & Notebaert, W. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.02.007 · Cited by 356
Frank, M. J., & Badre, D. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr114 · Cited by 337
Self-citationFrontal Cortex and the Discovery of Abstract Action Rules
Badre, D., Kayser, A. S., & D'Esposito, M. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.025 · Cited by 329
Snyder, H. R., Kaiser, R. H., Warren, S. L., & Heller, W. (2015) · Clinical Psychological Science · doi:10.1177/2167702614534210 · Cited by 325
The impact of the human thalamus on brain-wide information processing
Shine, J. M., Lewis, L. D., Garrett, D. D., & Hwang, K. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00701-0 · Cited by 305
Multiple gates on working memory
Chatham, C. H., & Badre, D. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2014.08.001 · Cited by 268
Goschke, T., & Bolte, A. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.07.015 · Cited by 288
Hierarchical cognitive control deficits following damage to the human frontal lobe
Badre, D., Hoffman, J., Cooney, J. W., & D'Esposito, M. (2009) · Nature Neuroscience · doi:10.1038/nn.2277 · Cited by 266
Barch, D. M., Pagliaccio, D., & Luking, K. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_376 · Cited by 218
Banishing the Control Homunculi in Studies of Action Control and Behavior Change
Verbruggen, F., McLaren, I. P. L., & Chambers, C. D. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614526414 · Cited by 214
Estimates of projection overlap and zones of convergence within frontal-striatal circuits
Averbeck, B. B., Lehman, J., Jacobson, M., & Haber, S. N. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.5806-12.2014 · Cited by 179
O'Callaghan, C., Bertoux, M., & Hornberger, M. (2014) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2012-304558 · Cited by 131
Vive les differences! Individual variation in neural mechanisms of executive control
Braver, T. S., Cole, M. W., & Yarkoni, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.002 · Cited by 130
A neural network model of individual differences in task switching abilities
Herd, S. A., O׳Reilly, R. C., Hazy, T. E., Chatham, C. H., Brant, A. M., & Friedman, N. P. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.04.014 · Cited by 128
Self-citationFrom an Executive Network to Executive Control: A Computational Model of the n-back Task
Chatham, C. H., Herd, S. A., Brant, A. M., Hazy, T. E., Miyake, A., O'Reilly, R., & Friedman, N. P. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00047 · Cited by 115
Self-citationCooperation between the hippocampus and the striatum during episodic encoding
Sadeh, T., Shohamy, D., Levy, D. R., Reggev, N., & Maril, A. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21549 · Cited by 104
Cognitive flexibility in neurological disorders: Cognitive components and event-related potentials
Lange, F., Seer, C., & Kopp, B. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.09.011 · Cited by 84
Reineberg, A. E., & Banich, M. T. (2016) · Human Brain Mapping · doi:10.1002/hbm.23219 · Cited by 88
A simple hypothesis of executive function
Kopp, B. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00159 · Cited by 49
Pauli, W. M., Hazy, T. E., & O'Reilly, R. C. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00155 · Cited by 32
Self-citationWhyte, C. J., Hohwy, J., & Smith, R. (2022) · Current Research in Neurobiology · doi:10.1016/j.crneur.2022.100036 · Cited by 24
Dopamine Alters the Fidelity of Working Memory Representations according to Attentional Demands
Fallon, S. J., Zokaei, N., Norbury, A., Manohar, S. G., & Husain, M. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01073 · Cited by 22
Strategic cognitive sequencing: a computational cognitive neuroscience approach
Herd, S. A., Krueger, K. A., Kriete, T. E., Huang, T.-R., Hazy, T. E., & O'Reilly, R. C. (2013) · Computational Intelligence and Neuroscience · doi:10.1155/2013/149329 · Cited by 20
Self-citationHow Limited Systematicity Emerges
O'Reilly, R. C., Petrov, A. A., Cohen, J. D., Lebiere, C. J., Herd, S. A., & Kriete, T. (2014) · The Architecture of Cognition · doi:10.7551/mitpress/9780262027236.003.0008 · Cited by 15
Self-citation
Metadata
- Authors
- Hazy, T. E., Frank, M. J., & O'Reilly, R. C.
- Venue
- Philosophical Transactions of the Royal Society B: Biological Sciences
- Publisher
- The Royal Society
- Published
- 2007-04-11
- Volume
- 362
- Issue
- 1485
- Pages
- 1601-1613
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- OpenAlex
- W2102548837
- Cited by
- 452
- References
- 118
- FWCI
- 8.97
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.