Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Anterior cingulate and dorsolateral prefrontal cortex (ACC and dlPFC, respectively) are core components of the cognitive control network. Activation of these regions is routinely observed in tasks that involve monitoring the external environment and maintaining information in order to generate appropriate responses. Despite the ubiquity of studies reporting coactivation of these two regions, a consensus on how they interact to support cognitive control has yet to emerge. In this letter, we present a new hypothesis and computational model of ACC and dlPFC. The error representation hypothesis states that multidimensional error signals generated by ACC in response to surprising outcomes are used to train representations of expected error in dlPFC, which are then associated with relevant task stimuli. Error representations maintained in dlPFC are in turn used to modulate predictive activity in ACC in order to generate better estimates of the likely outcomes of actions. We formalize the error representation hypothesis in a new computational model based on our previous model of ACC. The hierarchical error representation (HER) model of ACC/dlPFC suggests a mechanism by which hierarchically organized layers within ACC and dlPFC interact in order to solve sophisticated cognitive tasks. In a series of simulations, we demonstrate the ability of the HER model to autonomously learn to perform structured tasks in a manner comparable to human performance, and we show that the HER model outperforms current deep learning networks by an order of magnitude.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Baddeley, A. D., & Hitch, G. (1974) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60452-1 · Cited by 9,860
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“Specifically, the dlPFC learns to maintain representations of stimuli that reliably co-occur with prediction errors (Friston, 2010).”
BackgroundRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
MacDonald, A. W., Cohen, J. D., Stenger, V. A., & Carter, C. S. (2000) · Science · doi:10.1126/science.288.5472.1835 · Cited by 3,666
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273 · cited 1×
“The AX and 1-2AX continuous performance task (CPT) are frequently used in the study of WM and in diagnosing behavioral and cognitive deficits related to WM dysfunction (Carter et al., 1998; Servan-Schreiber, Cohen, & Steingard, 1996).”
MethodPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Cited by
Toward a rational and mechanistic account of mental effort
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T. L., Cohen, J. D., & Botvinick, M. M. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031526 · Cited by 1,077
Frontal Cortex and the Hierarchical Control of Behavior
Badre, D., & Nee, D. E. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.11.005 · Cited by 611
Dorsal anterior cingulate cortex and the value of control
Shenhav, A., Cohen, J. D., & Botvinick, M. M. (2016) · Nature Neuroscience · doi:10.1038/nn.4384 · Cited by 565
Hierarchical active inference: A theory of motivated control
Pezzulo, G., Rigoli, F., & Friston, K. J. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.009 · Cited by 334
Herding Brains: A Core Neural Mechanism for Social Alignment
Shamay-Tsoory, S. G., Saporta, N., Marton-Alper, I. Z., & Gvirts, H. Z. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.01.002 · Cited by 289
Computational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort
Vassena, E., Holroyd, C. B., & Alexander, W. H. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00316 · Cited by 140
“While the PRO-Control assigns the same computations to ACC as in previous iterations of the model (Alexander and Brown, 2011, 2014; Alexander et al., 2015), it is able to account for additional behavioral and imaging effects related to deploying control, including effects of foraging value and choice…”
BackgroundMethodSelf-citationSurprise, value and control in anterior cingulate cortex during speeded decision-making
Vassena, E., Deraeve, J., & Alexander, W. H. (2020) · Nature Human Behaviour · doi:10.1038/s41562-019-0801-5 · Cited by 87
Self-citationMonitoring demands for executive control: shared functions between human and nonhuman primates
Mansouri, F. A., Egner, T., & Buckley, M. J. (2017) · Trends in Neurosciences · doi:10.1016/j.tins.2016.11.001 · Cited by 89
Standke, I., Trempler, I., Dannlowski, U., Schubotz, R. I., & Lencer, R. (2021) · NeuroImage: Clinical · doi:10.1016/j.nicl.2021.102855 · Cited by 11
“Consistent with its presumed role in generating error signals in response to changes in current behavioral demands (Alexander and Brown 2015), reduced activation of the medial prefrontal cortex has been found in patients; this is associated with disruptions in learning from prediction errors (Reinhart et al.”
Background
Metadata
- Authors
- Alexander, W. H., & Brown, J. W.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2015-11
- Volume
- 27
- Issue
- 11
- Pages
- 2354-2410
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2167031142
- Cited by
- 116
- References
- 44
- FWCI
- 5.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.