CoChat

An insula-frontostriatal network mediates flexible cognitive control by adaptively predicting changing control demands

Open access
Jiang, Jiefeng, Beck, Jeffrey, Heller, Katherine, Egner, Tobias · 2015 · Nature Communications

The DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.

Abstract

The anterior cingulate and lateral prefrontal cortices have been implicated in implementing context-appropriate attentional control, but the learning mechanisms underlying our ability to flexibly adapt the control settings to changing environments remain poorly understood. Here we show that human adjustments to varying control demands are captured by a reinforcement learner with a flexible, volatility-driven learning rate. Using model-based functional magnetic resonance imaging, we demonstrate that volatility of control demand is estimated by the anterior insula, which in turn optimizes the prediction of forthcoming demand in the caudate nucleus. The caudate’s prediction of control demand subsequently guides the implementation of proactive and reactive attentional control in dorsal anterior cingulate and dorsolateral prefrontal cortices. These data enhance our understanding of the neuro-computational mechanisms of adaptive behaviour by connecting the classic cingulate-prefrontal cognitive control network to a subcortical control-learning mechanism that infers future demands by flexibly integrating remote and recent past experiences.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/ncomms9165

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Model structure and schematic illustration of model-based analyses (N=21). (a) The graphical representation of the belief update model (upper panel) and the flexible control model (lower panel). The two models use identical structure and inference algorithms except that the flexible control model also uses reaction time (RT) to update the belief of latent variables. Note that only the flexible control model was used in all analyses to account for individual difference of behaviour. The flexible control model uses four variables, flexible LR/volatility (α), predicted conflict (f), congruency (o, shown in grey indicating this variable is observable) and RT for each trial. The directed edges indicate the information flow. At a given trial, horizontal and top–down edges represent the estimation of flexible LR/volatility and predicted conflict level prior to stimulus presentation. Subsequently, the observed congruency and RT are used to update belief of latent variables in anticipation of the next trial (bottom-up edges). (b) A schematic illustration of the univariate and multivariate encoding analysis using the example model variable of predicted conflict level (see Methods for details). Importantly, prior to multivariate analysis, the searchlight mean activation vector was also regressed from each voxel's activation vector to ensure the orthogonality between the two analyses.
Figure 1 Model structure and schematic illustration of model-based analyses (N=21). (a) The graphical representation of the belief update model (upper panel) and the flexible control model (lower panel). The two models use identical structure and inference algorithms except that the flexible control model also uses reaction time (RT) to update the belief of latent variables. Note that only the flexible control model was used in all analyses to account for individual difference of behaviour. The flexible control model uses four variables, flexible LR/volatility (α), predicted conflict (f), congruency (o, shown in grey indicating this variable is observable) and RT for each trial. The directed edges indicate the information flow. At a given trial, horizontal and top–down edges represent the estimation of flexible LR/volatility and predicted conflict level prior to stimulus presentation. Subsequently, the observed congruency and RT are used to update belief of latent variables in anticipation of the next trial (bottom-up edges). (b) A schematic illustration of the univariate and multivariate encoding analysis using the example model variable of predicted conflict level (see Methods for details). Importantly, prior to multivariate analysis, the searchlight mean activation vector was also regressed from each voxel's activation vector to ensure the orthogonality between the two analyses.CC BY · PubMed Central
Figure 2 Experimental task and simulation and behavioural results (N=21). (a) Example stimuli and timing of presentation. This example depicts an incongruent trial, followed by a congruent trial. (b) Individual mean model LRs, plotted as a function of run type. Each line represents a subject. (c) The time course of group mean LR and s.e.m. in the first and last 10 trials of volatile (in blue) and stable (in red) blocks. Note that in this graph, which averages over all blocks, the difference in LR at the beginning of the blocks was driven by volatile blocks 2–4 in the volatile runs, as in these blocks the LR had already been raised by preceding volatile blocks. (d) Time courses of the underlying proportion congruency (in black) and the corresponding predicted conflict level (in red) of an example run. (e) Individual RS, plotted as a function of congruency. Each line represents one subject. Note that higher RT equals lower RS. (Con=congruent trials; Inc=incongruent trials). (f) Group mean RS and s.e.m., centred across trials for each subject, plotted as a function of unsigned prediction error of congruency (control prediction error).
Figure 2 Experimental task and simulation and behavioural results (N=21). (a) Example stimuli and timing of presentation. This example depicts an incongruent trial, followed by a congruent trial. (b) Individual mean model LRs, plotted as a function of run type. Each line represents a subject. (c) The time course of group mean LR and s.e.m. in the first and last 10 trials of volatile (in blue) and stable (in red) blocks. Note that in this graph, which averages over all blocks, the difference in LR at the beginning of the blocks was driven by volatile blocks 2–4 in the volatile runs, as in these blocks the LR had already been raised by preceding volatile blocks. (d) Time courses of the underlying proportion congruency (in black) and the corresponding predicted conflict level (in red) of an example run. (e) Individual RS, plotted as a function of congruency. Each line represents one subject. Note that higher RT equals lower RS. (Con=congruent trials; Inc=incongruent trials). (f) Group mean RS and s.e.m., centred across trials for each subject, plotted as a function of unsigned prediction error of congruency (control prediction error).CC BY · PubMed Central
Figure 3 Estimation and updating of the volatility-driven flexible LR of control demand (N=21). (a) Searchlights in the AI and adjacent IFG track the model estimates of volatility/LR (in red, P<0.05 corrected, one sample t-test). (b) The flexible control model, highlighting in red the information processing mechanisms related to the updating of LR. (c) Visualization of searchlights encoding LR (red, P<0.05 corrected) and searchlights showing an interaction between predicted conflict level and congruency, or control prediction error (green, P<0.05 corrected, one sample t-test); overlap between these independently defined effects is shown in yellow. (d) Probabilistic distribution of t-values measuring the group-level univariate effect of prediction error of congruency (in grey) and the underlying null t-distribution (in red). The t-values were calculated from searchlights in the LR-encoding cluster shown in (a). The red vertical dotted line denotes the threshold for statistical significance (P<0.05). (e) Group mean activation levels (±s.e.m.) in the left AI/IFG ROI showing significant encoding of the volatility-driven flexible LR. The trial-by-trial ROI-mean fMRI activation (in t-values, in accordance with the univariate and multivariate analyses) were binned for each individual into 20 quantiles, which are plotted as a function of 20 quantiles of the LR (left) and estimation uncertainty (right). (f) Trial-wise estimation uncertainty of a representative example subject, plotted as a function of its corresponding LR. Each trial is represented by a translucent grey disk. Although the correlation coefficient between these two model estimates is significant (r=0.32, P<0.0001), the r2 statistic indicates that only 10% of variance is shared between them (for group statistics, see Supplementary Tables 5 and 6).
Figure 3 Estimation and updating of the volatility-driven flexible LR of control demand (N=21). (a) Searchlights in the AI and adjacent IFG track the model estimates of volatility/LR (in red, P<0.05 corrected, one sample t-test). (b) The flexible control model, highlighting in red the information processing mechanisms related to the updating of LR. (c) Visualization of searchlights encoding LR (red, P<0.05 corrected) and searchlights showing an interaction between predicted conflict level and congruency, or control prediction error (green, P<0.05 corrected, one sample t-test); overlap between these independently defined effects is shown in yellow. (d) Probabilistic distribution of t-values measuring the group-level univariate effect of prediction error of congruency (in grey) and the underlying null t-distribution (in red). The t-values were calculated from searchlights in the LR-encoding cluster shown in (a). The red vertical dotted line denotes the threshold for statistical significance (P<0.05). (e) Group mean activation levels (±s.e.m.) in the left AI/IFG ROI showing significant encoding of the volatility-driven flexible LR. The trial-by-trial ROI-mean fMRI activation (in t-values, in accordance with the univariate and multivariate analyses) were binned for each individual into 20 quantiles, which are plotted as a function of 20 quantiles of the LR (left) and estimation uncertainty (right). (f) Trial-wise estimation uncertainty of a representative example subject, plotted as a function of its corresponding LR. Each trial is represented by a translucent grey disk. Although the correlation coefficient between these two model estimates is significant (r=0.32, P<0.0001), the r2 statistic indicates that only 10% of variance is shared between them (for group statistics, see Supplementary Tables 5 and 6).CC BY · PubMed Central
Figure 4 Modulation of volatility on predicted control demand (conflict level, N=21). (a) Searchlights in the caudate track the model's prediction of conflict level (in red, P<0.05 corrected, one sample t-test) (b) The flexible control model, highlighting in red the information processing mechanisms related to the modulation of volatility on predicted conflict level. (c) Individual modulation of volatility on caudate activity-derived LR. Each horizontal bar represents a participant.
Figure 4 Modulation of volatility on predicted control demand (conflict level, N=21). (a) Searchlights in the caudate track the model's prediction of conflict level (in red, P<0.05 corrected, one sample t-test) (b) The flexible control model, highlighting in red the information processing mechanisms related to the modulation of volatility on predicted conflict level. (c) Individual modulation of volatility on caudate activity-derived LR. Each horizontal bar represents a participant.CC BY · PubMed Central
Figure 5 Titration of cognitive control by predicted conflict level (N=21). (a) The flexible control model, highlighting in red the information processing mechanisms related to the mediation of predicted conflict level on cognitive control. (b,c) Brain regions involved in proactive/reactive control in the dlPFC (b) and ACC (c), showing a significant correlation between predicted conflict level × congruency interaction in the RSs and encoding strength of predicted conflict level (in red)/prediction error of predicted conflict level (in green), respectively. For each cluster displayed, predicted conflict level × congruency interaction in the RS is plotted as a function of cluster mean of encoding strength across subjects.
Figure 5 Titration of cognitive control by predicted conflict level (N=21). (a) The flexible control model, highlighting in red the information processing mechanisms related to the mediation of predicted conflict level on cognitive control. (b,c) Brain regions involved in proactive/reactive control in the dlPFC (b) and ACC (c), showing a significant correlation between predicted conflict level × congruency interaction in the RSs and encoding strength of predicted conflict level (in red)/prediction error of predicted conflict level (in green), respectively. For each cluster displayed, predicted conflict level × congruency interaction in the RS is plotted as a function of cluster mean of encoding strength across subjects.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 54 references

Cited by

Items 101–162 of 162

Metadata

Authors
Jiang, J., Beck, J., Heller, K., & Egner, T.
Affiliations
Duke University (US)
Corresponding author
Jiang, Jiefeng
Venue
Nature Communications
Published
2015-09-22
Volume
6
Issue
1
Pages
8165-8165
ISSN
2041-1723 (ISSN-L)
OpenAlex
W2259098601
Cited by
160
References
55
Citations by year
2026: 10 · 2025: 16 · 2024: 22 · 2023: 20 · 2022: 18 · 2021: 19 · 2020: 15 · 2019: 16 · 2018: 7 · 2017: 9 · 2016: 7 · 2015: 1
FWCI
4.81
Type
journal article
Language
en
Open access
Licence
Locations
  • Nature Communications (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Funders
National Institute of Mental Health (R01MH087610)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
Keywords
cognitive control, flexible control, anterior insula, caudate nucleus, anterior cingulate cortex, dorsolateral prefrontal cortex, reinforcement learning, prediction, adaptive behavior, model-based fMRI
MeSH terms
Facial Recognition, Adult, Cerebral Cortex, Cognition, Female, Humans, Male, Nerve Net

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.