CoChat

Pharmacological Fingerprints of Contextual Uncertainty

Open access

The DOI matches its Crossref record; 116 of the 116 references it cites were found in a registry or an index.

Abstract

Successful interaction with the environment requires flexible updating of our beliefs about the world. By estimating the likelihood of future events, it is possible to prepare appropriate actions in advance and execute fast, accurate motor responses. According to theoretical proposals, agents track the variability arising from changing environments by computing various forms of uncertainty. Several neuromodulators have been linked to uncertainty signalling, but comprehensive empirical characterisation of their relative contributions to perceptual belief updating, and to the selection of motor responses, is lacking. Here we assess the roles of noradrenaline, acetylcholine, and dopamine within a single, unified computational framework of uncertainty. Using pharmacological interventions in a sample of 128 healthy human volunteers and a hierarchical Bayesian learning model, we characterise the influences of noradrenergic, cholinergic, and dopaminergic receptor antagonism on individual computations of uncertainty during a probabilistic serial reaction time task. We propose that noradrenaline influences learning of uncertain events arising from unexpected changes in the environment. In contrast, acetylcholine balances attribution of uncertainty to chance fluctuations within an environmental context, defined by a stable set of probabilistic associations, or to gross environmental violations following a contextual switch. Dopamine supports the use of uncertainty representations to engender fast, adaptive responses.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pbio.1002575

Cites

116 of 116 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Task design. (A) Trial sequence. A trial began with the presentation of a central white fixation cross against a black background. After an initial delay of 1,500 ms at the start of each block, one of four visual stimuli was presented for 200 ms. Participants were required to make a speeded button-press response before the end of a 1,200 ms intertrial interval (ITI). (B) Stimulus transitions were generated by one of eight different transition matrices (TMs), which changed every 50 trials without explicit indication to the participant. These TMs comprised two different first-order sequences, two alternating sequences, and four zeroth-order sequences, each of which occurred three times in a pseudorandom order across 1,200 trials. The overall probability of each stimulus was equal across the 1,200 trials. For full details, see S1 Fig. (C) Example trial sequences generated from the three example TMs in 1B. (D) By tracking the transition probabilities, participants could learn to predict high probability events and prepare to make the correct button press accordingly. Faster responses were observed for predictable stimuli compared to unexpected stimuli. Here we depict Placebo group log(RTs) (mean ± standard error of the mean [SEM]) for each of the 16 possible combinations between consecutive stimuli for the first-order sequence shown in B. Grey boxes indicate stimulus combinations with a high transition probability. (E) Indeed, across all types of TM, responses were faster for stimuli with higher transition probabilities (mean ± SEM). http://dx.doi.org/10.6084/m9.figshare.3796314.v1.
Fig 1 Task design. (A) Trial sequence. A trial began with the presentation of a central white fixation cross against a black background. After an initial delay of 1,500 ms at the start of each block, one of four visual stimuli was presented for 200 ms. Participants were required to make a speeded button-press response before the end of a 1,200 ms intertrial interval (ITI). (B) Stimulus transitions were generated by one of eight different transition matrices (TMs), which changed every 50 trials without explicit indication to the participant. These TMs comprised two different first-order sequences, two alternating sequences, and four zeroth-order sequences, each of which occurred three times in a pseudorandom order across 1,200 trials. The overall probability of each stimulus was equal across the 1,200 trials. For full details, see S1 Fig. (C) Example trial sequences generated from the three example TMs in 1B. (D) By tracking the transition probabilities, participants could learn to predict high probability events and prepare to make the correct button press accordingly. Faster responses were observed for predictable stimuli compared to unexpected stimuli. Here we depict Placebo group log(RTs) (mean ± standard error of the mean [SEM]) for each of the 16 possible combinations between consecutive stimuli for the first-order sequence shown in B. Grey boxes indicate stimulus combinations with a high transition probability. (E) Indeed, across all types of TM, responses were faster for stimuli with higher transition probabilities (mean ± SEM). http://dx.doi.org/10.6084/m9.figshare.3796314.v1.CC BY · PubMed Central
Fig 2 Model-agnostic changes in log(RT) indicate that participants learned to predict the stimulus transitions. (A) In all four groups, log(RT) increased as a stimulus’ true transition probability decreased. (B) A median split on each 50-trial contextual block was used to compare mean log(RTs) on Early (1–25) and Late (25–50) trials at each probability level. Over the course of a context, participants became faster at responding to High and Mid probability stimuli and slower at responding to Low probability stimuli. (C) Across drug groups, participants showed evidence of post-error slowing on correct trials that followed an erroneous response compared to those following correct responses. (D) They also showed evidence of slowing on correct trials that followed an infrequent stimulus transition. Results are mean ± SEM, corrected for the covariates Δalertness and body weight. Results shown in A, B, and D were modulated by drug group. http://dx.doi.org/10.6084/m9.figshare.3796353.v1.
Fig 2 Model-agnostic changes in log(RT) indicate that participants learned to predict the stimulus transitions. (A) In all four groups, log(RT) increased as a stimulus’ true transition probability decreased. (B) A median split on each 50-trial contextual block was used to compare mean log(RTs) on Early (1–25) and Late (25–50) trials at each probability level. Over the course of a context, participants became faster at responding to High and Mid probability stimuli and slower at responding to Low probability stimuli. (C) Across drug groups, participants showed evidence of post-error slowing on correct trials that followed an erroneous response compared to those following correct responses. (D) They also showed evidence of slowing on correct trials that followed an infrequent stimulus transition. Results are mean ± SEM, corrected for the covariates Δalertness and body weight. Results shown in A, B, and D were modulated by drug group. http://dx.doi.org/10.6084/m9.figshare.3796353.v1.CC BY · PubMed Central
Fig 3 Hierarchical Gaussian Filter (HGF). (A) The perceptual model tracks an individual’s learning of the task’s structure across three levels. State x1 represents trialwise stimulus transitions from one stimulus to the next, x2 the probability of the transitions (i.e., transition contingencies), and x3 the phasic volatility, where t is the current trial number. Participants hold and update beliefs about the true quantities at each level, with a mean μ and a variance σ. ϑ and ω are participant-specific parameters that couple the levels and determine the respective speed of belief updating about phasic volatility and transition contingencies. The response model describes the mapping from a participant’s trialwise beliefs onto their observed log(RT) responses. (B) Example of the trialwise dynamics at level 3 from Placebo Participant 2. μ3 reflects the participant’s belief about the true phasic volatility (x3). Vertical dashed lines indicate true context switches. μ3 tends to increase following a context change and then decreases over the course of a context as the participant learns the new contextual rule and thus perceives the environment to be increasingly stable. √ϑ is a variance determining the step-size of μ3 and therefore how quickly the participant updates their phasic volatility estimates. (C) As in B, but for precision-weighted contingency prediction error [PE] (ε3) at level 2. This estimate results from weighting the contingency PE (δ2) by a precision ratio that captures uncertainty about input from the level below relative to the level above. The higher the precision at level 2, the more meaningful a deviation from the predicted stimulus transition contingency. This in turn increases the impact on phasic volatility belief updating at level 3. For simplicity, we only depict the ε3 trajectory for true transition changes. (D) As in B and C, but for sensory PE (δ1) at level 1. This estimate arises from irreducible uncertainty about stimulus transitions. Trialwise values are equivalent to 1−x^1, where x^1 is equal to the participant’s trialwise prediction of the occurring transition. Again, for simplicity we only show δ1 values for true transitions here. (E) Mean β values for the Placebo group indicate that increases in sensory PE (β1), precision-weighted contingency PE (β2), and phasic volatility estimates (β3) slowed participants’ trialwise log(RTs). There was also evidence of post-error slowing (β4). Results are mean ± SEM. * p < 0.05, ** p < 0.01, *** p < 0.001. http://dx.doi.org/10.6084/m9.figshare.3796356.v1.
Fig 3 Hierarchical Gaussian Filter (HGF). (A) The perceptual model tracks an individual’s learning of the task’s structure across three levels. State x1 represents trialwise stimulus transitions from one stimulus to the next, x2 the probability of the transitions (i.e., transition contingencies), and x3 the phasic volatility, where t is the current trial number. Participants hold and update beliefs about the true quantities at each level, with a mean μ and a variance σ. ϑ and ω are participant-specific parameters that couple the levels and determine the respective speed of belief updating about phasic volatility and transition contingencies. The response model describes the mapping from a participant’s trialwise beliefs onto their observed log(RT) responses. (B) Example of the trialwise dynamics at level 3 from Placebo Participant 2. μ3 reflects the participant’s belief about the true phasic volatility (x3). Vertical dashed lines indicate true context switches. μ3 tends to increase following a context change and then decreases over the course of a context as the participant learns the new contextual rule and thus perceives the environment to be increasingly stable. √ϑ is a variance determining the step-size of μ3 and therefore how quickly the participant updates their phasic volatility estimates. (C) As in B, but for precision-weighted contingency prediction error [PE] (ε3) at level 2. This estimate results from weighting the contingency PE (δ2) by a precision ratio that captures uncertainty about input from the level below relative to the level above. The higher the precision at level 2, the more meaningful a deviation from the predicted stimulus transition contingency. This in turn increases the impact on phasic volatility belief updating at level 3. For simplicity, we only depict the ε3 trajectory for true transition changes. (D) As in B and C, but for sensory PE (δ1) at level 1. This estimate arises from irreducible uncertainty about stimulus transitions. Trialwise values are equivalent to 1−x^1, where x^1 is equal to the participant’s trialwise prediction of the occurring transition. Again, for simplicity we only show δ1 values for true transitions here. (E) Mean β values for the Placebo group indicate that increases in sensory PE (β1), precision-weighted contingency PE (β2), and phasic volatility estimates (β3) slowed participants’ trialwise log(RTs). There was also evidence of post-error slowing (β4). Results are mean ± SEM. * p < 0.05, ** p < 0.01, *** p < 0.001. http://dx.doi.org/10.6084/m9.figshare.3796356.v1.CC BY · PubMed Central
Fig 4 True and estimated stimulus transition contingencies for two example participants. (A) Transitions between pairs of stimuli, from trial t-1 to trial t, were defined by TMs. Every 50 trials, the TM switched to a different matrix. (B) Each panel corresponds to 1 of 16 possible transitions between stimuli across 1,200 trials. The black lines indicate the true transition contingencies. The blue lines reflect the participant’s inferred estimates (i.e., the posterior expectation of these contingencies, μ^1), before seeing the stimulus outcome on each trial. The model tracked the true underlying contingencies and detected change points. In a representative participant from the Placebo group, the model tracked the true transition contingencies closely. An example participant from the ACh- group showed a greater discrepancy in the tracking of the true transition contingencies. This is reflected in the two participants’ ω estimates: Placebo Participant 2 showed a higher transition contingency learning rate (ω = −3.27) than ACh- Participant 16 (ω = −5.84). http://dx.doi.org/10.6084/m9.figshare.3796362.v2.
Fig 4 True and estimated stimulus transition contingencies for two example participants. (A) Transitions between pairs of stimuli, from trial t-1 to trial t, were defined by TMs. Every 50 trials, the TM switched to a different matrix. (B) Each panel corresponds to 1 of 16 possible transitions between stimuli across 1,200 trials. The black lines indicate the true transition contingencies. The blue lines reflect the participant’s inferred estimates (i.e., the posterior expectation of these contingencies, μ^1), before seeing the stimulus outcome on each trial. The model tracked the true underlying contingencies and detected change points. In a representative participant from the Placebo group, the model tracked the true transition contingencies closely. An example participant from the ACh- group showed a greater discrepancy in the tracking of the true transition contingencies. This is reflected in the two participants’ ω estimates: Placebo Participant 2 showed a higher transition contingency learning rate (ω = −3.27) than ACh- Participant 16 (ω = −5.84). http://dx.doi.org/10.6084/m9.figshare.3796362.v2.CC BY · PubMed Central
Fig 5 Model-based changes in log(RT) mirror our model-agnostic finding that participants learned to predict the stimulus transitions. In all four groups, faster responses were observed as participants’ estimates of the true transition contingencies increased, mirroring our model-agnostic result (see Fig 2A). Results are mean ± SEM, corrected for Δalertness and body weight. http://dx.doi.org/10.6084/m9.figshare.3796401.v2.
Fig 5 Model-based changes in log(RT) mirror our model-agnostic finding that participants learned to predict the stimulus transitions. In all four groups, faster responses were observed as participants’ estimates of the true transition contingencies increased, mirroring our model-agnostic result (see Fig 2A). Results are mean ± SEM, corrected for Δalertness and body weight. http://dx.doi.org/10.6084/m9.figshare.3796401.v2.CC BY · PubMed Central
Fig 6 Model parameter results. (A–H) Compared to the Placebo group, NA and ACh antagonism modulated participants’ perceptual belief updating. NA- increased the rate at which participants updated their volatility estimates (increased ϑ). ACh- decreased the rate at which participants learned about stimulus contingencies (decreased ω) and increased participants’ ϑ estimates. DA- antagonism decreased the sensitivity of participants’ trialwise responses to their phasic volatility estimates (β3). DA- and ACh- antagonism also caused some general response slowing (β0). The three drug groups and the Placebo group showed equivalent post-error slowing (β4) and Gaussian noise (ζ). Results are (mean Drug) − (mean Placebo), ± the standard error of the difference (SED) between the means of the two samples and corrected for the covariates Δalertness and body weight. For uncorrected comparisons: * p < 0.05, ** p < 0.01, *** p < 0.001. For corrections for three comparisons, +’s are used for Benjamini-Hochberg-corrected significance thresholds at + p < 0.05, ++ p < 0.01, +++ p < 0.001. See S2 Table for Placebo group means. (I) First-level learning rate (α1) trajectories for truly occurring trials from the Placebo group. Increases in α1 are observed following a true change in context. This α1 increase is amplified for a more obvious switch from one easy-to-detect zeroth-order context to a different zeroth-order context. In contrast, a switch to an alternating context, which is trickier to detect, is accompanied by a modest, more gradual increase in α1. Results are mean ± SEM. http://dx.doi.org/10.6084/m9.figshare.3796407.v1.
Fig 6 Model parameter results. (A–H) Compared to the Placebo group, NA and ACh antagonism modulated participants’ perceptual belief updating. NA- increased the rate at which participants updated their volatility estimates (increased ϑ). ACh- decreased the rate at which participants learned about stimulus contingencies (decreased ω) and increased participants’ ϑ estimates. DA- antagonism decreased the sensitivity of participants’ trialwise responses to their phasic volatility estimates (β3). DA- and ACh- antagonism also caused some general response slowing (β0). The three drug groups and the Placebo group showed equivalent post-error slowing (β4) and Gaussian noise (ζ). Results are (mean Drug) − (mean Placebo), ± the standard error of the difference (SED) between the means of the two samples and corrected for the covariates Δalertness and body weight. For uncorrected comparisons: * p < 0.05, ** p < 0.01, *** p < 0.001. For corrections for three comparisons, +’s are used for Benjamini-Hochberg-corrected significance thresholds at + p < 0.05, ++ p < 0.01, +++ p < 0.001. See S2 Table for Placebo group means. (I) First-level learning rate (α1) trajectories for truly occurring trials from the Placebo group. Increases in α1 are observed following a true change in context. This α1 increase is amplified for a more obvious switch from one easy-to-detect zeroth-order context to a different zeroth-order context. In contrast, a switch to an alternating context, which is trickier to detect, is accompanied by a modest, more gradual increase in α1. Results are mean ± SEM. http://dx.doi.org/10.6084/m9.figshare.3796407.v1.CC BY · PubMed Central
Fig 7 Random effects Bayesian model comparison confirmed that Response Model 1 was superior in all four groups. Posterior probabilities quantify the likelihood of each model given the data. Protected exceedance probabilities quantify how likely it is that any given model is more frequent than all other models in the comparison set while also protecting against the possibility that the observed variability in (log-) model evidences could be due to chance. The dotted line indicates the threshold for chance-level posterior probabilities (0.33). http://dx.doi.org/10.6084/m9.figshare.3796413.v1.
Fig 7 Random effects Bayesian model comparison confirmed that Response Model 1 was superior in all four groups. Posterior probabilities quantify the likelihood of each model given the data. Protected exceedance probabilities quantify how likely it is that any given model is more frequent than all other models in the comparison set while also protecting against the possibility that the observed variability in (log-) model evidences could be due to chance. The dotted line indicates the threshold for chance-level posterior probabilities (0.33). http://dx.doi.org/10.6084/m9.figshare.3796413.v1.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 116 references

Research works printed but not linked: 2

  1. A Yu, 2003, Adv Neural Inf Process Syst, 173
  2. S Vossel, 2014, Spatial Attention, Precision, and Bayesian Inference: A Study of Saccadic Response Speed, Cereb Cortex, 24, 1436, 10.1093/cercor/bhs418 · DOI · Paper page

Cited by

Items 101–152 of 152

Metadata

Authors
Marshall, L., Mathys, C., Ruge, D., de Berker, A. O., Dayan, P., Stephan, K. E., & Bestmann, S.
Affiliations
  • UCL Queen Square Institute of Neurology (GB)
  • Wellcome Centre for Human Neuroimaging (GB)
  • TU Dortmund University (DE)
  • Gatsby Computational Neuroscience Unit (GB)
Corresponding author
  • Marshall, Louise
  • Mathys, Christoph
  • Ruge, Diane
  • Dayan, Peter
  • Stephan, Klaas E.
  • Bestmann, Sven
Venue
PLOS Biology
Published
2016-11-15
Volume
14
Issue
11
Pages
e1002575
ISSN
  • 1544-9173 (ISSN-L)
  • 1545-7885
OpenAlex
W2555795336
Cited by
158
References
116
Citations by year
2026: 14 · 2025: 22 · 2024: 17 · 2023: 15 · 2022: 12 · 2021: 12 · 2020: 24 · 2019: 17 · 2018: 18 · 2017: 6 · 2016: 1
FWCI
8.91
Type
journal article
Language
en
Open access
Locations
  • PLoS Biology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by)
  • Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
  • SDL (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • Max Planck Digital Library (submittedVersion)
  • Informationszentrum Lebenswissenschaften (ZB MED) (submittedVersion, cc-by)
  • MPG.PuRe (Max Planck Society) (submittedVersion)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by)
  • ETH Zürich Research Collection (cc-by)
  • Zurich Open Repository and Archive (University of Zurich)
Funders
  • Medical Research Council
  • European Research Council
  • Gatsby Charitable Foundation (GB)
  • Clinical Research Priority Program
  • Wellcome Trust
  • Tourette Syndrome Association
  • Dorothy Feiss Scientific Research Grant
  • René and Susanne Braginsky Foundation
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords
contextual uncertainty, norepinephrine, acetylcholine, dopamine, neuromodulators, belief updating, perceptual learning
MeSH terms
Adult, Brain, Humans, Models, Theoretical, Biogenic Monoamines, Likelihood Functions, Uncertainty

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.