CoChat

Serotonin, Inhibition, and Negative Mood

Open access
Dayan, Peter, Huys, Quentin J. M · 2008 · PLoS Computational Biology

The DOI matches its Crossref record; 118 of the 118 references it cites were found in a registry or an index.

Abstract

Pavlovian predictions of future aversive outcomes lead to behavioral inhibition, suppression, and withdrawal. There is considerable evidence for the involvement of serotonin in both the learning of these predictions and the inhibitory consequences that ensue, although less for a causal relationship between the two. In the context of a highly simplified model of chains of affectively charged thoughts, we interpret the combined effects of serotonin in terms of pruning a tree of possible decisions, (i.e., eliminating those choices that have low or negative expected outcomes). We show how a drop in behavioral inhibition, putatively resulting from an experimentally or psychiatrically influenced drop in serotonin, could result in unexpectedly large negative prediction errors and a significant aversive shift in reinforcement statistics. We suggest an interpretation of this finding that helps dissolve the apparent contradiction between the fact that inhibition of serotonin reuptake is the first-line treatment of depression, although serotonin itself is most strongly linked with aversive rather than appetitive outcomes and predictions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pcbi.0040004

Cites

118 of 118 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Markov Models of Thought The abstract state space is divided into the four blocks shown. The right two, O℘ + and O℘ −, are associated with direct affective values r(s) (inset histograms); the left two, I℘ − and I℘ +, are internal. Transitions between (belief) states are determined by actions (thoughts). We initially focus on a fixed policy, leading to the transition between states shown in the figure: states in each internal block I℘ + and I℘ − preferentially connect with each other and their respective outcome states O℘ + and O℘ −. However, each state has links to states in the other block. The model is approximately balanced as a whole, with an equal number of positive and negative states.
Figure 1 Markov Models of Thought The abstract state space is divided into the four blocks shown. The right two, O℘ + and O℘ −, are associated with direct affective values r(s) (inset histograms); the left two, I℘ − and I℘ +, are internal. Transitions between (belief) states are determined by actions (thoughts). We initially focus on a fixed policy, leading to the transition between states shown in the figure: states in each internal block I℘ + and I℘ − preferentially connect with each other and their respective outcome states O℘ + and O℘ −. However, each state has links to states in the other block. The model is approximately balanced as a whole, with an equal number of positive and negative states.CC BY · PubMed Central
Figure 2 Probability of Continuing a Train of Thoughts For values V(s) > 0, thoughts are continued with probability 1. Conversely, when the state s has negative value, the probability of continuation drops of as an exponential function of the value. The rate of the exponential is set by α 5HT.
Figure 2 Probability of Continuing a Train of Thoughts For values V(s) > 0, thoughts are continued with probability 1. Conversely, when the state s has negative value, the probability of continuation drops of as an exponential function of the value. The rate of the exponential is set by α 5HT.CC BY · PubMed Central
Figure 3 Learning with Behavioral Inhibition (A,B) With α 5HT = 0, for one particular learning run, the values V est match their true values V true (inferred through dynamic programming) under an equal-sampling exploration policy (A), and trains of thought end in terminal states O℘ −, O℘ + equally often as a function of their actual outcomes (B) (the red line is the regression line). (C,D) With α 5HT = 20, negative V values are poorly estimated (since exploration is progressively inhibited for larger α 5HT), and the more negative the value of the outcome, the less frequently that outcome gets visited over learning (D). Importantly, there is an optimistic underestimate of the negative value of state. (E) The root mean squared error (averaging over 20 runs) for states with positive (dotted) and negative V true values as a function of α 5HT. The effect of the sampling bias is strikingly apparent, preventing accurate estimates mainly of the negatively valued states. (F) Average reward received during learning as a function of α 5HT—the benefits of behavioral inhibition are apparent.
Figure 3 Learning with Behavioral Inhibition (A,B) With α 5HT = 0, for one particular learning run, the values V est match their true values V true (inferred through dynamic programming) under an equal-sampling exploration policy (A), and trains of thought end in terminal states O℘ −, O℘ + equally often as a function of their actual outcomes (B) (the red line is the regression line). (C,D) With α 5HT = 20, negative V values are poorly estimated (since exploration is progressively inhibited for larger α 5HT), and the more negative the value of the outcome, the less frequently that outcome gets visited over learning (D). Importantly, there is an optimistic underestimate of the negative value of state. (E) The root mean squared error (averaging over 20 runs) for states with positive (dotted) and negative V true values as a function of α 5HT. The effect of the sampling bias is strikingly apparent, preventing accurate estimates mainly of the negatively valued states. (F) Average reward received during learning as a function of α 5HT—the benefits of behavioral inhibition are apparent.CC BY · PubMed Central
Figure 4 Reduced Inhibition These graphs show statistics of the effect of learning V values with α 5HT = 20, and then suffering from reduced serotonin α 5HT < 20 during sampling of thoughts. For a given thought environment, these are calculated in closed form, without estimation error. (A) As is also evident in Figure 3F, the average affective return is greatly reduced from the value with α 5HT = 20; in fact, for the extreme value of α 5HT = 0, it becomes slightly negative (reflecting a small sample bias in the particular collection of outcomes). (B,C) Normalized outcome prediction errors at the time of transition to O℘ + (B) or O℘ − (C) for α 5HT = 20 against α 5HT = 0. These reflect the individual probability that each terminal transition goes to r(s) from V(s′) for s ∈ O℘ and s′ ∈ I℘, including all the probabilistic contingencies of termination, etc. They are normalized for the two values of α 5HT. Terminations in O℘ + are largely unaffected by the change in inhibition; terminations in O℘ − with negative consequences have greatly increased negative prediction error.
Figure 4 Reduced Inhibition These graphs show statistics of the effect of learning V values with α 5HT = 20, and then suffering from reduced serotonin α 5HT < 20 during sampling of thoughts. For a given thought environment, these are calculated in closed form, without estimation error. (A) As is also evident in Figure 3F, the average affective return is greatly reduced from the value with α 5HT = 20; in fact, for the extreme value of α 5HT = 0, it becomes slightly negative (reflecting a small sample bias in the particular collection of outcomes). (B,C) Normalized outcome prediction errors at the time of transition to O℘ + (B) or O℘ − (C) for α 5HT = 20 against α 5HT = 0. These reflect the individual probability that each terminal transition goes to r(s) from V(s′) for s ∈ O℘ and s′ ∈ I℘, including all the probabilistic contingencies of termination, etc. They are normalized for the two values of α 5HT. Terminations in O℘ + are largely unaffected by the change in inhibition; terminations in O℘ − with negative consequences have greatly increased negative prediction error.CC BY · PubMed Central
Figure 5 Reward Seeking and Recall Bias Both plots are in the same form as Figure 4A, showing the percentage utilities compared with the standard learning case α 5HT = 20, as a function of α 5HT (the emboldened blue curve is exactly that in Figure 4A). (A) Given a mood-dependent bias on the starting state, with , the plots show the consequences of various values of β. Negative β, favoring low value states, leads to substantially negative average outcomes. (B) Instrumental control of action choice, a putative model of dopaminergic effects, can also either exacerbate or improve the outcomes, depending on the value of the parameter θ governing a softmax choice of actions.
Figure 5 Reward Seeking and Recall Bias Both plots are in the same form as Figure 4A, showing the percentage utilities compared with the standard learning case α 5HT = 20, as a function of α 5HT (the emboldened blue curve is exactly that in Figure 4A). (A) Given a mood-dependent bias on the starting state, with , the plots show the consequences of various values of β. Negative β, favoring low value states, leads to substantially negative average outcomes. (B) Instrumental control of action choice, a putative model of dopaminergic effects, can also either exacerbate or improve the outcomes, depending on the value of the parameter θ governing a softmax choice of actions.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 118 references

Research works printed but not linked: 6

  1. 1983, Roles of brain serotonergic neurons in escape, avoidance and other behaviors., J Psychopharmacol, 43, 563
  2. Gray JA 1991 The psychology of fear and stress. Problems in the behavioural sciences, Volume 5. 2nd edition Cambridge (United Kingdom) Cambridge University Press 432
  3. 1998, Role of 5HT in stress, anxiety and depression., Pharm Biochem Behav, 54, 129
  4. Gray JA McNaughton N 2000 The neuropsychology of anxiety Oxford Oxford University Press 424
  5. Huys QJM 2007 Reinforcers and control. Towards a computational aetiology of depression [dissertation] Gatsby Computational Neuroscience Unit, UCL University of London (United Kingdom) Available at: http://www.gatsby.ucl.ac.uk/~qhuys/pub.html. Accessed 6 December 2007.
  6. 2000, Depression: The case for a monoamine deficiency., J Clin Psychiatry, 61, 7

Cited by

Items 201–263 of 263

Metadata

Authors
Dayan, P., & Huys, Q. J. M.
Affiliations
Gatsby Computational Neuroscience Unit (GB)
Corresponding author
Huys, Quentin J. M
Venue
PLoS Computational Biology
Published
2008-02-01
Volume
4
Issue
2
Pages
e4
ISSN
  • 1553-734X (ISSN-L)
  • 1553-7358
OpenAlex
W2019403801
Cited by
263
References
117
Citations by year
2026: 9 · 2025: 12 · 2024: 9 · 2023: 16 · 2022: 9 · 2021: 19 · 2020: 14 · 2019: 11 · 2018: 30 · 2017: 12 · 2016: 12 · 2015: 14 · 2014: 22 · 2013: 18 · 2012: 14
FWCI
6.05
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • PLoS Computational Biology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • UCL Discovery (University College London) (submittedVersion)
  • Figshare (submittedVersion, cc-by)
  • MPG.PuRe (Max Planck Society) (submittedVersion)
Funders
Gatsby Charitable Foundation
Topics
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
Keywords
serotonin, behavioral inhibition, negative mood, classical conditioning, serotonin reuptake inhibition, depression treatment, aversive learning
MeSH terms
Brain, Depression, Humans, Inhibition, Psychological, Learning, Models, Neurological, Models, Psychological, Serotonin

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.