Affective bias as a rational response to the statistics of rewards and punishments
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Affective bias, the tendency to differentially prioritise the processing of negative relative to positive events, is commonly observed in clinical and non-clinical populations. However, why such biases develop is not known. Using a computational framework, we investigated whether affective biases may reflect individuals’ estimates of the information content of negative relative to positive events. During a reinforcement learning task, the information content of positive and negative outcomes was manipulated independently by varying the volatility of their occurrence. Human participants altered the learning rates used for the outcomes selectively, preferentially learning from the most informative. This behaviour was associated with activity of the central norepinephrine system, estimated using pupilometry, for loss outcomes. Humans maintain independent estimates of the information content of distinct positive and negative outcomes which may bias their processing of affective events. Normalising affective biases using computationally inspired interventions may represent a novel approach to treatment development.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Rush, A. J., Trivedi, M. H., Ibrahim, H. M., Carmody, T. J., Arnow, B., Klein, D. N., Markowitz, J. C., Ninan, P. T., Kornstein, S., Manber, R., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01866-8 · Cited by 3,829 · cited 1×
“…completed a novel learning task (described below) as well as standard questionnaire measures of depression (Quick Inventory of Depressive Symptoms, QIDS [Rush et al., 2003]) and anxiety (Spielberger State-Trait Anxiety Inventory, trait subscale, STAI [Spielberger et al., 1983]) symptoms.”
MethodCognitive vulnerability to emotional disorders
Mathews, A., & MacLeod, C. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.143916 · Cited by 2,100 · cited 5×
“…of interventions which modify this estimate, as the affective biases associated with emotional disorders are seen across a wide variety of contexts (Mathews and MacLeod, 2005) and thus an intervention which modifies one particular instance of bias is unlikely to be useful therapeutically.”
BackgroundMethodInfluentialLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 4×
“The neural mechanism by which this modification of learning rate is achieved is thought to depend on activity of the central norepinepheric system (Yu and Dayan, 2005), with increased phasic activity of the system, which may be estimated using pupilometry (Joshi et al., 2016), reporting the…”
BackgroundInfluentialJoshi, S., Li, Y., Kalwani, R. M., & Gold, J. I. (2016) · Neuron · doi:10.1016/j.neuron.2015.11.028 · Cited by 1,387
Associative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925 · cited 3×
“While a number of studies have examined the effect of volatility on learning (Behrens et al., 2008; Behrens et al., 2007; Browning et al., 2015; Nassar et al., 2012), they have all utilised only one type of outcome (i.e. rewards or punishments) and thus their results could be accounted for by…”
BackgroundMethodAttentional biases for negative interpersonal stimuli in clinical depression
Gotlib, I. H., Krasnoperova, E., Yue, D. N., & Joormann, J. (2004) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.113.1.121 · Cited by 911 · cited 1×
“…been shown to be more influenced by negative events, for example tending to remember more negative than positive events (Bradley et al., 1995), attend to negative more than positive events (Gotlib et al., 2004) and learn more from negative and less from positive outcomes (Eshel and Roiser, 2010).”
BackgroundRational regulation of learning dynamics by pupil-linked arousal systems
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., & Gold, J. I. (2012) · Nature Neuroscience · doi:10.1038/nn.3130 · Cited by 722 · cited 10×
“The first 10 trials from each block were not used in the analysis as initial pupil adaption can occur in response to luminance changes in this period (Browning et al., 2015; Nassar et al., 2012).”
BackgroundMethodResultInfluentialReward and Punishment Processing in Depression
Eshel, N., & Roiser, J. P. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.01.027 · Cited by 575 · cited 1×
“…been shown to be more influenced by negative events, for example tending to remember more negative than positive events (Bradley et al., 1995), attend to negative more than positive events (Gotlib et al., 2004) and learn more from negative and less from positive outcomes (Eshel and Roiser, 2010).”
BackgroundMapping anhedonia onto reinforcement learning: a behavioural meta-analysis
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-12 · Cited by 480
Anxious individuals have difficulty learning the causal statistics of aversive environments
Browning, M., Behrens, T. E., Jocham, G., O'Reilly, J. X., & Bishop, S. J. (2015) · Nature Neuroscience · doi:10.1038/nn.3961 · Cited by 476
Self-citationForming beliefs: Why valence matters
Sharot, T., & Garrett, N. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.11.002 · Cited by 345 · cited 1×
“For example, many people display an optimism bias, updating their beliefs to a greater extent following positive than negative outcomes (Sharot and Garrett, 2016).”
BackgroundInfluentialImplicit and explicit memory for emotion-congruent information in clinical depression and anxiety
Bradley, B. P., Mogg, K., & Williams, R. (1995) · Behaviour Research and Therapy · doi:10.1016/0005-7967(95)00029-w · Cited by 291 · cited 2×
“In the case of depression, patients have been shown to be more influenced by negative events, for example tending to remember more negative than positive events (Bradley et al., 1995), attend to negative more than positive events (Gotlib et al.”
BackgroundUsing Attentional Bias Modification as a Cognitive Vaccine Against Depression
Browning, M., Holmes, E. A., Charles, M., Cowen, P. J., & Harmer, C. J. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.04.014 · Cited by 197 · cited 2×
“…be causally related to symptoms of depression (Mathews and MacLeod, 2005), and interventions designed to alter negative biases can reduce symptoms (Browning et al., 2012; NICE, 2009), these results raise the possibility that novel interventions which target exstimated information content may act…”
BackgroundMethodSelf-citationCatecholaminergic Regulation of Learning Rate in a Dynamic Environment
Jepma, M., Murphy, P. R., Nassar, M. R., Rangel-Gomez, M., Meeter, M., & Nieuwenhuis, S. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005171 · Cited by 91
Cited by
Anxiety, Depression, and Decision Making: A Computational Perspective
Bishop, S. J., & Gagne, C. (2018) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-080317-062007 · Cited by 240
The Misestimation of Uncertainty in Affective Disorders
Pulcu, E., & Browning, M. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.07.007 · Cited by 156
“We have also described studies in which the simple Rescorla–Wagner learning rule was used to obtain separate estimates of learning rate when uncertainty was high versus low [7,8,10,11].”
Self-citationA model for learning based on the joint estimation of stochasticity and volatility
Piray, P., & Daw, N. D. (2021) · Nature Communications · doi:10.1038/s41467-021-26731-9 · Cited by 153
Levy, I., & Schiller, D. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.11.007 · Cited by 95
Price, R. B., Brown, V., & Siegle, G. J. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.09.022 · Cited by 84
Metadata
- Authors
- Pulcu, E., & Browning, M.
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2017-10-04
- Volume
- 6
- ISSN
- 2050-084X (ISSN-L)
- OpenAlex
- W2762760131
- Cited by
- 93
- References
- 16
- FWCI
- 3.72
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.