The DOI matches its Crossref record; 141 of the 142 references it cites were found in a registry or an index, and 1 are not checked yet.
Deeply Felt Affect: The Emergence of Valence in Deep Active Inference
Open accessAbstract
The positive-negative axis of emotional valence has long been recognized as fundamental to adaptive behavior, but its origin and underlying function have largely eluded formal theorizing and computational modeling. Using deep active inference, a hierarchical inference scheme that rests on inverting a model of how sensory data are generated, we develop a principled Bayesian model of emotional valence. This formulation asserts that agents infer their valence state based on the expected precision of their action model—an internal estimate of overall model fitness (“subjective fitness”). This index of subjective fitness can be estimated within any environment and exploits the domain generality of second-order beliefs (beliefs about beliefs). We show how maintaining internal valence representations allows the ensuing affective agent to optimize confidence in action selection preemptively. Valence representations can in turn be optimized by leveraging the (Bayes-optimal) updating term for subjective fitness, which we label affective charge (AC). AC tracks changes in fitness estimates and lends a sign to otherwise unsigned divergences between predictions and outcomes. We simulate the resulting affective inference by subjecting an in silico affective agent to a T-maze paradigm requiring context learning, followed by context reversal. This formulation of affective inference offers a principled account of the link between affect, (mental) action, and implicit metacognition. It characterizes how a deep biological system can infer its affective state and reduce uncertainty about such inferences through internal action (i.e., top-down modulation of priors that underwrite confidence). Thus, we demonstrate the potential of active inference to provide a formal and computationally tractable account of affect. Our demonstration of the face validity and potential utility of this formulation represents the first step within a larger research program. Next, this model can be leveraged to test the hypothesized role of valence by fitting the model to behavioral and neuronal responses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This vector can be used to encode common sense and habits [34], [35], but can also be used to adapt the plans online due for instance to runtime component failure.”
From Active Inference and Behavior Trees for Reactive Action Planning and Execution in Robotics (2023) · cites this paper as [35]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“agents don’t seek only to minimize prediction error in the present but are sensitive to rates of change in prediction error minimization over time, relative to their prior expectations about that rate”
From Active inference goes to school: the importance of active learning in the age of large language models (2024) · cites this paper as [43]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deane et al. (2020) suggest that a sensitivity to worse than expected rates of prediction error reduction over time (Kiverstein et al. 2017, 2020; Hesp et al. 2021), manifesting phenomenologically as negative affect, drives the system to switch to more tractable goals.”
From Consciousness in active inference: Deep self-models, other minds, and the challenge of psychedelic-induced ego-dissolution (2021) · cites this paper as Hesp et al. 2021
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Inference about endogenous control of self-evidencing outcomes can thus be understood as an inference about ‘subjective fitness’—the expected precision of the organism’s phenotype-congruent action model (Hesp et al. 2021).”
From Consciousness in active inference: Deep self-models, other minds, and the challenge of psychedelic-induced ego-dissolution (2021) · cites this paper as Hesp et al. 2021
The cited source says what the claim attributes to it.
In the citing paper
“Inference about the reliability of the action model allows the system to increase or decrease precision on the current policy (Kiverstein et al. 2019; Hesp et al. 2021).”
From Consciousness in active inference: Deep self-models, other minds, and the challenge of psychedelic-induced ego-dissolution (2021) · cites this paper as Hesp et al. 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Yaşlı Kadınlarda Üreme Sağlığı
Kokanalı, D., & Engin Üstün, Y. (n.d.) · DergiPark (Istanbul University) · Cited by 170,090
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433 · cited 1×
“…standard measures of valence (e.g., self-report scales of pleasant or unpleasant subjective experience, potentiated startle responses; Watson, Clark, & Tellegen, 1988; Bradley & Lang, 1994; Bublatzky, Guerra, Pastor, Schupp, & Vila, 2013) should be correlated with experimental…”
ResultReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 3×
“Some perspectives in emotion research and associated neuroscience research posit that valence is unidimensional (Russell, 1980; Barrett & Russell, 1999) and assume (for example) that a single neural system should increase (or decrease) in activity as valence changes along this dimension.”
BackgroundMeasuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538 · cited 1×
“…valence (e.g., self-report scales of pleasant or unpleasant subjective experience, potentiated startle responses; Watson, Clark, & Tellegen, 1988; Bradley & Lang, 1994; Bublatzky, Guerra, Pastor, Schupp, & Vila, 2013) should be correlated with experimental inductions of uncertainty about the…”
BackgroundA neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“AC is formally related to reward prediction error within reinforcement learning models (Friston et al., 2014; Schultz, Dayan, & Montague, 1997; Stauffer, Lak, & Schultz, 2014).”
BackgroundThe organization of the human cerebral cortex estimated by intrinsic functional connectivity
Thomas Yeo, B. T., Krienen, F. M., Sepulcre, J., Sabuncu, M. R., Lashkari, D., Hollinshead, M., Roffman, J. L., Smoller, J. W., Zöllei, L., Polimeni, J. R., et al. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00338.2011 · Cited by 9,182
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 4×
“This framework revolves around the notion that all living systems embody statistical models of their worlds (Friston, 2010; Gallagher & Allen, 2018).”
BackgroundMethodInfluentialSelf-citationFunctional Network Organization of the Human Brain
Power, J. D., Cohen, A. L., Nelson, S. M., Wig, G. S., Barnes, K. A., Church, J. A., Vogel, A. C., Laumann, T. O., Miezin, F. M., Schlaggar, B. L., et al. (2011) · Neuron · doi:10.1016/j.neuron.2011.09.006 · Cited by 4,124
Parvalbumin neurons and gamma rhythms enhance cortical circuit performance
Sohal, V. S., Zhang, F., Yizhar, O., & Deisseroth, K. (2009) · Nature · doi:10.1038/nature07991 · Cited by 2,606
Research works printed but not linked: 1
- Gray, J. A. (1994). Three fundamental emotion systems. In P.Ekman & R. J.Davidson (Eds.), The nature of emotion (pp. 243–247). New York: Oxford University Press.
Cited by
A step-by-step tutorial on active inference and its application to empirical data
Smith, R., Friston, K. J., & Whyte, C. J. (2022) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2021.102632 · Cited by 246
Self-citationIn the body's eye: the computational anatomy of interoceptive inference
Allen, M., Levy, A., Parr, T., & Friston, K. J. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1010490 · Cited by 185
“, whether one is certain if a heartbeat has occurred or not) inferences in hierarchical models, with temporal depth [37,47,48,70,91].”
BackgroundMethodSelf-citationSmith, R., Badcock, P., & Friston, K. J. (2021) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.13138 · Cited by 174
“22 On the left, a network of abstract neuron-like nodes (and select connections) is depicted, where the higher level represents different possible concept-level inferences about one ’ s own internal state, including emotional and somatic interpretations.”
BackgroundSmith, R. S., Parr, T., & Friston, K. J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02844 · Cited by 150
Self-citationFriston, K. J., Costa, L. D., Hafner, D., Hesp, C., & Parr, T. (2021) · Neural Computation · doi:10.1162/neco_a_01351 · Cited by 183
Self-citation
Metadata
- Authors
- Hesp, C., Smith, R., Parr, T., Allen, M., Friston, K. J., & Ramstead, M. J. D.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- Laureate Institute for Brain Research (US)
- Aarhus University (DK)
- Corresponding author
- Hesp, Casper
- Smith, Ryan
- Parr, Thomas
- Allen, Micah
- Friston, Karl J.
- Ramstead, Maxwell J. D.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2021-02-01
- Volume
- 33
- Issue
- 2
- Pages
- 398-446
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- PMC
- PMC8594962
- OpenAlex
- W3108742966
- Cited by
- 246
- References
- 126
- Citations by year
- 2026: 32 · 2025: 29 · 2024: 40 · 2023: 40 · 2022: 47 · 2021: 38
- FWCI
- 19.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Neural Computation (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- William K. Warren Foundation
- Aarhus Universitet
- McGill University
- Wellcome Trust (R272-2017-4345, 088130, 754513, 088130/Z/09/Z)
- European Commission (HORIZON2020, 754513)
- Rosetrees Trust (173346)
- Aarhus Universitets Forskningsfond (754513, R272-2017-4345)
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (406.18, 406.18.535)
- Lundbeckfonden (R272‐2017‐4345, 754513)
- Canada First Research Excellence Fund
- Social Sciences and Humanities Research Council of Canada
- H2020 Marie Skłodowska-Curie Actions (754513, HORIZON2020, R272-2017-4345)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Keywords
- emotional valence, second-order beliefs, metacognition, Bayesian inference, top-down modulation, T-maze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deeply Felt Affect: The Emergence of Valence in Deep Active Inference. https://app.cochat.ai/papers/10.1162/neco_a_01341
- The paper
- Hesp, C., Smith, R., Parr, T., Allen, M., Friston, K. J., & Ramstead, M. J. D. (2021). Deeply Felt Affect: The Emergence of Valence in Deep Active Inference. Neural Computation. https://doi.org/10.1162/neco_a_01341
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.