Deeply Felt Affect: The Emergence of Valence in Deep Active Inference
Open accessThe DOI matches its Crossref record; 142 of the 143 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
The positive-negative axis of emotional valence has long been recognized as fundamental to adaptive behavior, but its origin and underlying function have largely eluded formal theorizing and computational modeling. Using deep active inference, a hierarchical inference scheme that rests on inverting a model of how sensory data are generated, we develop a principled Bayesian model of emotional valence. This formulation asserts that agents infer their valence state based on the expected precision of their action model—an internal estimate of overall model fitness (“subjective fitness”). This index of subjective fitness can be estimated within any environment and exploits the domain generality of second-order beliefs (beliefs about beliefs). We show how maintaining internal valence representations allows the ensuing affective agent to optimize confidence in action selection preemptively. Valence representations can in turn be optimized by leveraging the (Bayes-optimal) updating term for subjective fitness, which we label affective charge (AC). AC tracks changes in fitness estimates and lends a sign to otherwise unsigned divergences between predictions and outcomes. We simulate the resulting affective inference by subjecting an in silico affective agent to a T-maze paradigm requiring context learning, followed by context reversal. This formulation of affective inference offers a principled account of the link between affect, (mental) action, and implicit metacognition. It characterizes how a deep biological system can infer its affective state and reduce uncertainty about such inferences through internal action (i.e., top-down modulation of priors that underwrite confidence). Thus, we demonstrate the potential of active inference to provide a formal and computationally tractable account of affect. Our demonstration of the face validity and potential utility of this formulation represents the first step within a larger research program. Next, this model can be leveraged to test the hypothesized role of valence by fitting the model to behavioral and neuronal responses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This vector can be used to encode common sense and habits [34], [35], but can also be used to adapt the plans online due for instance to runtime component failure.”
From Active Inference and Behavior Trees for Reactive Action Planning and Execution in Robotics (2023) · cites this paper as [35]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“agents don’t seek only to minimize prediction error in the present but are sensitive to rates of change in prediction error minimization over time, relative to their prior expectations about that rate”
From Active inference goes to school: the importance of active learning in the age of large language models (2024) · cites this paper as [43]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deane et al. (2020) suggest that a sensitivity to worse than expected rates of prediction error reduction over time (Kiverstein et al. 2017, 2020; Hesp et al. 2021), manifesting phenomenologically as negative affect, drives the system to switch to more tractable goals.”
From Consciousness in active inference: Deep self-models, other minds, and the challenge of psychedelic-induced ego-dissolution (2021) · cites this paper as Hesp et al. 2021
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Inference about endogenous control of self-evidencing outcomes can thus be understood as an inference about ‘subjective fitness’—the expected precision of the organism’s phenotype-congruent action model (Hesp et al. 2021).”
From Consciousness in active inference: Deep self-models, other minds, and the challenge of psychedelic-induced ego-dissolution (2021) · cites this paper as Hesp et al. 2021
The cited source says what the claim attributes to it.
In the citing paper
“Inference about the reliability of the action model allows the system to increase or decrease precision on the current policy (Kiverstein et al. 2019; Hesp et al. 2021).”
From Consciousness in active inference: Deep self-models, other minds, and the challenge of psychedelic-induced ego-dissolution (2021) · cites this paper as Hesp et al. 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Yaşlı Kadınlarda Üreme Sağlığı
Kokanalı, D., & Engin Üstün, Y. (n.d.) · DergiPark (Istanbul University) · Cited by 170,090
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433 · cited 1×
“…standard measures of valence (e.g., self-report scales of pleasant or unpleasant subjective experience, potentiated startle responses; Watson, Clark, & Tellegen, 1988; Bradley & Lang, 1994; Bublatzky, Guerra, Pastor, Schupp, & Vila, 2013) should be correlated with experimental…”
ResultReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 3×
“Some perspectives in emotion research and associated neuroscience research posit that valence is unidimensional (Russell, 1980; Barrett & Russell, 1999) and assume (for example) that a single neural system should increase (or decrease) in activity as valence changes along this dimension.”
BackgroundMeasuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538 · cited 1×
“…valence (e.g., self-report scales of pleasant or unpleasant subjective experience, potentiated startle responses; Watson, Clark, & Tellegen, 1988; Bradley & Lang, 1994; Bublatzky, Guerra, Pastor, Schupp, & Vila, 2013) should be correlated with experimental inductions of uncertainty about the…”
BackgroundA neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“AC is formally related to reward prediction error within reinforcement learning models (Friston et al., 2014; Schultz, Dayan, & Montague, 1997; Stauffer, Lak, & Schultz, 2014).”
BackgroundThe organization of the human cerebral cortex estimated by intrinsic functional connectivity
Thomas Yeo, B. T., Krienen, F. M., Sepulcre, J., Sabuncu, M. R., Lashkari, D., Hollinshead, M., Roffman, J. L., Smoller, J. W., Zöllei, L., Polimeni, J. R., et al. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00338.2011 · Cited by 9,182
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 4×
“This framework revolves around the notion that all living systems embody statistical models of their worlds (Friston, 2010; Gallagher & Allen, 2018).”
BackgroundMethodInfluentialSelf-citationFunctional Network Organization of the Human Brain
Power, J. D., Cohen, A. L., Nelson, S. M., Wig, G. S., Barnes, K. A., Church, J. A., Vogel, A. C., Laumann, T. O., Miezin, F. M., Schlaggar, B. L., et al. (2011) · Neuron · doi:10.1016/j.neuron.2011.09.006 · Cited by 4,124
Parvalbumin neurons and gamma rhythms enhance cortical circuit performance
Sohal, V. S., Zhang, F., Yizhar, O., & Deisseroth, K. (2009) · Nature · doi:10.1038/nature07991 · Cited by 2,606
Hayes, S. C. (2004) · Behavior Therapy · doi:10.1016/s0005-7894(04)80013-3 · Cited by 2,493 · cited 2×
“, 2018; Smith, Weihs, Alkozei, Killgore, & Lane, 2019; Smith, Killgore, & Lane, 2020), each of them central to current evidence-based psychotherapies (Barlow, Allen, & Choate, 2016; Hayes, 2016).”
(2017) · Cited by 2,433
Ekman, P. (1992) · Psychological Review · doi:10.1037//0033-295x.99.3.550 · Cited by 2,372 · cited 2×
“subcortical neuronal circuits and associated “affect programs” for different emotion categories (e.g., distinct circuits for generating the feelings and visceral/behavioral expressions of anger, fear, or happiness; Ekman, 1992; Panksepp, Lane, Solms, & Smith, 2017).”
BackgroundEvolutionary Psychology: The New Science of the Mind
Buss, D. M. (1998) · Cited by 2,040
Cognitive Reappraisal of Emotion: A Meta-Analysis of Human Neuroimaging Studies
Buhle, J. T., Silvers, J. A., Wager, T. D., Lopez, R., Onyemekwu, C., Kober, H., Weber, J., & Ochsner, K. N. (2014) · Cerebral Cortex · doi:10.1093/cercor/bht154 · Cited by 1,896
Cacioppo, J. T., & Berntson, G. G. (1994) · Psychological Bulletin · doi:10.1037//0033-2909.115.3.401 · Cited by 1,882 · cited 1×
“Alternatively, others have suggested that valence is itself a two-dimensional construct (Cacioppo & Berntson, 1994; Briesemeister, Kuchinke, & Jacobs, 2012), with the intensity of negative and positive valence each represented by its own axis (i.e., where high negative and positive valence can…”
BackgroundInteroceptive predictions in the brain
Barrett, L. F., & Simmons, W. K. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3950 · Cited by 1,766
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479
Liking, wanting, and the incentive-sensitization theory of addiction
Berridge, K. C., & Robinson, T. E. (2016) · American Psychologist · doi:10.1037/amp0000059 · Cited by 1,440 · cited 4×
“This includes the notion of RPEs discussed above, as well as that of salience, wanting, pleasure, and motivation, each of which has been related to dopamine in previous literature and appears distinct from AC (Berridge & Robinson, 2016).”
BackgroundResultInfluentialToward a unified treatment for emotional disorders
Barlow, D. H., Allen, L. B., & Choate, M. L. (2004) · Behavior Therapy · doi:10.1016/s0005-7894(04)80036-4 · Cited by 1,430 · cited 1×
“…capacities for emotional awareness (Smith, Steklis, Steklis, Weihs, & Lane, 2020; Smith, Bajaj et al., 2018; Smith, Weihs, Alkozei, Killgore, & Lane, 2019; Smith, Kill-gore, & Lane, 2020), each of them central to current evidence-based psy-chotherapies (Barlow, Allen, & Choate, 2016; Hayes, 2016).”
Phillips, M. L., Ladouceur, C. D., & Drevets, W. C. (2008) · Molecular Psychiatry · doi:10.1038/mp.2008.65 · Cited by 1,383
A mechanism for impaired fear recognition after amygdala damage
Adolphs, R., Gosselin, F., Buchanan, T. W., Tranel, D., Schyns, P., & Damasio, A. R. (2005) · Nature · doi:10.1038/nature03086 · Cited by 1,331 · cited 1×
“…attention to affective stimuli and manipulating affective information within working memory; Smith, Lane et al., 2017; Smith, Lane, Alkozei et al., 2018; Smith, Lane, Sanova et al., 2018) or external (e.g., saccade selection to affective cues; Adolphs et al., 2005; Moriuchi, Klin, & Jones, 2017).”
BackgroundBayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224 · cited 1×
“Furthermore, it generalizes many established formulations of optimal behavior (Itti & Baldi, 2009; Schmidhuber, 2010; Mirza, Adams, Mathys, & Friston, 2016; Veale, Hafed, & Yoshida, 2017) and provides a formal description of the motivated and self-preserving behavior of living systems (Friston,…”
BackgroundThe world of emotions is not two-dimensional
Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.02024.x · Cited by 1,179 · cited 1×
“Other perspectives posit two dimensions (Fontaine et al., 2007), potentially corresponding to two independent neural systems activated by negative and positive valence, respectively.”
BackgroundActive inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156 · cited 4×
“The resulting generative model provides a principled account of the subjective relevance of behavioral policies and their expected outcomes, in which an agent trades off between seeking reward and seeking new information (Friston, FitzGerald, Rigoli, Schwartenbeck, & Pezzulo, 2017.”
BackgroundMethodInfluentialSelf-citationAttending to the Big Picture: Mood and Global Versus Local Processing of Visual Information
Gasper, K., & Clore, G. L. (2002) · Psychological Science · doi:10.1111/1467-9280.00406 · Cited by 1,075 · cited 1×
“Crucially, negatively valenced states lead to behavior suggesting a reduced reliance on prior expectations (Bodenhausen, Sheppard, & Kramer, 1994; Gasper & Clore, 2002), while positively valenced states appear to increase reliance on prior expectations (Bodenhausen, Kramer, & Süsser, 1994; Park &…”
BackgroundExplicit and implicit emotion regulation: a dual-process framework.
Gyurak, A., Gross, J. J., & Etkin, A. (2011) · Cognition and Emotion · doi:10.1080/02699931.2010.544160 · Cited by 1,015 · cited 1×
“…to several widely studied automatic and voluntary emotion regulation mechanisms (Buhle et al., 2014; Phillips, Ladouceur, & Drevets, 2008; Gyurak, Gross, & Etkin, 2011; Smith, Alkozei, Lane, & Kill-gore, 2016; Smith, Alkozei, Bao, & Killgore, 2018), as well as capacities for emotional…”
What does the prefrontal cortex “do” in affect: perspectives on frontal EEG asymmetry research
Davidson, R. J. (2004) · Biological Psychology · doi:10.1016/j.biopsycho.2004.03.008 · Cited by 992 · cited 2×
“, nucleus accumbens, left frontal cortex, dopamine systems; Rutledge, Skandali, Dayan, & Dolan, 2015) or punishment and/or avoidance behavior (e.g., amygdala, right frontal cortex; Davidson, 2004).”
BackgroundThe Structure of Current Affect: Controversies and Emerging Consensus
Barrett, L. F., & Russell, J. A. (1999) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00003 · Cited by 974
Izquierdo, I., & Medina, J. H. (1997) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1997.3799 · Cited by 959
Active interoceptive inference and the emotional brain
Seth, A. K., & Friston, K. J. (2016) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0007 · Cited by 945 · cited 2×
“…mentioned above as well as prior work on other emotional phenomena within the active inference framework (Smith, Parr, & Friston, 2019; Smith, Lane, Parr, & Friston, 2019); Smith, Lane, Nadel, L., & Moutoussis, 2020; Joffily & Coricelli, 2013; Clark, Watson, & Friston, 2016; Seth & Friston, 2016).”
BackgroundSelf-citationThe primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917
Negative affect and social judgment: The differential impact of anger and sadness
Bodenhausen, G. V., Sheppard, L. A., & Kramer, G. P. (1994) · European Journal of Social Psychology · doi:10.1002/ejsp.2420240104 · Cited by 874 · cited 1×
“Crucially, negatively valenced states lead to behavior suggesting a reduced reliance on prior expectations (Bodenhausen, Sheppard, & Kramer, 1994; Gasper & Clore, 2002), while positively valenced states appear to increase reliance on prior expectations (Bodenhausen, Kramer, & Süsser, 1994; Park &…”
BackgroundHayes, S. C. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.11.006 · Cited by 785 · cited 1×
“…capacities for emotional awareness (Smith, Steklis, Steklis, Weihs, & Lane, 2020; Smith, Bajaj et al., 2018; Smith, Weihs, Alkozei, Killgore, & Lane, 2019; Smith, Kill-gore, & Lane, 2020), each of them central to current evidence-based psy-chotherapies (Barlow, Allen, & Choate, 2016; Hayes, 2016).”
Formal theory of creativity, fun, and intrinsic motivation (1990–2010)
Schmidhuber, J. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2056368 · Cited by 747 · cited 2×
“Furthermore, it generalizes many established formulations of optimal behavior (Itti & Baldi, 2009; Schmidhuber, 2010; Mirza, Adams, Mathys, & Friston, 2016; Veale, Hafed, & Yoshida, 2017) and provides a formal description of the motivated and self-preserving behavior of living systems (Friston,…”
BackgroundActive inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731 · cited 1×
“Accordingly, it may be reported or encoded by neuromodulators like dopamine in the brain (Friston, Rigoli et al., 2015; Schwartenbeck et al., 2015), a view that has been empirically supported us-ing functional magnetic resonance imaging of decision making under uncertainty (Schwartenbeck et al.,…”
BackgroundSelf-citationHappiness and stereotypic thinking in social judgment.
Bodenhausen, G. V., Kramer, G. P., & Süsser, K. (1994) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.66.4.621 · Cited by 716 · cited 1×
“…(Bodenhausen, Sheppard, & Kramer, 1994; Gasper & Clore, 2002), while positively valenced states appear to increase reliance on prior expectations (Bodenhausen, Kramer, & Süsser, 1994; Park & Banaji, 2000)—both consistent with the idea that valence relates to confidence in one’s internal model of…”
BackgroundLindquist, K. A., Satpute, A. B., Wager, T. D., Weber, J., & Barrett, L. F. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv001 · Cited by 713 · cited 6×
“Indeed, some downstream systems could selectively use negative or positive AC information (as in a two-dimensional model), or multiple systems could use bivalent information for a diverse set of functions (as in affective workspace views; Lindquist et al., 2016).”
BackgroundInfluentialWinkielman, P., Berridge, K. C., & Wilbarger, J. L. (2005) · Personality and Social Psychology Bulletin · doi:10.1177/0146167204271309 · Cited by 708 · cited 2×
“Thus, unlike other modeling approaches, valence is here related to, but distinct from, both reward and punishment and approach and avoidance behavior (i.e., consistent with empirically observed dissociations between self-reported valence and these other constructs; see Smith & Lane, 2016; Panksepp et al., 2017; Winkie…”
BackgroundFriston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., ODoherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Self-citationActive Inference, homeostatic regulation and adaptive behavioural control
Pezzulo, G., Rigoli, F., & Friston, K. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.001 · Cited by 650 · cited 1×
“The particular implementation of active (affective) inference we use in this letter is based on a T-maze paradigm (see Figure 4), for which an active-inference MDP has been validated previously (Pezzulo, Rigoli, & Friston, 2015).”
MethodSelf-citationEvidence for a large-scale brain system supporting allostasis and interoception in humans
Kleckner, I. R., Zhang, J., Touroutoglou, A., Chanes, L., Xia, C., Simmons, W. K., Quigley, K. S., Dickerson, B. C., & Feldman Barrett, L. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0069 · Cited by 641
Hohwy, J. (2016) · Noûs · doi:10.1111/nous.12062 · Cited by 578 · cited 1×
“In active inference, every organism enacts an implicit phenotype-congruent model of its embodied existence (Ramstead, Kirch-hoff, Constant, & Friston, 2019; Hesp et al., 2019), which has been referred to as self-evidencing (Hohwy, 2016).”
BackgroundToward a unified treatment for emotional disorders - republished Article
Barlow, D. H., Allen, L. B., & Choate, M. L. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.11.005 · Cited by 536
The hierarchical basis of neurovisceral integration
Smith, R., Thayer, J. F., Khalsa, S. S., & Lane, R. D. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.003 · Cited by 523 · cited 1×
“Beyond internal fluctuations in subjective fitness ( AC , as in our formulation), affective inference is also plausibly informed by exteroceptive cues as well as interoceptive signals (e.g., heart rate variability; Allen, Levy, Parr, & Fris-ton, 2019; Smith, Thayer, Khalsa, & Lane, 2017).”
BackgroundSelf-citationAbsolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA
Bunzeck, N., & Düzel, E. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.021 · Cited by 503
Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression
Stephan, K. E., Manjaly, Z. M., Mathys, C. D., Weber, L. A. E., Paliwal, S., Gard, T., Tittgemeyer, M., Fleming, S. M., Haker, H., Seth, A. K., et al. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00550 · Cited by 437 · cited 1×
“This echoes other work on Bayesian approaches to metacognition (Stephan et al., 2016).”
BackgroundThe graphical brain: Belief propagation and active inference
Friston, K. J., Parr, T., & de Vries, B. (2017) · Network Neuroscience · doi:10.1162/netn_a_00018 · Cited by 415 · cited 2×
“In this letter, we demonstrate that hierarchical (i.e., deep) Bayesian networks, solved using active inference (Friston, Parr, & de Vries, 2018), afford a principled formulation of emotional valence—building on both the work mentioned above as well as prior work on other emotional phenomena within…”
MethodSelf-citationToward a computational theory of conscious processing
Dehaene, S., Charles, L., King, J.-R., & Marti, S. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.12.005 · Cited by 404 · cited 2×
“We assume, based on what is known about conscious versus unconscious neural processes (e.g., Dehaene et al., 2014; Whyte & Smith, in press), that explicit state representation is a necessary condition for self-reportable experience, and thus that higher-level valence representation (as in our…”
BackgroundMethodReexamining the circumplex model of affect.
Remington, N. A., Fabrigar, L. R., & Visser, P. S. (2000) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.79.2.286 · Cited by 397
Mood as representation of momentum
Eldar, E., Rutledge, R. B., Dolan, R. J., & Niv, Y. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.010 · Cited by 383 · cited 2×
“More recent models have suggested that mood reflects the recent history of reward prediction errors, which serves the function of biasing perception of future reward (Eldar et al., 2016; Eldar & Niv, 2015).”
BackgroundEmotional Valence and the Free-Energy Principle
Joffily, M., & Coricelli, G. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003094 · Cited by 322 · cited 3×
“As another example, Joffily and Coricelli (2013) proposed an interpretation of emotional valence in terms of rates of change in variational free energy.”
BackgroundSubliminal Instrumental Conditioning Demonstrated in the Human Brain
Pessiglione, M., Petrovic, P., Daunizeau, J., Palminteri, S., Dolan, R. J., & Frith, C. D. (2008) · Neuron · doi:10.1016/j.neuron.2008.07.005 · Cited by 308 · cited 1×
“…and pleasant or unpleasant experiences need not always be surprising (Smith & Lane, 2016; Smith, Kaszniak et al., 2019; Panksepp et al., 2017; Winkielman, Berridge, & Wilbarger, 2005; Pessiglione et al., 2008; Lane, Weihs, Herring, Hishaw, & Smith, 2015; Lane, Solms, Weihs, Hishaw, & Smith, 2020).”
Evolutionary Psychology: The New Science of the Mind
Buss, D. (2015) · Psychology Press eBooks · doi:10.4324/9781315663319 · Cited by 304
Botvinick, M., & Toussaint, M. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.08.006 · Cited by 292 · cited 1×
“In brief, active inference offers a generic approach to planning as inference (Attias, 2003; Botvinick & Toussaint, 2012; Kaplan & Friston, 2018) under the free energy principle (Friston, 2010).”
MethodThe anatomy of choice: dopamine and decision-making.
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0481 · Cited by 289 · cited 4×
“Accordingly, because Gπ is a function of achieving preferred outcomes, AC can be construed as a reward prediction error, where reward is inversely proportional to Gπ (Friston et al., 2014).”
BackgroundInfluentialSelf-citationMood and heuristics: The influence of happy and sad states on sensitivity and bias in stereotyping.
Park, J., & Banaji, M. R. (2000) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.78.6.1005 · Cited by 280 · cited 1×
“…Sheppard, & Kramer, 1994; Gasper & Clore, 2002), while positively valenced states appear to increase reliance on prior expectations (Bodenhausen, Kramer, & Süsser, 1994; Park & Banaji, 2000)—both consistent with the idea that valence relates to confidence in one’s internal model of the world.”
BackgroundThe neural basis of one's own conscious and unconscious emotional states
Smith, R., & Lane, R. D. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.003 · Cited by 241 · cited 2×
“…debates about the nature of specific emotions, which further encompasses appraisal processes, facial expression patterns, visceral control, cognitive biases, and conceptualization processes, among others (Smith & Lane, 2015; Smith, Killgore, Alkozei, & Lane, 2018; Smith, Killgore, & Lane, 2020).”
BackgroundSelf-citationDeep temporal models and active inference
Friston, K. J., Rosch, R., Parr, T., Price, C., & Bowman, H. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.04.009 · Cited by 237 · cited 2×
“Previous research has shown, for example, how this type of deep hierarchical structure can allow an agent to hold information in working memory (Parr & Friston, 2017) and to infer the meaning of sentences based on recognizing a sequence of words (Friston, Rosch et al., 2017).”
MethodSelf-citationKnowing one's place: a free-energy approach to pattern regulation
Friston, K., Levin, M., Sengupta, B., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.1383 · Cited by 234 · cited 1×
“…optimal behavior (Itti & Baldi, 2009; Schmidhuber, 2010; Mirza, Adams, Mathys, & Friston, 2016; Veale, Hafed, & Yoshida, 2017) and provides a formal description of the motivated and self-preserving behavior of living systems (Friston, Levin, Table 3: A Generative Model of Action (M 3 in Figure 2).”
BackgroundSelf-citationWorking memory, attention, and salience in active inference
Parr, T., & Friston, K. J. (2017) · Scientific Reports · doi:10.1038/s41598-017-15249-0 · Cited by 227 · cited 2×
“Previous research has shown, for example, how this type of deep hierarchical structure can allow an agent to hold information in working memory (Parr & Friston, 2017) and to infer the meaning of sentences based on recognizing a sequence of words (Friston, Rosch et al., 2017).”
BackgroundMethodSelf-citationA free energy principle for a particular physics
Friston, K. (2019) · arXiv · doi:10.48550/arxiv.1906.10184 · Cited by 222
Self-citationMoment-to-moment tracking of state value in the amygdala
Belova, M. A., Paton, J. J., & Salzman, C. D. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1400-08.2008 · Cited by 221
The dopaminergic midbrain encodes the expected certainty about desired outcomes
Schwartenbeck, P., FitzGerald, T. H. B., Mathys, C., Dolan, R., & Friston, K. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu159 · Cited by 219 · cited 8×
“Recent work has begun to compare active inference models with common reinforcement learning models, often supporting the claim that active inference offers added explanatory power in accounting for human behavior (Schwartenbeck et al., 2015).”
BackgroundMethodInfluentialSelf-citationDopaminergic Modulation of Decision Making and Subjective Well-Being
Rutledge, R. B., Skandali, N., Dayan, P., & Dolan, R. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0702-15.2015 · Cited by 217 · cited 2×
“On the one hand, some studies have linked dopamine to the magnitude of “liking” in response to reward (Rutledge et al., 2015), and some effective antidepressants are dopaminergic agonists (Pytka et al., 2016); thus, there is evidence supporting an (at least indirect) link to pleasure.”
BackgroundThe hierarchically mechanistic mind: A free-energy formulation of the human psyche
Badcock, P. B., Friston, K. J., & Ramstead, M. J. D. (2019) · Physics of Life Reviews · doi:10.1016/j.plrev.2018.10.002 · Cited by 217
Self-citationActive inference, enactivism and the hermeneutics of social cognition
Gallagher, S., & Allen, M. (2018) · Synthese · doi:10.1007/s11229-016-1269-8 · Cited by 214 · cited 1×
“This framework revolves around the notion that all living systems embody statistical models of their worlds (Friston, 2010; Gallagher & Allen, 2018).”
BackgroundSelf-citationThe convergence of information about rewarding and aversive stimuli in single neurons
Morrison, S. E., & Salzman, C. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1815-09.2009 · Cited by 206 · cited 1×
“In contrast, single neurons have been found that respond preferentially to positive or negative stimuli (Paton, Belova, Morrison, & Salzman, 2006; Morrison & Salzman, 2009), and separable brain systems for behavioral activation and inhibition (often linked to positive and negative valence,…”
BackgroundLane, R. D., Weihs, K. L., Herring, A., Hishaw, A., & Smith, R. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.06.007 · Cited by 204 · cited 1×
“…and pleasant or unpleasant experiences need not always be surprising (Smith & Lane, 2016; Smith, Kaszniak et al., 2019; Panksepp et al., 2017; Winkielman, Berridge, & Wilbarger, 2005; Pessiglione et al., 2008; Lane, Weihs, Herring, Hishaw, & Smith, 2015; Lane, Solms, Weihs, Hishaw, & Smith, 2020).”
Self-citationDopamine Reward Prediction Error Responses Reflect Marginal Utility
Stauffer, W. R., Lak, A., & Schultz, W. (2014) · Current Biology · doi:10.1016/j.cub.2014.08.064 · Cited by 204 · cited 1×
“AC is formally related to reward prediction error within reinforcement learning models (Friston et al., 2014; Schultz, Dayan, & Montague, 1997; Stauffer, Lak, & Schultz, 2014).”
BackgroundPlanning by Probabilistic Inference.
Attias, H. T. (2003) · Cited by 204
What is mood? A computational perspective
Clark, J. E., Watson, S., & Friston, K. J. (2018) · Psychological Medicine · doi:10.1017/s0033291718000430 · Cited by 204 · cited 2×
“In other contexts, it has been suggested that action model precision updates (what we have labeled AC ) could be used to inform selective attention (e.g., Clark et al., 2018; Palacios, Razi, Parr, Kirchhoff, & Friston, 2019).”
BackgroundSelf-citationA variational approach to niche construction
Constant, A., Ramstead, M. J. D., Veissière, S. P. L., Campbell, J. O., & Friston, K. J. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0685 · Cited by 204 · cited 3×
“On this higher level of description, evolution can be cast as a process of Bayesian model selection (Campbell, 2016; Constant et al., 2018; Hesp et al., 2019), in which biological fitness now becomes the evidence (also known as marginal likelihood) that drives model (i.e., natural) selection across…”
BackgroundSelf-citationPlanning and navigation as active inference
Kaplan, R., & Friston, K. J. (2018) · Biological Cybernetics · doi:10.1007/s00422-018-0753-2 · Cited by 203 · cited 1×
“In brief, active inference offers a generic approach to planning as inference (Attias, 2003; Botvinick & Toussaint, 2012; Kaplan & Friston, 2018) under the free energy principle (Friston, 2010).”
MethodSelf-citationMechanisms of Diminished Attention to Eyes in Autism
Moriuchi, J. M., Klin, A., & Jones, W. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.15091222 · Cited by 200 · cited 1×
“…attention to affective stimuli and manipulating affective information within working memory; Smith, Lane et al., 2017; Smith, Lane, Alkozei et al., 2018; Smith, Lane, Sanova et al., 2018) or external (e.g., saccade selection to affective cues; Adolphs et al., 2005; Moriuchi, Klin, & Jones, 2017).”
BackgroundSmith, R., Kuplicki, R., Feinstein, J., Forthman, K. L., Stewart, J. L., Paulus, M. P., Tulsa 1000 investigators, & Khalsa, S. S. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008484 · Cited by 196
Self-citationPanksepp, J., Lane, R. D., Solms, M., & Smith, R. S. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.010 · Cited by 194 · cited 3×
“…changes in conscious affect, and pleasant or unpleasant experiences need not always be surprising (Smith & Lane, 2016; Smith, Kaszniak et al., 2019; Panksepp et al., 2017; Winkielman, Berridge, & Wilbarger, 2005; Pessiglione et al., 2008; Lane, Weihs, Herring, Hishaw, & Smith, 2015; Lane, Solms,…”
BackgroundSelf-citationInteraction between emotional state and learning underlies mood instability
Eldar, E., & Niv, Y. (2015) · Nature Communications · doi:10.1038/ncomms7149 · Cited by 193 · cited 2×
“More recent models have suggested that mood reflects the recent history of reward prediction errors, which serves the function of biasing perception of future reward (Eldar et al., 2016; Eldar & Niv, 2015).”
BackgroundRao, R. P. N. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00146 · Cited by 191 · cited 1×
“In cases where expected ambiguity is negligible, AC becomes equivalent to RPE, as both score differences in utility between expected and obtained outcomes (see Rao, 2010; Colombo, 2014; FitzGerald, Dolan, & Friston, 2015).”
BackgroundThe depressed brain: an evolutionary systems theory
Badcock, P. B., Davey, C. G., Whittle, S., Allen, N. B., & Friston, K. J. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.01.005 · Cited by 190 · cited 1×
“Along these lines, various researchers have developed conceptual models of valence based on the expected precision of beliefs about behavior (Seth & Friston, 2016; Badcock et al., 2017; Clark et al., 2018).”
BackgroundSelf-citationIn the body's eye: the computational anatomy of interoceptive inference
Allen, M., Levy, A., Parr, T., & Friston, K. J. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1010490 · Cited by 185
Self-citationFouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
How is visual salience computed in the brain? Insights from behaviour, neurobiology and modelling
Veale, R., Hafed, Z. M., & Yoshida, M. (2017) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0113 · Cited by 173 · cited 1×
“…it generalizes many established formulations of optimal behavior (Itti & Baldi, 2009; Schmidhuber, 2010; Mirza, Adams, Mathys, & Friston, 2016; Veale, Hafed, & Yoshida, 2017) and provides a formal description of the motivated and self-preserving behavior of living systems (Friston, Levin,…”
BackgroundScene Construction, Visual Foraging, and Active Inference
Mirza, M. B., Adams, R. A., Mathys, C. D., & Friston, K. J. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00056 · Cited by 165 · cited 1×
“Furthermore, it generalizes many established formulations of optimal behavior (Itti & Baldi, 2009; Schmidhuber, 2010; Mirza, Adams, Mathys, & Friston, 2016; Veale, Hafed, & Yoshida, 2017) and provides a formal description of the motivated and self-preserving behavior of living systems (Friston,…”
BackgroundSelf-citationTopolinski, S., Likowski, K. U., Weyers, P., & Strack, F. (2008) · Cognition & Emotion · doi:10.1080/02699930801994112 · Cited by 163 · cited 1×
“…versus negative valence has been linked to cognitive matches versus mismatches (e.g., Williams & Gordon, 2007), coherence versus inco-herence (e.g., Topolinski, Likowski, Weyers, & Strack, 2009), resonance versus dissonance (e.g., Sohal, Zhang, Yizhar, & Deisseroth, 2009), and fluency versus…”
BackgroundREMIJNSE, P., NIELEN, M., UYLINGS, H., & VELTMAN, D. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.009 · Cited by 163
Pharmacological Fingerprints of Contextual Uncertainty
Marshall, L., Mathys, C., Ruge, D., de Berker, A. O., Dayan, P., Stephan, K. E., & Bestmann, S. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002575 · Cited by 158
Limanowski, J., & Friston, K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00643 · Cited by 154
Self-citationMultiscale integration: beyond internalism and externalism
Ramstead, M. J. D., Kirchhoff, M. D., Constant, A., & Friston, K. J. (2021) · Synthese · doi:10.1007/s11229-019-02115-x · Cited by 150
Self-citationThe origin and function of pleasure
Johnston, V. (2003) · Cognition and Emotion · doi:10.1080/02699930302290 · Cited by 146 · cited 2×
“” Feeling good or bad—emotional valence—is a crucial component of affect and plays a critical role in the struggle for existence in a world that is ever-changing yet also substantially predictable (Johnston, 2003).”
BackgroundActive Inference: Demystified and Compared
Sajid, N., Ball, P. J., Parr, T., & Friston, K. J. (2021) · Neural Computation · doi:10.1162/neco_a_01357 · Cited by 145 · cited 1×
“…between reinforcement learning and active inference also tend to provide evidence for the claim that the latter tends to have comparable performance to, or can outperform, the latter, especially in environments with changing contingencies and sparse rewards (Sajid, Ball, & Friston, 2020).”
Self-citation(2021) · UCL Discovery (University College London) · Cited by 141
Self-citationUniversal darwinism as a process of bayesian inference
Campbell, J. O. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00049 · Cited by 140 · cited 2×
“On this higher level of description, evolution can be cast as a process of Bayesian model selection (Campbell, 2016; Constant et al., 2018; Hesp et al., 2019), in which biological fitness now becomes the evidence (also known as marginal likelihood) that drives model (i.e., natural) selection across…”
BackgroundUnconscious emotion: A cognitive neuroscientific perspective
Smith, R. S., & Lane, R. D. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.08.013 · Cited by 134 · cited 2×
“…learning can occur in the absence of changes in conscious affect, and pleasant or unpleasant experiences need not always be surprising (Smith & Lane, 2016; Smith, Kaszniak et al., 2019; Panksepp et al., 2017; Winkielman, Berridge, & Wilbarger, 2005; Pessiglione et al., 2008; Lane,…”
BackgroundSelf-citationSmith, R., Parr, T., & Friston, K. J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02844 · Cited by 133
Self-citationNeuronal message passing using mean-field, bethe, and marginal approximations
Parr, T., Markovic, D., Kiebel, S. J., & Friston, K. J. (2019) · Scientific Reports · doi:10.1038/s41598-018-38246-3 · Cited by 128 · cited 5×
“Note the factor of 1 / 2 in posterior state beliefs ¯ s τ results from the marginal message-passing approximation introduced by Parr et al. (2019).”
BackgroundInfluentialSelf-citationDopamine ups and downs in vulnerability to addictions: a neurodevelopmental model
Leyton, M., & Vezina, P. (2014) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2014.04.002 · Cited by 127
Computational nosology and precision psychiatry
Friston, K. J., Redish, A. D., & Gordon, J. A. (2017) · Computational Psychiatry · doi:10.1162/cpsy_a_00001 · Cited by 126
Self-citationSmith, R., Killgore, W. D. S., & Lane, R. D. (2018) · Emotion · doi:10.1037/emo0000376 · Cited by 121 · cited 1×
“…debates about the nature of specific emotions, which further encompasses appraisal processes, facial expression patterns, visceral control, cognitive biases, and conceptualization processes, among others (Smith & Lane, 2015; Smith, Killgore, Alkozei, & Lane, 2018; Smith, Killgore, & Lane, 2020).”
BackgroundSelf-citationOn markov blankets and hierarchical self-organisation
Palacios, E. R., Razi, A., Parr, T., Kirchhoff, M., & Friston, K. (2020) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2019.110089 · Cited by 115 · cited 1×
“In other contexts, it has been suggested that action model precision updates (what we have labeled AC ) could be used to inform selective attention (e.g., Clark et al., 2018; Palacios, Razi, Parr, Kirchhoff, & Friston, 2019).”
BackgroundSelf-citationDopamine, reward learning, and active inference
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00136 · Cited by 112 · cited 2×
“First, there are alternative interpretations of the role of dopamine proposed within the active inference field (FitzGerald et al., 2015; Friston et al., 2014)—namely, that it encodes expected precision as opposed to RPEs.”
BackgroundSelf-citationNeural correlates of reversal learning in severe mood dysregulation and pediatric bipolar disorder
Adleman, N. E., Kayser, R., Dickstein, D., Blair, R. J. R., Pine, D., & Leibenluft, E. (2011) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2011.07.011 · Cited by 106 · cited 1×
“We use unexpected context changes to elicit affective responses, motivated in part by the fact that affective disorders are associated with deficiencies in performing this kind of task (Adlerman et al., 2011; Dickstein et al., 2010).”
MethodImpaired probabilistic reversal learning in youths with mood and anxiety disorders
Dickstein, D. P., Finger, E. C., Brotman, M. A., Rich, B. A., Pine, D. S., Blair, J. R., & Leibenluft, E. (2010) · Psychological Medicine · doi:10.1017/s0033291709991462 · Cited by 105 · cited 1×
“We use unexpected context changes to elicit affective responses, motivated in part by the fact that affective disorders are associated with deficiencies in performing this kind of task (Adlerman et al., 2011; Dickstein et al., 2010).”
MethodBayesian model reductionPreprint
Friston, K. J., Parr, T., & Zeidman, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07092 · Cited by 104 · cited 1×
“…messages from the (continuous) expected precision to the (discrete) affective states, we use Bayesian model reduction (for the derivation, see Friston, Parr, and Zeidman, 2018) to evaluate the marginal likelihood under the priors associated with each affective state: Again, this contains…”
MethodSelf-citationAffective Value in the Predictive Mind
Van De Cruys, S. (2017) · Theoretical Philosophy/MIND Group – JGU Mainz · doi:10.15502/9783958573253 · Cited by 100 · cited 1×
“This provides a formal way to relate changes in processing fluency across different domains to particular affective states, formalizing previous conceptual models (Phaf & Rotteveel, 2012; Joffily & Coricelli, 2013; Van de Cruys, 2017).”
The role of serotonergic, adrenergic and dopaminergic receptors in antidepressant-like effect
Pytka, K., Podkowa, K., Rapacz, A., Podkowa, A., Żmudzka, E., Olczyk, A., Sapa, J., & Filipek, B. (2015) · Pharmacological Reports · doi:10.1016/j.pharep.2015.08.007 · Cited by 95
Smith, R., Lane, R. D., Parr, T., & Friston, K. J. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.09.002 · Cited by 89
Self-citationIn the Body’s Eye: The Computational Anatomy of Interoceptive InferencePreprint
Allen, M., Levy, A., Parr, T., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/603928 · Cited by 86
Self-citationSmith, R. S., Schwartenbeck, P., Stewart, J. L., Kuplicki, R., Ekhtiari, H., T Investigators, & Paulus, M. P. (2020) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2020.108208 · Cited by 85
Self-citationThe Predictive Global Neuronal Workspace: A Formal Active Inference Model of Visual Consciousness
Whyte, C. J., & Smith, R. (2020) · doi:10.1101/2020.02.11.944611 · Cited by 84
Self-citationThe predictive global neuronal workspace: a formal active inference model of visual consciousness
Whyte, C. J., & Smith, R. (2021) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2020.101918 · Cited by 84
Self-citationSmith, R., Kirlic, N., Stewart, J. L., Touthang, J., Kuplicki, R., Khalsa, S. S., Feinstein, J., Paulus, M. P., & Aupperle, R. L. (2021) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.200032 · Cited by 81
Self-citationLinson, A., Parr, T., & Friston, K. J. (2020) · Behavioural Brain Research · doi:10.1016/j.bbr.2019.112421 · Cited by 71
Self-citationDynamic Organization of the Emotional Brain: Responsivity, Stability, and Instability
Williams, L. M., & Gordon, E. (2007) · The Neuroscientist · doi:10.1177/10738584070130040801 · Cited by 68 · cited 1×
“Across domains of experience, positive versus negative valence has been linked to cognitive matches versus mismatches (e.g., Williams & Gordon, 2007), coherence versus inco-herence (e.g., Topolinski, Likowski, Weyers, & Strack, 2009), resonance versus dissonance (e.g., Sohal, Zhang, Yizhar, &…”
BackgroundNiu (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00336 · Cited by 65 · cited 1×
“Interestingly, the implied hierarchical (and temporal) dissociation is corroborated by Niu, Todd, and Anderson (2012), who synthesize findings that suggest a dissociation between perceptual salience and affective salience.”
BackgroundA Multi-scale View of the Emergent Complexity of Life: A Free-Energy Proposal
Hesp, C., Ramstead, M., Constant, A., Badcock, P., Kirchhoff, M., & Friston, K. (2019) · Springer Proceedings in Complexity · doi:10.1007/978-3-030-00075-2_7 · Cited by 63 · cited 2×
“On this higher level of description, evolution can be cast as a process of Bayesian model selection (Campbell, 2016; Constant et al., 2018; Hesp et al., 2019), in which biological fitness now becomes the evidence (also known as marginal likelihood) that drives model (i.e., natural) selection across…”
BackgroundSelf-citationEvolutionary systems theory: a unifying meta-theory of psychological science
Badcock, P. B. (2012) · Review of General Psychology · doi:10.1037/a0026381 · Cited by 61 · cited 2×
“…imperative: to minimize the divergence between observed outcomes and phenotypically expected (i.e., preferred) outcomes under a (generative) model that is fine-tuned over phylogeny and ontogeny (Badcock, 2012; Bad-cock, Davey, Whittle, Allen, & Friston, 2017; Badcock, Friston, & Ramstead, 2019).”
BackgroundSmith, R., Lane, R. D., Alkozei, A., Bao, J., Smith, C., Sanova, A., Nettles, M., & Killgore, W. D. S. (2018) · Scientific Reports · doi:10.1038/s41598-018-21896-8 · Cited by 61 · cited 1×
“…attention to affective stimuli and manipulating affective information within working memory; Smith, Lane et al., 2017; Smith, Lane, Alkozei et al., 2018; Smith, Lane, Sanova et al., 2018) or external (e.g., saccade selection to affective cues; Adolphs et al., 2005; Moriuchi, Klin, & Jones, 2017).”
BackgroundSelf-citationEmotional Valence: A Bipolar Continuum or Two Independent Dimensions?
Briesemeister, B. B., Kuchinke, L., & Jacobs, A. M. (2012) · SAGE Open · doi:10.1177/2158244012466558 · Cited by 59 · cited 1×
“Alternatively, others have suggested that valence is itself a two-dimensional construct (Cacioppo & Berntson, 1994; Briesemeister, Kuchinke, & Jacobs, 2012), with the intensity of negative and positive valence each represented by its own axis (i.e., where high negative and positive valence can…”
BackgroundSmith, R., Lane, R. D., Alkozei, A., Bao, J., Smith, C., Sanova, A., Nettles, M., & Killgore, W. D. S. (2017) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsx011 · Cited by 59 · cited 1×
“…selection, whether internal (e.g., directing one’s attention to affective stimuli and manipulating affective information within working memory; Smith, Lane et al., 2017; Smith, Lane, Alkozei et al., 2018; Smith, Lane, Sanova et al., 2018) or external (e.g., saccade selection to affective…”
BackgroundSelf-citationExpectation violation and attention to pain jointly modulate neural gain in somatosensory cortex
Fardo, F., Auksztulewicz, R., Allen, M., Dietz, M. J., Roepstorff, A., & Friston, K. J. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.03.041 · Cited by 59
Self-citationDeep and beautiful. The reward prediction error hypothesis of dopamine
Colombo, M. (2013) · Studies in History and Philosophy of Science Part C Studies in History and Philosophy of Biological and Biomedical Sciences · doi:10.1016/j.shpsc.2013.10.006 · Cited by 57 · cited 1×
“In cases where expected ambiguity is negligible, AC becomes equivalent to RPE, as both score differences in utility between expected and obtained outcomes (see Rao, 2010; Colombo, 2014; FitzGerald, Dolan, & Friston, 2015).”
BackgroundA neuro-cognitive process model of emotional intelligence
Smith, R., Killgore, W. D. S., Alkozei, A., & Lane, R. D. (2018) · Biological Psychology · doi:10.1016/j.biopsycho.2018.10.012 · Cited by 56 · cited 2×
“…debates about the nature of specific emotions, which further encompasses appraisal processes, facial expression patterns, visceral control, cognitive biases, and conceptualization processes, among others (Smith & Lane, 2015; Smith, Killgore, Alkozei, & Lane, 2018; Smith, Killgore, & Lane, 2020).”
BackgroundSelf-citationSigned reward prediction errors drive declarative learning
Loof, E. D., Ergo, K., Naert, L., Janssens, C., Talsma, D., Filip Van Opstal, A., & Verguts, T. (2018) · PLoS ONE · doi:10.1371/journal.pone.0189212 · Cited by 52 · cited 1×
“In studies on reinforcement learning (De Loof et al., 2018; Sutton & Barto, 2018), signed reward prediction error (RPE) has been introduced as a measure of the difference between expected and obtained reward, which is used to update beliefs about the values of actions.”
BackgroundSmith, R. S., Steklis, H. D., Steklis, N. G., Weihs, K. L., & Lane, R. D. (2020) · Biological Psychology · doi:10.1016/j.biopsycho.2020.107925 · Cited by 52
Self-citationAdditive Effects of Threat-of-Shock and Picture Valence on Startle Reflex Modulation
Bublatzky, F., Guerra, P. M., Pastor, M. C., Schupp, H. T., & Vila, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0054003 · Cited by 51 · cited 1×
“…scales of pleasant or unpleasant subjective experience, potentiated startle responses; Watson, Clark, & Tellegen, 1988; Bradley & Lang, 1994; Bublatzky, Guerra, Pastor, Schupp, & Vila, 2013) should be correlated with experimental inductions of uncertainty about the actions that will lead to…”
BackgroundMere exposure effect: A consequence of direct and indirect fluency–preference links
Willems, S. J., & der Linden, M. V. (2005) · Consciousness and Cognition · doi:10.1016/j.concog.2005.06.008 · Cited by 48
Smith, R. S., Weihs, K. L., Alkozei, A., Killgore, W. D. S., & Lane, R. D. (2018) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000661 · Cited by 39 · cited 1×
“…Bao, & Killgore, 2018), as well as capacities for emotional awareness (Smith, Steklis, Steklis, Weihs, & Lane, 2020; Smith, Bajaj et al., 2018; Smith, Weihs, Alkozei, Killgore, & Lane, 2019; Smith, Kill-gore, & Lane, 2020), each of them central to current evidence-based psy-chotherapies…”
Self-citationAffective Monitoring: A Generic Mechanism for Affect Elicitation
Phaf, R. H., & Rotteveel, M. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00047 · Cited by 34
Hesp, C., Tschantz, A., Millidge, B., Ramstead, M. J. D., Friston, K. J., & Smith, R. S. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-64919-7_18 · Cited by 29
Self-citationSmith, R. S., Kuplicki, R., Teed, A. R., Upshaw, V., & Khalsa, S. S. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-64919-7_16 · Cited by 27
Self-citationMetzinger, T. K. (2017) · PhilPapers (PhilPapers Foundation) · doi:10.15502/9783958573208 · Cited by 25
Smith, R., Kaszniak, A. W., Katsanis, J., Lane, R. D., & Nielsen, L. (2019) · Consciousness and Cognition · doi:10.1016/j.concog.2018.12.004 · Cited by 23 · cited 1×
“…can occur in the absence of changes in conscious affect, and pleasant or unpleasant experiences need not always be surprising (Smith & Lane, 2016; Smith, Kaszniak et al., 2019; Panksepp et al., 2017; Winkielman, Berridge, & Wilbarger, 2005; Pessiglione et al., 2008; Lane, Weihs, Herring, Hishaw,…”
BackgroundSelf-citationSmith, R., Bajaj, S., Dailey, N. S., Alkozei, A., Smith, C. J., Sanova, A., Lane, R., & Killgore, W. (2018) · Consciousness and Cognition · doi:10.1016/j.concog.2017.11.004 · Cited by 19 · cited 1×
“…et al., 2014; Phillips, Ladouceur, & Drevets, 2008; Gyurak, Gross, & Etkin, 2011; Smith, Alkozei, Lane, & Kill-gore, 2016; Smith, Alkozei, Bao, & Killgore, 2018), as well as capacities for emotional awareness (Smith, Steklis, Steklis, Weihs, & Lane, 2020; Smith, Bajaj et al., 2018; Smith,…”
Self-citationSmith, R., Lane, R. D., Sanova, A., Alkozei, A., Smith, C., & Killgore, W. D. S. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00370 · Cited by 17
Self-citationAffective agnosia: a core affective processing deficit in the alexithymia spectrum
Lane, R., Solms, M., Weihs, K., Hishaw, A., & Smith, R. (2020) · BioPsychoSocial Medicine · doi:10.1186/s13030-020-00184-w · Cited by 17 · cited 1×
“…and pleasant or unpleasant experiences need not always be surprising (Smith & Lane, 2016; Smith, Kaszniak et al., 2019; Panksepp et al., 2017; Winkielman, Berridge, & Wilbarger, 2005; Pessiglione et al., 2008; Lane, Weihs, Herring, Hishaw, & Smith, 2015; Lane, Solms, Weihs, Hishaw, & Smith, 2020).”
Self-citationA Computational Neuroscience Perspective on the Change Process in Psychotherapy
Smith, R. P., Lane, R. D., Nadel, L., & Moutoussis, M. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190881511.003.0015 · Cited by 14 · cited 1×
“…mentioned above as well as prior work on other emotional phenomena within the active inference framework (Smith, Parr, & Friston, 2019; Smith, Lane, Parr, & Friston, 2019); Smith, Lane, Nadel, L., & Moutoussis, 2020; Joffily & Coricelli, 2013; Clark, Watson, & Friston, 2016; Seth & Friston, 2016).”
Self-citationSmith, R. S., Alkozei, A., Lane, R. D., & Killgore, W. D. S. (2016) · Consciousness and Cognition · doi:10.1016/j.concog.2016.07.008 · Cited by 12 · cited 2×
“…learning can occur in the absence of changes in conscious affect, and pleasant or unpleasant experiences need not always be surprising (Smith & Lane, 2016; Smith, Kaszniak et al., 2019; Panksepp et al., 2017; Winkielman, Berridge, & Wilbarger, 2005; Pessiglione et al., 2008; Lane,…”
BackgroundSelf-citationSmith, R., Kirlic, N., Stewart, J. L., Touthang, J., Kuplicki, R., Khalsa, S. S., Paulus, M. P., Investigators, T., & Aupperle, R. (2020) · doi:10.31234/osf.io/t2dhn · Cited by 10
Self-citationSmith, R. S., Kuplicki, R., Teed, A. R., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.31.275594 · Cited by 9
Self-citationSmith, R. S., Alkozei, A., Bao, J., & Killgore, W. D. S. (2017) · Psychological Reports · doi:10.1177/0033294117723018 · Cited by 7 · cited 1×
“…mechanisms (Buhle et al., 2014; Phillips, Ladouceur, & Drevets, 2008; Gyurak, Gross, & Etkin, 2011; Smith, Alkozei, Lane, & Kill-gore, 2016; Smith, Alkozei, Bao, & Killgore, 2018), as well as capacities for emotional awareness (Smith, Steklis, Steklis, Weihs, & Lane, 2020; Smith, Bajaj et…”
Self-citationBarbero (2014) · doi:10.1016/j · Cited by 1
Affective value in the predictive mind
Van de Cruys, S. (2017) · MIND Group · doi:10.25358/openscience-647 · Cited by 1
Research works printed but not linked: 1
- Gray, J. A. (1994). Three fundamental emotion systems. In P.Ekman & R. J.Davidson (Eds.), The nature of emotion (pp. 243–247). New York: Oxford University Press.
Cited by
A step-by-step tutorial on active inference and its application to empirical data
Smith, R., Friston, K. J., & Whyte, C. J. (2022) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2021.102632 · Cited by 246
Self-citationIn the body's eye: the computational anatomy of interoceptive inference
Allen, M., Levy, A., Parr, T., & Friston, K. J. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1010490 · Cited by 185
“, whether one is certain if a heartbeat has occurred or not) inferences in hierarchical models, with temporal depth [37,47,48,70,91].”
BackgroundMethodSelf-citationSmith, R., Badcock, P., & Friston, K. J. (2021) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.13138 · Cited by 174
“22 On the left, a network of abstract neuron-like nodes (and select connections) is depicted, where the higher level represents different possible concept-level inferences about one ’ s own internal state, including emotional and somatic interpretations.”
BackgroundSmith, R., Parr, T., & Friston, K. J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02844 · Cited by 133
Self-citationFriston, K., Da Costa, L., Hafner, D., Hesp, C., & Parr, T. (2021) · Neural Computation · doi:10.1162/neco_a_01351 · Cited by 117
Self-citation
Metadata
- Authors
- Hesp, C., Smith, R., Parr, T., Allen, M., Friston, K. J., & Ramstead, M. J. D.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- Laureate Institute for Brain Research (US)
- Aarhus University (DK)
- Corresponding author
- Hesp, Casper
- Smith, Ryan
- Parr, Thomas
- Allen, Micah
- Friston, Karl J.
- Ramstead, Maxwell J. D.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2021-02-01
- Volume
- 33
- Issue
- 2
- Pages
- 398-446
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- PMC
- PMC8594962
- OpenAlex
- W3108742966
- Cited by
- 246
- References
- 126
- Citations by year
- 2026: 32 · 2025: 29 · 2024: 40 · 2023: 40 · 2022: 47 · 2021: 38
- FWCI
- 19.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Neural Computation (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- William K. Warren Foundation
- Aarhus Universitet
- McGill University
- Wellcome Trust (R272-2017-4345, 088130, 754513, 088130/Z/09/Z)
- European Commission (HORIZON2020, 754513)
- Rosetrees Trust (173346)
- Aarhus Universitets Forskningsfond (754513, R272-2017-4345)
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (406.18, 406.18.535)
- Lundbeckfonden (R272‐2017‐4345, 754513)
- Canada First Research Excellence Fund
- Social Sciences and Humanities Research Council of Canada
- H2020 Marie Skłodowska-Curie Actions (754513, HORIZON2020, R272-2017-4345)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Keywords
- emotional valence, second-order beliefs, metacognition, Bayesian inference, top-down modulation, T-maze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.