The graphical brain: Belief propagation and active inference
Open accessThe DOI matches its Crossref record; 112 of the 112 references it cites were found in a registry or an index; none of the 73 sources its claims cite is checked for support yet.
Abstract
This paper considers functional integration in the brain from a computational perspective. We ask what sort of neuronal message passing is mandated by active inference—and what implications this has for context-sensitive connectivity at microscopic and macroscopic levels. In particular, we formulate neuronal processing as belief propagation under deep generative models. Crucially, these models can entertain both discrete and continuous states, leading to distinct schemes for belief updating that play out on the same (neuronal) architecture. Technically, we use Forney (normal) factor graphs to elucidate the requisite message passing in terms of its form and scheduling. To accommodate mixed generative models (of discrete and continuous states), one also has to consider link nodes or factors that enable discrete and continuous representations to talk to each other. When mapping the implicit computational architecture onto neuronal connectivity, several interesting features emerge. For example, Bayesian model averaging and comparison, which link discrete and continuous states, may be implemented in thalamocortical loops. These and other considerations speak to a computational connectome that is inherently state dependent and self-organizing in ways that yield to a principled (variational) account. We conclude with simulations of reading that illustrate the implicit neuronal message passing, with a special focus on how discrete (semantic) representations inform, and are informed by, continuous (visual) sampling of the sensorium.
Overview
CoChat Summary
TL;DR
This paper derives belief propagation under deep generative models as a computational architecture for functional integration in the brain, using Forney factor graphs to link discrete and continuous state representations. It maps the resulting message passing onto intrinsic/extrinsic cortical microcircuits and cortico–basal ganglia–thalamic loops, illustrating the scheme with simulations of pictographic reading.
Key findings
- Belief propagation under deep generative models can be expressed with Forney factor graphs; discrete models use A/B/C/D matrices and policies, continuous models use generalized coordinates and predictive coding, and mixed models require link factors implementing Bayesian model averaging and comparison.
- Discrete and continuous representations are linked by Bayesian model averaging (descending empirical priors) and Bayesian model comparison (ascending posterior over outcome models); thalamocortical loops may implement this, while expected free energy and policy expectations involve cortico–basal ganglia–thalamic loops.
- In simulations of reading, the model has two discrete hierarchical levels with six sentences and four words, with letters/pictograms in quadrants; saccades are assumed to take about 256 ms, continuous integration uses 24/25 time steps of about 10 ms, and the subject resolves the sentence on the last saccade of the last word.
- Minimizing variational free energy also minimizes Lyapunov exponents, so belief propagation organizes toward critical slowing; self-organized criticality is described as an epiphenomenon of self-evidencing.
Methods
- Theoretical/computational derivation using Bayesian networks, Forney factor graphs, and neural network/circuit mappings; derives belief propagation for discrete, continuous, and mixed generative models.
- Simulation of pictographic reading: two discrete hierarchical levels (six sentences, four words; letters/pictograms in quadrants), a continuous visuomotor model with 32 × 32 pixel images, equations integrated with 16 iterations per time point per discrete level, saccades about 256 ms, continuous integration 24/25 time steps of about 10 ms, and roughly 4.5 s of simulated time.
- Main analysis is simulation-based: eye movements, posterior probabilities/evidence accumulation, simulated firing rates/depolarization, and band-pass filtered local field potentials between 4 Hz and 32 Hz; no empirical dataset is analyzed.
Limitations
- Stated: the neural networks “should not be taken too seriously” and are offered as a starting point for refinement and deconstruction; many anatomical issues are ignored, including direct/indirect pathways and dopamine modulation.
- Stated: the sensory attenuation model is “quite a crude way” of modeling sensory attenuation, and the reading simulation is “a bit abstract.”
- Evident: the anatomical mappings are speculative and not empirically tested here, and the simulation results depend on the model assumptions and message-passing schedule.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures














Verification
Claims the paper makes
0 Valid · 1 Not valid · 45 Not checked · 146 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Here, the subject correctly infers, on the last saccade of the last word, that the first sentence generated the stimuli.”
§ The graphical brain: Belief propagation and active inference > SIMULATIONS OF READING > Categorization and Evidence Accumulation
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This means that a partially observed sequence of outcomes can inform expectations about the future, which are necessary to evaluate the expected free energy of a policy.”
§ The graphical brain: Belief propagation and active inference > DISCRETE GENERATIVE MODELS > Belief Updating and Propagation
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“When a generative model is specified as a factor graph, latent variables can often be inferred by executing a message passing schedule that can be derived automatically.”
§ The graphical brain: Belief propagation and active inference > INTRODUCTION
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Factor graphs are an important type of probabilistic graphical model because they facilitate the derivation of (approximate) Bayesian inference algorithms.”
§ The graphical brain: Belief propagation and active inference > INTRODUCTION
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, note that the outcomes that inform the expected free energy are not the observed outcomes but predicted outcomes based upon expected states, under each policy (i.e., message 5).”
§ The graphical brain: Belief propagation and active inference > DISCRETE GENERATIVE MODELS
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
112 more claims
Create a free account to see all 192 claims and to verify the 73 references still open.
- Probably not a substantial claim. 39
- It may state two separate claims as one. 42
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This means that systems able to make such future-oriented inferences must possess a generative model with temporal or counterfactual depth [26,39].”
From The Markov blankets of life: autonomy, active inference and the free energy principle (2018) · cites this paper as [39]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In some simulations, one can mix discrete and continuous state-space models by placing the former on top of the latter, to produce deep generative models that, through active inference, can be used to simulate many known aspects of computational anatomy and physiology in the brain [158].”
From The free energy principle made simpler but not too simple (2023) · cites this paper as [158]
The cited source says what the claim attributes to it.
In the citing paper
“In this sense, it is sometimes referred to as epistemic affordance [158].”
From The free energy principle made simpler but not too simple (2023) · cites this paper as [158]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The graphical brain: Belief propagation and active inference > MIXED MODELS
“E(t)m=−lnoτ,m−∫0TL(t)mdtL(t)m=lnP(õ(t)|ηm)−lnP(õ(t)|η).(12)”
§ The graphical brain: Belief propagation and active inference > MIXED MODELS
“This equation expresses the free energy E of competing outcome models as the prior surprise plus the log evidence for each outcome model (integrated over time).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The graphical brain: Belief propagation and active inference > SIMULATIONS OF READING > Categorization and Evidence Accumulation
“This figure illustrates belief propagation (producing the behavior shown in Figure 11), in terms of simulated firing rates and depolarization.”
§ The graphical brain: Belief propagation and active inference > SIMULATIONS OF READING
“Figure 12 shows the behavior that results from integrating the message passing scheme described in Figure 10.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The graphical brain: Belief propagation and active inference > SIMULATIONS OF READING
“each of the 25 time steps of the continuous integration scheme corresponds roughly to 10 ms”
§ The graphical brain: Belief propagation and active inference > SIMULATIONS OF READING
“This trajectory is shown as a function of the time steps used to integrate the generalized belief updating (24 time steps, each corresponding to about 10 ms of real time).”
Citations
Cites
(1988) · Cited by 16,582
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783 · cited 2×
“Given that the message passing requires prediction errors on hidden causes to be passed to higher levels, one can assume they are encoded by superficial pyramidal cells; that is, the source of ascending extrinsic connections (Bastos et al., 2012; Felleman & Van Essen, 1991; Markov et al., 2013).”
BackgroundSelf-organized criticality: An explanation of the 1/f noise
Bak, P., Tang, C., & Wiesenfeld, K. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.381 · Cited by 7,591 · cited 1×
“From the perspective of active inference, this implies self-evidencing (Hohwy, 2016), which entails self-organized criticality (Bak et al., 1987) and dynamic connectivity (Allen et al., 2012; Breakspear, 2004).”
BackgroundFactor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · cited 1×
“In particular, we assume that the brain engages in some form of (Bayesian) inference—and can therefore be described as maximizing Bayesian model evidence (Clark, 2013; Friston, Kilner, & Harrison, 2006; Hohwy, 2016; Mumford, 1992).”
BackgroundRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 2×
“Before considering the implications for hierarchical architectures in the brain, we turn to the equivalent message passing for continuous variables, which transpires to be predictive coding (Rao & Ballard, 1999; Srinivasan, Laughlin, & Dubs, 1982).”
BackgroundA mechanism for cognitive dynamics: neuronal communication through neuronal coherence.
Fries, P. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.08.011 · Cited by 4,284 · cited 1×
“…dynamics) mechanism may be particularly important in understanding attention in terms of communication through coherence (Akam & Kullman, 2012; Fries, 2005) and the important role of inhibitory interneurons in mediating synchronous gain control (Kann, Papageorgiou, & Draguhn, 2014; Lee,…”
BackgroundHoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118 · cited 1×
“See K. Friston and Penny (2011) and Hoeting et al. (1999) for details.”
BackgroundPreface: Cerebral Cortex Has Come of Age
Goldman-Rakic, P. S., & Rakic, P. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1-a · Cited by 3,393
Tracking whole-brain connectivity dynamics in the resting state
Allen, E. A., Damaraju, E., Plis, S. M., Erhardt, E. B., Eichele, T., & Calhoun, V. D. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs352 · Cited by 2,992 · cited 3×
“We focus on the modulation of intrinsic excitability; specifically, the afferents to superficial pyramidal cells—and, as a more abstract level, the implications for self-organized criticality of the sort entailed by dynamic fluctuations in connectivity (Aertsen, Gerstein, Habib, & Palm, 1989; Allen et al., 2012; Baker…”
Research works printed but not linked: 4
- Beal M. J. (2003). Variational algorithms for approximate Bayesian inference (Doctoral thesis, University College London).
- Friston K. J., Parr T., & de Vries B. (2017). Appendices for “The graphical brain: Belief propagation and active inference.” Network Neuroscience. 10.1162/netn_a_00018 PMC5798592 29417960
- Loeliger H.-A. (2002). Least squares and Kalman filtering on Forney graphs. In Blahut R. E. & Koetter R. (Eds.), Codes, graphs, and systems: A celebration of the life and career of G. David Forney, Jr., on the occasion of his sixtieth birthday (pp. 113– 135). Boston, MA: Springer US.
- MacKay D. J. C. (2003). Information theory inference and learning algorithms. Cambridge: Cambridge University Press.
Cited by
Communication dynamics in complex brain networks
Avena-Koenigsberger, A., Misic, B., & Sporns, O. (2018) · Nature Reviews Neuroscience · doi:10.1038/nrn.2017.149 · Cited by 856
“How global network architecture shapes the capacity of the system to minimize variational free energy and enact this mechanism is an exciting topic for future research 167 .”
BackgroundThe Markov blankets of life: autonomy, active inference and the free energy principle
Kirchhoff, M., Parr, T., Palacios, E., Friston, K., & Kiverstein, J. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0792 · Cited by 473
Self-citationCellular Mechanisms of Conscious Processing
Aru, J., Suzuki, M., & Larkum, M. E. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.07.006 · Cited by 321
“These computational theories are predictive coding (PC), which has various implementations [67–69], and active inference [70,71].”
BackgroundNew directions in predictive processing
Hohwy, J. (2020) · Mind & Language · doi:10.1111/mila.12281 · Cited by 247
“If discrete, then it may be easier to map on to (propositional) thought but this will also change neuronal message passing into a different format than predictive coding (Friston et al., 2017).”
BackgroundUncertainty, epistemics and active inference
Parr, T., & Friston, K. J. (2017) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0376 · Cited by 252
“In other words, this form of generative model can account for processes with ‘memory’, something that is further enhanced in hierarchical extensions of this model [16,21].”
BackgroundSelf-citationA step-by-step tutorial on active inference and its application to empirical data
Smith, R., Friston, K. J., & Whyte, C. J. (2022) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2021.102632 · Cited by 246
Self-citationDeeply Felt Affect: The Emergence of Valence in Deep Active Inference
Hesp, C., Smith, R., Parr, T., Allen, M., Friston, K. J., & Ramstead, M. J. D. (2021) · Neural Computation · doi:10.1162/neco_a_01341 · Cited by 246
“In this letter, we demonstrate that hierarchical (i.e., deep) Bayesian networks, solved using active inference (Friston, Parr, & de Vries, 2018), afford a principled formulation of emotional valence—building on both the work mentioned above as well as prior work on other emotional phenomena within…”
MethodSelf-citationGeneralised free energy and active inference
Parr, T., & Friston, K. J. (2019) · Biological Cybernetics · doi:10.1007/s00422-019-00805-w · Cited by 236
Self-citationA tale of two densities: active inference is enactive inference
Ramstead, M. J., Kirchhoff, M. D., & Friston, K. J. (2020) · Adaptive Behavior · doi:10.1177/1059712319862774 · Cited by 220
“From a technical point of view, active inference and perceptual inference are not merely two sides of the same coin.”
BackgroundInfluentialSelf-citationActive inference on discrete state-spaces: A synthesis
Da Costa, L., Parr, T., Sajid, N., Veselic, S., Neacsu, V., & Friston, K. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102447 · Cited by 226
“…states – have been used to model behaviour involving discrete and continuous representations (e.g., decision-making and movement [28], pharmacologically induced changes in eye-movement control [29] or reading; involving continuous visual sampling informing inferences about discrete semantics [27]).”
BackgroundMethodInfluentialSelf-citationA free energy principle for a particular physics
Friston, K. (2019) · arXiv · doi:10.48550/arxiv.1906.10184 · Cited by 222
“In cognitive neuroscience, this ultimately leads to ambiguity reducing, curious behaviour that underwrites the exploratory (i.e., epistemic) foraging that characterises self-evidencing (Baranes and Oudeyer, 2009; Berlyne, 1950; Friston et al., 2017b; Schmidhuber, 2006; Still and Precup, 2012).”
BackgroundMethodInfluentialSelf-citationThe Anatomy of Inference: Generative Models and Brain Structure
Parr, T., & Friston, K. J. (2018) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2018.00090 · Cited by 204
“It is computed based upon the C factor, the entropy 2 of the likelihood (a) (weighted by beliefs about states), and posterior predictive beliefs about outcomes (b) (Friston et al., 2017a).”
BackgroundMethodResultInfluentialSelf-citationSmith, R., Kuplicki, R., Feinstein, J., Forthman, K. L., Stewart, J. L., Paulus, M. P., Tulsa 1000 investigators, & Khalsa, S. S. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008484 · Cited by 196
“The neural process theory associated with active inference and related Bayesian models suggests that an inability to adjust IP estimates would correspond to reductions in synaptic plasticity in response to changes in patterns of interoceptive prediction-errors [10, 24, 77, 79, 104], most plausibly within neural networ…”
BackgroundMethodIn the body's eye: the computational anatomy of interoceptive inference
Allen, M., Levy, A., Parr, T., & Friston, K. J. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1010490 · Cited by 185
Self-citationActive Inference: Demystified and Compared
Sajid, N., Ball, P. J., Parr, T., & Friston, K. J. (2021) · Neural Computation · doi:10.1162/neco_a_01357 · Cited by 145
“…2017; Friston, Parr, et al., 2017; Parr & Friston, 2017), continuous state-space models (Buckley, Kim, McGregor, & Seth, 2017; Parr & Friston, 2019a; Ueltzhöffer, 2018) or mixed models with both discrete and continuous states as described in Friston, Parr, et al. (2017) and Parr and Friston (2018).”
BackgroundInfluentialSelf-citationSmith, R., Badcock, P., & Friston, K. J. (2021) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.13138 · Cited by 174
“For an introduction to the associated mathematics describing neuronal interactions in this theory, see Friston et al ., 2, 16 and Da Costa et al .”
BackgroundMethodInfluentialSelf-citationPredictive processing as a systematic basis for identifying the neural correlates of consciousness
Hohwy, J., & Seth, A. (2020) · Philosophy and the Mind Sciences · doi:10.33735/phimisci.2020.ii.64 · Cited by 170
The free energy principle made simpler but not too simple
Friston, K., Da Costa, L., Sajid, N., Heins, C., Ueltzhöffer, K., Pavliotis, G. A., & Parr, T. (2023) · Physics Reports · doi:10.1016/j.physrep.2023.07.001 · Cited by 163
“In this sense, it is sometimes referred to as epistemic affordance [158].”
InfluentialSelf-citationCorcoran, A. W., Pezzulo, G., & Hohwy, J. (2020) · Biology & Philosophy · doi:10.1007/s10539-020-09746-2 · Cited by 161
“Formally, volatility can be construed as the (inverse) precision over transition probabilities (i.e. confidence about the way hidden states evolve over time; Parr and Friston 2017; Parr et al.”
BackgroundInfluentialComputational psychiatry: from synapses to sentience
Friston, K. J. (2022) · Molecular Psychiatry · doi:10.1038/s41380-022-01743-z · Cited by 197
“Crucially, these accounts have attendant process theories that specify various forms of neuronal dynamics and message passing that can be evaluated empirically [54, 66, 70, 71, 73, 74, 176, 177].”
BackgroundSelf-citationLimanowski, J., & Friston, K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00643 · Cited by 154
Self-citationComputational Neuropsychology and Bayesian Inference
Parr, T., Rees, G., & Friston, K. J. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00061 · Cited by 149
“An intuitive example is the kind of generative model required for reading (Friston et al., 2017d).”
BackgroundMethodInfluentialSelf-citationMultiscale integration: beyond internalism and externalism
Ramstead, M. J. D., Kirchhoff, M. D., Constant, A., & Friston, K. J. (2021) · Synthese · doi:10.1007/s11229-019-02115-x · Cited by 150
Self-citationMarkov blankets, information geometry and stochastic thermodynamics
Parr, T., Da Costa, L., & Friston, K. (2020) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2019.0159 · Cited by 141
“It may be that the distinction between the sorts of systems we generally think of as engaging in cognitive, inferential, dynamics [34] and simpler systems [35] rests upon the level of sophistication of the generative models that best describe their dynamics or gradient flows [36].”
BackgroundSelf-citation(2021) · UCL Discovery (University College London) · Cited by 141
Variational ecology and the physics of sentient systems
Ramstead, M. J. D., Constant, A., Badcock, P. B., & Friston, K. J. (2019) · Physics of Life Reviews · doi:10.1016/j.plrev.2018.12.002 · Cited by 141
Self-citationJanzen, T. B., Koshimori, Y., Williams, N. R., & Thaut, M. H. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.789467 · Cited by 190
Safron, A. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00030 · Cited by 133
“This information flow may also be viewed as Bayesian belief propagation or (marginal) message passing (Friston et al., 2017b; Parr et al., 2019).”
BackgroundThe Emperor's New Markov Blankets
Bruineberg, J., Dołęga, K., Dewhurst, J., & Baltieri, M. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21002351 · Cited by 124
Neuronal message passing using mean-field, bethe, and marginal approximations
Parr, T., Markovic, D., Kiebel, S. J., & Friston, K. J. (2019) · Scientific Reports · doi:10.1038/s41598-018-38246-3 · Cited by 128
“6 forms part of the cortical microcircuit proposed for active inference in Markov decision processes 52 , and can be extended for generative models associated with precision parameters 53 , and for continuous state space models 10 .”
BackgroundSelf-citationSmith, R., Parr, T., & Friston, K. J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02844 · Cited by 133
Self-citationThe evolution of brain architectures for predictive coding and active inference
Pezzulo, G., Parr, T., & Friston, K. (2022) · Philosophical Transactions of the Royal Society B · doi:10.1098/rstb.2020.0531 · Cited by 117
Self-citationFriston, K., Da Costa, L., Hafner, D., Hesp, C., & Parr, T. (2021) · Neural Computation · doi:10.1162/neco_a_01351 · Cited by 117
Self-citationPath integrals, particular kinds, and strange things
Friston, K., Da Costa, L., Sakthivadivel, D. A. R., Heins, C., Pavliotis, G. A., Ramstead, M., & Parr, T. (2023) · Physics of Life Reviews · doi:10.1016/j.plrev.2023.08.016 · Cited by 113
Self-citationSandved-Smith, L., Hesp, C., Mattout, J., Friston, K., Lutz, A., & Ramstead, M. J. D. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niab018 · Cited by 110
“…of cognitive access and control; e.g. it is able to model the deployment of attentional and emotional ‘processes’ that direct the flow of perceptual inference and action (Parr and Friston 2017b) but cannot yet model the agent’s access to, and evaluation and control of, its own attentional ‘states’.”
BackgroundMethodInfluentialSelf-citationDeep active inference as variational policy gradients
Millidge, B. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102348 · Cited by 115
Generative models, linguistic communication and active inference
Friston, K. J., Parr, T., Yufik, Y., Sajid, N., Price, C. J., & Holmes, E. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.07.005 · Cited by 108
Self-citationAwareness as inference in a higher-order state space
Fleming, S. M. (2020) · Neuroscience of Consciousness · doi:10.1093/nc/niz020 · Cited by 111
“(For recent work translating probabilistic graphical models into models of neuronal message passing see George et al. (2017) and Friston et al. (2017).).”
An Active Inference Approach to Modeling Structure Learning: Concept Learning as an Example Case
Smith, R., Schwartenbeck, P., Parr, T., & Friston, K. J. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00041 · Cited by 99
Self-citationActive inference as a theory of sentient behavior
Pezzulo, G., Parr, T., & Friston, K. (2024) · Biological Psychology · doi:10.1016/j.biopsycho.2023.108741 · Cited by 109
Self-citationTschantz, A., Barca, L., Maisto, D., Buckley, C. L., Seth, A. K., & Pezzulo, G. (2022) · Biological Psychology · doi:10.1016/j.biopsycho.2022.108266 · Cited by 124
Friston, K. J., Sajid, N., Quiroga-Martinez, D. R., Parr, T., Price, C. J., & Holmes, E. (2021) · Hearing Research · doi:10.1016/j.heares.2020.107998 · Cited by 93
Self-citationSiman-Tov, T., Granot, R., Shany, O., Singer, N., Hendler, T., & Gordon, C. R. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.08.012 · Cited by 106
Representation Wars: Enacting an Armistice Through Active Inference
Constant, A., Clark, A., & Friston, K. J. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.598733 · Cited by 95
Self-citationWhence the Expected Free Energy?
Millidge, B., Tschantz, A., & Buckley, C. L. (2021) · Neural Computation · doi:10.1162/neco_a_01354 · Cited by 94
Linson, A., Clark, A., Ramamoorthy, S., & Friston, K. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00021 · Cited by 90
“Please see Friston et al. (2017b) for technical details and Friston et al. (2017a) for a discussion of how this belief updating might be implemented in a brain. provide evidence for the most apt generative model or policy (Lupyan and Clark, 2015), enhancing the control information for the relevant…”
BackgroundSelf-citationPerceptual awareness and active inference
Parr, T., Corcoran, A. W., Friston, K. J., & Hohwy, J. (2019) · Neuroscience of Consciousness · doi:10.1093/nc/niz012 · Cited by 91
Self-citationBelief formation – A driving force for brain evolution
Seitz, R. J., & Angel, H. (2020) · Brain and Cognition · doi:10.1016/j.bandc.2020.105548 · Cited by 116
Parcels and particles: Markov blankets in the brain
Friston, K. J., Fagerholm, E. D., Zarghami, T. S., Parr, T., Hipólito, I., Magrou, L., & Razi, A. (2021) · Network Neuroscience · doi:10.1162/netn_a_00175 · Cited by 91
Self-citationFradkin, I., Adams, R. A., Parr, T., Roiser, J. P., & Huppert, J. D. (2020) · Psychological Review · doi:10.1037/rev0000188 · Cited by 89
Self-citationSmith, R., Lane, R. D., Parr, T., & Friston, K. J. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.09.002 · Cited by 89
Self-citationWorld model learning and inference
Friston, K., Moran, R. J., Nagai, Y., Taniguchi, T., Gomi, H., & Tenenbaum, J. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.09.011 · Cited by 90
“The simulation (Friston, Parr et al., 2017) accounts for reading phenomena such as word skipping (Him-melstoss, Schuster, Hutzler, Moran, & Hawelka, 2020; Rayner, Slattery, Drieghe, & Liversedge, 2011), for example once evidence has been accumulated for a subset of sentences, to disambiguate those…”
BackgroundInfluentialSelf-citationFrom Generative Models to Generative Passages: A Computational Approach to (Neuro) Phenomenology
Ramstead, M. J. D., Seth, A. K., Hesp, C., Sandved-Smith, L., Mago, J., Lifshitz, M., Pagnoni, G., Smith, R., Dumas, G., Lutz, A., et al. (2022) · Review of Philosophy and Psychology · doi:10.1007/s13164-021-00604-y · Cited by 84
“These are generative models, so-called because they are a way of representing the relations between some states that are of interest to us, which we believe have generated our data (Ashburner et al., 2003; Friston et al. 2017; Ramstead et al. 2019a).”
BackgroundMethodInfluentialSelf-citationPrecision and False Perceptual Inference
Parr, T., Benrimoh, D. A., Vincent, P., & Friston, K. J. (2018) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2018.00039 · Cited by 87
Self-citationBoldt, A., Schiffer, A.-M., Waszak, F., & Yeung, N. (2019) · Scientific Reports · doi:10.1038/s41598-019-40681-9 · Cited by 86
The predictive global neuronal workspace: a formal active inference model of visual consciousness
Whyte, C. J., & Smith, R. (2021) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2020.101918 · Cited by 84
A sensory–motor theory of the neocortex
Rao, R. P. N. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01673-9 · Cited by 105
“The goal of putting action on an equal footing with perception in terms of Bayesian inference and prediction error minimization is in keeping with the theories of free energy minimization proposed by Friston and others 3,8,69 .”
Introducing a Bayesian model of selective attention based on active inference
Mirza, M. B., Adams, R. A., Friston, K., & Parr, T. (2019) · Scientific Reports · doi:10.1038/s41598-019-50138-8 · Cited by 83
“While we have not addressed the contributions of early visual pathways here, we could interpret our sensory outcomes as alternative hypotheses about continuous attributes of visual objects 52 .”
MethodSelf-citationLaminar fMRI and computational theories of brain function
Stephan, K. E., Petzschner, F. H., Kasper, L., Bayer, J., Wellstein, K. V., Stefanics, G., Pruessmann, K. P., & Heinzle, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2017.11.001 · Cited by 82
Smith, R., Kirlic, N., Stewart, J. L., Touthang, J., Kuplicki, R., Khalsa, S. S., Feinstein, J., Paulus, M. P., & Aupperle, R. L. (2021) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.200032 · Cited by 81
Smith, R. S., Schwartenbeck, P., Stewart, J. L., Kuplicki, R., Ekhtiari, H., T Investigators, & Paulus, M. P. (2020) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2020.108208 · Cited by 85
Linson, A., Parr, T., & Friston, K. J. (2020) · Behavioural Brain Research · doi:10.1016/j.bbr.2019.112421 · Cited by 71
Self-citationAll Thinking is ‘Wishful’ Thinking
Kruglanski, A. W., Jasko, K., & Friston, K. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.03.004 · Cited by 74
Self-citationToward a formal theory for computing machines made out of whatever physics offers
Jaeger, H., Noheda, B., & van der Wiel, W. G. (2023) · Nature Communications · doi:10.1038/s41467-023-40533-1 · Cited by 130
“…combinations of bit streams 34,35 , signal processing and control 36 – 40 , self-organized pattern formation 11,26,41,42 , nonlinear neural dynamics 21,43,44 , stochastic search and optimization 9,45 , evolutionary optimization 46 – 48 , dynamics on networks 49,50 or statistical inference 51 – 53 .”
BackgroundExperimental validation of the free-energy principle with in vitro neural networks
Isomura, T., Kotani, K., Jimbo, Y., & Friston, K. J. (2023) · Nature Communications · doi:10.1038/s41467-023-40141-z · Cited by 92
Self-citationBayesian model reductionPreprint
Friston, K. J., Parr, T., & Zeidman, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07092 · Cited by 104
“Please see [34, 35] for details.”
Self-citationPredictive coding and stochastic resonance as fundamental principles of auditory phantom perception.
Schilling, A., Sedley, W., Gerum, R., Metzner, C., Tziridis, K., Maier, A., Schulze, H., Zeng, F.-G., Friston, K. J., & Krauss, P. (2023) · Brain · doi:10.1093/brain/awad255 · Cited by 70
Self-citationThe Discrete and Continuous Brain: From Decisions to Movement—And Back Again
Parr, T., & Friston, K. J. (2018) · Neural Computation · doi:10.1162/neco_a_01102 · Cited by 71
Self-citationThe empirical status of predictive coding and active inference
Hodson, R., Mehta, M., & Smith, R. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105473 · Cited by 69
Gut inference: A computational modelling approach
Smith, R., Mayeli, A., Taylor, S., Al Zoubi, O., Naegele, J., & Khalsa, S. S. (2021) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108152 · Cited by 66
Canonical neural networks perform active inference
Isomura, T., Shimazaki, H., & Friston, K. J. (2022) · Communications Biology · doi:10.1038/s42003-021-02994-2 · Cited by 67
Self-citationDesigning ecosystems of intelligence from first principles
Friston, K. J., Ramstead, M. J. D., Kiefer, A. B., Tschantz, A., Buckley, C. L., Albarracin, M., Pitliya, R. J., Heins, C., Klein, B., Millidge, B., et al. (2024) · Collective Intelligence · doi:10.1177/26339137231222481 · Cited by 94
“In these structures — and in simulations of hierarchical processing in the brain — certain factors at higher hierarchical levels can control the selection of messages by lower levels (Parr and Friston, 2017; Smith et al., 2019).”
BackgroundInfluentialSelf-citationMotor and Predictive Processes in Auditory Beat and Rhythm Perception
Proksch, S., Comstock, D. C., Médé, B., Pabst, A., & Balasubramaniam, R. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.578546 · Cited by 78
The digital twin in neuroscience: from theory to tailored therapy
Fekonja, L. S., Schenk, R., Schröder, E., Tomasello, R., Tomšič, S., & Picht, T. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1454856 · Cited by 76
“…fusion methods and Bayesian approaches like hierarchical modeling allow combining data with different noise characteristics and spatiotemporal resolutions, further enhancing the robustness and applicability of digital twin models in neuroscience (Friston et al., 2017; Calhoun and Sui, 2016).”
MethodDeep active inference agents using Monte-Carlo methods
Fountas, Z., Sajid, N., Mediano, P. A. M., & Friston, K. (2020) · arXiv · doi:10.48550/arxiv.2006.04176 · Cited by 64
“Specifically, this principle provides a framework for understanding biological intelligence, termed active inference, by bringing together perception and action under a single objective: minimizing free energy across time [3–7].”
BackgroundSelf-citationWilliams, D. (2020) · Synthese · doi:10.1007/s11229-018-1768-x · Cited by 63
Bayesian mechanics for stationary processes
Da Costa, L., Friston, K., Heins, C., & Pavliotis, G. A. (2021) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2021.0518 · Cited by 63
Self-citationWhat does the free energy principle tell us about the brain?
Gershman, S. J. (2019) · Neurons Behavior Data analysis and Theory · doi:10.51628/001c.10839 · Cited by 74
Active Inference and Auditory Hallucinations
Benrimoh, D. A., Parr, T., Vincent, P., Adams, R. A., & Friston, K. (2018) · Computational Psychiatry · doi:10.1162/cpsy_a_00022 · Cited by 63
Self-citationThe computational neurology of movement under active inference
Parr, T., Limanowski, J., Rawji, V., & Friston, K. (2021) · Brain · doi:10.1093/brain/awab085 · Cited by 60
Self-citationSPM 25: open source neuroimaging analysis software
Tierney, T. M., Alexander, N., Ashburner, J., Labra, N., Balbastre, Y., Barnes, G. R., Bezsudnova, Y., Brudfors, M., Eckstein, K., Flandin, G., et al. (2025) · The Journal of Open Source Software · doi:10.21105/joss.08103 · Cited by 82
“The key features are: • A series of inversion schemes for generative models based upon Partially Observable Markov Decision Processes (POMDPs) that can be used to simulate sequential choices, decision making, and planning (K. Friston et al., 2017).”
Self-citationA neuro-cognitive process model of emotional intelligence
Smith, R., Killgore, W. D. S., Alkozei, A., & Lane, R. D. (2018) · Biological Psychology · doi:10.1016/j.biopsycho.2018.10.012 · Cited by 56
On the Relationship Between Active Inference and Control as Inference
Millidge, B., Tschantz, A., Seth, A. K., & Buckley, C. L. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-64919-7_1 · Cited by 96
In vitro neural networks minimise variational free energy
Isomura, T., & Friston, K. (2018) · Scientific Reports · doi:10.1038/s41598-018-35221-w · Cited by 62
Self-citationAn Introduction to Predictive Processing Models of Perception and Decision‐Making
Sprevak, M. D., & Smith, R. S. (2023) · Topics in Cognitive Science · doi:10.1111/tops.12704 · Cited by 85
“There are also so-called mixed models in the active inference framework that link discrete and continuous models hierarchically and bear some resemblance to this idea, while also incorporating motor control (e.g., see Friston, Parr, & de Vries, 2017).”
BackgroundFunctional neurological disorder and placebo and nocebo effects: shared mechanisms
Fiorio, M., Braga, M., Marotta, A., Villa‐Sánchez, B., Edwards, M. J., Tinazzi, M., & Barbiani, D. (2022) · Nature Reviews Neurology · doi:10.1038/s41582-022-00711-z · Cited by 70
Active Inference in OpenAI Gym: A Paradigm for Computational Investigations Into Psychiatric Illness
Cullen, M., Davey, B., Friston, K. J., & Moran, R. J. (2018) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2018.06.010 · Cited by 55
Self-citationThe emergence of synchrony in networks of mutually inferring neurons
Palacios, E. R., Isomura, T., Parr, T., & Friston, K. (2019) · Scientific Reports · doi:10.1038/s41598-019-42821-7 · Cited by 56
“We will consider all three timescales of free energy minimisation, where synaptic activity corresponds to a gradient flow on variational free energy 32,34 , while slower changes in synaptic efficacy (i.e., strength or precision) perform a gradient descent on variational free energy 35 .”
MethodInfluentialSelf-citationWith an eye on uncertainty: Modelling pupillary responses to environmental volatility
Vincent, P., Parr, T., Benrimoh, D., & Friston, K. J. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007126 · Cited by 54
Self-citationHallucinations both in and out of context: An active inference account
Benrimoh, D., Parr, T., Adams, R. A., & Friston, K. (2019) · PLOS ONE · doi:10.1371/journal.pone.0212379 · Cited by 51
Self-citationActive inference and the anatomy of oculomotion
Parr, T., & Friston, K. J. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.01.041 · Cited by 51
“It forms a distributed network (Parr and Friston, 2017a) that involves the cerebral cortex (Paus, 1996; Corbetta et al., 1998), the cerebellum (Berretta et al., 1993), and the basal ganglia (Hikosaka and Wurtz, 1985b; Hikosaka et al., 2000).”
BackgroundInfluentialSelf-citationTrust as Extended Control: Human-Machine Interactions as Active Inference
Schoeller, F., Miller, M. M., Salomon, R., & Friston, K. J. (2021) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2021.669810 · Cited by 62
“This translates into precise beliefs about state transitions during controlled exchanges (Parr and Friston, 2017; Parr et al., 2018).”
BackgroundSelf-citationActive inference models do not contradict folk psychology
Smith, R. S., Ramstead, M. J. D., & Kiefer, A. B. (2022) · Synthese · doi:10.1007/s11229-022-03480-w · Cited by 62
Degeneracy and Redundancy in Active Inference
Sajid, N., Parr, T., Hope, T. M., Price, C. J., & Friston, K. J. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa148 · Cited by 49
Self-citationHallucinations in posttraumatic stress disorder: insights from predictive coding
Lyndon, S., & Corlett, P. R. (2020) · Journal of Abnormal Psychology · doi:10.1037/abn0000531 · Cited by 48
Prefrontal Computation as Active Inference
Parr, T., Rikhye, R. V., Halassa, M. M., & Friston, K. J. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhz118 · Cited by 48
“As we will see later, it is this temporal depth that underwrites working memory (Parr and Friston 2017d) as a key aspect of active inference.”
BackgroundMethodInfluentialSelf-citationSome Interesting Observations on the Free Energy Principle
Friston, K. J., Da Costa, L., & Parr, T. (2021) · Entropy · doi:10.3390/e23081076 · Cited by 49
Self-citationThe Free Energy Principle for Perception and Action: A Deep Learning Perspective
Mazzaglia, P., Verbelen, T., Çatal, O., & Dhoedt, B. (2022) · Entropy · doi:10.3390/e24020301 · Cited by 75
“As a consequence of minimizing free energy, the agent possesses beliefs about the process generating outcomes, but also about action policies that lead to generating those outcomes [60].”
BackgroundGenerative models for active vision
Parr, T., Sajid, N., Da Costa, L., Mirza, M. B., & Friston, K. J. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.651432 · Cited by 46
“It is this bidirectionality that manifests in neurobiology (Friston et al., 2017a; Parr and Friston, 2018b), where messages are passed reciprocally between neural populations In a sense, everything we have said so far only brings us to the point that vision is not just ‘bottom-up’ but that it has…”
BackgroundMethodInfluentialSelf-citationSmith, R. S., Steklis, H. D., Steklis, N. G., Weihs, K. L., & Lane, R. D. (2020) · Biological Psychology · doi:10.1016/j.biopsycho.2020.107925 · Cited by 52
Metadata
- Authors
- Friston, K. J., Parr, T., & de Vries, B.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- Eindhoven University of Technology, Department of Electrical Engineering, Eindhoven, The Netherlands
- Corresponding author
- Parr, Thomas
- Venue
- Network Neuroscience
- Publisher
- MIT Press
- Published
- 2017-12
- Volume
- 1
- Issue
- 4
- Pages
- 381-414
- ISSN
- 2472-1751 (ISSN-L)
- PMC
- PMC5798592
- OpenAlex
- W2623066203
- Cited by
- 415
- References
- 111
- Citations by year
- 2026: 49 · 2025: 39 · 2024: 41 · 2023: 61 · 2022: 51 · 2021: 56 · 2020: 55 · 2019: 32 · 2018: 25 · 2017: 6
- FWCI
- 18.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Network Neuroscience (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- TU/e Research Portal (submittedVersion, other-oa)
- TU/e Research Portal (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- TU/e Research Portal (submittedVersion, cc-by)
- Funders
- Wellcome Trust (088130/Z/09/Z)
- Rosetrees Trust (173346)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- active inference, belief propagation, deep generative models, factor graphs, Bayesian model averaging, thalamocortical loop, functional integration, reading, semantic representation, visual sampling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.