The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
The free energy principle for action and perception: A mathematical review
Open accessAbstract
The ‘free energy principle’ (FEP) has been suggested to provide a unified theory of the brain, integrating data and theory relating to action, perception, and learning. The theory and implementation of the FEP combines insights from Helmholtzian ‘perception as inference’, machine learning theory, and statistical thermodynamics. Here, we provide a detailed mathematical evaluation of a suggested biologically plausible implementation of the FEP that has been widely used to develop the theory. Our objectives are (i) to describe within a single article the mathematical structure of this implementation of the FEP; (ii) provide a simple but complete agent-based model utilising the FEP and (iii) to disclose the assumption structure of this implementation of the FEP to help elucidate its significance for the brain sciences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120
Thrun, S. (2002) · Communications of the ACM · doi:10.1145/504729.504754 · Cited by 7,994
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · cited 8×
“ironmental causes of sensory signals, which are continually modied by bottom-up prediction error signals communicating mismatches between predicted and actual signals across hierarchical levels (see [8] for a nice review). In the context of the FEP the R-density is 175 updated using a hierarchical predictive coding (s…”
BackgroundMethodInfluentialCasella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 10×
“…a constant, E(µ, ϕ) = − ln p(ϕ|µ) − ln p(µ) (24) = 1 2σz ε2z + 1 2σw ε2w + 1 2 ln (σzσw) , (25) where the auxiliary notations have been introduced as εz ≡ ϕ − g(µ; θ ) and εw ≡ µ − µ̄, which comprise a residual error or a prediction error in the predictive coding terminology (Rao & Ballard, 1999).”
BackgroundMethodInfluentialA theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
Canonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 3×
“Here, the simple idea is that top-down cortical signalling conveys predictions while bottom-up activity returns prediction errors (Bastos et al., 2012).”
BackgroundInfluential(1998) · Springer eBooks · doi:10.1007/978-94-011-5014-9 · Cited by 2,418
Treatise on Physiological Optics
von Helmholtz, H., & Southall, P. C. (1962) · Medical Entomology and Zoology · Cited by 2,196
A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants
Neal, R. M., & Hinton, G. E. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_12 · Cited by 2,187
Nonequilibrium Statistical Mechanics
Zwanzig, R. (2001) · doi:10.1093/oso/9780195140187.001.0001 · Cited by 2,051
The free-energy principle: a rough guide to the brain?
Friston, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.04.005 · Cited by 1,831
Predictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
Elements of Information Theory
Phoenix, S. J. D. (1992) · Journal of Modern Optics · doi:10.1080/09500349214551641 · Cited by 1,380
A free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369
Nonequilibrium Statistical Mechanics
(1990) · doi:10.1142/1009 · Cited by 1,322
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
(1993) · Cited by 1,173
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156
The functional logic of cortical connections
Zeki, S., & Shipp, S. (1988) · Nature · doi:10.1038/335311a0 · Cited by 1,067 · cited 2×
“In the FEP, hierarchical models aremapped onto the hierarchical organisation of the cortex (Felleman & Van Essen, 1991; Zeki & Shipp, 1988), which requires extension of the simple generativemodel described above.”
MethodLearning multiple layers of representation
Hinton, G. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.004 · Cited by 1,011
Hierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · cited 7×
“In this state-space, a point represents an infinitedimensional vector that encodes the instantaneous trajectory of a brain variable [21].”
BackgroundInfluentialVariational free energy and the Laplace approximation
Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., & Penny, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.08.035 · Cited by 880
Advances in Neural Information Processing Systems 7
Tesauro, G., Touretzky, D. S., & Leen, T. K. (1995) · Cited by 869
Action and behavior: a free-energy formulation
Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010) · Biological Cybernetics · doi:10.1007/s00422-010-0364-z · Cited by 866 · cited 16×
“…the FEP is claimed to provide a ‘‘mathematical specification of ‘what’ the brain is doing’’ (Friston, 2009 p.300), to unify perception and action (Friston et al., 2010), and to provide a basis for integrating several general brain theories including the Bayesian brain hypothesis, neural…”
BackgroundInfluentialComputational approaches to motor control
Wolpert, D. M. (1997) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(97)01070-x · Cited by 855
Predictions not commands: Active inference in the motor system
Adams, R. A., Shipp, S., & Friston, K. J. (2013) · Brain Structure and Function · doi:10.1007/s00429-012-0475-5 · Cited by 765
Friston, K. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0475 · Cited by 754
Friston, K. J., & Stephan, K. E. (2007) · Synthese · doi:10.1007/s11229-007-9237-y · Cited by 673
Active Inference, homeostatic regulation and adaptive behavioural control
Pezzulo, G., Rigoli, F., & Friston, K. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.001 · Cited by 650 · cited 1×
“Examples of various generating functions have already been provided (Friston, 2008a; Friston et al., 2010, 2016; Pezzulo et al., 2015; Pio-Lopez, Nizard, Friston, & Pezzulo, 2016), to which we refer the reader.”
BackgroundPrediction, cognition and the brain
Bubic (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00025 · Cited by 647
The default-mode, ego-functions and free-energy: a neurobiological account of Freudian ideas
Carhart-Harris, R. L., & Friston, K. J. (2010) · Brain · doi:10.1093/brain/awq010 · Cited by 574
Kass, R. E., & Steffey, D. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478825 · Cited by 474 · cited 4×
“Hierarchical models provide a powerful response to this challenge, in which higher levels can provide empirical priors or constraints on lower levels (Kass & Steffey, 1989).”
BackgroundMethodInfluentialPerceptions as Hypotheses: Saccades as Experiments
Friston, K., Adams, R. A., Perrinet, L., & Breakspear, M. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00151 · Cited by 462
Reinforcement learning or active inference?
Friston, K. J., Daunizeau, J., & Kiebel, S. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006421 · Cited by 443
Elias, P. (1955) · IEEE Transactions on Information Theory · doi:10.1109/tit.1955.1055126 · Cited by 428
Oksanen, T., Tiusanen, J., & Kostamo, J. (2009) · Precision agriculture '09 · doi:10.3920/9789086866649_102 · Cited by 414
Seth, A. K. (2014) · Cognitive Neuroscience · doi:10.1080/17588928.2013.877880 · Cited by 346
Self-citationWhat is optimal about motor control?
Friston, K. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.018 · Cited by 332
Emotional Valence and the Free-Energy Principle
Joffily, M., & Coricelli, G. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003094 · Cited by 322 · cited 1×
“Parameters like these, which play important roles in the estimation of – but not specification of – the VFE, can be incorporated into process theories in many ways, with as yet no clear consensus (though see, for one proposal (Joffily & Coricelli, 2013)).”
BackgroundSchwabl, F. (2002) · Advanced Texts in Physics · doi:10.1007/978-3-662-04702-6 · Cited by 319
A tutorial on the free-energy framework for modelling perception and learning
Bogacz, R. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.11.003 · Cited by 283 · cited 3×
“It is possible to pursue the full general case, e.g., see Bogacz (2017) for a nice tutorial on this, but we do not consider this here.”
BackgroundInfluentialDEM: A variational treatment of dynamic systems
Friston, K. J., Trujillo-Barreto, N., & Daunizeau, J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.054 · Cited by 278 · cited 13×
“̇̃ μα , in the generalised state-space is distinct from the ‘trajectory’ encoded in the brain (flow velocity) (Friston, 2008a, b; Friston et al., 2008).”
BackgroundMethodInfluentialSeth, A. K. (2015) · Figshare · doi:10.15502/9783958570108 · Cited by 211
Self-citation(2002) · Understanding Social Science Research · doi:10.4135/9780857020208.n7 · Cited by 195
Cortical circuits for perceptual inference
Friston, K., & Kiebel, S. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.07.023 · Cited by 172
Friston, K., Stephan, K., Li, B., & Daunizeau, J. (2010) · Mathematical Problems in Engineering · doi:10.1155/2010/621670 · Cited by 171
Active inference and robot control: a case study
Pio‐Lopez, L., Nizard, A., Friston, K. J., & Pezzulo, G. (2016) · Journal of The Royal Society Interface · doi:10.1098/rsif.2016.0616 · Cited by 108
Friston, K. J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.017 · Cited by 68
Is the free-energy principle neurocentric?
Friston, K. (2010) · Nature reviews. Neuroscience · doi:10.1038/nrn2787-c2 · Cited by 63
Learning Population Codes by Minimizing Description Length
Zemel, R. S., & Hinton, G. E. (1995) · Neural Computation · doi:10.1162/neco.1995.7.3.549 · Cited by 48
Bayesian state estimation using generalized coordinates
Balaji, B., & Friston, K. J. (2011) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.883513 · Cited by 28
Counter-factual mathematics of counterfactual predictive models
Otworowska, M., Kwisthout, J., & van Rooij, I. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00801 · Cited by 9
Some free-energy puzzles resolved: response to Thornton
Friston, K. J. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.11.008 · Cited by 4
Cited by
Towards a neuroscience of active sampling and curiosity
Gottlieb, J., & Oudeyer, P.-Y. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0078-0 · Cited by 494
Being a Beast Machine: The Somatic Basis of Selfhood
Seth, A. K., & Tsakiris, M. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.08.008 · Cited by 371
“While the mathematical details of the FEP are complicated (see [67] for a recent review), the basic message is simple.”
InfluentialSelf-citationHierarchical active inference: A theory of motivated control
Pezzulo, G., Rigoli, F., & Friston, K. J. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.009 · Cited by 334
A step-by-step tutorial on active inference and its application to empirical data
Smith, R., Friston, K. J., & Whyte, C. J. (2022) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2021.102632 · Cited by 246
Active inference on discrete state-spaces: A synthesis
Da Costa, L., Parr, T., Sajid, N., Veselic, S., Neacsu, V., & Friston, K. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102447 · Cited by 226
“Furthermore, this paper and [18] provide the building blocks necessary to understand active inference on mixed generative models.”
BackgroundInfluential
Metadata
- Authors
- Buckley, C. L., Kim, C. S., McGregor, S., & Seth, A. K.
- Venue
- Journal of Mathematical Psychology
- Publisher
- Elsevier BV
- Published
- 2017-12
- Volume
- 81
- Pages
- 55-79
- ISSN
- 0022-2496 (ISSN-L)
- OpenAlex
- W2617660370
- Cited by
- 363
- References
- 57
- FWCI
- 15.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.