Cognitive Dynamics: From Attractors to Active Inference
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
This paper combines recent formulations of self-organization and neuronal processing to provide an account of cognitive dynamics from basic principles. We start by showing that inference (and autopoiesis) are emergent features of any (weakly mixing) ergodic random dynamical system. We then apply the emergent dynamics to action and perception in a way that casts action as the fulfillment of (Bayesian) beliefs about the causes of sensations. More formally, we formulate ergodic flows on global random attractors as a generalized descent on a free energy functional of the internal states of a system. This formulation rests on a partition of states based on a Markov blanket that separates internal states from hidden states in the external milieu. This separation means that the internal states effectively represent external states probabilistically. The generalized descent is then related to classical Bayesian (e.g., Kalman-Bucy) filtering and predictive coding-of the sort that might be implemented in the brain. Finally, we present two simulations. The first simulates a primordial soup to illustrate the emergence of a Markov blanket and (active) inference about hidden states. The second uses the same emergent dynamics to simulate action and action observation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Information theory and statistical mechanics
Jaynes, E. T. (1957) · Physical Review · doi:10.1103/physrev.106.620 · Cited by 12,931
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 2×
“The ensuing (variational) free-energy principle has been applied widely in neurobiology [30].”
BackgroundSelf-citationAutopoiesis and Cognition: The Realization of the Living
Maturana, H. R., & Varela, F. J. (1980) · Boston Studies in the Philosophy and History of Science · doi:10.1007/978-94-009-8947-4 · Cited by 5,815
Canonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 2×
“In neurobiological implementations of predictive coding [58], the sources of bottom-up prediction errors are thought to be superficial pyramidal cells that send forward connections to higher cortical areas.”
BackgroundSelf-citationPredictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
Self-citationHierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473 · cited 1×
“In statistics and machine learning, this is known as approximate Bayesian inference and provides a normative basis for the Bayesian brain hypothesis [20]–[24].”
A free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369
Self-citationAttention, uncertainty, and free-energy
Feldman, H., & Friston, K. J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00215 · Cited by 1,365
Self-citationObject perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269 · cited 1×
“[23] D.”
On the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074
Keeping the neural networks simple by minimizing the description length of the weights
Hinton, G. E., & van Camp, D. (1993) · Proceedings of the sixth annual conference on Computational learning theory - COLT '93 · doi:10.1145/168304.168306 · Cited by 994 · cited 2×
“, variational Bayes) [39], [41], [42].”
Hierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · cited 2×
“This is known as generalized predictive coding [56], with linear predictive coding [57] as a special case.”
BackgroundSelf-citationOn the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929 · cited 2×
“In this scheme, the sources of forward and backward connections are superficial (red) and deep (black) pyramidal cells respectively [59].”
BackgroundVariational free energy and the Laplace approximation
Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., & Penny, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.08.035 · Cited by 880 · cited 1×
“Under this assumption, the solution of (16) for the variational precision is C 1 1⁄4 P 1⁄4 @~ ~ Lð~ Þ ) @CF 1⁄4 0 [54].”
BackgroundSelf-citationBirkhoff, G. D. (1931) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.17.2.656 · Cited by 867
Action and behavior: a free-energy formulation
Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010) · Biological Cybernetics · doi:10.1007/s00422-010-0364-z · Cited by 866 · cited 1×
“[84] K.”
Self-citationGregory, R. L. (1980) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1980.0090 · Cited by 789
Predictions not commands: Active inference in the motor system
Adams, R. A., Shipp, S., & Friston, K. J. (2013) · Brain Structure and Function · doi:10.1007/s00429-012-0475-5 · Cited by 765 · cited 1×
“the same sorts of questions apply to perception [70], [71]: for example, are visually evoked neuronal responses caused by external events or by our movements? We will return to this question in Section VI.”
BackgroundSelf-citationFriston, K. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0475 · Cited by 754 · cited 6×
“More formally, the flow through any point ð~s; ~ a;~rÞ in the space of the internal states and their Markov blanket is [11]”
BackgroundMethodInfluentialSelf-citationEvery Good Regulator of a System Must Be a Model of That System
Conant, R. C., & Ashby, W. R. (1991) · Facets of Systems Science · doi:10.1007/978-1-4899-0718-9_37 · Cited by 712
Action understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665
Self-citationActive inference, sensory attenuation and illusions
Brown, H., Adams, R. A., Parees, I., Edwards, M., & Friston, K. (2013) · Cognitive Processing · doi:10.1007/s10339-013-0571-3 · Cited by 488 · cited 1×
“[82] H.”
Self-citationKass, R. E., & Steffey, D. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478825 · Cited by 474 · cited 2×
“, variational Bayes) [39], [41], [42].”
Reinforcement learning or active inference?
Friston, K. J., Daunizeau, J., & Kiebel, S. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006421 · Cited by 443
Self-citationUpper processing stages of the perception–action cycle
Fuster, J. M. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.004 · Cited by 380 · cited 2×
“The resulting circular causality between perception and action fits comfortably with many formulations in embodied cognition and artificial intelligence; for example, the perception–action cycle [25], active vision [71], the use of predictive information [26]– [28], and homeokinetic formulations [29].”
BackgroundA free energy principle for biological systems
Karl, F. (2012) · Entropy · doi:10.3390/e14112100 · Cited by 377 · cited 3×
“The second is an attempt to understand the nature of self-organization in random dynamical systems [2]–[6], in particular, our work on variational free-energy minimization [7]–[10].”
BackgroundDEM: A variational treatment of dynamic systems
Friston, K. J., Trujillo-Barreto, N., & Daunizeau, J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.054 · Cited by 278 · cited 1×
“This means generalized filtering takes the form of (extended) Kalman–Bucy filtering, with the usual prediction and correction terms [55]”
MethodDifferentiable generalized synchronization of chaos
Hunt, B. R., Ott, E., & Yorke, J. A. (1997) · Physical Review E · doi:10.1103/physreve.55.4029 · Cited by 201
Friston, K., Stephan, K., Li, B., & Daunizeau, J. (2010) · Mathematical Problems in Engineering · doi:10.1155/2010/621670 · Cited by 171
Self-citationThalamic pathways for active vision
Wurtz, R. H., McAlonan, K., Cavanaugh, J., & Berman, R. A. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.02.004 · Cited by 127 · cited 2×
“The resulting circular causality between perception and action fits comfortably with many formulations in embodied cognition and artificial intelligence; for example, the perception–action cycle [25], active vision [71], the use of predictive information [26]– [28], and homeokinetic formulations [29].”
BackgroundGlobal random attractors are uniquely determined by attracting deterministic compact sets
Crauel, H. (1999) · Annali di Matematica Pura ed Applicata · doi:10.1007/bf02505989 · Cited by 108 · cited 1×
“Because the system is ergodic (and weakly mixing) it will, after a sufficient amount of time, converge to an invariant set of states called a pullback or random global attractor [31], [32].”
Background
Cited by
Bruineberg, J., Kiverstein, J., & Rietveld, E. (2018) · Synthese · doi:10.1007/s11229-016-1239-1 · Cited by 383
“There is a body of literature that relates generalized synchronization to active inference more generally (see for example Friston et al. 2014, 2015 and Friston and Frith 2015). and skills we learn.”
BackgroundA free energy principle for a particular physics
Friston, K. (2019) · arXiv · doi:10.48550/arxiv.1906.10184 · Cited by 222
Self-citationLevin, M. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.768201 · Cited by 195
“Cells with a chemical receptor can engage in predictive coding to manage their sensory experience [239; 244; 245].”
BackgroundOn markov blankets and hierarchical self-organisation
Palacios, E. R., Razi, A., Parr, T., Kirchhoff, M., & Friston, K. (2020) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2019.110089 · Cited by 115
Self-citationLevin, M. (2021) · Biochemical and Biophysical Research Communications · doi:10.1016/j.bbrc.2020.10.077 · Cited by 92
Metadata
- Authors
- Friston, K., Sengupta, B., & Auletta, G.
- Venue
- Proceedings of the IEEE
- Published
- 2014-04
- Volume
- 102
- Issue
- 4
- Pages
- 427-445
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2153418039
- Cited by
- 98
- References
- 31
- FWCI
- 4.09
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.