The Active Inference Approach to Ecological Perception: General Information Dynamics for Natural and Artificial Embodied Cognition
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
The emerging neurocomputational vision of humans as embodied, ecologically embedded, social agents-who shape and are shaped by their environment-offers a golden opportunity to revisit and revise ideas about the physical and information-theoretic underpinnings of life, mind, and consciousness itself. In particular, the active inference framework (AIF) makes it possible to bridge connections from computational neuroscience and robotics/AI to ecological psychology and phenomenology, revealing common underpinnings and overcoming key limitations. AIF opposes the mechanistic to the reductive, while staying fully grounded in a naturalistic and information-theoretic foundation, using the principle of free energy minimization. The latter provides a theoretical basis for a unified treatment of particles, organisms, and interactive machines, spanning from the inorganic to organic, non-life to life, and natural to artificial agents. We provide a brief introduction to AIF, then explore its implications for evolutionary theory, ecological psychology, embodied phenomenology, and robotics/AI research. We conclude the paper by considering implications for machine consciousness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 2×
“Given the convergences between Freeman’s neurody-namics and AIF (Friston, 2008, 2010; De Ridder et al., 2014), it is not surprising that the latter should offer the robust response to the frame problem Dreyfus anticipated.”
BackgroundSelf-citationWhatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · cited 3×
“uk Linson, Adam, Clark, Andy, Ramamoorthy, Subramanian and Friston, Karl (2018) The active inference approach to ecological perception: general information dynamics for natural and artificial embodied cognition.”
BackgroundSelf-citationToward a mechanistic psychology of dialogue.
Pickering, M. J., & Garrod, S. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000056 · Cited by 2,678
Hohwy, J. (2013) · doi:10.1093/acprof:oso/9780199682737.001.0001 · Cited by 1,914
Radical Embodied Cognitive Science
Chemero, A. P. (2009) · doi:10.7551/mitpress/8367.001.0001 · Cited by 1,899
The free-energy principle: a rough guide to the brain?
Friston, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.04.005 · Cited by 1,831
Self-citationInteroceptive inference, emotion, and the embodied self
Seth, A. K. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.007 · Cited by 1,816 · cited 1×
“While many discussions of AIF center on epistemic foraging in the environment, it is also possible to consider epistemic foraging of the self, also a rich source of signals in the noise (Seth, 2013; Seth and Friston, 2016).”
BackgroundOn Distinguishing Epistemic from Pragmatic Action
Kirsh, D., & Maglio, P. (1994) · Cognitive Science · doi:10.1207/s15516709cog1804_1 · Cited by 1,641 · cited 1×
“To achieve this, agents engage in some interactions that serve an epistemic rather than pragmatic purpose, i.e., epistemic actions (Kirsh and Maglio, 1994).”
BackgroundWhat computers still can't do: a critique of artificial reason
Penny, S., & Dreyfus, H. (1994) · Leonardo · doi:10.2307/1575958 · Cited by 1,637
Neuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557 · cited 1×
“More recently, there has been a proliferation of fruitful exchanges between robotics/AI and neuroscience (Hassabis et al., 2017), especially with respect to PP.”
BackgroundSurfing Uncertainty: Prediction, Action, and the Embodied Mind
Clark, A. (2016) · doi:10.1093/acprof:oso/9780190217013.001.0001 · Cited by 1,358
Self-citationBayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156 · cited 1×
“Please see Friston et al. (2017b) for technical details and Friston et al. (2017a) for a discussion of how this belief updating might be implemented in a brain. provide evidence for the most apt generative model or policy (Lupyan and Clark, 2015), enhancing the control information for the relevant…”
BackgroundSelf-citationInter-Brain Synchronization during Social Interaction
Dumas, G., Nadel, J., Soussignan, R., Martinerie, J., & Garnero, L. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012166 · Cited by 966 · cited 1×
“There has been increasing interest in socially grounded neuroscience (e.g., Dumas et al., 2010; Dumas, 2011) and social robotics (Leite et al., 2013).”
BackgroundHierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · cited 5×
“see Friston et al. (2017b) for technical details and Friston et al.”
BackgroundInfluentialSelf-citationAn Interoceptive Predictive Coding Model of Conscious Presence
Seth, A. K., Suzuki, K., & Critchley, H. D. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00395 · Cited by 950 · cited 1×
“Key among these are the priors over interoceptive predictions, by which we reliably come to recognize internal sensations such as hunger, fatigue, lack of fresh air, and so on (Seth et al., 2012).”
BackgroundActive interoceptive inference and the emotional brain
Seth, A. K., & Friston, K. J. (2016) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0007 · Cited by 945 · cited 1×
“While many discussions of AIF center on epistemic foraging in the environment, it is also possible to consider epistemic foraging of the self, also a rich source of signals in the noise (Seth, 2013; Seth and Friston, 2016).”
BackgroundSelf-citationA hierarchy of temporal receptive windows in human cortex
Hasson, U., Yang, E., Vallines, I., Heeger, D. J., & Rubin, N. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5487-07.2008 · Cited by 874
Social Robots for Long-Term Interaction: A Survey
Leite, I., Martinho, C., & Paiva, A. (2013) · International Journal of Social Robotics · doi:10.1007/s12369-013-0178-y · Cited by 871
Action and behavior: a free-energy formulation
Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010) · Biological Cybernetics · doi:10.1007/s00422-010-0364-z · Cited by 866 · cited 3×
“Given the convergences between Freeman’s neurody-namics and AIF (Friston, 2008, 2010; De Ridder et al., 2014), it is not surprising that the latter should offer the robust response to the frame problem Dreyfus anticipated.”
BackgroundSelf-citationWhat is intrinsic motivation? A typology of computational approaches
Oudeyer, P.-Y. (2007) · Frontiers in Neurorobotics · doi:10.3389/neuro.12.006.2007 · Cited by 811
Predictions not commands: Active inference in the motor system
Adams, R. A., Shipp, S., & Friston, K. J. (2013) · Brain Structure and Function · doi:10.1007/s00429-012-0475-5 · Cited by 765 · cited 1×
“Working backwards in a sense, to facilitate this transition, a series of actions “fall out,” unfolding without requiring the planning of a sequence of action commands (Adams et al., 2013), in stark contrast to the robotics paradigm of sense-plan-act.”
ResultSelf-citationFormal theory of creativity, fun, and intrinsic motivation (1990–2010)
Schmidhuber, J. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2056368 · Cited by 747
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
Self-citationA Hierarchy of Time-Scales and the Brain
Kiebel, S. J., Daunizeau, J., & Friston, K. J. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000209 · Cited by 694 · cited 1×
“Primates (including humans) exhibit nested spatiotemporal integration when interactively engaged in a dynamic situation or observing a visual sequence, as do humans when following along with speech or writing by integrating syllables into words, words into sentences, and sentences into a narrative (Hasson et al., 2008…”
BackgroundSelf-citationFriston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., ODoherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Self-citationActive Inference, homeostatic regulation and adaptive behavioural control
Pezzulo, G., Rigoli, F., & Friston, K. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.001 · Cited by 650 · cited 2×
“Exploiting high likelihoods refers to the probabilistic Bayesian decision-making computations that play out on a dynamic, neurobiological substrate (Pezzulo et al., 2015).”
BackgroundSelf-citationObserving the unexpected enhances infants’ learning and exploration
Stahl, A. E., & Feigenson, L. (2015) · Science · doi:10.1126/science.aaa3799 · Cited by 617
Hohwy, J. (2016) · Noûs · doi:10.1111/nous.12062 · Cited by 578 · cited 1×
“This is the notion of indirect perception that Hohwy (2013, 2016) advocates (cf. Clark, 2016).”
BackgroundDehaene, S., Meyniel, F., Wacongne, C., Wang, L., & Pallier, C. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.019 · Cited by 478
Reinforcement learning or active inference?
Friston, K. J., Daunizeau, J., & Kiebel, S. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006421 · Cited by 443
Self-citationThe Human Fetus Preferentially Engages with Face-like Visual Stimuli
Reid, V. M., Dunn, K., Young, R. J., Amu, J., Donovan, T., & Reissland, N. (2017) · Current Biology · doi:10.1016/j.cub.2017.05.044 · Cited by 421
Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition
Pezzulo, G., & Cisek, P. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.013 · Cited by 419
The graphical brain: Belief propagation and active inference
Friston, K. J., Parr, T., & de Vries, B. (2017) · Network Neuroscience · doi:10.1162/netn_a_00018 · Cited by 415 · cited 1×
“Please see Friston et al. (2017b) for technical details and Friston et al. (2017a) for a discussion of how this belief updating might be implemented in a brain. provide evidence for the most apt generative model or policy (Lupyan and Clark, 2015), enhancing the control information for the relevant…”
BackgroundSelf-citationBarto, A., Mirolli, M., & Baldassarre, G. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00907 · Cited by 397 · cited 1×
“This means that the most probable policies or paths are those that resolve uncertainty when navigating the lived world (Berlyne, 1950; Schmidhuber, 2006; Baranes and Oudeyer, 2009; Still and Precup, 2012; Barto et al., 2013; Moulin and Souchay, 2015).”
BackgroundBruineberg, J., Kiverstein, J., & Rietveld, E. (2018) · Synthese · doi:10.1007/s11229-016-1239-1 · Cited by 383 · cited 1×
“When a potentially significant aspect of the environment recruits a policy, it becomes relevant; this is equivalent to the notion of a “solicitation” in affordance theory and phenomenological philosophy (see Bruineberg and Rietveld, 2014; Bruineberg et al., 2016).”
Brain activity differentiates face and object processing in 6-month-old infants.
de Haan, M., & Nelson, C. A. (1999) · Developmental Psychology · doi:10.1037/0012-1649.35.4.1113 · Cited by 370 · cited 1×
“There is evidence of this mechanism in brain scans of primates (Sliwa and Freiwald, 2017) and human infants (de Haan and Nelson, 1999, Southgate et al., 2008), and from human in utero behavioral experiments (Reid et al., 2017).”
BackgroundWhat is optimal about motor control?
Friston, K. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.018 · Cited by 332
Self-citationSame Story, Different Story: The Neural Representation of Interpretive Frameworks
Yeshurun, Y., Swanson, S., Simony, E., Chen, J., Lazaridi, C., Honey, C. J., & Hasson, U. (2017) · Psychological Science · doi:10.1177/0956797616682029 · Cited by 300 · cited 1×
“Primates (including humans) exhibit nested spatiotemporal integration when interactively engaged in a dynamic situation or observing a visual sequence, as do humans when following along with speech or writing by integrating syllables into words, words into sentences, and sentences into a narrative (Hasson et al., 2008…”
BackgroundKnowing one's place: a free-energy approach to pattern regulation
Friston, K., Levin, M., Sengupta, B., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.1383 · Cited by 234
Self-citationInformation and efficiency in the nervous system-a synthesis.
Sengupta, B., Stemmler, M. B., & Friston, K. J. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003157 · Cited by 212 · cited 2×
“They also generalize to the sub-ecological “action” scale, as reflex arcs, grounded in the physics of nerve electricity (Friston et al., 2010; Sengupta et al., 2013), and the supra-ecological “activity” scale, as extended active and resting states, grounded in physiological homeostasis/allostasis dynamics (Ashourvan e…”
BackgroundSelf-citationCueing attention after the stimulus is gone can retrospectively trigger conscious perception
Sergent, C., Wyart, V., Babo-Rebelo, M., Cohen, L., Naccache, L., & Tallon-Baudry, C. (2013) · Current Biology · doi:10.1016/j.cub.2012.11.047 · Cited by 195 · cited 1×
“On the complex interplay between phenomenal sensation and preconscious information, see Sergent et al. (2013).”
BackgroundAn information-theoretic approach to curiosity-driven reinforcement learning
Still, S., & Precup, D. (2012) · Theory in Biosciences · doi:10.1007/s12064-011-0142-z · Cited by 165 · cited 1×
“This means that the most probable policies or paths are those that resolve uncertainty when navigating the lived world (Berlyne, 1950; Schmidhuber, 2006; Baranes and Oudeyer, 2009; Still and Precup, 2012; Barto et al., 2013; Moulin and Souchay, 2015).”
BackgroundScene Construction, Visual Foraging, and Active Inference
Mirza, M. B., Adams, R. A., Mathys, C. D., & Friston, K. J. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00056 · Cited by 165
Self-citationUniversal darwinism as a process of bayesian inference
Campbell, J. O. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00049 · Cited by 140 · cited 1×
“Indeed, some perspectives in theore tical biology speak to evolution itself as a FEM process, for instance, generalizing Darwinian processes as physical implementations of Bayesian inference (Frank, 2012; Lammert et al., 2012; Campbell, 2016).”
BackgroundModel averaging, optimal inference, and habit formation
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00457 · Cited by 121
Self-citationA Theory of Resonance: Towards an Ecological Cognitive Architecture
Raja, V. (2018) · Minds and Machines · doi:10.1007/s11023-017-9431-8 · Cited by 115 · cited 1×
“…of “resonance” appears to be appropriately matched to such complex situated activity, in which the agent’s multiscale embodied neurody namics “resonate” with the multiscale environmental dynamics, following experiential attunement to the relevant regularities (Teques et al., 2017; cf. Raja, 2017).”
Evidence for surprise minimization over value maximization in choice behavior
Schwartenbeck, P., FitzGerald, T. H. B., Mathys, C., Dolan, R., Kronbichler, M., & Friston, K. (2015) · Scientific Reports · doi:10.1038/srep16575 · Cited by 96 · cited 1×
“, 2015) and reinforcement learning (Schwartenbeck et al., 2015) through to language (Friston et al.”
BackgroundSelf-citationInference to the Best Prediction: A Reply to Wanja Wiese
Seth, A. K. (2015) · Theoretical Philosophy/MIND Group – JGU Mainz · doi:10.15502/9783958570986 · Cited by 34
Tracing the Roots of Cognition in Predictive Processing
Pezzulo, G. (2017) · Theoretical Philosophy/MIND Group – JGU Mainz · doi:10.15502/9783958573215 · Cited by 33
Frank, S. A. (2012) · Journal of Evolutionary Biology · doi:10.1111/jeb.12010 · Cited by 21
Cited by
Corcoran, A. W., Pezzulo, G., & Hohwy, J. (2020) · Biology & Philosophy · doi:10.1007/s10539-020-09746-2 · Cited by 161
Safron, A. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00030 · Cited by 133
“Along these lines, by enabling the generation of inferences with rapidity and reliability, SOHMs could afford approximate models capable of guiding action–perception cycles and decision-making (von Uexküll, 1957; Fuster, 2009; Madl et al., 2011; Vul et al., 2014; Linson et al., 2018; Parr and Friston, 2018b).”
BackgroundLearning action-oriented models through active inference
Tschantz, A., Seth, A. K., & Buckley, C. L. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007805 · Cited by 121
Reframing PTSD for computational psychiatry with the active inference framework
Linson, A., & Friston, K. (2019) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2019.1665994 · Cited by 81
“…selected-for evolutionary hyperpriors and hyperparameters (i.e., the embodied-embedded architecture) pertaining to organism and species survival would contribute to the governing of action selection in light of counterfactual trade-o ff s in metabolic and temporal costs (Linson et al., 2018).”
BackgroundSelf-citationFrom metaphor to theory: the role of resonance in perceptual learning
Raja, V. (2019) · Adaptive Behavior · doi:10.1177/1059712319854350 · Cited by 34
Metadata
- Authors
- Linson, A., Clark, A., Ramamoorthy, S., & Friston, K.
- Venue
- Frontiers in Robotics and AI
- Publisher
- Frontiers Media SA
- Published
- 2018-03-08
- Volume
- 5
- Pages
- 21-21
- ISSN
- 2296-9144 (ISSN-L)
- OpenAlex
- W2793764002
- Cited by
- 90
- References
- 51
- FWCI
- 5.67
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.