Free-energy minimization in joint agent-environment systems: A niche construction perspective
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
The free-energy principle is an attempt to explain the structure of the agent and its brain, starting from the fact that an agent exists (Friston and Stephan, 2007; Friston et al., 2010). More specifically, it can be regarded as a systematic attempt to understand the 'fit' between an embodied agent and its niche, where the quantity of free-energy is a measure for the 'misfit' or disattunement (Bruineberg and Rietveld, 2014) between agent and environment. This paper offers a proof-of-principle simulation of niche construction under the free-energy principle. Agent-centered treatments have so far failed to address situations where environments change alongside agents, often due to the action of agents themselves. The key point of this paper is that the minimum of free-energy is not at a point in which the agent is maximally adapted to the statistics of a static environment, but can better be conceptualized an attracting manifold within the joint agent-environment state-space as a whole, which the system tends toward through mutual interaction. We will provide a general introduction to active inference and the free-energy principle. Using Markov Decision Processes (MDPs), we then describe a canonical generative model and the ensuing update equations that minimize free-energy. We then apply these equations to simulations of foraging in an environment; in which an agent learns the most efficient path to a pre-specified location. In some of those simulations, unbeknownst to the agent, the 'desire paths' emerge as a function of the activity of the agent (i.e. niche construction occurs). We will show how, depending on the relative inertia of the environment and agent, the joint agent-environment system moves to different attracting sets of jointly minimized free-energy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Newsome, W., & Pare, E. (1988) · The Journal of Neuroscience · doi:10.1523/jneurosci.08-06-02201.1988 · Cited by 1,615
The extended evolutionary synthesis: its structure, assumptions and predictions
Laland, K. N., Uller, T., Feldman, M. W., Sterelny, K., Müller, G. B., Moczek, A., Jablonka, E., & Odling-Smee, J. (2015) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2015.1019 · Cited by 1,399
A Rich Landscape of Affordances
Rietveld, E., & Kiverstein, J. (2014) · Ecological Psychology · doi:10.1080/10407413.2014.958035 · Cited by 1,160
Self-citationActive inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156 · cited 1×
“Over time, the agents mutually constrain each other until an attracting (synchronization) manifold is reached ( Friston and Frith, 2015 ).”
BackgroundSelf-citationAction and behavior: a free-energy formulation
Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010) · Biological Cybernetics · doi:10.1007/s00422-010-0364-z · Cited by 866
Self-citationGregory, R. L. (1980) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1980.0090 · Cited by 789
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
Self-citationEvery Good Regulator of a System Must Be a Model of That System
Conant, R. C., & Ashby, W. R. (1991) · Facets of Systems Science · doi:10.1007/978-1-4899-0718-9_37 · Cited by 712
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., ODoherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Self-citationFriston, K. J., & Stephan, K. E. (2007) · Synthese · doi:10.1007/s11229-007-9237-y · Cited by 673
Self-citationEvolutionary consequences of niche construction and their implications for ecology
Laland, K. N., Odling-Smee, F. J., & Feldman, M. W. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.18.10242 · Cited by 624 · cited 1×
“2 There are potentially many ways to model niche construction, using conceptual analysis, numerical analysis or formal models that vary in their form and assumptions: see ( Creanza and Feld-man, 2014; Krakauer et al., 2009; Laland et al., 1999; Lehmann, 2008 ) for some compelling examples.”
MethodPerceptions as Hypotheses: Saccades as Experiments
Friston, K., Adams, R. A., Perrinet, L., & Breakspear, M. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00151 · Cited by 462
Self-citationA Specific and Enduring Improvement in Visual Motion Discrimination
Ball, K., & Sekuler, R. (1982) · Science · doi:10.1126/science.7134968 · Cited by 383
Bruineberg, J., Kiverstein, J., & Rietveld, E. (2018) · Synthese · doi:10.1007/s11229-016-1239-1 · Cited by 383
Self-citationFriston, K., & Frith, C. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2014.12.003 · Cited by 359
Self-citationDEM: A variational treatment of dynamic systems
Friston, K. J., Trujillo-Barreto, N., & Daunizeau, J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.054 · Cited by 278 · cited 1×
“On time-scales of perception and action, an organism improves its fit, or grip ( Bruineberg and Rietveld, 2014 ), by selectively being sensitive to the action possibilities, or affordances ( Gibson, 1979; Rietveld and Kiverstein, 2014 ) that are offered by the environment.”
BackgroundKnowing one's place: a free-energy approach to pattern regulation
Friston, K., Levin, M., Sengupta, B., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.1383 · Cited by 234
Self-citationA variational approach to niche construction
Constant, A., Ramstead, M. J. D., Veissière, S. P. L., Campbell, J. O., & Friston, K. J. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0685 · Cited by 204
Self-citationThe feeling of grip: novelty, error dynamics, and the predictive brain
Kiverstein, J., Miller, M., & Rietveld, E. (2019) · Synthese · doi:10.1007/s11229-017-1583-9 · Cited by 143
Self-citationUniversal darwinism as a process of bayesian inference
Campbell, J. O. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00049 · Cited by 140
Frank, S. A. (2012) · Journal of Evolutionary Biology · doi:10.1111/jeb.12010 · Cited by 21
Cited by
Thinking through other minds: A variational approach to cognition and culture
Veissière, S. P. L., Constant, A., Ramstead, M. J. D., Friston, K. J., & Kirmayer, L. J. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x19001213 · Cited by 348
Self-citationGeneralised free energy and active inference
Parr, T., & Friston, K. J. (2019) · Biological Cybernetics · doi:10.1007/s00422-019-00805-w · Cited by 236
Self-citationActive inference on discrete state-spaces: A synthesis
Da Costa, L., Parr, T., Sajid, N., Veselic, S., Neacsu, V., & Friston, K. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102447 · Cited by 226
“[1,9,10] Atari games Active inference compares favourably to reinforcement learning in the game of Doom.”
BackgroundResultSelf-citationThe brain and its time: intrinsic neural timescales are key for input processing
Golesorkhi, M., Gomez-Pilar, J., Zilio, F., Berberian, N., Wolff, A., Yagoub, M. C. E., & Northoff, G. (2021) · Communications Biology · doi:10.1038/s42003-021-02483-6 · Cited by 198
Corcoran, A. W., Pezzulo, G., & Hohwy, J. (2020) · Biology & Philosophy · doi:10.1007/s10539-020-09746-2 · Cited by 161
Metadata
- Authors
- Bruineberg, J., Rietveld, E., Parr, T., van Maanen, L., & Friston, K. J.
- Venue
- Journal of Theoretical Biology
- Publisher
- Elsevier BV
- Published
- 2018-10
- Volume
- 455
- Pages
- 161-178
- ISSN
- 0022-5193 (ISSN-L)
- OpenAlex
- W2884852581
- Cited by
- 99
- References
- 21
- FWCI
- 6.09
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.