PID Control as a Process of Active Inference with Linear Generative Models
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
In the past few decades, probabilistic interpretations of brain functions have become widespread in cognitive science and neuroscience. In particular, the free energy principle and active inference are increasingly popular theories of cognitive functions that claim to offer a unified understanding of life and cognition within a general mathematical framework derived from information and control theory, and statistical mechanics. However, we argue that if the active inference proposal is to be taken as a general process theory for biological systems, it is necessary to understand how it relates to existing control theoretical approaches routinely used to study and explain biological systems. For example, recently, PID (Proportional-Integral-Derivative) control has been shown to be implemented in simple molecular systems and is becoming a popular mechanistic explanation of behaviours such as chemotaxis in bacteria and amoebae, and robust adaptation in biochemical networks. In this work, we will show how PID controllers can fit a more general theory of life and cognition under the principle of (variational) free energy minimisation when using approximate linear generative models of the world. This more general interpretation also provides a new perspective on traditional problems of PID controllers such as parameter tuning as well as the need to balance performances and robustness conditions of a controller. Specifically, we then show how these problems can be understood in terms of the optimisation of the precisions (inverse variances) modulating different prediction errors in the free energy functional.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 7×
“Active inference has been proposed as a general mathematical theory of life and cognition according to the minimisation of variational free energy [10].”
BackgroundMethodInfluentialAn introduction to cybernetics
Ashby, W. R. (1956) · doi:10.5962/bhl.title.5851 · Cited by 7,578
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“These models describe perception as a combination of feedforward prediction errors 46 and feedback predictions combined under a generative model to infer the hidden causes and states 47 of sensory data [2].”
BackgroundInternal models for motor control and trajectory planning.
Kawato, M. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)00028-8 · Cited by 2,685
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
Computational principles of movement neuroscience
Wolpert, D. M., & Ghahramani, Z. (2000) · Nature Neuroscience · doi:10.1038/81497 · Cited by 2,122 · cited 1×
“As discussed in [13], this step highlights the fundamental differences between the FEP and the more traditional forward/inverse models formulation of control problems in biological systems [71,72].”
BackgroundHohwy, J. (2013) · doi:10.1093/acprof:oso/9780199682737.001.0001 · Cited by 1,914
The free-energy principle: a rough guide to the brain?
Friston, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.04.005 · Cited by 1,831
Bayesian Filtering and Smoothing
Särkkä, S. (2013) · doi:10.1017/cbo9781139344203 · Cited by 1,784 · cited 1×
“Furthermore, (co)variances can be solved analytically in terms of the Hessian of the free energy evaluated at the mode [8,67,68].”
BackgroundA free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369
Surfing Uncertainty: Prediction, Action, and the Embodied Mind
Clark, A. (2016) · doi:10.1093/acprof:oso/9780190217013.001.0001 · Cited by 1,358
Cybernetics, or control and communication in the animal and the machine (2nd ed.).
Wiener, N. (1961) · doi:10.1037/13140-000 · Cited by 1,068
Hierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · cited 10×
“Starting from the latter, we define a generative model formulated as a one dimensional generalised state-space model [12]:”
BackgroundMethodInfluentialVariational free energy and the Laplace approximation
Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., & Penny, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.08.035 · Cited by 880 · cited 3×
“Under the Laplace approximation [66,67], the form of the recognition density q(θ) is specified in terms of a Gaussian distribution centred around the estimated mode (i.”
BackgroundMethodAction and behavior: a free-energy formulation
Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010) · Biological Cybernetics · doi:10.1007/s00422-010-0364-z · Cited by 866 · cited 10×
“, [8,13,15], we will define ψ as proprioceptive observations, where proprioception is the sense of position and movement of different parts of one’s body.”
BackgroundMethodInfluentialFriston, K. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0475 · Cited by 754
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
Action understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665
Active inference, sensory attenuation and illusions
Brown, H., Adams, R. A., Parees, I., Edwards, M., & Friston, K. (2013) · Cognitive Processing · doi:10.1007/s10339-013-0571-3 · Cited by 488 · cited 2×
“This is implemented in the weighting mechanism of prediction errors by precisions in equation (19); see also [13,26,70] for similar discussions on the role of precisions for behaviour.”
BackgroundReinforcement learning or active inference?
Friston, K. J., Daunizeau, J., & Kiebel, S. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006421 · Cited by 443
Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition
Pezzulo, G., & Cisek, P. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.013 · Cited by 419
A free energy principle for biological systems
Karl, F. (2012) · Entropy · doi:10.3390/e14112100 · Cited by 377 · cited 3×
“According to the free energy principle, living system must minimise the surprisal, or self-information, of their observations [4,9,10,19], defined as:”
BackgroundWhat is optimal about motor control?
Friston, K. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.018 · Cited by 332
A tutorial on the free-energy framework for modelling perception and learning
Bogacz, R. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.11.003 · Cited by 283
DEM: A variational treatment of dynamic systems
Friston, K. J., Trujillo-Barreto, N., & Daunizeau, J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.054 · Cited by 278 · cited 11×
“To do so, we extend our previous formulation and replace fixed sensory precisions πz, πz′ , πz′′ with expected sensory precisions μπz , μπz′ , μπz′′ , derived from a Laplace approximation applied not only to hidden states x but extended also to these hyperparameters, now considered as random variables to be estimated,…”
BackgroundMethodInfluentialGeneral duality between optimal control and estimation
Todorov, E. (2008) · 2008 47th IEEE Conference on Decision and Control · doi:10.1109/cdc.2008.4739438 · Cited by 248 · cited 1×
“A unifying view of these two theoretical frameworks is nowadays proposed for instance in stochastic optimal control [32,33]”
BackgroundThe cybernetic Bayesian brain : from interoceptive inference to sensorimotor contingencies
Seth, A. K. (2015) · MIND Group · doi:10.25358/openscience-84 · Cited by 239
Friston, K., Stephan, K., Li, B., & Daunizeau, J. (2010) · Mathematical Problems in Engineering · doi:10.1155/2010/621670 · Cited by 171
A complete class theorem for statistical problems with finite sample spaces
Brown, L. D. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345645 · Cited by 97
Cited by
Predictive Coding: a Theoretical and Experimental Review
Millidge, B., Seth, A., & Buckley, C. L. (2021) · arXiv · doi:10.48550/arxiv.2107.12979 · Cited by 106
“Specifically, it has been shown that the well-known PID (‘proportional-integral-derivative’) control method (Johnson & Moradi, 2005) is a special case of predictive coding with generalized coordinates (Baltieri & Buckley, 2019).”
InfluentialSelf-citationpymdp: A Python library for active inference in discrete state spaces
Heins, C., Millidge, B., Demekas, D., Klein, B., Friston, K., Couzin, I. D., & Tschantz, A. (2022) · Journal of Open Source Software · doi:10.21105/joss.04098 · Cited by 70
Bayesian mechanics for stationary processes
Da Costa, L., Friston, K., Heins, C., & Pavliotis, G. A. (2021) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2021.0518 · Cited by 63
“PID control is a well-known control method in engineering [77,80].”
BackgroundMethodInfluentialCollective behavior from surprise minimization
Heins, C., Millidge, B., Da Costa, L., Mann, R. P., Friston, K. J., & Couzin, I. D. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2320239121 · Cited by 55
Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?
Millidge, B., Salvatori, T., Song, Y., Bogacz, R., & Lukasiewicz, T. (2022) · arXiv · doi:10.48550/arxiv.2202.09467 · Cited by 31
Metadata
- Authors
- Baltieri, M., & Buckley, C.
- Venue
- Entropy
- Publisher
- MDPI AG
- Published
- 2019-03-07
- Volume
- 21
- Issue
- 3
- Pages
- 257
- ISSN
- 1099-4300 (ISSN-L)
- OpenAlex
- W2919878953
- Cited by
- 70
- References
- 30
- FWCI
- 5.27
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.