CoChat

On Bayesian mechanics: a physics of and by beliefs

Open access
Ramstead, Maxwell J. D., Sakthivadivel, Dalton A. R., Heins, Conor, Koudahl, Magnus, Millidge, Beren, Da Costa, Lancelot, Klein, Brennan, Friston, Karl J. · 2023 · Interface Focus
Cited by 120

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

The aim of this paper is to introduce a field of study that has emerged over the last decade, called Bayesian mechanics. Bayesian mechanics is a probabilistic mechanics, comprising tools that enable us to model systems endowed with a particular partition (i.e. into particles), where the internal states (or the trajectories of internal states) of a particular system encode the parameters of beliefs about external states (or their trajectories). These tools allow us to write down mechanical theories for systems that look as if they are estimating posterior probability distributions over the causes of their sensory states. This provides a formal language for modelling the constraints, forces, potentials and other quantities determining the dynamics of such systems, especially as they entail dynamics on a space of beliefs (i.e. on a statistical manifold). Here, we will review the state of the art in the literature on the free energy principle, distinguishing between three ways in which Bayesian mechanics has been applied to particular systems (i.e. path-tracking, mode-tracking and mode-matching). We go on to examine a duality between the free energy principle and the constrained maximum entropy principle, both of which lie at the heart of Bayesian mechanics, and discuss its implications.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1098/rsfs.2022.0029

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 28 references

Research works printed but not linked: 88

  1. 10.3390/e23091220 · DOI · Paper page
  2. Ueltzhöffer K. 2020 On the thermodynamics of prediction under dissipative adaptation. (http://arxiv.org/abs/2009.04006) · arXiv
  3. Sakthivadivel DAR. 2022 Towards a geometry and analysis for Bayesian mechanics. (http://arxiv.org/abs/2204.11900) · arXiv
  4. 10.3390/e22080889 · DOI
  5. 10.1177/1059712319862774 · DOI · Paper page
  6. 10.1103/PhysRevLett.109.120604 · DOI · Paper page
  7. Perunov N, Marsland RA, England JL. 2016 Statistical physics of adaptation. Phys. Rev. X 6, 021036. (doi:10.1103/PhysRevX.6.021036) · DOI
  8. 10.3390/e21121211 · DOI · Paper page
  9. 10.3390/e23091115 · DOI
  10. Nicolis G, Prigogine I. 1977 Self-organization in nonequilibrium systems: from dissipative structures to order through fluctuations. New York, NY: Wiley.
  11. 10.1038/nnano.2015.250 · DOI · Paper page
  12. MacKay DJC. 2003 Information theory, inference and learning algorithms. Cambridge, UK: Cambridge University Press.
  13. Barlow H. 1961 Possible principles underlying the transformations of sensory messages. In Sensory communication (ed. WA Rosenblith) pp. 217–234. Cambridge MA: MIT Press.
  14. 10.1068/p030123 · DOI · Paper page
  15. 10.1209/0295-5075/97/30003 · DOI
  16. Sengupta B Friston K. 2017 Approximate Bayesian inference as a gauge theory. (http://arxiv.org/abs/1705.06614) · arXiv
  17. 10.1098/rsta.2019.0159 · DOI · Paper page
  18. 10.1002/9783527658701.ch11 · DOI
  19. Yang YJ Qian H. 2022 Statistical thermodynamics and data infinitum: conjugate variables as forces and their statistical variations. (http://arxiv.org/abs/2205.09321) · arXiv · doi:10.21203/rs.3.rs-3152338/v1
  20. 10.1002/j.1538-7305.1948.tb01338.x · DOI · Paper page
  21. 10.1080/01621459.2017.1285773 · DOI · Paper page
  22. Fields C Friston K Glazebrook JF Levin M. 2021 A free energy principle for generic quantum systems. (http://arxiv.org/abs/211215242)
  23. Clark A. 2015 Surfing uncertainty: prediction, action, and the embodied mind. Oxford, UK: Oxford University Press.
  24. 10.1007/BF02478302 · DOI · Paper page
  25. 10.1007/BF02477890 · DOI
  26. Chemero AP. 2011 Radical embodied cognitive science. Cambridge, MA: MIT Press.
  27. Bolt J Hedges J Zahn P. 2019 Bayesian open games. (http://arxiv.org/abs/1910.03656) · arXiv
  28. Smithe TSC. 2021 Compositional active inference I. Bayesian lenses. Statistical games. (http://arxiv.org/abs/2109.04461) · arXiv
  29. Capucci M Gavranović B Hedges J Rischel EF. 2021 Towards foundations of categorical cybernetics. (http://arxiv.org/abs/2105.06332) · arXiv
  30. 10.1007/s10539-021-09807-0 · DOI
  31. 10.1017/S0140525X22000310 · DOI
  32. 10.1093/bjps/axm011 · DOI · Paper page
  33. Weisberg M. 2012 Simulation and similarity: using models to understand the world. Oxford, UK: Oxford University Press.
  34. Van Gelder T Port RF. 1995 It’s about time: an overview of the dynamical approach to cognition. In Mind as motion: explorations in the dynamics of cognition (eds T Van Gelder RF Port) pp. 1–43. Cambridge MA: MIT Press.
  35. 10.1017/S0140525X98001733 · DOI · Paper page
  36. 10.1086/661755 · DOI · Paper page
  37. Weinberg S. 1977 The search for unity: notes for a history of quantum field theory, pp. 17–35. Cambridge, MA: Daedalus.
  38. 10.1098/rsta.2009.0227 · doi:10.1098/rsta.2009.0227
  39. Arnol’d VI Givental AB Novikov SP. 2001 Symplectic geometry. In Dynamical systems IV pp. 1–138. New York NY: Springer. · DOI
  40. 10.1093/oso/9780198743040.001.0001 · DOI
  41. Markowich PA, Villani C. 2000 On the trend to equilibrium for the Fokker-Planck equation: an interplay between physics and functional analysis. Matemática Contemporânea (SBM) 19, 1-29.
  42. Jaynes ET. 1978 Where do we stand on maximum entropy? In Maximum Entropy Formalism Conf. Cambridge MA USA 2–4 May 1978 . Cambridge MA: MIT Press.
  43. 10.1103/RevModPhys.85.1115 · DOI · Paper page
  44. Heins C Klein B Demekas D Aguilera M Buckley C. 2022 Spin glass systems as collective active inference. (https://arxiv.org/abs/2207.06970) · DOI
  45. 10.3389/fpsyg.2019.02688 · DOI · Paper page
  46. 10.1016/j.plrev.2017.12.009 · DOI
  47. 10.1177/1059712319862774 · DOI · Paper page
  48. 10.3390/e23081076 · DOI · Paper page
  49. Sakthivadivel DAR. 2022 Weak Markov blankets in high-dimensional sparsely-coupled random dynamical systems. (http://arxiv.org/abs/2207.07620) · arXiv
  50. Sakthivadivel DAR. 2022 A worked example of the Bayesian mechanics of classical objects. (http://arxiv.org/abs/2206.12996) · arXiv
  51. Friston K Da Costa L Sakthivadivel DA Heins C Pavliotis GA Ramstead M Parr T. 2022 Path integrals particular kinds and strange things. (http://arxiv.org/abs/2210.12761) · DOI · Paper page
  52. 10.1017/S0140525X22000334 · doi:10.1017/s0140525x22000334
  53. 10.1016/j.plrev.2022.06.001 · DOI
  54. Fields C, Hoffman DD, Prakash C, Prentner R. 2017 Eigenforms, interfaces and holographic encoding. Constructivist Found. 12, 265-291.
  55. Balaji B, Friston K. 2011 Bayesian state estimation using generalized coordinates. Signal Process. Sensor Fusion Target Recogn. XX 8050, 716-727. (doi:10.1117/12.883513) · DOI
  56. 10.1007/s100510051129 · DOI
  57. Barp A Da Costa L França G Friston K Girolami M Jordan MI Pavliotis GA. 2022 Geometric methods for sampling optimisation inference and adaptive agents. (http://arxiv.org/abs/220310592) · DOI
  58. 10.1007/s10539-021-09818-x · DOI
  59. 10.1016/j.plrev.2018.12.002 · DOI · Paper page
  60. Isomura T Kotani K Jimbo Y Friston K. 2022 Experimental validation of the free-energy principle with in vitro neural networks. bioRxiv . (doi:10.1101/2022.10.03.510742) · DOI
  61. 10.1007/978-1-4939-1323-7 · DOI · Paper page
  62. 10.1016/j.plrev.2021.11.001 · DOI
  63. 10.1162/neco_a_01354 · DOI · Paper page
  64. Millidge B Tschantz A Seth AK Buckley CL. 2020 On the relationship between active inference and control as inference. In Int. Workshop on Active Inference pp. 3–11. New York NY: Springer. · DOI
  65. Attias H. 2003 Planning by probabilistic inference. Proc. Mach. Learn. Res. R4, 9-16.
  66. Rawlik K Toussaint M Vijayakumar S. 2012 On stochastic optimal control and reinforcement learning by approximate inference. In Proc. Robotics: Science and Systems Conf. Sydney Australia 9–13 July 2012 . · DOI · Paper page
  67. 10.1137/080721340 · DOI
  68. 10.1016/j.plrev.2022.05.006 · DOI
  69. Sakthivadivel DAR. 2022 Regarding flows under the free energy principle: a comment on ‘How particular is the physics of the free energy principle?’ by Aguilera Millidge Tschantz and Buckley. (http://arxiv.org/abs/2205.07793) · arXiv
  70. 10.3390/e23030293 · DOI · Paper page
  71. 10.1016/j.plrev.2022.05.002 · DOI
  72. 10.1142/2324 · DOI · Paper page
  73. Rubakov V, Wilson SS. 2002 Classical theory of gauge fields. Princeton, NJ: Princeton University Press.
  74. Giancoli DC. 2008 Physics for scientists and engineers with modern physics. London, UK: Pearson Education.
  75. 10.1109/TIT.1980.1056144 · DOI · Paper page
  76. 10.1016/j.plrev.2021.09.001 · DOI
  77. 10.1007/978-3-030-64919-7_1 · DOI
  78. Ramstead MJD. 2021 The empire strikes back: some responses to Bruineberg and colleagues. (http://arxiv.org/abs/2112.15528) · arXiv · doi:10.1017/s0140525x22000139
  79. 10.1002/bies.201900228 · DOI · Paper page
  80. Jankélévitch V. 1924 Deux philosophes de la vie Bergson, Guyau. Revue Philosophique de la France et de l’Étranger 97, 402-449.
  81. 10.1111/sjp.12096 · DOI
  82. 10.1016/j.shpsa.2022.02.005 · DOI
  83. Ramstead MJ Sakthivadivel DA Friston KJ. 2022 On the map-territory fallacy fallacy. (http://arxiv.org/abs/2208.06924) · arXiv
  84. van Es T. 2020 Living models or life modelled? On the use of models in the free energy principle. Adapt. Behav. 29, 1059712320918678. (doi:10.1177/1059712320918678) · DOI
  85. Cook AH. 1994 Observational foundations of physics. Cambridge, UK: Cambridge University Press.
  86. Bridgman PW. 1954 Remarks on the present state of operationalism. Sci. Mon. 79, 224-226.
  87. 10.1016/j.biosystems.2022.104714 · DOI
  88. 10.1016/0550-3213(95)00158-O · DOI · Paper page

Cited by

Metadata

Authors
Ramstead, M. J. D., Sakthivadivel, D. A. R., Heins, C., Koudahl, M., Millidge, B., Da Costa, L., Klein, B., & Friston, K. J.
Venue
Interface Focus
Published
2023-04-14
Volume
13
Issue
3
Pages
20220029-20220029
ISSN
  • 2042-8898 (ISSN-L)
  • 2042-8901
OpenAlex
W4365515296
Cited by
120
References
28
FWCI
15.64
Type
journal article
Language
en
Open access
hybrid
Licence
royalsociety.org/journals/ethics-policies/data-sharing-mining/ (tdm)
Funders
  • Office of Naval Research (N00014-19-1-2556)
  • Biotechnology and Biological Sciences Research Council (BB/s006338/1)
  • Wellcome Trust (205103/Z/16/Z)
  • EPSRC Centre for Doctoral Training in Mathematics of Random Systems: Analysis, Modelling and Simulation (EP/S023925/1)
  • Canada-UK Artificial Intelligence Initiative (ES/T01279X/1)
  • Fonds National de la Recherche Luxembourg (13568875)
  • John Templeton Foundation (61780)
  • Medical Research Council (MC UU 00003/1)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.