CoChat

On Bayesian mechanics: a physics of and by beliefs

Open access
Ramstead, Maxwell J. D., Sakthivadivel, Dalton A. R., Heins, Conor, Koudahl, Magnus, Millidge, Beren, Da Costa, Lancelot, Klein, Brennan, Friston, Karl J. · 2023 · Interface Focus
Cited by 120

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Abstract

The aim of this paper is to introduce a field of study that has emerged over the last decade, called Bayesian mechanics. Bayesian mechanics is a probabilistic mechanics, comprising tools that enable us to model systems endowed with a particular partition (i.e. into particles), where the internal states (or the trajectories of internal states) of a particular system encode the parameters of beliefs about external states (or their trajectories). These tools allow us to write down mechanical theories for systems that look as if they are estimating posterior probability distributions over the causes of their sensory states. This provides a formal language for modelling the constraints, forces, potentials and other quantities determining the dynamics of such systems, especially as they entail dynamics on a space of beliefs (i.e. on a statistical manifold). Here, we will review the state of the art in the literature on the free energy principle, distinguishing between three ways in which Bayesian mechanics has been applied to particular systems (i.e. path-tracking, mode-tracking and mode-matching). We go on to examine a duality between the free energy principle and the constrained maximum entropy principle, both of which lie at the heart of Bayesian mechanics, and discuss its implications.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1098/rsfs.2022.0029

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 22 references

Research works printed but not linked: 94

  1. 10.3390/e23091220 · DOI
  2. Ueltzhöffer K. 2020 On the thermodynamics of prediction under dissipative adaptation. (http://arxiv.org/abs/2009.04006) · arXiv
  3. Sakthivadivel DAR. 2022 Towards a geometry and analysis for Bayesian mechanics. (http://arxiv.org/abs/2204.11900) · arXiv
  4. 10.3390/e22080889 · DOI
  5. 10.1177/1059712319862774 · DOI · Paper page
  6. 10.1002/cplx.20191 · DOI · Paper page
  7. 10.1103/PhysRevLett.109.120604 · DOI · Paper page
  8. Perunov N, Marsland RA, England JL. 2016 Statistical physics of adaptation. Phys. Rev. X 6, 021036. (doi:10.1103/PhysRevX.6.021036) · DOI
  9. 10.3390/e21121211 · DOI
  10. 10.3390/e23091115 · DOI
  11. Nicolis G, Prigogine I. 1977 Self-organization in nonequilibrium systems: from dissipative structures to order through fluctuations. New York, NY: Wiley.
  12. 10.1126/science.201.4358.777 · DOI · Paper page
  13. 10.1038/nnano.2015.250 · DOI · Paper page
  14. MacKay DJC. 2003 Information theory, inference and learning algorithms. Cambridge, UK: Cambridge University Press.
  15. 10.1007/978-4-431-55978-8 · DOI · Paper page
  16. Barlow H. 1961 Possible principles underlying the transformations of sensory messages. In Sensory communication (ed. WA Rosenblith) pp. 217–234. Cambridge MA: MIT Press.
  17. 10.1068/p030123 · DOI
  18. 10.1073/pnas.231499798 · DOI · Paper page
  19. 10.1016/j.tics.2011.11.018 · DOI · Paper page
  20. 10.1209/0295-5075/97/30003 · DOI
  21. Sengupta B Friston K. 2017 Approximate Bayesian inference as a gauge theory. (http://arxiv.org/abs/1705.06614) · arXiv
  22. 10.1098/rsta.2019.0159 · DOI · Paper page
  23. 10.1002/9783527658701.ch11 · DOI
  24. Yang YJ Qian H. 2022 Statistical thermodynamics and data infinitum: conjugate variables as forces and their statistical variations. (http://arxiv.org/abs/2205.09321) · arXiv · doi:10.21203/rs.3.rs-3152338/v1
  25. 10.1002/j.1538-7305.1948.tb01338.x · DOI · Paper page
  26. 10.1080/01621459.2017.1285773 · DOI · Paper page
  27. Fields C Friston K Glazebrook JF Levin M. 2021 A free energy principle for generic quantum systems. (http://arxiv.org/abs/211215242)
  28. Clark A. 2015 Surfing uncertainty: prediction, action, and the embodied mind. Oxford, UK: Oxford University Press.
  29. 10.1007/BF02478302 · DOI · Paper page
  30. 10.1007/BF02477890 · DOI
  31. Chemero AP. 2011 Radical embodied cognitive science. Cambridge, MA: MIT Press.
  32. Bolt J Hedges J Zahn P. 2019 Bayesian open games. (http://arxiv.org/abs/1910.03656) · arXiv
  33. Smithe TSC. 2021 Compositional active inference I. Bayesian lenses. Statistical games. (http://arxiv.org/abs/2109.04461) · arXiv
  34. Capucci M Gavranović B Hedges J Rischel EF. 2021 Towards foundations of categorical cybernetics. (http://arxiv.org/abs/2105.06332) · arXiv
  35. 10.1007/s10539-021-09807-0 · DOI
  36. 10.1017/S0140525X22000310 · DOI
  37. 10.1093/bjps/axm011 · DOI · Paper page
  38. Weisberg M. 2012 Simulation and similarity: using models to understand the world. Oxford, UK: Oxford University Press.
  39. Van Gelder T Port RF. 1995 It’s about time: an overview of the dynamical approach to cognition. In Mind as motion: explorations in the dynamics of cognition (eds T Van Gelder RF Port) pp. 1–43. Cambridge MA: MIT Press.
  40. 10.1017/S0140525X98001733 · DOI · Paper page
  41. 10.1086/661755 · DOI · Paper page
  42. Weinberg S. 1977 The search for unity: notes for a history of quantum field theory, pp. 17–35. Cambridge, MA: Daedalus.
  43. 10.1098/rsta.2009.0227 · doi:10.1098/rsta.2009.0227
  44. Arnol’d VI Givental AB Novikov SP. 2001 Symplectic geometry. In Dynamical systems IV pp. 1–138. New York NY: Springer. · doi:10.1007/978-3-662-06791-8_1
  45. 10.1093/oso/9780198743040.001.0001 · DOI
  46. Markowich PA, Villani C. 2000 On the trend to equilibrium for the Fokker-Planck equation: an interplay between physics and functional analysis. Matemática Contemporânea (SBM) 19, 1-29.
  47. Jaynes ET. 1978 Where do we stand on maximum entropy? In Maximum Entropy Formalism Conf. Cambridge MA USA 2–4 May 1978 . Cambridge MA: MIT Press.
  48. 10.1103/RevModPhys.85.1115 · DOI · Paper page
  49. Heins C Klein B Demekas D Aguilera M Buckley C. 2022 Spin glass systems as collective active inference. (https://arxiv.org/abs/2207.06970) · DOI
  50. 10.3389/fpsyg.2019.02688 · DOI · Paper page
  51. 10.1016/j.plrev.2017.12.009 · DOI
  52. 10.1177/1059712319862774 · DOI · Paper page
  53. 10.3390/e23081076 · DOI
  54. Sakthivadivel DAR. 2022 Weak Markov blankets in high-dimensional sparsely-coupled random dynamical systems. (http://arxiv.org/abs/2207.07620) · arXiv
  55. Sakthivadivel DAR. 2022 A worked example of the Bayesian mechanics of classical objects. (http://arxiv.org/abs/2206.12996) · arXiv
  56. Friston K Da Costa L Sakthivadivel DA Heins C Pavliotis GA Ramstead M Parr T. 2022 Path integrals particular kinds and strange things. (http://arxiv.org/abs/2210.12761) · DOI
  57. 10.1017/S0140525X22000334 · doi:10.1017/s0140525x22000334
  58. 10.1016/j.plrev.2022.06.001 · DOI
  59. Fields C, Hoffman DD, Prakash C, Prentner R. 2017 Eigenforms, interfaces and holographic encoding. Constructivist Found. 12, 265-291.
  60. Balaji B, Friston K. 2011 Bayesian state estimation using generalized coordinates. Signal Process. Sensor Fusion Target Recogn. XX 8050, 716-727. (doi:10.1117/12.883513) · DOI
  61. 10.1007/s100510051129 · DOI
  62. Barp A Da Costa L França G Friston K Girolami M Jordan MI Pavliotis GA. 2022 Geometric methods for sampling optimisation inference and adaptive agents. (http://arxiv.org/abs/220310592) · DOI
  63. 10.1007/s10539-021-09818-x · DOI
  64. 10.1016/j.plrev.2018.12.002 · DOI · Paper page
  65. Isomura T Kotani K Jimbo Y Friston K. 2022 Experimental validation of the free-energy principle with in vitro neural networks. bioRxiv . (doi:10.1101/2022.10.03.510742) · DOI
  66. 10.1007/978-1-4939-1323-7 · DOI · Paper page
  67. 10.1016/j.plrev.2021.11.001 · DOI
  68. 10.1162/neco_a_01354 · DOI · Paper page
  69. Millidge B Tschantz A Seth AK Buckley CL. 2020 On the relationship between active inference and control as inference. In Int. Workshop on Active Inference pp. 3–11. New York NY: Springer. · DOI
  70. Attias H. 2003 Planning by probabilistic inference. Proc. Mach. Learn. Res. R4, 9-16.
  71. Rawlik K Toussaint M Vijayakumar S. 2012 On stochastic optimal control and reinforcement learning by approximate inference. In Proc. Robotics: Science and Systems Conf. Sydney Australia 9–13 July 2012 . · DOI · Paper page
  72. 10.1137/080721340 · DOI
  73. 10.1016/j.plrev.2022.05.006 · DOI
  74. Sakthivadivel DAR. 2022 Regarding flows under the free energy principle: a comment on ‘How particular is the physics of the free energy principle?’ by Aguilera Millidge Tschantz and Buckley. (http://arxiv.org/abs/2205.07793) · arXiv
  75. 10.3390/e23030293 · DOI
  76. 10.1016/j.plrev.2022.05.002 · DOI
  77. 10.1142/2324 · DOI · Paper page
  78. Rubakov V, Wilson SS. 2002 Classical theory of gauge fields. Princeton, NJ: Princeton University Press.
  79. Giancoli DC. 2008 Physics for scientists and engineers with modern physics. London, UK: Pearson Education.
  80. 10.1109/TIT.1980.1056144 · DOI · Paper page
  81. 10.1016/j.plrev.2021.09.001 · DOI
  82. 10.1098/rstb.2005.1622 · DOI · Paper page
  83. 10.1007/978-3-030-64919-7_1 · DOI
  84. Ramstead MJD. 2021 The empire strikes back: some responses to Bruineberg and colleagues. (http://arxiv.org/abs/2112.15528) · arXiv · doi:10.1017/s0140525x22000139
  85. 10.1002/bies.201900228 · DOI · Paper page
  86. Jankélévitch V. 1924 Deux philosophes de la vie Bergson, Guyau. Revue Philosophique de la France et de l’Étranger 97, 402-449.
  87. 10.1111/sjp.12096 · DOI
  88. 10.1016/j.shpsa.2022.02.005 · DOI
  89. Ramstead MJ Sakthivadivel DA Friston KJ. 2022 On the map-territory fallacy fallacy. (http://arxiv.org/abs/2208.06924) · arXiv
  90. van Es T. 2020 Living models or life modelled? On the use of models in the free energy principle. Adapt. Behav. 29, 1059712320918678. (doi:10.1177/1059712320918678) · DOI
  91. Cook AH. 1994 Observational foundations of physics. Cambridge, UK: Cambridge University Press.
  92. Bridgman PW. 1954 Remarks on the present state of operationalism. Sci. Mon. 79, 224-226.
  93. 10.1016/j.biosystems.2022.104714 · DOI
  94. 10.1016/0550-3213(95)00158-O · DOI · Paper page

Cited by

See all 120

Metadata

Authors
Ramstead, M. J. D., Sakthivadivel, D. A. R., Heins, C., Koudahl, M., Millidge, B., Da Costa, L., Klein, B., & Friston, K. J.
Venue
Interface Focus
Published
2023-04-14
Volume
13
Issue
3
Pages
20220029-20220029
ISSN
  • 2042-8898 (ISSN-L)
  • 2042-8901
OpenAlex
W4365515296
Cited by
120
References
22
FWCI
15.64
Type
journal article
Language
en
Open access
hybrid
Licence
royalsociety.org/journals/ethics-policies/data-sharing-mining/ (tdm)
Funders
  • Office of Naval Research (N00014-19-1-2556)
  • Biotechnology and Biological Sciences Research Council (BB/s006338/1)
  • Wellcome Trust (205103/Z/16/Z)
  • EPSRC Centre for Doctoral Training in Mathematics of Random Systems: Analysis, Modelling and Simulation (EP/S023925/1)
  • Canada-UK Artificial Intelligence Initiative (ES/T01279X/1)
  • Fonds National de la Recherche Luxembourg (13568875)
  • John Templeton Foundation (61780)
  • Medical Research Council (MC UU 00003/1)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: On Bayesian mechanics: a physics of and by beliefs. https://app.cochat.ai/papers/10.1098/rsfs.2022.0029
The paper
Ramstead, M. J. D., Sakthivadivel, D. A. R., Heins, C., Koudahl, M., Millidge, B., Da Costa, L., Klein, B., & Friston, K. J. (2023). On Bayesian mechanics: a physics of and by beliefs. Interface Focus. https://doi.org/10.1098/rsfs.2022.0029

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.