Modules or Mean-Fields?
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
The segregation of neural processing into distinct streams has been interpreted by some as evidence in favour of a modular view of brain function. This implies a set of specialised ‘modules’, each of which performs a specific kind of computation in isolation of other brain systems, before sharing the result of this operation with other modules. In light of a modern understanding of stochastic non-equilibrium systems, like the brain, a simpler and more parsimonious explanation presents itself. Formulating the evolution of a non-equilibrium steady state system in terms of its density dynamics reveals that such systems appear on average to perform a gradient ascent on their steady state density. If this steady state implies a sufficiently sparse conditional independency structure, this endorses a mean-field dynamical formulation. This decomposes the density over all states in a system into the product of marginal probabilities for those states. This factorisation lends the system a modular appearance, in the sense that we can interpret the dynamics of each factor independently. However, the argument here is that it is factorisation, as opposed to modularisation, that gives rise to the functional anatomy of the brain or, indeed, any sentient system. In the following, we briefly overview mean-field theory and its applications to stochastic dynamical systems. We then unpack the consequences of this factorisation through simple numerical simulations and highlight the implications for neuronal message passing and the computational architecture of sentience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120
Self-citationRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Stochastic thermodynamics, fluctuation theorems and molecular machines
Seifert, U. (2012) · Reports on Progress in Physics · doi:10.1088/0034-4885/75/12/126001 · Cited by 3,300 · cited 1×
“Consistent with the fluctuation theorems of stochastic thermodynamics [35], this highlights that the direction of change in entropy depends upon whether the initial or steady-state density has the greater dispersion.”
BackgroundThe Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 1×
“Second, conditional densities of this kind underwrite the Bayesian brain hypothesis [64–67].”
BackgroundHickok, G., & Poeppel, D. (2004) · Cognition · doi:10.1016/j.cognition.2003.10.011 · Cited by 2,212
‘What’ and ‘where’ in the human brain
Ungerleider, L. G., & Haxby, J. V. (1994) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(94)90066-3 · Cited by 1,913 · cited 1×
“In other words, we have segregated sensory streams that deal with di ff erent aspects of the sensorium: similar to cognitive processing associated with visual [44], auditory [45], language [46], and temporal [47] tasks.”
BackgroundTononi, G., Sporns, O., & Edelman, G. M. (1994) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.91.11.5033 · Cited by 1,626 · cited 1×
“Multimodal properties of this sort speak to the importance of functional integration alongside modular segregation [2,57], heightened during cognitive processing [58].”
BackgroundPredictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
Self-citationRiemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
(1988) · doi:10.1016/b978-0-08-051489-5.50008-4 · Cited by 1,429
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072
A hierarchy of intrinsic timescales across primate cortex
Murray, J. D., Bernacchia, A., Freedman, D. J., Romo, R., Wallis, J. D., Cai, X., Padoa-Schioppa, C., Pasternak, T., Seo, H., Lee, D., et al. (2014) · Nature Neuroscience · doi:10.1038/nn.3862 · Cited by 990
A hierarchy of temporal receptive windows in human cortex
Hasson, U., Yang, E., Vallines, I., Heeger, D. J., & Rubin, N. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5487-07.2008 · Cited by 874
Origins of domain specificity: The evolution of functional organization
Cosmides, L., & Tooby, J. (1994) · Mapping the Mind · doi:10.1017/cbo9780511752902.005 · Cited by 849
Friston, K. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0475 · Cited by 754 · cited 1×
“For a numerical proof-of-principle of this approach, see [86].”
BackgroundSelf-citationObject Representation in the Ventral Premotor Cortex (Area F5) of the Monkey
Murata, A., Fadiga, L., Fogassi, L., Gallese, V., Raos, V., & Rizzolatti, G. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.4.2226 · Cited by 753
A Hierarchy of Time-Scales and the Brain
Kiebel, S. J., Daunizeau, J., & Friston, K. J. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000209 · Cited by 694 · cited 1×
“This mimics the (slow and fast) temporal separation seen in neurobiological hierarchies [48–51].”
BackgroundSelf-citation(2005) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.5555/1046920.1088695 · Cited by 650
Cortical high-density counterstream architectures
Markov, N. T., Ercsey-Ravasz, M., Van Essen, D. C., Knoblauch, K., Toroczkai, Z., & Kennedy, H. (2013) · Science · doi:10.1126/science.1238406 · Cited by 616
Hohwy, J. (2016) · Noûs · doi:10.1111/nous.12062 · Cited by 578
The graphical brain: Belief propagation and active inference
Friston, K. J., Parr, T., & de Vries, B. (2017) · Network Neuroscience · doi:10.1162/netn_a_00018 · Cited by 415 · cited 2×
“This general formalism has been exploited in signal processing [22], Newtonian [23] and quantum dynamics [24], and neurobiology [25,26].”
MethodSelf-citationTowards a mathematical theory of cortical micro-circuits
George, D., & Hawkins, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000532 · Cited by 404 · cited 1×
“In summary, we can interpret the dynamics of a system described by mean-field density dynamics in terms of messages (i.e., mean-fields) passed between module-like regions of a network [69–71].”
Neural masses and fields in dynamic causal modeling
Moran, R., Pinotsis, D. A., & Friston, K. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00057 · Cited by 255
Self-citationActive inference on discrete state-spaces: A synthesis
Da Costa, L., Parr, T., Sajid, N., Veselic, S., Neacsu, V., & Friston, K. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102447 · Cited by 226 · cited 1×
“For introductions to the resulting active inference schemes, see [73,74].”
BackgroundSelf-citationA free energy principle for a particular physics
Friston, K. (2019) · arXiv · doi:10.48550/arxiv.1906.10184 · Cited by 222
Self-citationLimanowski, J., & Blankenburg, F. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.3987-15.2016 · Cited by 173
Markov blankets, information geometry and stochastic thermodynamics
Parr, T., Da Costa, L., & Friston, K. (2020) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2019.0159 · Cited by 141 · cited 1×
“Things become even more interesting when we think about distributions over alternative trajectories of the internal, active, sensory, and external components of the system [72].”
BackgroundSelf-citationNeuronal message passing using mean-field, bethe, and marginal approximations
Parr, T., Markovic, D., Kiebel, S. J., & Friston, K. J. (2019) · Scientific Reports · doi:10.1038/s41598-018-38246-3 · Cited by 128
Self-citationLearning action-oriented models through active inference
Tschantz, A., Seth, A. K., & Buckley, C. L. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007805 · Cited by 121 · cited 1×
“It may be that the data-generating process is of a form that requires some transformation of the x variables, or even that the generative model is not an accurate description of the data-generating process [68].”
Background
Cited by
Hipólito, I., Ramstead, M. J. D., Convertino, L., Bhat, A., Friston, K., & Parr, T. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.02.003 · Cited by 79
Self-citationNeural and phenotypic representation under the free-energy principle
Ramstead, M. J. D., Hesp, C., Tschantz, A., Smith, R., Constant, A., & Friston, K. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.11.024 · Cited by 43
Self-citationHierarchical generative modelling for autonomous robots
Yuan, K., Sajid, N., Friston, K., & Li, Z. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00752-z · Cited by 23
“From a biological perspective, this kind of factorization can be regarded as a functional segregation that is often associated with modular architectures and functional specialization in the brain 36 .”
Self-citationA worked example of Fokker-Planck-based active inference
Koudahl, M. T., & de Vries, B. (2020) · Communications in Computer and Information Science · doi:10.1007/978-3-030-64919-7_4 · Cited by 7
“Theoretical treatments of the free energy Principle (FEP) and active inference are often framed in terms of the Fokker-Planck equation [5,6,10,12] and related flows.”
Method
Metadata
- Authors
- Parr, T., Sajid, N., & Friston, K. J.
- Venue
- Entropy
- Publisher
- MDPI AG
- Published
- 2020-05-14
- Volume
- 22
- Issue
- 5
- Pages
- 552
- ISSN
- 1099-4300 (ISSN-L)
- OpenAlex
- W3024223917
- Cited by
- 39
- References
- 29
- FWCI
- 3.88
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.