The DOI matches its Crossref record; 94 of the 95 references it cites were found in a registry or an index.
Neuronal message passing using Mean-field, Bethe, and Marginal approximations
Open accessAbstract
Neuronal computations rely upon local interactions across synapses. For a neuronal network to perform inference, it must integrate information from locally computed messages that are propagated among elements of that network. We review the form of two popular (Bayesian) message passing schemes and consider their plausibility as descriptions of inference in biological networks. These are variational message passing and belief propagation – each of which is derived from a free energy functional that relies upon different approximations (mean-field and Bethe respectively). We begin with an overview of these schemes and illustrate the form of the messages required to perform inference using Hidden Markov Models as generative models. Throughout, we use factor graphs to show the form of the generative models and of the messages they entail. We consider how these messages might manifest neuronally and simulate the inferences they perform. While variational message passing offers a simple and neuronally plausible architecture, it falls short of the inferential performance of belief propagation. In contrast, belief propagation allows exact computation of marginal posteriors at the expense of the architectural simplicity of variational message passing. As a compromise between these two extremes, we offer a third approach – marginal message passing – that features a simple architecture, while approximating the performance of belief propagation. Finally, we link formal considerations to accounts of neurological and psychiatric syndromes in terms of aberrant message passing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, we do believe that inference and learning in CSCG can be achieved using biologically plausible mechanisms (15, 22).”
From Space is a latent sequence: A theory of the hippocampus (2024) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“From an FEP-AI perspective, this synchrony-enhanced communication would facilitate information sharing among (and marginalization over) coupled dynamics, thereby organizing message passing (or belief propagation) for inference (Parr and Friston, 2018a; Parr et al., 2019).”
From An Integrated World Modeling Theory (IWMT) of Consciousness (2020) · cites this paper as Parr et al., 2019
The cited source says what the claim attributes to it.
In the citing paper
“Therefore, the communication of information regarding sub-system internal states (via MBs, definitionally) to the larger systems of which they are part is the propagation of a probabilistic belief—e.g., marginal message passing (Parr et al., 2019)—and so overall hierarchical organization of systems and sub-systems must instantiate HPP.”
From An Integrated World Modeling Theory (IWMT) of Consciousness (2020) · cites this paper as Parr et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“Note that the classical ‘forward-backward’ algorithm 68 is a special case of the belief propagation applied to an HMM.”
Background(1988) · Cited by 16,582
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Irreversibility and heat generation in the computing process
Landauer, R. (1961) · IBM Journal of Research and Development · doi:10.1147/rd.53.0183 · Cited by 4,980
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Rhythms for cognition: communication through coherence
Fries, P. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.034 · Cited by 2,725
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 1×
“( ) ( ) ( ) ( ) (1) s s s t t s s s t t”
Research works printed but not linked: 6
- Deneve, S. In Advances in neural information processing systems. 353–360.
- Dauwels, J. In Information Theory, 2007. ISIT 2007. IEEE International Symposium on. 2546–2550 (IEEE).
- Jaakkola, T., Singh, S. P. & Jordan, M. I. In Advances in neural information processing systems. 345–352.
- Heskes, T. In Advances in neural information processing systems. 359–366.
- Weller, A., Tang, K., Sontag, D. & Jebara, T. In 30th Conference on Uncertainty in Artificial Intelligence, UAI. (AUAI Press, 2014).
- Nowlan, S. J. In Advances in neural information processing systems. 574–582.
Cited by
A tale of two densities: active inference is enactive inference
Ramstead, M. J., Kirchhoff, M. D., & Friston, K. J. (2020) · Adaptive Behavior · doi:10.1177/1059712319862774 · Cited by 220
Self-citationA step-by-step tutorial on active inference and its application to empirical data
Smith, R., Friston, K. J., & Whyte, C. J. (2022) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2021.102632 · Cited by 246
Self-citationDeeply Felt Affect: The Emergence of Valence in Deep Active Inference
Hesp, C., Smith, R., Parr, T., Allen, M., Friston, K. J., & Ramstead, M. J. D. (2021) · Neural Computation · doi:10.1162/neco_a_01341 · Cited by 246
“Note the factor of 1 / 2 in posterior state beliefs ¯ s τ results from the marginal message-passing approximation introduced by Parr et al. (2019).”
BackgroundInfluentialSelf-citationActive inference on discrete state-spaces: A synthesis
Da Costa, L., Parr, T., Sajid, N., Veselic, S., Neacsu, V., & Friston, K. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102447 · Cited by 226
Self-citationActive Inference: Demystified and Compared
Sajid, N., Ball, P. J., Parr, T., & Friston, K. J. (2021) · Neural Computation · doi:10.1162/neco_a_01357 · Cited by 252
Self-citation
Metadata
- Authors
- Parr, T., Markovic, D., Kiebel, S. J., & Friston, K. J.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- Technische Universität Dresden (DE)
- Corresponding author
- Parr, Thomas
- Venue
- Scientific Reports
- Published
- 2019-02-13
- Volume
- 9
- Issue
- 1
- Pages
- 1889-1889
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC6374414
- OpenAlex
- W2918957485
- Cited by
- 128
- References
- 95
- Citations by year
- 2026: 10 · 2025: 10 · 2024: 7 · 2023: 16 · 2022: 17 · 2021: 32 · 2020: 27 · 2019: 9
- FWCI
- 9.69
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Rosetrees Trust (173346)
- Deutsche Forschungsgemeinschaft (SFB 940/2, Project A9)
- Wellcome Trust (088130/Z/09/Z)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- variational message passing, belief propagation, mean-field approximation, Bethe approximation, free energy principle, hidden Markov models, factor graphs, marginal posterior, neuropsychiatric disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Neuronal message passing using Mean-field, Bethe, and Marginal approximations. https://app.cochat.ai/papers/10.1038/s41598-018-38246-3
- The paper
- Parr, T., Markovic, D., Kiebel, S. J., & Friston, K. J. (2019). Neuronal message passing using Mean-field, Bethe, and Marginal approximations. Scientific Reports. https://doi.org/10.1038/s41598-018-38246-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.