Bayesian Computation in Recurrent Neural Circuits
The DOI matches its Crossref record; 77 of the 78 references it cites were found in a registry or an index.
Abstract
A large number of human psychophysical results have been successfully explained in recent years using Bayesian models. However, the neural implementation of such models remains largely unclear. In this article, we show that a network architecture commonly used to model the cerebral cortex can implement Bayesian inference for an arbitrary hidden Markov model. We illustrate the approach using an orientation discrimination task and a visual motion detection task. In the case of orientation discrimination, we show that the model network can infer the posterior distribution over orientations and correctly estimate stimulus orientation in the presence of significant noise. In the case of motion detection, we show that the resulting model network exhibits direction selectivity and correctly computes the posterior probabilities over motion direction and position. When used to solve the well-known random dots motion discrimination task, the model generates responses that mimic the activities of evidence-accumulating neurons in cortical areas LIP and FEF. The framework we introduce posits a new interpretation of cortical activities in terms of log posterior probabilities of stimuli occurring in the natural world.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Message-passing inference in CSCG is computationally cheap and biologically plausible using simple integrate-and-fire neurons (23).”
From Space is a latent sequence: A theory of the hippocampus (2024) · cites this paper as [23]
In the citing paper
“Moreover, there are population coding mechanisms that could support explicit probabilistic computations (Zemel and Dayan, 1997; Sahani and Dayan, 2003; Rao, 2004; Ma et al., 2006; Eliasmith and Martens, 2011; Gershman and Beck, 2016).”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Rao, 2004
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444 · cited 1×
“We intend to explore the question of synaptic learning using biologically-plausible approximations to the expectation-maximization (EM) algorithm (Dempster, Laird, & Rubin, 1977).”
MethodHebb, D. O. (2005) · doi:10.4324/9781410612403 · Cited by 9,825
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783 · cited 2×
“Such models would provide a better approximation to the multi-layered architecture of the cortex and the hierarchical connections that exist between cortical areas (Felleman & Van Essen, 1991).”
BackgroundRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 4×
“…question is how the suggested framework could be extended to allow neural implementation of hierarchical Bayesian inference in graphical models that are more general than hidden Markov models (cf. (Dayan et al., 1995; Dayan & Hinton, 1996; Hinton & Ghahramani, 1997; Rao & Ballard, 1997, 1999)).”
BackgroundMethodResultInfluentialSelf-citationAn introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775 · cited 1×
“For standard hidden Markov models, the E-step in the EM algorithm is realized by the “forward-backward” algorithm (Rabiner & Juang, 1986).”
MethodTheoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems
Dayan, P., & Abbott, L. F. (2001) · Cited by 4,099
The Handbook of brain theory and neural networks
(1996) · Choice Reviews Online · doi:10.5860/choice.33-4484 · Cited by 3,870
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
Parallel & distributed processing
Slusallek, P., Shirley, P., Mark, W., Stoll, G., & Wald, I. (2005) · ACM SIGGRAPH 2005 Courses on - SIGGRAPH '05 · doi:10.1145/1198555.1198750 · Cited by 2,568
Biophysics of Computation: Information Processing in Single Neurons
Koch, C. (1998) · Oxford University Press eBooks · doi:10.1093/oso/9780195104912.001.0001 · Cited by 2,283
Research works printed but not linked: 1
- 10.1037/0033-295X.106.2.261 · doi:10.1037/0033-295x.106.2.261 · Paper page
Cited by
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
The free-energy principle: a rough guide to the brain?
Friston, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.04.005 · Cited by 1,831
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Shortlist B: A Bayesian model of continuous speech recognition.
Norris, D., & McQueen, J. M. (2008) · Psychological Review · doi:10.1037/0033-295x.115.2.357 · Cited by 686
Probabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615
“Several groups have explored a variation of these ideas in which, rather than coding for the log probability that a feature is present, neurons code for the log probability that a feature takes on a particular value 38–42 .”
Background
Metadata
- Authors
- Rao, R. P. N.
- Affiliations
- University of Washington (US)
- Corresponding author
- Rao, Rajesh P. N.
- ORCID
- Rao, Rajesh P. N.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2004-01-01
- Volume
- 16
- Issue
- 1
- Pages
- 1-38
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2133861842
- Cited by
- 252
- References
- 78
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 5 · 2023: 8 · 2022: 5 · 2021: 8 · 2020: 8 · 2019: 5 · 2018: 12 · 2017: 8 · 2016: 10 · 2015: 12 · 2014: 20 · 2013: 10 · 2012: 16
- FWCI
- 9.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- Bayesian inference, recurrent neural circuits, hidden Markov models, orientation discrimination, visual motion detection, random dot motion, direction selectivity, posterior probability estimation, evidence accumulation, lateral intraparietal area, frontal eye field
- MeSH terms
- Action Potentials, Animals, Bayes Theorem, Cerebral Cortex, Discrimination Learning, Humans, Markov Chains, Motion Perception, Nerve Net, Neural Pathways, Synaptic Transmission, Neurons, Orientation, Pattern Recognition, Visual, Photic Stimulation, Reaction Time, Visual Fields, Artifacts, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bayesian Computation in Recurrent Neural Circuits. https://app.cochat.ai/papers/10.1162/08997660460733976
- The paper
- Rao, R. P. N. (2004). Bayesian Computation in Recurrent Neural Circuits. Neural Computation. https://doi.org/10.1162/08997660460733976
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.