Bayesian Computation in Recurrent Neural Circuits
The DOI matches its Crossref record; 77 of the 78 references it cites were found in a registry or an index.
Abstract
A large number of human psychophysical results have been successfully explained in recent years using Bayesian models. However, the neural implementation of such models remains largely unclear. In this article, we show that a network architecture commonly used to model the cerebral cortex can implement Bayesian inference for an arbitrary hidden Markov model. We illustrate the approach using an orientation discrimination task and a visual motion detection task. In the case of orientation discrimination, we show that the model network can infer the posterior distribution over orientations and correctly estimate stimulus orientation in the presence of significant noise. In the case of motion detection, we show that the resulting model network exhibits direction selectivity and correctly computes the posterior probabilities over motion direction and position. When used to solve the well-known random dots motion discrimination task, the model generates responses that mimic the activities of evidence-accumulating neurons in cortical areas LIP and FEF. The framework we introduce posits a new interpretation of cortical activities in terms of log posterior probabilities of stimuli occurring in the natural world.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Message-passing inference in CSCG is computationally cheap and biologically plausible using simple integrate-and-fire neurons (23).”
From Space is a latent sequence: A theory of the hippocampus (2024) · cites this paper as [23]
In the citing paper
“Moreover, there are population coding mechanisms that could support explicit probabilistic computations (Zemel and Dayan, 1997; Sahani and Dayan, 2003; Rao, 2004; Ma et al., 2006; Eliasmith and Martens, 2011; Gershman and Beck, 2016).”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Rao, 2004
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444 · cited 1×
“We intend to explore the question of synaptic learning using biologically-plausible approximations to the expectation-maximization (EM) algorithm (Dempster, Laird, & Rubin, 1977).”
MethodHebb, D. O. (2005) · doi:10.4324/9781410612403 · Cited by 9,825
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783 · cited 2×
“Such models would provide a better approximation to the multi-layered architecture of the cortex and the hierarchical connections that exist between cortical areas (Felleman & Van Essen, 1991).”
BackgroundRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 4×
“…question is how the suggested framework could be extended to allow neural implementation of hierarchical Bayesian inference in graphical models that are more general than hidden Markov models (cf. (Dayan et al., 1995; Dayan & Hinton, 1996; Hinton & Ghahramani, 1997; Rao & Ballard, 1997, 1999)).”
BackgroundMethodResultInfluentialSelf-citationAn introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775 · cited 1×
“For standard hidden Markov models, the E-step in the EM algorithm is realized by the “forward-backward” algorithm (Rabiner & Juang, 1986).”
MethodTheoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems
Dayan, P., & Abbott, L. F. (2001) · Cited by 4,099
The Handbook of brain theory and neural networks
(1996) · Choice Reviews Online · doi:10.5860/choice.33-4484 · Cited by 3,870
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
Parallel & distributed processing
Slusallek, P., Shirley, P., Mark, W., Stoll, G., & Wald, I. (2005) · ACM SIGGRAPH 2005 Courses on - SIGGRAPH '05 · doi:10.1145/1198555.1198750 · Cited by 2,568
Biophysics of Computation: Information Processing in Single Neurons
Koch, C. (1998) · Oxford University Press eBooks · doi:10.1093/oso/9780195104912.001.0001 · Cited by 2,283
A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants
Neal, R. M., & Hinton, G. E. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_12 · Cited by 2,187 · cited 1×
“…M-step to maximize Q t through gradient ascent with respect to W and M (this actually implements a form of incremental or generalized EM algorithm (Neal & Hinton, 1998)): where (cid:11) and (cid:12) are learning rates, and The above expressions were derived by substituting the right hand side of…”
MethodThe time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152 · cited 4×
“A number of models of decision-making, based typically on diffusion processes or races between variables, have been proposed in the psychological literature (Ratcliff et al., 1999; Luce, 1986; Usher & McClelland, 2001).”
BackgroundMethodInfluentialThe analysis of visual motion: a comparison of neuronal and psychophysical performance
Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04745.1992 · Cited by 1,958 · cited 1×
“These graphs are qualitatively similar to psychometric performance curves obtained in human and monkey experiments (see, for example, (Britten, Shadlen, Newsome, & Movshon, 1992)).”
ResultNeural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755 · cited 7×
“The activity of the “decision neurons” in the model during this task resemble the activity of evidence-accumulating neurons in LIP and FEF, two cortical areas known to be involved in visual decision-making.”
BackgroundMethodInfluentialSingle Units and Sensation: A Neuron Doctrine for Perceptual Psychology?
Barlow, H. B. (1972) · Perception · doi:10.1068/p010371 · Cited by 1,730
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · cited 2×
“We expect ideas from reinforcement learning and Bayesian decision theory as well as recent neurophysiological results in the monkey (Platt & Glimcher, 1999) to be helpful in guiding our research in this direction.”
BackgroundResultRoitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 1×
“The activities of many neurons in this area progressively increase during the motion viewing period, with faster rates of rise for more coherent stimuli (see Figure 12F) (Roitman & Shadlen, 2002).”
BackgroundPerception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Probabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242
Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4
Reynolds, J. H., Chelazzi, L., & Desimone, R. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01736.1999 · Cited by 1,236 · cited 1×
“Evidence for non-linear reductions in firing rates for multiple stimuli in the receptive field comes from some experiments in V1 (DeAngelis, Robson, Ohzawa, & Freeman, 1992) and other attention-related experiments in higher cortical areas (Reynolds, Chelazzi, & Desimone, 1999).”
BackgroundDayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207 · cited 2×
“…question is how the suggested framework could be extended to allow neural implementation of hierarchical Bayesian inference in graphical models that are more general than hidden Markov models (cf. (Dayan et al., 1995; Dayan & Hinton, 1996; Hinton & Ghahramani, 1997; Rao & Ballard, 1997, 1999)).”
BackgroundMethodNeural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145 · cited 2×
“In another study, the saccadic response time distribution of monkeys could be predicted from the time taken by neural activity in area FEF to reach a fixed threshold (Hanes & Schall, 1996), suggesting that these neurons are involved in accumulating evidence (interpreted as log likelihoods) over time.”
BackgroundMotion illusions as optimal percepts
Weiss, Y., Simoncelli, E. P., & Adelson, E. H. (2002) · Nature Neuroscience · doi:10.1038/nn0602-858 · Cited by 1,076 · cited 4×
“The study of such stored “priors” constitutes a major research direction in Bayesian psychophysics (e.g. ( Bloj et al., 1999; Weiss et al., 2002) and chapters in (Rao et al., 2002)).”
BackgroundMethodInfluentialSynaptic reverberation underlying mnemonic persistent activity
Wang, X.-J. (2001) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01868-3 · Cited by 1,059 · cited 1×
“However, it may be possible to achieve longer integration time constants by combining slow synapses (for example, NMDA synapses) with relatively strong recurrent excitation (see, for example, (Seung, 1996; Wang, 2001)).”
BackgroundNeuronal responses to static texture patterns in area V1 of the alert macaque monkey
Knierim, J. J., & van Essen, D. C. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.4.961 · Cited by 1,043 · cited 1×
“Thus, the suppression of neural responses in some cortical areas due to the addition of contextual information (e.g. surround effects in V1 (Knierim & Essen, 1992; Zipser, Lamme, & Schiller, 1996)) or due to increasing familiarity with a stimulus (e.g. response reduction in IT due to stimulus…”
BackgroundPredictive coding: a fresh view of inhibition in the retina
Srinivasan, M. V., Laughlin, S. B., & Dubs, A. (1982) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1982.0085 · Cited by 1,042 · cited 1×
“Such a model of response suppression is similar in spirit to predictive coding models (Srinivasan, Laughlin, & Dubs, 1982; Rao & Ballard, 1999) but differs from these earlier models in assuming that the responses represent log posterior probabilities rather than prediction errors.”
ResultLearning and relearning in Boltzmann machines
Hinton, G. E., & Sejnowski, T. J. (2001) · Graphical Models · doi:10.7551/mitpress/3349.003.0005 · Cited by 1,037 · cited 2×
“Perhaps the earliest neural model of probabilistic inference is the Boltzmann machine (Hinton & Sejnowski, 1983, 1986), a stochastic network of binary units.”
MethodNeural computations that underlie decisions about sensory stimuli
Gold, J. I., & Shadlen, M. N. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01567-9 · Cited by 881 · cited 4×
“There is converging evidence that decisions are made based on the log of the likelihood ratio of one alternative over another (Carpenter & Williams, 1995; Gold & Shadlen, 2001).”
BackgroundResultInfluentialContextual modulation in primary visual cortex
Zipser, K., Lamme, V. A. F., & Schiller, P. H. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-22-07376.1996 · Cited by 873 · cited 1×
“Thus,thesuppression of neural responses in somecortical areas due to the addition of contextual information, such as surround effects in V1 (Knierim & Van Essen, 1992; Zipser, Lamme, & Schiller, 1996 ), or due to increasing familiarity with a stimulus, such as response reduction in IT due to stimulus repetition (Mille…”
BackgroundNeural computation of log likelihood in control of saccadic eye movements
Carpenter, R. H. S., & Williams, M. L. L. (1995) · Nature · doi:10.1038/377059a0 · Cited by 823 · cited 7×
“In these experiments (Carpenter & Williams, 1995), a human subject was required to make an eye movement to a dim target that appeared randomly to the left or right of a fixation point after a random delay of 0.5–1.5 seconds.”
BackgroundMethodInfluentialInformation processing with population codes
Pouget, A., Dayan, P., & Zemel, R. (2000) · Nature Reviews Neuroscience · doi:10.1038/35039062 · Cited by 752 · cited 1×
“…of neural tuning curves or basis functions and have typically focused on the estimation of static quantities such as stimulus position or orientation (Anderson & Van Essen, 1994; Zemel, Dayan, & Pouget, 1998; Deneve, Latham, & Pouget, 1999; Pouget, Dayan, & Zemel, 2000; Eliasmith & Anderson, 2003).”
BackgroundZhang, K., Ginzburg, I., McNaughton, B. L., & Sejnowski, T. J. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.79.2.1017 · Cited by 741 · cited 1×
“A second class of models addresses this problem using a generative approach, where an encoding model is first assumed and a Bayesian decoding model is used to estimate the stimulus x (or its distribution), given a set of responses ri ( Zhang, Ginzburg, McNaughton, & Sejnowski, 1998; Pouget, Zhang, Deneve, & Latham, 19…”
MethodA Neural Mechanism for Working and Recognition Memory in Inferior Temporal Cortex
Miller, E. K., Li, L., & Desimone, R. (1991) · Science · doi:10.1126/science.1962197 · Cited by 706 · cited 1×
“…& Essen, 1992; Zipser, Lamme, & Schiller, 1996)) or due to increasing familiarity with a stimulus (e.g. response reduction in IT due to stimulus repetition (Miller, Li, & Desimone, 1991)) can be interpreted as increases in posterior probabilities of the state encoded by the recorded neurons.”
BackgroundConnectionist and diffusion models of reaction time.
Ratcliff, R., Van Zandt, T., & McKoon, G. (1999) · Psychological Review · doi:10.1037//0033-295x.106.2.261 · Cited by 591 · cited 1×
“A number of models of decision-making, based typically on diffusion processes or races between variables, have been proposed in the psychological literature (Ratcliff et al., 1999; Luce, 1986; Usher & McClelland, 2001).”
BackgroundHinton, G. E., & Sejnowski, J. (1983) · Cited by 562
Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems
(2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.826381 · Cited by 543
How the brain keeps the eyes still
Seung, H. S. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.23.13339 · Cited by 534
Forming sparse representations by local anti-Hebbian learning
Földiák, P. (1990) · Biological Cybernetics · doi:10.1007/bf02331346 · Cited by 528 · cited 1×
“Thus, both learning rules remain anti-Hebbian and encourage decorrelation (F¨oldi´ak, 1990) unless the net feedforward and recurrent input ( u i ( t ) ) is high enough to make the joint probability of the state i and the current input exceed the threshold of (1 =e ) e Q t ( W ; M ) .”
BackgroundNEURAL SELECTION AND CONTROL OF VISUALLY GUIDED EYE MOVEMENTS
Schall, J. D., & Thompson, K. G. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.241 · Cited by 489 · cited 1×
“Figure 12E shows the activity of a neuron in the frontal eye fields (FEF) for fast, medium, and slow responses to a visual target (Schall & Hanes, 1998; Schall & Thompson, 1999).”
BackgroundThe influence of urgency on decision time
Reddi, B. A. J., & Carpenter, R. H. S. (2000) · Nature Neuroscience · doi:10.1038/77739 · Cited by 411 · cited 5×
“The output of the model is , where c is a “confidence threshold” that depends on task constraints (for example, accuracy versus speed requirements) (Reddi & Carpenter, 2000).”
BackgroundMethodInfluentialReading population codes: a neural implementation of ideal observers
Deneve, S., Latham, P. E., & Pouget, A. (1999) · Nature Neuroscience · doi:10.1038/11205 · Cited by 392 · cited 1×
“…of neural tuning curves or basis functions and have typically focused on the estimation of static quantities such as stimulus position or orientation (Anderson & Van Essen, 1994; Zemel, Dayan, & Pouget, 1998; Deneve, Latham, & Pouget, 1999; Pouget, Dayan, & Zemel, 2000; Eliasmith & Anderson, 2003).”
BackgroundSynaptic integration in an excitable dendritic tree
Mel, B. W. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.70.3.1086 · Cited by 391 · cited 2×
“Indeed, it has been suggested that multiplicative interactions between inputs may occur in dendrites of cortical cells (Mel, 1993), which could perhaps allow Equation 5 to be directly implemented in a recurrent circuit (cf.”
BackgroundProbabilistic Models of the Brain : Perception and Neural Function
Rao, R. P. N., Olshausen, B. A., & Lewicki, M. S. (2002) · Cited by 385
Self-citationOrganization of suppression in receptive fields of neurons in cat visual cortex
DeAngelis, G. C., Robson, J. G., Ohzawa, I., & Freeman, R. D. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.1.144 · Cited by 355 · cited 1×
“Evidence for non-linear reductions in firing rates for multiple stimuli in the receptive field comes from some experiments in V1 (DeAngelis, Robson, Ohzawa, & Freeman, 1992) and other attention-related experiments in higher cortical areas (Reynolds, Chelazzi, & Desimone, 1999).”
BackgroundProbabilistic Interpretation of Population Codes
Zemel, R. S., Dayan, P., & Pouget, A. (1998) · Neural Computation · doi:10.1162/089976698300017818 · Cited by 333
Perception of three-dimensional shape influences colour perception through mutual illumination
Bloj, M. G., Kersten, D., & Hurlbert, A. C. (1999) · Nature · doi:10.1038/47245 · Cited by 306 · cited 2×
“The study of such stored “priors” constitutes a major research direction in Bayesian psychophysics (e.g. ( Bloj et al., 1999; Weiss et al., 2002) and chapters in (Rao et al., 2002)).”
BackgroundProbabilistic Interpretation of Population Codes
Zemel, R. S., Dayan, P., & Pouget, A. (1999) · Neural Codes and Distributed Representations · doi:10.7551/mitpress/4924.003.0011 · Cited by 305
Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex
Rao, R. P. N., & Ballard, D. H. (1997) · Neural Computation · doi:10.1162/neco.1997.9.4.721 · Cited by 290 · cited 3×
“…question is how the suggested framework could be extended to allow neural implementation of hierarchical Bayesian inference in graphical models that are more general than hidden Markov models (cf. (Dayan et al., 1995; Dayan & Hinton, 1996; Hinton & Ghahramani, 1997; Rao & Ballard, 1997, 1999)).”
BackgroundMethodSelf-citationGenerative models for discovering sparse distributed representations
Hinton, G. E., & Ghahramani, Z. (1997) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1997.0101 · Cited by 220 · cited 3×
“…question is how the suggested framework could be extended to allow neural implementation of hierarchical Bayesian inference in graphical models that are more general than hidden Markov models (cf. (Dayan et al., 1995; Dayan & Hinton, 1996; Hinton & Ghahramani, 1997; Rao & Ballard, 1997, 1999)).”
BackgroundMethodStatistically Efficient Estimation Using Population Coding
Pouget, A., Zhang, K., Deneve, S., & Latham, P. E. (1998) · Neural Computation · doi:10.1162/089976698300017809 · Cited by 212 · cited 1×
“…is first assumed and a Bayesian decoding model is used to estimate the stimulus x (or its distribution), given a set of responses r i (Zhang, Ginzburg, McNaughton, & Sejnowski, 1998; Pouget, Zhang, Deneve, & Latham, 1998; Zemel et al., 1998; Zemel & Dayan, 1999; Wu, Chen, Niranjan, & Amari, 2003).”
MethodInterpreting Neural Response Variability as Monte Carlo Sampling of the Posterior
Hoyer, P. O., & Hyvärinen, A. (2002) · neural information processing systems · Cited by 200
Decisions, Decisions, Decisions
Glimcher, P. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00962-5 · Cited by 176 · cited 1×
“Other recent models have focused on establishing a relation between the effects of rewards on decision making and concepts from decision theory and game theory (Platt & Glimcher, 1999; Glimcher, 2002).”
BackgroundKoch, C. (2004) · Oxford University Press eBooks · Cited by 174
An optimal estimation approach to visual perception and learning
Rao, R. P. N. (1999) · Vision Research · doi:10.1016/s0042-6989(98)00279-x · Cited by 164 · cited 4×
“Finally, Rao and Ballard have suggested a hierarchical model for neural computation based on Kalman filtering (or predictive coding) (Rao & Ballard, 1997, 1999; Rao, 1999).”
MethodInfluentialSelf-citationBayesian inference and attentional modulation in the visual cortex
Rao, R. P. N. (2005) · NeuroReport · doi:10.1097/01.wnr.0000183900.92901.fc · Cited by 161
Self-citationUsing Bayes' Rule to Model Multisensory Enhancement in the Superior Colliculus
Anastasio, T. J., Patton, P. E., & Belkacem-Boussaid, K. (2000) · Neural Computation · doi:10.1162/089976600300015547 · Cited by 150 · cited 1×
“Such a model for spiking can be viewed as a variant of the noisy threshold model,wherethecellspikesifitspotentialexceedsanoisythreshold.Asdee nedabove,thespikingprobabilityofaneuronbecomesexactlyequaltothe posterior probability of the neuron’ s preferred state µi given the inputs (see also Anastasio, Patton, & Belkace…”
BackgroundVarieties of Helmholtz Machine
Dayan, P., & Hinton, G. E. (1996) · Neural Networks · doi:10.1016/s0893-6080(96)00009-3 · Cited by 136 · cited 2×
“…question is how the suggested framework could be extended to allow neural implementation of hierarchical Bayesian inference in graphical models that are more general than hidden Markov models (cf. (Dayan et al., 1995; Dayan & Hinton, 1996; Hinton & Ghahramani, 1997; Rao & Ballard, 1997, 1999)).”
BackgroundMethodDistributed representation and analysis of visual motion
Simoncelli, E. P. (1993) · Cited by 131
Alpha-nets: A recurrent ‘neural’ network architecture with a hidden Markov model interpretation
Bridle, J. S. (1990) · Speech Communication · doi:10.1016/0167-6393(90)90049-f · Cited by 129 · cited 3×
“Bridle first suggested that statistical inference for hidden Markov models could be implemented using a modification of the standard recurrent neural network (Bridle, 1990).”
BackgroundMethodWelch, D. A. (2001) · Cited by 110
PATTERN RECOGNITION AND THE RESPONSES OF SENSORY NEURONS*
Barlow, H. B. (1969) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1969.tb14019.x · Cited by 93 · cited 1×
“2 A different model based also on a negative log encoding scheme has been suggested by Barlow (1969, 1972) .”
MethodGraphical models: Probabilistic inference
Jordan, M. I., & Weiss, Y. (2002) · Cited by 68
Computing with Continuous Attractors: Stability and Online Aspects
Wu, S., & Amari, S.-I. (2005) · Neural Computation · doi:10.1162/0899766054615626 · Cited by 65
Koechlin, É., Anton, J. L., & Burnod, Y. (1999) · Biological Cybernetics · doi:10.1007/s004220050502 · Cited by 61 · cited 1×
“Several probabilistic models have also been suggested for solving specie c problems in visual motion processing such as the aperture problem (Simoncelli, 1993; Koechlin, Anton, & Burnod, 1999; Zemel & Dayan, 1999; Ascher & Grzywacz, 2000; Freeman, Haddon, & Pasztor, 2002; Weiss & Fleet, 2002; Weiss et al., 2002) These…”
MethodBayesian Unsupervised Learning of Higher Order Structure
Lewicki, M. S., & B, T. J. S. A. (1996) · neural information processing systems · Cited by 54
A Bayesian model for the measurement of visual velocity
Ascher, D., & Grzywacz, N. M. (2000) · Vision Research · doi:10.1016/s0042-6989(00)00176-0 · Cited by 47 · cited 1×
“…models have also been suggested for solving specific problems in visual motion processing such as the aperture problem (Simoncelli, 1993; Koechlin, Anton, & Burnod, 1999; Zemel & Dayan, 1999; Ascher & Grzywacz, 2000; Freeman, Haddon, & Pasztor, 2002; Weiss & Fleet, 2002; Weiss et al., 2002).”
Neural mechanisms of selection and control of visually guided eye movements
Schall, J. D., & Hanes, D. P. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00059-8 · Cited by 46 · cited 1×
“Figure 12E shows the activity of a neuron in the frontal eye fields (FEF) for fast, medium, and slow responses to a visual target (Schall & Hanes, 1998; Schall & Thompson, 1999).”
BackgroundDistributional Population Codes and Multiple Motion Models
Zemel, R. S., & Dayan, P. (1999) · MPG.PuRe (Max Planck Society) · Cited by 27
Sequential Bayesian Decoding with a Population of Neurons
Wu, S., Chen, D., Niranjan, M., & Амари, Ш.-И. (2003) · Neural Computation · doi:10.1162/089976603765202631 · Cited by 24 · cited 1×
“A second class of models addresses this problem using a generative approach, where an encoding model is e rst assumed and a Bayesian decoding model is used to estimate the stimulus x (or its distribution), given a set of responses ri (Zhang, Ginzburg, McNaughton, & Sejnowski, 1998; Pouget, Zhang, Deneve, & Latham, 199…”
MethodInferring figure-ground using a recurrent integrate-and-fire neural circuit
Baek, K., & Sajda, P. (2005) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2005.847388 · Cited by 22
Why aren’t all deep superior colliculus neurons multisensory? A Bayes’ ratio analysis
Colonius, H., & Diederich, A. (2004) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.4.3.344 · Cited by 20
Integration of form and motion within a generative model of visual cortex
Sajda, P., & Baek, K. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.03.013 · Cited by 14
Unifying perspectives on neuronal codes and processing
Anderson, C. H. (1996) · Lecture notes in computer science · doi:10.1007/3-540-61510-5_6 · Cited by 13 · cited 1×
“One class of approaches uses basis functions to represent probability distributions within neuronal ensembles (Anderson & Van Essen, 1994; Anderson, 1995; Deneve & Pouget, 2001; Eliasmith & Anderson, 2003).”
BackgroundFluctuation-Dissipation Theorem and Models of Learning
Nemenman, I. M. (2005) · Neural Computation · doi:10.1162/0899766054322982 · Cited by 13
Schwabe, L., & Obermayer, K. (2005) · Vision Research · doi:10.1016/j.visres.2005.05.028 · Cited by 5
Population approach to a neural discrimination task
Gaillard, B., Buxton, H., & Feng, J. (2005) · Biological Cybernetics · doi:10.1007/s00422-005-0039-3 · Cited by 4
Inferring direction of figure using a recurrent integrate-and-fire neural circuit
Baek, K., Kim, D., & Sajda, P. (2005) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2004.1404269 · Cited by 1
Research works printed but not linked: 1
- 10.1037/0033-295X.106.2.261 · doi:10.1037/0033-295x.106.2.261 · Paper page
Cited by
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
The free-energy principle: a rough guide to the brain?
Friston, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.04.005 · Cited by 1,831
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Shortlist B: A Bayesian model of continuous speech recognition.
Norris, D., & McQueen, J. M. (2008) · Psychological Review · doi:10.1037/0033-295x.115.2.357 · Cited by 686
Probabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615
“Several groups have explored a variation of these ideas in which, rather than coding for the log probability that a feature is present, neurons code for the log probability that a feature takes on a particular value 38–42 .”
Background
Metadata
- Authors
- Rao, R. P. N.
- Affiliations
- University of Washington (US)
- Corresponding author
- Rao, Rajesh P. N.
- ORCID
- Rao, Rajesh P. N.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2004-01-01
- Volume
- 16
- Issue
- 1
- Pages
- 1-38
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2133861842
- Cited by
- 252
- References
- 78
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 5 · 2023: 8 · 2022: 5 · 2021: 8 · 2020: 8 · 2019: 5 · 2018: 12 · 2017: 8 · 2016: 10 · 2015: 12 · 2014: 20 · 2013: 10 · 2012: 16
- FWCI
- 9.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- Bayesian inference, recurrent neural circuits, hidden Markov models, orientation discrimination, visual motion detection, random dot motion, direction selectivity, posterior probability estimation, evidence accumulation, lateral intraparietal area, frontal eye field
- MeSH terms
- Action Potentials, Animals, Bayes Theorem, Cerebral Cortex, Discrimination Learning, Humans, Markov Chains, Motion Perception, Nerve Net, Neural Pathways, Synaptic Transmission, Neurons, Orientation, Pattern Recognition, Visual, Photic Stimulation, Reaction Time, Visual Fields, Artifacts, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.