Complex Probabilistic Inference: From Cognition to Neural Computation
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Our understanding of probabilistic inference in the brain has progressed rapidly. However, there remains a big gap between the relatively simple probabilistic inference problems facing low-level sensory systems and the intractably complex problems facing high-level cognitive sys- tems. Psychologists have begun exploring cognitively plausible algorithms for approximately solving complex inference problems. We review recent attempts to connect these algorithmic accounts to neural circuit mechanisms, and argue that neural mechanisms for solving low-level sensory inference problems can be extended to tackle complex inference problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
A learning algorithm for Boltzmann machines
Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985) · Cognitive Science · doi:10.1207/s15516709cog0901_7 · Cited by 3,402
Canonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 1×
“, a canonical microcircuit; [66]) that applies universally? If the former, do different brain areas implement different approximations, or does the same area implement different approximations under different circumstances? One possibility is that the brain is designed to flexibly exploit the strengths and weaknesses…”
BackgroundHow to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815
Robust Monte Carlo localization for mobile robots
Thrun, S., Fox, D., Burgard, W., & Dellaert, F. (2001) · Artificial Intelligence · doi:10.1016/s0004-3702(01)00069-8 · Cited by 1,809 · cited 1×
“Particle filters have been successfully applied to problems with dynamical structure like object tracking [23] and robot navigation [24].”
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Self-citationPerception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Object perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269 · cited 1×
“Bayesian models have been applied to a wide variety of perceptual phenomena [14, 15], and form the cornerstone of signal detection theory [16].”
BackgroundMacmillan, N. A., & Creelman, C. D. (2004) · doi:10.4324/9781410611147 · Cited by 1,269
Topics in semantic representation
Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.211 · Cited by 1,122
Probabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615 · cited 1×
“Understanding the nature of these representations and how they are computed is the goal of a vigorous program of research [1].”
BackgroundSelf-citationNeural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554 · cited 1×
“It is worth nothing that this process could have been inverted: We could have started out by assuming that the evidence integration or cue combination operation is implemented by neurons that linearly combine their inputs, as has been observed in multisensory tasks such as [56] and most famously in sequential evidence…”
BackgroundVul (2014) · doi:10.1111/cogs.12101 · Cited by 502
A rational analysis of rule-based concept learning
Goodman, N. D., Tenenbaum, J. B., Feldman, J., & Griffiths, T. L. (2008) · Cognitive Science · doi:10.1080/03640210701802071 · Cited by 469
Probabilistic models of language processing and acquisition
Chater, N., & Manning, C. D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.006 · Cited by 411 · cited 1×
“The same principles, applied to different generative models, have been used to explain more complex cognitive phenomena, such as causal reasoning [17], semantic memory [18], language processing [19], and concept learning [20, 21, 22].”
BackgroundTowards a mathematical theory of cortical micro-circuits
George, D., & Hawkins, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000532 · Cited by 404 · cited 2×
“A variety of neural schemes for complex inference have been proposed [6, 7, 8, 9, 10], but so far these have made relatively little contact with the rich literature on psychological mechanisms.”
BackgroundBuesing, L., Bill, J., Nessler, B., & Maass, W. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002211 · Cited by 384 · cited 13×
“[7] proposed a mapping between spikes and samples that allows for the discrete nature of MCMC sampling to be implemented by continuous time spiking dynamics of neurons.”
BackgroundInfluentialRational approximations to rational models: alternative algorithms for category learning
Sanborn, A. N., Griffiths, T. L., & Navarro, D. J. (2010) · Psychological Review · doi:10.1037/a0020511 · Cited by 369 · cited 1×
“This form of explanation has been invoked to explain failures of change detection [51], object tracking [50], category learning [52], and word segmentation [53].”
BackgroundNot Noisy, Just Wrong: The Role of Suboptimal Inference in Behavioral Variability
Beck, J. M., Ma, W. J., Pitkow, X., Latham, P. E., & Pouget, A. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.016 · Cited by 316 · cited 1×
“[49] have argued that behavioral variability may be explained by suboptimal, deterministic inference algorithms.”
BackgroundSelf-citationProbability matching as a computational strategy used in perception
Wozny, D. R., Beierholm, U. R., & Shams, L. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000871 · Cited by 265
Bayesian Computation in Recurrent Neural Circuits
Rao, R. P. N. (2004) · Neural Computation · doi:10.1162/08997660460733976 · Cited by 252 · cited 2×
“For example, Rao [64] proposed a neural implementation of the sum-product message passing algorithm implemented in the log probability domain.”
BackgroundMethodBayesian sampling in visual perception
Moreno-Bote, R., Knill, D. C., & Pouget, A. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101430108 · Cited by 182
Multistability and perceptual inference
Gershman, S. J., Vul, E., & Tenenbaum, J. B. (2012) · Neural Computation · doi:10.1162/neco_a_00226 · Cited by 140 · cited 13×
“In related work, Moreno-Bote et al. [48] showed how an attractor neural network implementing another form of MCMC (Langevin Monte Carlo) could account for multistable perception of drifting gratings.”
BackgroundResultRational variability in children's causal inferences: the sampling hypothesis
Denison, S., Bonawitz, E., Gopnik, A., & Griffiths, T. L. (2013) · Cognition · doi:10.1016/j.cognition.2012.10.010 · Cited by 126
Types of approximation for probabilistic cognition: Sampling and variational.
Sanborn, A. N. (2017) · Brain and Cognition · doi:10.1016/j.bandc.2015.06.008 · Cited by 45 · cited 2×
“Both families have been explored as psychologically plausible mechanistic models of probabilistic inference [13].”
BackgroundAmortized Hypothesis Generation
Dasgupta, I., Schulz, E., Goodman, N. D., & Gershman, S. J. (2017) · doi:10.1101/137190 · Cited by 7
Self-citation
Cited by
(2021) · UCL Discovery (University College London) · Cited by 141
The Generative Adversarial Brain
Gershman, S. J. (2019) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2019.00018 · Cited by 89
Self-citationA theory of learning to infer.
Dasgupta, I., Schulz, E., Tenenbaum, J. B., & Gershman, S. J. (2020) · Psychological Review · doi:10.1037/rev0000178 · Cited by 70
Self-citation
Metadata
- Authors
- Gershman, S. J., & Beck, J. M.
- Venue
- Computational Models of Brain and Behavior
- Publisher
- Wiley
- Published
- 2017-09-11
- Pages
- 453-466
- OpenAlex
- W2755433381
- Cited by
- 28
- References
- 26
- Type
- other
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.