Causal Inference and Explaining Away in a Spiking Network
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
While the brain uses spiking neurons for communication, theoretical research on brain computations has mostly focused on non-spiking networks. The nature of spike-based algorithms that achieve complex computations, such as object probabilistic inference, is largely unknown. Here we demonstrate that a family of high-dimensional quadratic optimization problems with non-negativity constraints can be solved exactly and efficiently by a network of spiking neurons. The network naturally imposes the non-negativity of causal contributions that is fundamental to causal inference and uses simple operations, such as linear synapses with realistic time constants and neural spike generation and reset non-linearities. The network infers the set of most likely causes from an observation using explaining away, which is dynamically implemented by spike-based, tuned inhibition. The algorithm performs remarkably well even when the network intrinsically generates variable spike trains, the timing of spikes is scrambled by external sources of noise, or the network is mistuned. This type of network might underlie tasks such as odor identification and classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
A learning algorithm for Boltzmann machines
Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985) · Cognitive Science · doi:10.1207/s15516709cog0901_7 · Cited by 3,402
Homeostatic plasticity in the developing nervous system
Turrigiano, G. G., & Nelson, S. B. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1327 · Cited by 2,485 · cited 1×
“Homeostatic and synaptic learning mechanisms exist that might aid the stability of a network 37 and can be implemented efficiently by inhibitory synaptic plasticity 38 .”
BackgroundShadlen, M. N., & Newsome, W. T. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-10-03870.1998 · Cited by 2,178 · cited 1×
“Neurons in cortex fire in a variable way to repeated presentations to the same stimulus 33,34 and this variability is correlated across cells 46,47 .”
BackgroundSoftky, W., & Koch, C. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-01-00334.1993 · Cited by 1,689 · cited 3×
“Neurons in cortex fire in a variable way to repeated presentations to the same stimulus 33,34 and this variability is correlated across cells 46,47 .”
BackgroundMethodResultInfluentialBayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457 · cited 1×
“(12), where δ(t) is the delta-function.”
Object perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269 · cited 1×
“We show in this section that our spiking network can exactly (1) discriminate a cause among a multitude of others with just a handful of spikes, (2) identify the components of a complex mixture, and (3) approximate an odd input vector.”
BackgroundProbabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242
Correlated neuronal discharge rate and its implications for psychophysical performance
Zohary, E., Shadlen, M. N., & Newsome, W. T. (1994) · Nature · doi:10.1038/370140a0 · Cited by 1,237 · cited 1×
“Neurons in cortex fire in a variable way to repeated presentations to the same stimulus 33,34 and this variability is correlated across cells 46,47 .”
BackgroundCompte, A. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.9.910 · Cited by 1,143
Theory-based Bayesian models of inductive learning and reasoning
Tenenbaum, J. B., Griffiths, T. L., & Kemp, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.009 · Cited by 880
Statistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672 · cited 5×
“(6) over r at fixed μ is equivalent to minimizing the energy function”
BackgroundInfluentialHow the brain keeps the eyes still
Seung, H. S. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.23.13339 · Cited by 534 · cited 1×
“Because the N × N connectivity matrix J is a low rank matrix with rank M ≪ N , the neuronal dynamics offers a highly overcomplete representation of the input space and becomes a multi-dimensional attractor 35 .”
BackgroundBuesing, L., Bill, J., Nessler, B., & Maass, W. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002211 · Cited by 384
Bayesian sampling in visual perception
Moreno-Bote, R., Knill, D. C., & Pouget, A. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101430108 · Cited by 182
Self-citationNeuronal circuits underlying persistent representations despite time varying activity
Druckmann, S., & Chklovskii, D. B. (2012) · Current Biology · doi:10.1016/j.cub.2012.08.058 · Cited by 174 · cited 4×
“In this scenario, which is specific to the overcomplete representation of inputs, the same stimulus can be faithfully represented by potentially many different activity patterns consisting of different sets of neurons being active and representing different combination of causes 13 .”
BackgroundInfluential
Cited by
Efficient codes and balanced networks
Denève, S., & Machens, C. K. (2016) · Nature Neuroscience · doi:10.1038/nn.4243 · Cited by 471
“16–21).”
BackgroundHigh-Level Prediction Signals in a Low-Level Area of the Macaque Face-Processing Hierarchy
Schwiedrzik, C. M., & Freiwald, W. A. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.007 · Cited by 136
Neural correlates of sparse coding and dimensionality reduction
Beyeler, M., Rounds, E. L., Carlson, K. D., Dutt, N., & Krichmar, J. L. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006908 · Cited by 104
“Examples include elucidating the dimensions along which perceptual space is organized in the olfactory system [47, 48], the coordination of movement in the cortico-basal ganglia-thalamo-cortical loop [3, 49], and the combined representation of allocentric and route-based spatial navigation cues in retrosplenial cortex…”
BackgroundCausal inference accounts for heading perception in the presence of object motion
Dokka, K., Park, H., Jansen, M., DeAngelis, G. C., & Angelaki, D. E. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1820373116 · Cited by 80
“For example, information about causes might be encoded in slow variations of the firing rates of neural populations (58).”
BackgroundCortical reliability amid noise and chaos
Nolte, M., Reimann, M. W., King, J. G., Markram, H., & Muller, E. B. (2019) · Nature Communications · doi:10.1038/s41467-019-11633-8 · Cited by 56
Metadata
- Authors
- Moreno-Bote, R., & Drugowitsch, J.
- Venue
- Scientific Reports
- Published
- 2015-12-01
- Volume
- 5
- Issue
- 1
- Pages
- 17531-17531
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W2417747970
- Cited by
- 39
- References
- 16
- FWCI
- 0.74
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.