Synaptic plasticity as Bayesian inference
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Learning, especially rapid learning, is critical for survival. However, learning is hard; a large number of synaptic weights must be set based on noisy, often ambiguous, sensory information. In such a high-noise regime, keeping track of probability distributions over weights is the optimal strategy. Here we hypothesize that synapses take that strategy; in essence, when they estimate weights, they include error bars. They then use that uncertainty to adjust their learning rates, with more uncertain weights having higher learning rates. We also make a second, independent, hypothesis: synapses communicate their uncertainty by linking it to variability in postsynaptic potential size, with more uncertainty leading to more variability. These two hypotheses cast synaptic plasticity as a problem of Bayesian inference, and thus provide a normative view of learning. They generalize known learning rules, offer an explanation for the large variability in the size of postsynaptic potentials and make falsifiable experimental predictions. We propose that synapses compute probability distributions over weights, not just point estimates. Using probabilistic inference, we derive a new set of synaptic learning rules and show that they speed up learning in neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
Structural basis of long-term potentiation in single dendritic spines
Matsuzaki, M., Honkura, N., Ellis-Davies, G. C. R., & Kasai, H. (2004) · Nature · doi:10.1038/nature02617 · Cited by 2,483
Synaptic tagging and long-term potentiation
Frey, U., & Morris, R. G. M. (1997) · Nature · doi:10.1038/385533a0 · Cited by 1,736
Highly nonrandom features of synaptic connectivity in local cortical circuits
Song, S., Sjöström, P. J., Reigl, M., Nelson, S., & Chklovskii, D. B. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030068 · Cited by 1,512
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Self-citationSüdhof, T. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.06.012 · Cited by 1,251
Making memories last: the synaptic tagging and capture hypothesis
Redondo, R. L., & Morris, R. G. M. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn2963 · Cited by 792
Cited by
Filopodia are a structural substrate for silent synapses in adult neocortex
Vardalaki, D., Chung, K., & Harnett, M. T. (2022) · Nature · doi:10.1038/s41586-022-05483-6 · Cited by 96
Incorporating neuro-inspired adaptability for continual learning in artificial intelligence
Wang, L., Zhang, X., Li, Q., Zhang, M., Su, H., Zhu, J., & Zhong, Y. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00747-w · Cited by 91
Pennartz, C. M. A. (2022) · Behavioural Brain Research · doi:10.1016/j.bbr.2022.113969 · Cited by 40
Tottori, T., & Kobayashi, T. J. (2025) · Physical Review Research · doi:10.1103/gvl6-cvby · Cited by 6
Metadata
- Authors
- Aitchison, L., Jegminat, J., Menendez, J. A., Pfister, J.-P., Pouget, A., & Latham, P. E.
- Venue
- Nature Neuroscience
- Published
- 2021-03-11
- Volume
- 24
- Issue
- 4
- Pages
- 565-571
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W3135825807
- Cited by
- 83
- References
- 18
- FWCI
- 6.67
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Synaptic plasticity as Bayesian inference. https://app.cochat.ai/papers/10.1038/s41593-021-00809-5
- The paper
- Aitchison, L., Jegminat, J., Menendez, J. A., Pfister, J.-P., Pouget, A., & Latham, P. E. (2021). Synaptic plasticity as Bayesian inference. Nature Neuroscience. https://doi.org/10.1038/s41593-021-00809-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.