A few strong connections: optimizing information retention in neuronal avalanches
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Background: How living neural networks retain information is still incompletely understood. Two prominent ideas on this topic have developed in parallel, but have remained somewhat unconnected. The first of these, the "synaptic hypothesis," holds that information can be retained in synaptic connection strengths, or weights, between neurons. Recent work inspired by statistical mechanics has suggested that networks will retain the most information when their weights are distributed in a skewed manner, with many weak weights and only a few strong ones. The second of these ideas is that information can be represented by stable activity patterns. Multineuron recordings have shown that sequences of neural activity distributed over many neurons are repeated above chance levels when animals perform well-learned tasks. Although these two ideas are compelling, no one to our knowledge has yet linked the predicted optimum distribution of weights to stable activity patterns actually observed in living neural networks. Results: Here, we explore this link by comparing stable activity patterns from cortical slice networks recorded with multielectrode arrays to stable patterns produced by a model with a tunable weight distribution. This model was previously shown to capture central features of the dynamics in these slice networks, including neuronal avalanche cascades. We find that when the model weight distribution is appropriately skewed, it correctly matches the distribution of repeating patterns observed in the data. In addition, this same distribution of weights maximizes the capacity of the network model to retain stable activity patterns. Thus, the distribution that best fits the data is also the distribution that maximizes the number of stable patterns. Conclusions: We conclude that local cortical networks are very likely to use a highly skewed weight distribution to optimize information retention, as predicted by theory. Fixed distributions impose constraints on learning, however. The network must have mechanisms for preserving the overall weight distribution while allowing individual connection strengths to change with learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 2×
“In the recurrent Hopfield neural network model [8], storage capacity is actually reduced if each unit has too many strong connections.”
BackgroundThe perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Neuronal Avalanches in Neocortical Circuits
Beggs, J. M., & Plenz, D. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-35-11167.2003 · Cited by 2,325
Self-citationCoordinated memory replay in the visual cortex and hippocampus during sleep
Ji, D., & Wilson, M. A. (2007) · Nature Neuroscience · doi:10.1038/nn1825 · Cited by 1,669 · cited 3×
“This is an important topic for exploration because in vivo studies have increasingly suggested that memories in behaving animals are linked to spatio-temporal activity patterns, and not to static configurations of active neurons [21,24-26].”
BackgroundHighly nonrandom features of synaptic connectivity in local cortical circuits
Song, S., Sjöström, P. J., Reigl, M., Nelson, S., & Chklovskii, D. B. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030068 · Cited by 1,512
Internally Generated Cell Assembly Sequences in the Rat Hippocampus
Pastalkova, E., Itskov, V., Amarasingham, A., & Buzsáki, G. (2008) · Science · doi:10.1126/science.1159775 · Cited by 1,301
Spontaneously emerging cortical representations of visual attributes
Kenet, T., Bibitchkov, D., Tsodyks, M., Grinvald, A., & Arieli, A. (2003) · Nature · doi:10.1038/nature02078 · Cited by 924 · cited 1×
“In addition, the reproducible activity patterns seen in cultures and in slices are similar to each other [15,17,48], and are remarkably similar to activity patterns seen in vivo [49-51].”
ResultSynfire Chains and Cortical Songs: Temporal Modules of Cortical Activity
Ikegaya, Y., Aaron, G., Cossart, R., Aronov, D., Lampl, I., Ferster, D., & Yuste, R. (2004) · Science · doi:10.1126/science.1093173 · Cited by 838
Origin of Slow Cortical Oscillations in Deafferented Cortical Slabs
Timofeev, I. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.12.1185 · Cited by 710 · cited 1×
“In addition, the reproducible activity patterns seen in cultures and in slices are similar to each other [15,17,48], and are remarkably similar to activity patterns seen in vivo [49-51].”
ResultAttractor dynamics of network UP states in the neocortex
Cossart, R., Aronov, D., & Yuste, R. (2003) · Nature · doi:10.1038/nature01614 · Cited by 659 · cited 1×
“In addition, the reproducible activity patterns seen in cultures and in slices are similar to each other [15,17,48], and are remarkably similar to activity patterns seen in vivo [49-51].”
ResultFast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep
Euston, D. R., Tatsuno, M., & McNaughton, B. L. (2007) · Science · doi:10.1126/science.1148979 · Cited by 586 · cited 3×
“This is an important topic for exploration because in vivo studies have increasingly suggested that memories in behaving animals are linked to spatio-temporal activity patterns, and not to static configurations of active neurons [21,24-26].”
BackgroundThe criticality hypothesis: how local cortical networks might optimize information processing
Beggs, J. M. (2008) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2092 · Cited by 533
Self-citationSong replay during sleep and computational rules for sensorimotor vocal learning
Dave, A. S., & Margoliash, D. (2000) · Science · doi:10.1126/science.290.5492.812 · Cited by 458 · cited 3×
“This is an important topic for exploration because in vivo studies have increasingly suggested that memories in behaving animals are linked to spatio-temporal activity patterns, and not to static configurations of active neurons [21,24-26].”
BackgroundPost-pubertal Emergence of Prefrontal Cortical Up States Induced by D1-NMDA Co-activation
Tseng, K. Y. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh107 · Cited by 169 · cited 1×
“These agents also have been found to induce UP states in vivo [57], suggesting that avalanches may be related to UP states.”
Background
Cited by
Are Biological Systems Poised at Criticality?
Mora, T., & Bialek, W. (2011) · Journal of Statistical Physics · doi:10.1007/s10955-011-0229-4 · Cited by 734
“Similar models defined on lattices or on completely connected graphs were proposed to explore the functional properties of neural avalanches [74, 78, 79].”
BackgroundThe Functional Benefits of Criticality in the Cortex
Shew, W. L., & Plenz, D. (2013) · The Neuroscientist · doi:10.1177/1073858412445487 · Cited by 607
Being Critical of Criticality in the Brain
Beggs, J. M., & Timme, N. (2012) · Frontiers in Physiology · doi:10.3389/fphys.2012.00163 · Cited by 494
Self-citationSelf-organized criticality as a fundamental property of neural systems
Hesse, J., & Gross, T. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00166 · Cited by 440
Integrated information theory of consciousness: an updated account.
(2012) · PubMed · doi:10.4449/aib.v149i5.1388 · Cited by 370
Metadata
- Authors
- Chen, W., Hobbs, J. P., Tang, A., & Beggs, J. M.
- Venue
- BMC Neuroscience
- Published
- 2010-01-06
- Volume
- 11
- Issue
- 1
- Pages
- 3-3
- ISSN
- 1471-2202 (ISSN-L)
- OpenAlex
- W2167206575
- Cited by
- 37
- References
- 14
- FWCI
- 1.99
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.