Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
The aim of the present paper is to study the effects of Hebbian learning in random recurrent neural networks with biological connectivity, i.e. sparse connections and separate populations of excitatory and inhibitory neurons. We furthermore consider that the neuron dynamics may occur at a (shorter) time scale than synaptic plasticity and consider the possibility of learning rules with passive forgetting. We show that the application of such Hebbian learning leads to drastic changes in the network dynamics and structure. In particular, the learning rule contracts the norm of the weight matrix and yields a rapid decay of the dynamics complexity and entropy. In other words, the network is rewired by Hebbian learning into a new synaptic structure that emerges with learning on the basis of the correlations that progressively build up between neurons. We also observe that, within this emerging structure, the strongest synapses organize as a small-world network. The second effect of the decay of the weight matrix spectral radius consists in a rapid contraction of the spectral radius of the Jacobian matrix. This drives the system through the "edge of chaos" where sensitivity to the input pattern is maximal. Taken together, this scenario is remarkably predicted by theoretical arguments derived from dynamical systems and graph theory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bienenstock, E., Cooper, L., & Munro, P. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-01-00032.1982 · Cited by 2,896 · cited 1×
“For instance, it includes time-averages of the neuron activities, as well as passive forgetting, like in the original Bienenstock–Cooper–Munro (BCM) rule (Bienenstock et al., 1982).”
Bassett, D. S., & Bullmore, E. (2006) · The Neuroscientist · doi:10.1177/1073858406293182 · Cited by 2,600 · cited 1×
“Below, we first summarize the main results obtained from this mathematical analysis (for details, see [40]).”
Achard, S., Salvador, R., Whitcher, B., Suckling, J., & Bullmore, E. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3874-05.2006 · Cited by 2,393
Transient and persistent dendritic spines in the neocortex in vivo
Holtmaat, A. J. G. D., Trachtenberg, J. T., Wilbrecht, L., Shepherd, G. M., Zhang, X., Knott, G. W., & Svoboda, K. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.003 · Cited by 1,131
Markram, H., Lübke, J., Frotscher, M., Roth, A., & Sakmann, B. (1997) · The Journal of Physiology · doi:10.1113/jphysiol.1997.sp022031 · Cited by 960
Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks
Bertschinger, N., & Natschläger, T. (2004) · Neural Computation · doi:10.1162/089976604323057443 · Cited by 833 · cited 1×
“…dynamical regime, at the frontier between order (periodical or fixed point regimes) and disorder (chaos), has already be reported to be particularly suitable for recurrent neural networks, especially when computational power is considered (Soula et al., 2005; Bertschinger and Natschlager, 2004).”
BackgroundCalcium stores regulate the polarity and input specificity of synaptic modification
Nishiyama, M., Hong, K., Mikoshiba, K., Poo, M.-M., & Kato, K. (2000) · Nature · doi:10.1038/35046067 · Cited by 635 · cited 1×
“heterosynaptic forms) (Tao et al., 2000; Nishiyama et al., 2000) and took into account only homosynaptic LTD.”
Geometry and structural plasticity of synaptic connectivity
Stepanyants, A., Hof, P. R., & Chklovskii, D. B. (2002) · Neuron · doi:10.1016/s0896-6273(02)00652-9 · Cited by 312
Opioids block long-term potentiation of inhibitory synapses
Nugent, F. S., Penick, E. C., & Kauer, J. A. (2007) · Nature · doi:10.1038/nature05726 · Cited by 297 · cited 1×
“As in the case of excitatory synapses, heterosynaptic plastic interactions can occur (e.g. Nugent et al. (2007)).”
BackgroundUsing graph theoretical analysis of multi channel EEG to evaluate the neural efficiency hypothesis
Micheloyannis, S., Pachou, E., Stam, C. J., Vourkas, M., Erimaki, S., & Tsirka, V. (2006) · Neuroscience Letters · doi:10.1016/j.neulet.2006.04.006 · Cited by 277
Cited by
Complex brain networks: graph theoretical analysis of structural and functional systems
Bullmore, E., & Sporns, O. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2575 · Cited by 11,820
“It has been shown that an initially random wiring diagram can evolve through synaptic plasticity to a functional state characterized by a small-world topology of the most strongly connected nodes and by self-organized critical dynamics 115 .”
BackgroundThe organization of physiological brain networks
Stam, C. J., & van Straaten, E. C. W. (2012) · Clinical Neurophysiology · doi:10.1016/j.clinph.2012.01.011 · Cited by 567
Network analysis of resting state EEG in the developing young brain: structure comes with maturation
Boersma, M., Smit, D. J. A., de Bie, H. M. A., Van Baal, G. C. M., Boomsma, D. I., de Geus, E. J. C., Delemarre‐van de Waal, H. A., & Stam, C. J. (2011) · Human Brain Mapping · doi:10.1002/hbm.21030 · Cited by 235
“[Siri et al., 2007].”
Elliott, S. B., Harvey‐Girard, E., Giassi, A. C. C., & Maler, L. (2017) · Journal of Comparative Neurology · doi:10.1002/cne.24060 · Cited by 61
Metadata
- Authors
- Siri, B., Quoy, M., Delord, B., Cessac, B., & Berry, H.
- Venue
- Journal of Physiology-Paris
- Publisher
- Elsevier BV
- Published
- 2007-01
- Volume
- 101
- Issue
- 1-3
- Pages
- 136-148
- ISSN
- 0928-4257 (ISSN-L)
- OpenAlex
- W2125350568
- Cited by
- 65
- References
- 10
- FWCI
- 2.78
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.