Dynamical systems, attractors, and neural circuits
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Biology is the study of dynamical systems. Yet most of us working in biology have limited pedagogical training in the theory of dynamical systems, an unfortunate historical fact that can be remedied for future generations of life scientists. In my particular field of systems neuroscience, neural circuits are rife with nonlinearities at all levels of description, rendering simple methodologies and our own intuition unreliable. Therefore, our ideas are likely to be wrong unless informed by good models. These models should be based on the mathematical theories of dynamical systems since functioning neurons are dynamic—they change their membrane potential and firing rates with time. Thus, selecting the appropriate type of dynamical system upon which to base a model is an important first step in the modeling process. This step all too easily goes awry, in part because there are many frameworks to choose from, in part because the sparsely sampled data can be consistent with a variety of dynamical processes, and in part because each modeler has a preferred modeling approach that is difficult to move away from. This brief review summarizes some of the main dynamical paradigms that can arise in neural circuits, with comments on what they can achieve computationally and what signatures might reveal their presence within empirical data. I provide examples of different dynamical systems using simple circuits of two or three cells, emphasizing that any one connectivity pattern is compatible with multiple, diverse functions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 1×
“…the capacity (number of memories held) of such networks relied on binary neurons that were either on or off and updated in discrete time steps 12 , the principle of memory formation and memory retrieval via an imperfect stimulus has been demonstrated in continuous firing rate models in…”
BackgroundHopfield, J. J. (1984) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.81.10.3088 · Cited by 6,918
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025 · cited 1×
“Moreover, certain learning rules for changing of connection strengths between neurons in a chaotic system can allow the encoding of almost any spatiotemporal input pattern 4,95 , the switching between multiple patterns 4 , and the encoding and processing of many rule-based tasks 6,8 .”
BackgroundMechanisms of Gamma Oscillations
Buzsáki, G., & Wang, X.-J. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150444 · Cited by 2,796 · cited 1×
“…see supporting Matlab code, “dynamics_three_units.m”. presence of oscillations is inferred from a peak in the power spectrum at a particular frequency 73,74 —such a peak could arise from attractor state itinerancy, chaos, or heteroclinic orbits (see below) in the absence of a true oscillator.”
BackgroundNeurophysiological and Computational Principles of Cortical Rhythms in Cognition
Wang, X.-J. (2010) · Physiological Reviews · doi:10.1152/physrev.00035.2008 · Cited by 1,939
Hippocampal sharp wave-ripple: A cognitive biomarker for episodic memory and planning
Buzsáki, G. (2015) · Hippocampus · doi:10.1002/hipo.22488 · Cited by 1,759
The importance of mixed selectivity in complex cognitive tasks
Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., & Fusi, S. (2013) · Nature · doi:10.1038/nature12160 · Cited by 1,639
Lisman, J. E., & Jensen, O. (2013) · Neuron · doi:10.1016/j.neuron.2013.03.007 · Cited by 1,609
Synaptic theory of working memory
Mongillo, G., Barak, O., & Tsodyks, M. (2008) · Science · doi:10.1126/science.1150769 · Cited by 1,253
Compte, A. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.9.910 · Cited by 1,143
Stimulus onset quenches neural variability: A widespread cortical phenomenon
Churchland, M. M., Yu, B. M., Cunningham, J. P., Sugrue, L. P., Cohen, M. R., Corrado, G. S., Newsome, W. T., Clark, A. M., Hosseini, P., Scott, B. B., et al. (2010) · Nature Neuroscience · doi:10.1038/nn.2501 · Cited by 1,084
Chaos in random neural networks
Sompolinsky, H., Crisanti, A., & Sommers, H. J. (1988) · Physical Review Letters · doi:10.1103/physrevlett.61.259 · Cited by 1,061 · cited 1×
“A high-dimensional neural system—as arises if the activity of each neuron can vary with little correlation with the activity of other neurons—with a balance between excitatory and inhibitory random connections becomes chaotic if connections are strong enough 88–90 .”
BackgroundZhang, K. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-06-02112.1996 · Cited by 1,001 · cited 2×
“In neural circuit models, marginal states either depend on an underlying symmetry (for example, translation in space when considering memory for position via a ring attractor) 53–56 or require other fine-tuning of parameters 57–60 .”
BackgroundSynaptic basis of cortical persistent activity: the importance of NMDA receptors to working memory
Wang, X.-J. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-21-09587.1999 · Cited by 859 · cited 1×
“If recurrent feedback current is mediated primarily through N-methyl-D-aspartate (NMDA) receptors and they are allowed a 100 ms time constant (though 50 ms may be more reasonable at in vivo temperatures for mammals), then the high firing rate state can be limited to 20 to 30 Hz 46,47 .”
BackgroundReal-Time Computation at the Edge of Chaos in Recurrent Neural Networks
Bertschinger, N., & Natschläger, T. (2004) · Neural Computation · doi:10.1162/089976604323057443 · Cited by 833 · cited 3×
“Yet a system operating near or at the “edge of chaos” can be computationally efficient 93 and become reliably entrained to inputs while responding more rapidly than ordered systems 89,94 .”
BackgroundNeuronal correlates of parametric working memory in the prefrontal cortex
Romo, R., Brody, C. D., Hernández, A., & Lemus, L. (1999) · Nature · doi:10.1038/20939 · Cited by 822 · cited 1×
“These have acquired some degree of experimental support 67–69 .”
BackgroundGating of human theta oscillations by a working memory task
Raghavachari, S., Kahana, M. J., Rizzuto, D. S., Caplan, J. B., Kirschen, M. P., Bourgeois, B., Madsen, J. R., & Lisman, J. E. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-09-03175.2001 · Cited by 792 · cited 1×
“…correlations between oscillatory power or synchrony and behavior or cognitive process—whether related to attention 77 , arousal 78 , memory load 79 , or sleep state 80–82 —may indicate a causal dependence in one direction (oscillations cause the process) or the other (particular processes…”
BackgroundBrunel, N., & Wang, X.-J. (2001) · Journal of Computational Neuroscience · doi:10.1023/a:1011204814320 · Cited by 620
Huk, A. C., & Shadlen, M. N. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4684-04.2005 · Cited by 538 · cited 1×
“These have acquired some degree of experimental support 67–69 .”
BackgroundHow the brain keeps the eyes still
Seung, H. S. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.23.13339 · Cited by 534
The criticality hypothesis: how local cortical networks might optimize information processing
Beggs, J. M. (2008) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2092 · Cited by 533
Robust timing and motor patterns by taming chaos in recurrent neural networks
Laje, R., & Buonomano, D. V. (2013) · Nature Neuroscience · doi:10.1038/nn.3405 · Cited by 454
Lisman, J. (2005) · Hippocampus · doi:10.1002/hipo.20121 · Cited by 435
The slow (<1 Hz) rhythm of non-REM sleep: a dialogue between three cardinal oscillators
Crunelli, V., & Hughes, S. W. (2010) · Nature Neuroscience · doi:10.1038/nn.2445 · Cited by 435 · cited 1×
“…oscillatory power or synchrony and behavior or cognitive process—whether related to attention 77 , arousal 78 , memory load 79 , or sleep state 80–82 —may indicate a causal dependence in one direction (oscillations cause the process) or the other (particular processes cause oscillations as an…”
BackgroundStability of the memory of eye position in a recurrent network of conductance-based model neurons
Seung, H. S., Lee, D. D., Reis, B. Y., & Tank, D. W. (2000) · Neuron · doi:10.1016/s0896-6273(00)81155-1 · Cited by 339
Single-trial spike trains in parietal cortex reveal discrete steps during decision-making
Latimer, K. W., Yates, J. L., Meister, M. L. R., Huk, A. C., & Pillow, J. W. (2015) · Science · doi:10.1126/science.aaa4056 · Cited by 306
Rigotti, M. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00024 · Cited by 184
Bayesian sampling in visual perception
Moreno-Bote, R., Knill, D. C., & Pouget, A. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101430108 · Cited by 182
Task-dependent changes in short-term memory in the prefrontal cortex
Warden, M. R., & Miller, E. K. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1569-10.2010 · Cited by 171 · cited 1×
“Such rates are incompatible with the smaller changes of activity—often no more than 10 Hz between pre-stimulus and post-stimulus levels—during memory tasks in vivo 43,44 , calling into question the validity of these recurrent excitatory models.”
BackgroundA recurrent network model of somatosensory parametric working memory in the prefrontal cortex
Miller, P. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg101 · Cited by 144
Self-citationAksay, E., Baker, R., Seung, H. S., & Tank, D. W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.2.1035 · Cited by 119
Cortical development, electroencephalogram rhythms, and the sleep/wake cycle
Cirelli, C., & Tononi, G. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.12.017 · Cited by 117 · cited 1×
“…oscillatory power or synchrony and behavior or cognitive process—whether related to attention 77 , arousal 78 , memory load 79 , or sleep state 80–82 —may indicate a causal dependence in one direction (oscillations cause the process) or the other (particular processes cause oscillations as an…”
BackgroundWang (2011) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2011.00030 · Cited by 104
Cited by
Low-dimensional and monotonic preparatory activity in mouse anterior lateral motor cortex
Inagaki, H. K., Inagaki, M., Romani, S., & Svoboda, K. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.3152-17.2018 · Cited by 111
Ascending neurons convey behavioral state to integrative sensory and action selection brain regions
Chen, C.-L., Aymanns, F., Minegishi, R., Matsuda, V. D. V., Talabot, N., Günel, S., Dickson, B. J., & Ramdya, P. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01281-z · Cited by 58
Single-cell systems analysis: decision geometry in outliers
Abrahams, L. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btaa1078 · Cited by 3
Metadata
- Authors
- Miller, P.
- Venue
- F1000Research
- Publisher
- F1000 Research Ltd
- Published
- 2016-05-24
- Volume
- 5
- Pages
- 992
- ISSN
- 2046-1402 (ISSN-L)
- OpenAlex
- W2402905761
- Cited by
- 59
- References
- 34
- FWCI
- 2.35
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.