Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Depending on the connectivity, recurrent networks of simple computational units can show very different types of dynamics, ranging from totally ordered to chaotic. We analyze how the type of dynamics (ordered or chaotic) exhibited by randomly connected networks of threshold gates driven by a time-varying input signal depends on the parameters describing the distribution of the connectivity matrix. In particular, we calculate the critical boundary in parameter space where the transition from ordered to chaotic dynamics takes place. Employing a recently developed framework for analyzing real-time computations, we show that only near the critical boundary can such networks perform complex computations on time series. Hence, this result strongly supports conjectures that dynamical systems that are capable of doing complex computational tasks should operate near the edge of chaos, that is, the transition from ordered to chaotic dynamics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Intrinsic fluctuations that are poised ''at the edge of chaos'' are thought to maximize the computational efficiency of such systems and the flexibility to switch between adaptive regimes (Bertschinger & Natschla ¨ger, 2004).”
From A potential mechanism for Gibsonian resonance: behavioral entrainment emerges from local homeostasis in an unsupervised reservoir network (2024) · cites this paper as Bertschinger & Natschläger, 2004
In the citing paper
“Finally, we show that a randomly connected circuit model, akin to a “reservoir” network13-15, can reproduce the observed distribution of timescales, provided that the network operates at the critical point (or “edge of chaos”)16-18.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [17]
Citations
Cites
Self-organized criticality: An explanation of the 1/f noise
Bak, P., Tang, C., & Wiesenfeld, K. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.381 · Cited by 7,591
The origins of order; self organization and selection in evolution
(1994) · International Journal of Biochemistry · doi:10.1016/0020-711x(94)90119-8 · Cited by 6,649
Introduction to the theory of neural computation
(1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,401
Bak, P., Tang, C., & Wiesenfeld, K. (1988) · Physical Review A · doi:10.1103/physreva.38.364 · Cited by 4,713
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025 · cited 10×
“(Maass et al., 2002) and indepenently by Jaeger (Jaeger, 2002) who called it “echo state networks”.”
BackgroundInfluentialSelf-citationChaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity
van Vreeswijk, C., & Sompolinsky, H. (1996) · Science · doi:10.1126/science.274.5293.1724 · Cited by 1,811
Computation at the edge of chaos: Phase transitions and emergent computation
Langton, C. G. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90064-v · Cited by 1,527 · cited 5×
“These results provide further evidence for the idea of “computation at the edge of chaos” (Langton, 1990).”
BackgroundResultInfluentialFading memory and the problem of approximating nonlinear operators with Volterra series
Boyd, S., & Chua, L. (1985) · IEEE Transactions on Circuits and Systems · doi:10.1109/tcs.1985.1085649 · Cited by 991
Random Networks of Automata: A Simple Annealed Approximation
Derrida, B., & Pomeau, Y. (1986) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/1/2/001 · Cited by 706
Dynamic Patterns in Complex Systems
(1988) · doi:10.1142/0534 · Cited by 548
Research works printed but not linked: 1
- Mitchell M., 1993, Complex Systems, 7, 89
Cited by
Items 601–700 of 831
Chopra, R., Zhong, J., Miller, E. S., Tolossa, G. B., Fosque, L. J., Janzen-Meza, J. A., DeKorver, N. W., Guerriero, R. M., Ritter, N. J., Lambo, M. E., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.09.737603 · Cited by 3
Кондрашов, А. В., Kostylev, M., & Ustinov, A. B. (2024) · Journal of Magnetism and Magnetic Materials · doi:10.1016/j.jmmm.2023.171685 · Cited by 2
Enhanced predictive capability for chaotic dynamics by modified quantum reservoir computing
Wang, L., Sun, Y., & Zhang, X. (2024) · Physical Review Research · doi:10.1103/physrevresearch.6.043183 · Cited by 4
Tree networks of real-world data: Analysis of efficiency and spatiotemporal scales
Cipollini, D., & Schomaker, L. (2025) · Physical Review Research · doi:10.1103/ztmk-glc4 · Cited by 2
Homotopy reservoir computing: Harnessing chaos for computation
Choi, J.-S., & Kim, P. (2025) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0273406 · Cited by 3
Modeling natural neural networks of decision making with artificial neural networks
Funamizu, A., & Karakida, R. (2025) · Neuroscience Research · doi:10.1016/j.neures.2025.104961 · Cited by 3
Characterizing the edge of chaos in echo state networks
Gao, Y. (2025) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2025.117333 · Cited by 2
Morales, G. B., Santo, S. D., & Muñoz, M. A. (2025) · SEMA SIMAI Springer series · doi:10.1007/978-3-031-99044-1_2 · Cited by 6
Edge of Many-Body Quantum Chaos in Quantum Reservoir Computing
Kobayashi, K., & Motome, Y. (2026) · Physical Review Letters · doi:10.1103/j2qj-vwcl · Cited by 29
From chaotic itinerancy to intermittent synchronization in complex networks
Leyva, I., Sendiña–Nadal, I., Sevilla-Escoboza, R., Vera-Ávila, V. P., & Christophe Letellier, A. (2026) · Physical Review Research · doi:10.1103/s3gp-gtln · Cited by 3
Cortical columns for quick brains
Stoop, R., Saase, V., Stoop, B., & Stoop, R. (2014) · IEICE Proceeding Series · doi:10.15248/proc.1.852 · Cited by 2
“[14] Bertschinger N, Natschlaeger T (2004) Real-time computation at the edge of chaos in recurrent neural networks.”
BackgroundBianchi, F. M., Livi, L., & Alippi, C. (2017) · Studies in computational intelligence · doi:10.1007/978-3-319-67946-4_5 · Cited by 2
“In [5, 20, 21] it is shown that several dynamical systems, among which randomly connected RNNs, achieved the highest computational capabilities when moving toward the unstable (sometime even chaotic) regime, where the ESP is lost and the system enters into an oscillatory behavior.”
BackgroundRole of unstable periodic orbits in bubbling weak generalized synchronization
Takahashi, N., & Tsugawa, S. (2020) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2020.132678 · Cited by 2
Path integral approach to universal dynamics of reservoir computers
Haruna, J., Toshio, R., & Nakano, N. (2023) · Physical review. E · doi:10.1103/physreve.107.034306 · Cited by 6
“Although our result for the Gaussian network is essentially equivalent to the one discussed in previous studies [54–60], it provides us with a new perspective on the boundary between chaotic and polarized ordered phases.”
InfluentialStudy of power-law activity distributions in a spiking neural network model
Cho, M. W., & Choi, M. Y. (2023) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/aceb19 · Cited by 2
Meyer, C. T., & Kralj, J. M. (2021) · Science Advances · doi:10.1126/sciadv.adg3028 · Cited by 3
“Previous studies have demonstrated that systems poised at criticality maximize their information capacity ( 16 , 37 – 39 ).”
Topology-dependent coalescence controls scaling exponents in finite networks
Zeraati, R., Buendía, V., Engel, T. A., & Levina, A. (2024) · Physical Review Research · doi:10.1103/physrevresearch.6.023131 · Cited by 5
“Operating at this regime has been linked to optimal information processing [2,6], efficient coding [7], maximal dynamic range and sensitivity to stimulus [8,9], longer timescales during attention [10], and better stimuli discrimination [11,12].”
BackgroundThree-dimensional physical reservoir made of Ag2S particles
Ohno, Y., & Hasegawa, T. (2024) · Nonlinear Theory and Its Applications IEICE · doi:10.1587/nolta.15.861 · Cited by 2
Structural determinants of soft memory in recurrent biological networks
Vidal-Saez, M. S., & García‐Ojalvo, J. (2025) · Biophysical Reviews · doi:10.1007/s12551-025-01295-w · Cited by 4
“In particular, to combine both separability and generalizability, they need to operate between ordered and chaotic dynamics, i.e., near the so-called edge of chaos (Bertschinger and Natschläger 2004; Legenstein and Maass 2007;MoralesandMuñoz 2021;Vidal-Saezetal.2024).”
Echo state property and memory capacity of artificial spin ice
Taniguchi, T. (2025) · Scientific Reports · doi:10.1038/s41598-025-93189-w · Cited by 6
“In addition, while the edge of chaos has been often regarded as an ideal state for recurrent neural network 51 , it is recently mentioned by Jaeger in Foreword of Ref.”
Nowrouzi-Nezhad, H., Mahdisoltani, S., & Moghimi-Araghi, S. (2025) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2025.130535 · Cited by 3
Hierarchy of Chaotic Dynamics in Random Modular Networks
Kuśmierz, Ł., Pereira, U., Lu, Z., Mastrovito, D., & Mihalaş, Ş. (2025) · Physical Review Letters · doi:10.1103/physrevlett.134.148402 · Cited by 12
Voltage-mode reservoir computing with ferroelectric CMOS inverters
Suzuki, R., Toprasertpong, K., Nakane, R., Nako, E., Takenaka, M., & Takagi, S. (2025) · Applied Physics Express · doi:10.35848/1882-0786/ade199 · Cited by 2
Ikeda, N., Akita, D., & Takahashi, H. (2025) · Frontiers in Neural Circuits · doi:10.3389/fncir.2025.1585087 · Cited by 5
“…fading memory –preserving influences from past inputs and allowing interaction with network dynamics (Boyd and Chua, 1985; Maass et al., 2002; Bertschinger and Natschlager, 2004; Maass and Markram, 2004; Buonomano and Maass, 2009)– and achieve higher computational performance than…”
Yellin, D., Siegel, N., Malach, R., & Shriki, O. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013528 · Cited by 6
“The authors have declared that no competing interests exist. in a regime of richly chaotic yet bounded dynamics [43–45].”
Nonequilibrium Behavior in Neural Networks: Criticality and Optimal Performance
Torres, J. J., Johnson, S., Mejías, J. F., de Franciscis, S., & Marro, J. (2010) · Springer eBooks · doi:10.1007/978-90-481-9695-1_89 · Cited by 2
“This edge of chaos is particularly interesting, since it has been shown that this kind of transition can be optimal for certain magnitudes such as computational capacity [11] and dynamic range of sensitivity to stimuli [12].”
BackgroundSpiking neural networks signal processing
Rosselló, J. L., Canals, V., Oliver, A., Alomar, M. L., & Morro, A. (2014) · Conference on Design of Circuits and Integrated Systems · doi:10.1109/dcis.2014.7035556 · Cited by 3
Symmetries constrain the transition to heterogeneous chaos in balanced networks
Barreiro, A. K., Kutz, J. N., & Shlizerman, E. (2015) · BMC Neuroscience · doi:10.1186/1471-2202-16-s1-p229 · Cited by 1
“Recently, researchers have demonstrated how this spontaneous behavior underlies computational capabilities in large, recurrently connected networks of firing rate [1,2] and spiking [3] units.”
BackgroundLearning and Variability in Spiking Neural Networks - eScholarship
Rodny, J., & Kello, C. T. (2014) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 2
Duality Of Stochasticity And Natural Selection: A Cybernetic Evolution Theory
Heininger, K. (2015) · Cited by 2
Kushnir, M., Komarnytskyi, A., Tokarieva, K., Савчин, Н. М., Kroialo, P., & Toronchuk, V. (2020) · International Scientific-Practical Conference Problems of Infocommunications Science and Technology · doi:10.1109/picst51311.2020.9467935 · Cited by 2
Discrete scaling and criticality in a chain of adaptive excitable integrators
Martinez‐Saito, M. (2022) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2022.112574 · Cited by 3
Modeling and Evaluation of Echo-State Networks Using Spin Torque Nano-Oscillators
Qian, S., & Rakheja, S. (2023) · IEEE Journal on Exploratory Solid-State Computational Devices and Circuits · doi:10.1109/jxcdc.2023.3317240 · Cited by 2
“The PC is another task that can be used to evaluate an ESN’s ability to handle binary time-series data [33].”
BackgroundSolvable neural network model for input-output associations: Optimal recall at the onset of chaos
Kurikawa, T., & Kaneko, K. (2023) · Physical Review Research · doi:10.1103/physrevresearch.5.043221 · Cited by 3
Evolving Reservoirs for Meta Reinforcement Learning
Léger, C., Hamon, G., Nisioti, E., Hinaut, X., & Moulin-Frier, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56855-8_3 · Cited by 9
Jannesari, M., Saeedi, A., Zare, M., Ortiz‐Mantilla, S., Plenz, D., & BENASICH, A. A. (2019) · Brain Structure and Function · doi:10.1007/s00429-019-01918-5 · Cited by 2
“2011) and information transition (Beggs and Plenz 2003), optimal communication (Beggs and Plenz 2003; Bertschinger and Natschäger 2004; Rämö et al. 2007; Tanaka et al. 2009), high computational power (Bertschinger and Natschäger 2004) and maximal variability in phase synchrony (Yang et al.”
BackgroundInfluentialRetractedAnalysis of decision-making behavior based on complex adaptive system
Yu, C., & Luo, Y. (2008) · WSEAS TRANSACTIONS on SYSTEMS archive · Cited by 2
Toward bio-inspired information processing with networks of nano-scale switching elementsPreprint
Konkoli, Z., & Wendin, G. P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1311.6259 · Cited by 6
On the ground state of spiking network activity in mammalian cortexPreprint
Wilting, J., & Priesemann, V. (2018) · arXiv (Cornell University) · Cited by 4
DNA Reservoir Computing: A Novel Molecular Computing ApproachPreprint
Goudarzi, A., Lakin, M. R., & Stefanović, D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.5998 · Cited by 4
“Many studies have shown that to achieve a suitable reservoir in general, the underlying dynamical system must operate in the critical dynamical regime [8,16,20,21].”
BackgroundPredicting the computational performance of neural circuits modeled with simple digital neurons
Eyal, M. (2015) · Minds at UW (University of Wisconsin) · Cited by 2
Dynamical Phases and Resonance Phenomena in Information-Processing Recurrent Neural NetworksPreprint
Metzner, C., & Krauß, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.02545 · Cited by 2
Habibollahi, F., Kagan, B. J., Duc, D., Burkitt, A. N., & French, C. R. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.03.514955 · Cited by 2
conn2res : A toolbox for connectome-based reservoir computingPreprint
Suárez, L. E., Mihalik, Á., Milisav, F., Marshall, K., Li, M., Vértes, P. E., Lajoie, G., & Mišić, B. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.05.31.543092 · Cited by 2
“By parametrically tuning the dynamics to be closer or further from criticality, RC allows us to investigate the effects of qualitatively different neural trajectories near this critical point on the computational performance of the reservoir [43, 44].”
BackgroundHierarchical Timescales and Nested Process CompositionPreprint
Kello, C. T., Bhat, H., Alviar, C., & Turner, M. A. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tqyrz · Cited by 2
Switches in single-neuron excitability class can induce rich dynamical states in balanced networksPreprint
Drangmeister, M., Engelken, R., Schleimer, J., & Schreiber, S. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.02.28.640576 · Cited by 5
“In the case of liquid state machines, the optimal operating point of these networks is widely regarded to be on the edge of chaos [49, 50, 77], where separability of inputs is balanced with fading memory timescales.”
Multi-task and continual-learning capabilities of reservoir computing applied to speech recognition
Ando, M., Nagata, S., & Okumura, T. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650632 · Cited by 1
Study of power-law activity distributions in a two-dimensional model system
Cho, M. W. (2024) · Journal of the Korean Physical Society · doi:10.1007/s40042-024-01198-1 · Cited by 1
Memory–Non-Linearity Trade-Off in Distance-Based Delay Networks
Iacob, S., & Dambre, J. (2024) · Biomimetics · doi:10.3390/biomimetics9120755 · Cited by 1
Efficient Coding with Chaotic Neural Networks: A Journey From Neuroscience to Physics and Back
Kadmon, J. (2025) · Human Arenas · doi:10.1007/s42087-025-00507-9 · Cited by 4
“This characteristic allows these networks to function as highly effective classifiers, capable of distinguishing between minute differences in input stimuli (see, e.g., (Bertschinger and Natschl¨ager, 2004; Keup et al, 2021)).”
Multisensory integration in chaotic networks
Ponzi, A. P. D., & Suzuki, K. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107766 · Cited by 1
Noè, D., Yamamoto, H., Katori, Y., & Sato, S. (2025) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ae0826 · Cited by 1
“This behavior of the spectral radius is usually associated with a system approaching the ‘edge of chaos’, a regime of operation characterized by enhanced temporal stability and memory capacity [42, 43].”
Phase transitions from linear to nonlinear information processing in neural networks
Matsumura, M., & Haga, T. (2025) · Physical review. E · doi:10.1103/jrlp-vn6j · Cited by 3
“It is commonly believed that the information processing capacity is maximized at the edge of chaos, which is the boundary between ordered and chaotic dynamics [32–40].”
Echo State Network with Information Inheritance Properties
Wang, S., Geng, F., & Li, Y. (2025) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127426500458 · Cited by 1
Huang, Y., & Gunji, Y. (2026) · Biomimetics · doi:10.3390/biomimetics11010081 · Cited by 3
“Theoretically, operating at this critical phase transition is hypothesized to resolve the fundamental trade-off between computational efficiency and universality, enabling systems to maximize information processing capabilities [33,34].”
Digit image classification using magnonic reservoir computing
Ustinov, A. B., Кондрашов, А. В., Nikitin, A. A., Burovikhin, A. P., Semenov, A. A., & Kostylev, M. (2026) · Journal of Applied Physics · doi:10.1063/5.0313414 · Cited by 3
Gauge-covariant stochastic neural fields: stability and finite-width effects
Terin, R. C. (2026) · Scientific Reports · doi:10.1038/s41598-026-47071-y · Cited by 4
Nishimura, M., Nishioka, D., Namiki, W., Hikasa, S., Iguchi, R., Terabe, K., & Tsuchiya, T. (2026) · Japanese Journal of Applied Physics · doi:10.35848/1347-4065/ae5da2 · Cited by 3
Adaptation modulates effective connectivity and network stability
Richner, T. J., Dervinis, M., & Lundstrom, B. N. (2026) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2026.1761735 · Cited by 1
“Therefore, it is hypothesized that the brain operates near the edge of chaos for optimal information storage and processing capacity (Bertschinger and Natschläger, 2004; Boedecker et al., 2012; Ganguli et al., 2008; Langton, 1990; Legenstein and Maass, 2007).”
Randomized residual Convolutional Neural Networks
Pinna, M., Ceni, A., & Gallicchio, C. (2026) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2026.111363 · Cited by 1
Tripathi, T., Uversky, V., & Giuliani, A. (2026) · FEBS Letters · doi:10.1002/1873-3468.70404 · Cited by 2
Z₂ Gauge Theory as a Predictive Agent, with a Structural Relation for the Fine-Structure Constant
Tqemaladze, J. (2026) · Longevity Horizon · doi:10.65649/kxibzi6e · Cited by 3
“The connection to the edge of chaos (Langton, 1990; Bertschinger & Natschläger, 2004) is an assumption.”
InfluentialOn the operating point of cortical computation
Martin, R. L., Stimberg, M., Wimmer, K., & Obermayer, K. (2010) · Journal of Physics Conference Series · doi:10.1088/1742-6596/233/1/012020 · Cited by 2
The Robustness and Mutual Information Entropy of Random Modular Boolean Networks
Zhao, N., Guo, B. H., & Meng, F. C. (2014) · Advanced materials research · doi:10.4028/www.scientific.net/amr.989-994.4417 · Cited by 1
Amancio, D. R., Oliveira, O. N., & Costa, L. D. F. (2012) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2012/11/p11018 · Cited by 1
“, in the critical operation processing capabilities are enhanced [21]–[23] and epileptic seizures are prevented [17]), it is crucial to determine the factors leading to such restrictions of activity.”
BackgroundPriesemann, V., Valderrama, M. A., Wibral, M., & Quyen, M. L. V. (2013) · BMC Neuroscience · doi:10.1186/1471-2202-14-s1-p237 · Cited by 1
“In contrast, a single attractor state, called self-organized critical (SOC), has been proposed to govern human brain dynamics for its optimal information coding and processing capabilities [2].”
Analysis of the dynamics of a nonlinear neuron model
Alhawarat, M. O. (2015) · Applied Mathematical Sciences · doi:10.12988/ams.2015.58546 · Cited by 1
“Many chaotic neural networks have been devised and studied in the last couple of decades [10, 11, 12, 13, 14, 15] to seek chances of utilizing the dynamic behaviours that such models might allow.”
BackgroundTime Series from a Nonlinear Dynamical Systems Perspective
Durstewitz, D. (2017) · Bernstein series in computational neuroscience · doi:10.1007/978-3-319-59976-2_9 · Cited by 1
Brain and Nonlinear Dynamics: Slow-Wave Sleep Regulates to the Edge of Chaos
Steyn‐Ross, D. A., & Steyn‐Ross, M. L. (2017) · Springer series in cognitive and neural systems · doi:10.1007/978-3-319-29674-6_10 · Cited by 1
Hyper-spherical Reservoirs for Echo State Networks
Verzelli, P., Alippi, C., & Livi, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30493-5_9 · Cited by 1
Programmable Fading Memory in Atomic Switch Systems for Error Checking Applications
Aguilera, R., Sillin, H. O., Stieg, A. Z., & Gimzewski, J. K. (2021) · Natural computing series · doi:10.1007/978-981-13-1687-6_12 · Cited by 1
Durstewitz, D. (2017) · Bernstein series in computational neuroscience · doi:10.1007/978-3-319-59976-2_3 · Cited by 1
Calvet, E., Rouat, J., & Reulet, B. (2023) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2023.1223258 · Cited by 2
“In this article, we examine RandomBoolean Networks (RBNs) and demonstrate that specific distribution parameters can lead to diverse dynamics near critical points.”
BackgroundMethodResultInfluentialQuantifying brain-functional dynamics using deep dynamical systems: Technical considerations
Chen, J., Benedyk, A., Moldavski, A., Tost, H., Meyer‐Lindenberg, A., Braun, U., Durstewitz, D., Koppe, G., & Schwarz, E. (2024) · iScience · doi:10.1016/j.isci.2024.110545 · Cited by 1
“29,43 F08 reflects the mean activity level of the system; F11/12 is related to weight matrix W, characterizing how balanced or biased the connectivity and connection strengths are; and F17/18 reflects whether state information is distributed evenly or unevenly across observation signals.”
Chaotic Dynamics in Spin Torque Nano-oscillator Driven by Voltage Feedback
Sravani, M., & Bhuktare, S. (2025) · Journal of Superconductivity and Novel Magnetism · doi:10.1007/s10948-025-06980-1 · Cited by 1
“This phenomenon is widely used in practical applications like neuromorphic computing [27, 28], random number generators [29, 30], and physical reservoir computing [31, 32].”
Harvested reservoir computing from road traffic dynamics
Fukuzaki, R., Noguchi, T., & Ando, H. (2025) · Scientific Reports · doi:10.1038/s41598-025-30016-2 · Cited by 2
Defining and finding lifelike entities with a lazy filter
Martinez‐Saito, M. (2025) · Biosystems · doi:10.1016/j.biosystems.2025.105672 · Cited by 2
Kern, F. B., Date, T., & Chao, Z. C. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1014798 · Cited by 1
“Criticality leads to optimal computational capacities [3,4] and optimal information transmission [5,6].”
Biometric Nanotechnology and Nonlinear Dynamics
Raiesdana, S., Gholpayeghani, M. H., & Nasrabadi, A. M. (2007) · International Conference on Quantum, Nano and Micro Technologies (ICQNM) · doi:10.1109/icqnm.2007.4 · Cited by 1
Stochastic Spiking Neural Networks at the EDGE of CHAOS
Rosselló, J. L., Canals, V., Oliver, A., & Morro, A. (2014) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2014.6889597 · Cited by 1
“Some researchers support the theory that the brain is naturally poised near criticality at the edge between ordered and chaotic states [4] [5].”
Termsaithong, T., & Aihara, K. (2013) · Cognitive Neurodynamics · doi:10.1007/s11571-013-9251-3 · Cited by 1
“For example, simulations have demonstrated that the dynamic range (Kinouchi and Copelli 2006), memory capacity (Haldeman and Beggs 2005), and computational power (Bertschinger and Natschläger 2004) of neural networks are maximized at a critical point.”
BackgroundEXCITABLE NETWORKS: NONEQUILIBRIUM CRITICALITY AND OPTIMUM TOPOLOGY
Torres, J. J., de Franciscis, S., Johnson, S., & Marro, J. (2010) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127410026150 · Cited by 1
“These results are in qualitative agreement with other models in which the “edge of chaos” is seen to optimize magnitudes such as computational capacity [Bertschinger & Natschläger, 2004] and dynamic range of sensitivity to stimuli [Assis & Copelli, 2008].”
ResultZhang, X., Ju, H., Penney, T. B., & VanDongen, A. M. J. (2017) · eNeuro · doi:10.1523/eneuro.0361-16.2017 · Cited by 1
“Up- and down-states, bursting, and background noise It has been suggested that being at the “edge of chaos” (Crutchfield and Young, 1990; Langton, 1990) is desirable for neural networks performing complex computational tasks (Bertschinger and Natschläger, 2004).”
BackgroundCollective dynamics in heterogeneous networks of neuronal cellular automata
Manchanda, K., Bose, A., & Ramaswamy, R. (2017) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2017.06.021 · Cited by 1
“Analyzing phase transitions in networks with discrete nodal dynamics has received considerable attention [21, 34].”
BackgroundRandomness and isometries in echo state networks and compressed sensing
Prater, A. (2018) · Compressive Sensing · doi:10.1117/12.2304029 · Cited by 1
“Properties of the randomly assigned hidden layer weights W that contribute to good performance of ESNs are not fully understood.”
BackgroundInfluentialEvaluation of Information-Theoretic Measures in Echo State Networks on the Edge of Stability
Torda, M., & Farkas, A. I. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489152 · Cited by 2
“The well-known approach from the literature is the (characteristic) Lyapunov exponent (LE, or λ), based on evaluating the average sensitivity to perturbations of the initial conditions [1].”
MethodResultNetwork of Recurrent Neural Networks: Design for Emergence
Wang, C., & Zeng, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-04179-3_8 · Cited by 1
Evolution of activity-dependent adaptive Boolean networks towards criticality: an analytic approach
Haruna, T. (2018) · Journal of Complex Networks · doi:10.1093/comnet/cny006 · Cited by 1
“The advantages of criticality also have been studied: Optimal computational ability [11, 12], maximal sensitivity to external stimuli [13], maximal memory capacity [14] and so on.”
BackgroundNomura, H., Furuta, T., Tsujimoto, K., Kuwabiraki, Y., Samura, N., Tamura, E., Goto, M., Nakatani, R., Kubota, H., & Suzuki, Y. (2019) · Journal of Physics D Applied Physics · doi:10.1088/1361-6463/ab5a27 · Cited by 1
The Retina as a Dynamical System
Cessac, B. (2021) · World scientific series on nonlinear science, series B · doi:10.1142/9789811221903_0014 · Cited by 1
“…suggested [52, 53] that such the scale-free organisation observed in many neural systems [53, 54] could foster information storage and transfer, improvement of the computational capabilities [55], information transmission [54–56], sensitivity to stimuli and enlargement of dynamic range [57–60].”
BackgroundAstrocytes Learn to Detect and Signal Deviations From Critical Brain Dynamics
Ivanov, V. A., & Michmizos, K. P. (2022) · Neural Computation · doi:10.1162/neco_a_01532 · Cited by 1
“…empirical and theoretical evidence has also attributed the brain’s impressive information processing capabilities, including memory and learning (Bertschinger & Natschläger, 2004; Legenstein & Maass, 2007; Meisel, Klaus, Vyazovskiy, & Plenz, 2017; Shew et al., 2011), to its operation near a…”
BackgroundDetermining Reservoir Topologies from Short-Term Memory in Echo State Networks
Ma, Q., & Chen, W. (2012) · Communications in computer and information science · doi:10.1007/978-3-642-33506-8_9 · Cited by 1
Context-dependent representation in recurrent neural networksPreprint
Wainrib, G. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06602 · Cited by 2
“It has been argued that the regime close to criticality in such systems may be relevant in terms of information processing capabilities, both in the fields of neuroscience [2] and artificial intelligence [5, 4].”
BackgroundProduct Echo State Networks: Time-Series Computation with Multiplicative NeuronsPreprint
Goudarzi, A., Shabani, A., & Stefanović, D. (2015) · arXiv (Cornell University) · Cited by 1
Fractal coordination in cognitive performances
Wijnants, M. L. (2012) · Radboud Repository (Radboud University) · Cited by 2
Almassian, A. (2000) · doi:10.15760/etd.2720 · Cited by 1
“In all the three reservoir instances in our study, MI measures showed stable information representation in the reservoir, when connectivity weight coefficient w is less than or close to a critical value w0 (at the edge of chaos [4,5]).”
BackgroundReservoir computing for spatiotemporal signal classification without trained output weightsPreprint
Prater, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.03073 · Cited by 1
“representation of inputs within the reservoir response and the reconstructability of an input signal from reservoir states. For robustness to noise, generalization rank [18] or the Lyapunov coecient [14, 16, 17, 20, 21, 22] are considered. Although the reservoir dynamics (1) and (2) have simple descriptions, rigorous…”
BackgroundRobust transformations of firing patterns for neural networksPreprint
Kanders, K., Lorimer, T., Uwate, Y., Steeb, W.-H., & Stoop, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.04168 · Cited by 3
“In this case, computational benefits have been claimed by providing a whole spectrum of states representing integrated inputs [43, 44].”
BackgroundChaotic Neural Circuit Dynamics
Engelken, R. (2018) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-6718 · Cited by 4
25 years of criticality in neuroscience -- established results, open controversies, novel conceptsPreprint
Wilting, J., & Priesemann, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.05129 · Cited by 1
“Tuning models towards critical phase transitions has been shown to maximize the number of metastable states [12], the dynamic range [13, 14], information transmission in terms of mutual information [15, 16, 17], active information storage [18], and computational power in terms of input-output mappings [19, 20, 21].”
Background
Metadata
- Authors
- Bertschinger, N., & Natschläger, T.
- Affiliations
- Graz University of Technology (AT)
- Software Competence Center Hagenberg (Austria) (AT)
- ORCID
- Bertschinger, Nils
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2004-07-01
- Volume
- 16
- Issue
- 7
- Pages
- 1413-1436
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2057755457
- Cited by
- 833
- References
- 26
- Citations by year
- 2026: 45 · 2025: 73 · 2024: 61 · 2023: 48 · 2022: 66 · 2021: 73 · 2020: 52 · 2019: 53 · 2018: 47 · 2017: 48 · 2016: 26 · 2015: 33 · 2014: 29 · 2013: 33 · 2012: 27
- FWCI
- 13.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Cellular Automata and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Keywords
- edge of chaos, recurrent neural networks, critical connectivity, threshold gates, random connectivity, real-time processing, dynamical systems
- MeSH terms
- Animals, Artificial Intelligence, Computer Simulation, Feedback, Memory, Models, Neurological, Time Factors, Neural Networks, Computer, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.