Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Depending on the connectivity, recurrent networks of simple computational units can show very different types of dynamics, ranging from totally ordered to chaotic. We analyze how the type of dynamics (ordered or chaotic) exhibited by randomly connected networks of threshold gates driven by a time-varying input signal depends on the parameters describing the distribution of the connectivity matrix. In particular, we calculate the critical boundary in parameter space where the transition from ordered to chaotic dynamics takes place. Employing a recently developed framework for analyzing real-time computations, we show that only near the critical boundary can such networks perform complex computations on time series. Hence, this result strongly supports conjectures that dynamical systems that are capable of doing complex computational tasks should operate near the edge of chaos, that is, the transition from ordered to chaotic dynamics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Intrinsic fluctuations that are poised ''at the edge of chaos'' are thought to maximize the computational efficiency of such systems and the flexibility to switch between adaptive regimes (Bertschinger & Natschla ¨ger, 2004).”
From A potential mechanism for Gibsonian resonance: behavioral entrainment emerges from local homeostasis in an unsupervised reservoir network (2024) · cites this paper as Bertschinger & Natschläger, 2004
In the citing paper
“Finally, we show that a randomly connected circuit model, akin to a “reservoir” network13-15, can reproduce the observed distribution of timescales, provided that the network operates at the critical point (or “edge of chaos”)16-18.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [17]
Citations
Cites
Self-organized criticality: An explanation of the 1/f noise
Bak, P., Tang, C., & Wiesenfeld, K. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.381 · Cited by 7,591
The origins of order; self organization and selection in evolution
(1994) · International Journal of Biochemistry · doi:10.1016/0020-711x(94)90119-8 · Cited by 6,649
Introduction to the theory of neural computation
(1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,401
Bak, P., Tang, C., & Wiesenfeld, K. (1988) · Physical Review A · doi:10.1103/physreva.38.364 · Cited by 4,713
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025 · cited 10×
“(Maass et al., 2002) and indepenently by Jaeger (Jaeger, 2002) who called it “echo state networks”.”
BackgroundInfluentialSelf-citationChaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity
van Vreeswijk, C., & Sompolinsky, H. (1996) · Science · doi:10.1126/science.274.5293.1724 · Cited by 1,811
Computation at the edge of chaos: Phase transitions and emergent computation
Langton, C. G. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90064-v · Cited by 1,527 · cited 5×
“These results provide further evidence for the idea of “computation at the edge of chaos” (Langton, 1990).”
BackgroundResultInfluentialFading memory and the problem of approximating nonlinear operators with Volterra series
Boyd, S., & Chua, L. (1985) · IEEE Transactions on Circuits and Systems · doi:10.1109/tcs.1985.1085649 · Cited by 991
Random Networks of Automata: A Simple Annealed Approximation
Derrida, B., & Pomeau, Y. (1986) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/1/2/001 · Cited by 706
Dynamic Patterns in Complex Systems
(1988) · doi:10.1142/0534 · Cited by 548
Research works printed but not linked: 1
- Mitchell M., 1993, Complex Systems, 7, 89
Cited by
Items 501–600 of 831
Liouvillian skin effect in quantum neural networks
Sannia, A., Giorgi, G. L., Longhi, S., & Zambrini, R. (2025) · Optica Quantum · doi:10.1364/opticaq.541744 · Cited by 16
“The performances of the quantum reservoirs have also been tested considering the XOR task [72], which, unlike the STM task, requires the ability to process inputs non-linearly.”
Voltage-operating reservoir computing utilizing ferroelectric-FET source follower configurations
Suzuki, R., Toprasertpong, K., Nakane, R., Nako, E., Takenaka, M., & Takagi, S. (2025) · Japanese Journal of Applied Physics · doi:10.35848/1347-4065/adb295 · Cited by 5
Margem, M., & Gedık, O. S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09815-8 · Cited by 6
Chen, J., Nurdin, H. I., & Yamamoto, N. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9029180 · Cited by 6
“This value is chosen since ESNs operating in this regime are often claimed to process high computational power [18], [19].”
BackgroundAn Efficient and Flexible Spike Train Model Via Empirical Bayes
She, Q., Wu, X., Jelfs, B., Charles, A. S., & Chan, R. H. M. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3076885 · Cited by 6
When to Be Critical? Performance and Evolvability in Different Regimes of Neural Ising Agents
Khajehabdollahi, S., Prosi, J., Giannakakis, E., Martius, G., & Levina, A. (2022) · Artificial Life · doi:10.1162/artl_a_00383 · Cited by 10
Edge-of-Chaos and Chaotic Dynamics in Resistor-Inductor-Diode-Based Reservoir Computing
Abbas, A. H., Abdel-Ghani, H., & Maksymov, I. S. (2025) · IEEE Access · doi:10.1109/access.2025.3529815 · Cited by 7
“This suggests that the reservoir is more capable of capturing and generalizing the benchmarking time series when the RLD circuit operates in more regular, predictable dynamical regimes [22].”
The Evolution of Intelligent Developmental Systems
Richardson, K. (2013) · Advances in child development and behavior · doi:10.1016/b978-0-12-397947-6.00005-2 · Cited by 6
Stability Analysis of Complex Networks with Linear-Threshold Rate Dynamics
Nozari, E., & Cortés, J. (2018) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.2018.8431222 · Cited by 5
Fading Memory, Plasticity, and Criticality in Recurrent Networks
Papa, B. D., Priesemann, V., & Triesch, J. (2019) · Springer series on bio- and neurosystems · doi:10.1007/978-3-030-20965-0_6 · Cited by 8
Gallicchio, C., Micheli, A., & Silvestri, L. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534006 · Cited by 6
“Leveraging the property of a specific reservoir topology, this will enable us to drive system dynamics towards the ‘edge of stability’, a critical region where optimal computation in RNNs is expected [33], [34],”
Next-generation reservoir computing based on memristor array
Ren, K., Zhang, W., Wang, F., Guo, Z., & Shang, D. (2022) · Acta Physica Sinica · doi:10.7498/aps.71.20220082 · Cited by 8
Quantification of information processing capacity in living brain as physical reservoir
Ishida, N., Shiramatsu, T. I., Kubota, T., Akita, D., & Takahashi, H. (2023) · Applied Physics Letters · doi:10.1063/5.0152585 · Cited by 6
Biases in inverse Ising estimates of near-critical behavior
Kloucek, M. B., Machon, T., Kajimura, S., Royall, C. P., Masuda, N., & Turci, F. (2023) · Physical review. E · doi:10.1103/physreve.108.014109 · Cited by 8
“This gradient depends strongly on the state-point, system size and topology of the input data, e.g. we find b 1 (SK: T= 1.4) = 760, b 1 (SK: T= 2.0) = 450, and b 1 (Brain) = 3416. through edge-of-chaos computation [28, 29].”
BackgroundInfluentialSignatures of criticality in a maximum entropy model of the C. elegans brain during free behaviour
Aguilera, M., Alquézar, C., & Izquierdo, E. J. (2017) · European Conference on Artificial Life · doi:10.1162/isal_a_010 · Cited by 6
Spontaneous and stimulus-induced coherent states of critically balanced neuronal networks
Hayakawa, T., & Fukai, T. (2020) · Physical Review Research · doi:10.1103/physrevresearch.2.013253 · Cited by 13
“[66] Nils Bertschinger and Thomas Natschläger, “Real-time computation at the edge of chaos in recurrent neural networks,” Neural Computation 16, 1413–1436 (2004), https://doi.”
Spontaneous and stimulus-induced coherent states of critically balanced neuronal networks
Hayakawa, T., & Fukai, T. (2020) · Institutional Repositories DataBase (IRDB) · Cited by 5
Soft bodies as input reservoir: role of softness from the viewpoint of reservoir computing
Inoue, K., Nakajima, K., & Kuniyoshi, Y. (2019) · International Symposium on Micro-NanoMechatronics and Human Science · doi:10.1109/mhs48134.2019.9249256 · Cited by 6
“Indeed, it has been shown that the property of chaotic ESN causes a decrease in memory capacity, namely the ability to store and retrieve past input sequences [13], [14], [15].”
BackgroundEvolution of Neural Dynamics in an Ecological Model
Williams, S., & Yaeger, L. (2017) · Geosciences · doi:10.3390/geosciences7030049 · Cited by 5
“Of particular relevance to the present study is the work of Bertschinger and Natschläger [4], who showed that recurrent neural networks capable of performing complex computations exhibit dynamics at the edge of chaos.”
BackgroundOh, D. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06769 · Cited by 5
“To be practical, it has achieved great success in nonlinear system modeling, specifically, for generation [10], prediction [1,11-13], approximation [14], and adaptive controlling [15] of nonlinearly evolving sequences.”
Burrows, D. R. W., Diana, G., Pimpel, B., Moeller, F., Richardson, M. P., Bassett, D. S., Meyer, M., & Rosch, R. E. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.10.14.464473 · Cited by 6
“…various computational capacities, such as: i) network-mediated separation, the ability to separate similar inputs to distinguishable outputs (Bertschinger & Natschläger, 2004; Maass et al., 2002), ii) dynamic range, the range of inputs that the network can encode (Kinouchi & Copelli, 2006;…”
BackgroundCritical-like bistable dynamics in the resting-state human brainPreprint
Wang, S. H., Arnulfo, G., Myrov, V. O., Siebenhühner, F., Nobili, L., Breakspear, M. J., Palva, S., & Palva, J. M. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.01.09.475554 · Cited by 5
Bloembergen Problem based magnonic physical reservoir computing
Kostylev, M. (2025) · Journal of Applied Physics · doi:10.1063/5.0273688 · Cited by 4
Criticality at Work: Scaling in the Mouse Cortex Enhances Performance
Cambrainha, G. G., Castro, D. M., de Vasconcelos, N. A. P., Carelli, P. V., & Copelli, M. (2025) · PRX Life · doi:10.1103/w49n-2vz8 · Cited by 9
“This regime would be able to maximize information transmission, information storage, learning and dynamic range in response to incoming stimuli [7, 14–25], leading to debates about the possible clinical implications of the hypothesis [26–30].”
Memory-induced excitability in optical cavities
Braeckeveldt, B., Peters, K. J. H., Verdonschot, B., Maes, B., & Rodríguez, S. R. K. (2024) · Physical Review Research · doi:10.1103/physrevresearch.6.023008 · Cited by 5
Discontinuous transition to chaos in a canonical random neural network
Pazó, D. (2024) · Physical review. E · doi:10.1103/physreve.110.014201 · Cited by 11
Drayne, J. P., Mella, A. E., McLean, M. A., Ufkes, S., Chau, V., Guo, T., Branson, H. M., Kelly, E., Miller, S. P., GRUNAU, R. E., et al. (2024) · PLOS complex systems. · doi:10.1371/journal.pcsy.0000024 · Cited by 5
Bayesian RG flow in neural network field theories
Howard, J. N., Klinger, M. S., Maiti, A., & Stapleton, A. G. (2025) · SciPost Physics Core · doi:10.21468/scipostphyscore.8.1.027 · Cited by 16
“In line with our expectations, this distribution is well approximated by a Gaussian peaked around the value of the target function evaluated on this input.”
Altered neural avalanche spreading in people with drug-resistant epilepsy✰
Sancetta, B. M., Matarrese, M. A. G., Ricci, L., Lanzone, J., Lippa, G., Nesta, M., Zappasodi, F., Brunetti, M., Lazzaro, V. D., Tombini, M., et al. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121188 · Cited by 5
“In the past decades, numerous evidence supported the idea that the brain cortex obeys near-critical dynamics, similar to physical systems undergoing phase transitions (Maass, Natschl ¨ ager, and Markram 2002; Bertschinger and Natschl ¨ ager 2004; Hesse and Gross 2014).”
Enhancing traffic dynamics-induced machine learning through heterogeneous driving policies
Chu, K.-F., Ye, F., Abdulali, A., & Iida, F. (2025) · npj Unconventional Computing · doi:10.1038/s44335-025-00033-5 · Cited by 7
McCaul, G., Tripathy, G., Marcucci, G., & Gongora, J. S. T. (2025) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0283442 · Cited by 7
Self-organization of information processing in developing neuronal networks
Priesemann, V., Lizier, J. T., Wibral, M., Bullmore, E. T., Paulsen, O., Charlesworth, P., & Schröter, M. S. (2015) · BMC Neuroscience · doi:10.1186/1471-2202-16-s1-p221 · Cited by 4
“A popular hypothesis is that neuronal networks self-organize to a critical state [1-3], because in models, criticality maximizes information processing capacities [4-6].”
BackgroundSensory Stream Adaptation in Chaotic Networks
Ponzi, A. P. D. (2017) · Scientific Reports · doi:10.1038/s41598-017-16478-z · Cited by 4
Phase Transitions in Swarm Optimization Algorithms
Vantuch, T., Zelinka, I., Adamatzky, A., & Marwan, N. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-92435-9_15 · Cited by 4
“Each of the modes could imply different level of a computational complexity or an algorithm performance as it was revealed on different algorithms [6, 7, 15].”
Precise spatial memory in local random networks
Natale, J. L., Hentschel, H. G. E., & Nemenman, I. M. (2020) · Physical review. E · doi:10.1103/physreve.102.022405 · Cited by 8
Scaling of causal neural avalanches in a neutral model
Matin, S., Tenzin, T., & Klein, W. (2021) · Physical Review Research · doi:10.1103/physrevresearch.3.013107 · Cited by 4
“[26] Nils Bertschinger and Thomas Natschläger.”
BackgroundLee, T., & Tramontano, G. (2021) · World Journal of Neuroscience · doi:10.4236/wjns.2021.112014 · Cited by 3
“112014 184 World Journal of Neuroscience putation) and spiking neural microcircuit [115] [116] [117] [118] [119].”
BackgroundHon, K., TAKAHASHI, K., Enju, K., Goto, M., Suzuki, Y., & Nomura, H. (2022) · Applied Physics Letters · doi:10.1063/5.0073465 · Cited by 4
Glutamate Uptake by Astrocytic Transporters
Mergenthaler, K., Oschmann, F., & Obermeyer, K. (2019) · Springer series in computational neuroscience · doi:10.1007/978-3-030-00817-8_13 · Cited by 3
Assessing Criticality in Experiments
Priesemann, V., Levina, A., & Wilting, J. (2019) · Springer series on bio- and neurosystems · doi:10.1007/978-3-030-20965-0_11 · Cited by 6
Effect of Neural Decay Factors on Prediction Performance in Chaotic Echo State Networks
Ebato, Y., Nobukawa, S., & Nishimura, H. (2021) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc52423.2021.9659012 · Cited by 4
“The maximum Lyapunov exponent is used as a chaos index associated with the performance of the reservoir [23].”
MethodEs-saiydy, M., & Zitane, M. (2020) · Asia Pacific Journal of Mathematics · doi:10.28924/apjm/7-32 · Cited by 4
“In addition, most of the existing results are obtained by decomposing QVNNs into real-VNNs ( [7, 33]) or a complex-VNNs ( [14, 28]).”
ResultShimizu, D., Nagase, T., So, Y., Kuwahara, M., Ikarashi, N., & Nagao, M. (2022) · ACS Applied Nano Materials · doi:10.1021/acsanm.2c03162 · Cited by 4
Perception-based vowel insertion by native Spanish-speaking learners of English
Gibson, M. (2012) · TIPA Travaux interdisciplinaires sur la parole et le langage · doi:10.4000/tipa.205 · Cited by 4
Diversity of temporal correlations between genes in models of noisy and noiseless gene networks
Ribeiro, A. S., Lloyd‐Price, J., Chowdhury, S., & Yli-Harja, O. P. (2011) · Biosystems · doi:10.1016/j.biosystems.2011.02.003 · Cited by 6
Horcholle‐Bossavit, G., Quenet, B., & Foucart, O. (2006) · Biosystems · doi:10.1016/j.biosystems.2006.04.022 · Cited by 4
“…complex oscillatory “distributed synchrony”, 18 which could not be correctly defined by usual measurements of chaotic features in a pattern (Bertschinger and Natschläger, 2004), we defined an index, the Normalized Euclidian Distance, which is an appropriate descriptor of the temporal use…”
BackgroundLearning in chaotic recurrent neural networks
Abbott, L. F., & Sussillo, D. (2009) · Cited by 4
COMPLEXITY IN NEURONAL NETWORKS
Frégnac, Y., Rudolph, M., Davison, A. P., & Destexhe, A. (2007) · Complex systems and interdisciplinary science · doi:10.1142/9789812772367_0009 · Cited by 8
“Such large-scale networks can transform temporal codes into spatial codes by self-organisation [209], and computing frameworks have been proposed which exploit the capacity of such complex networks to cope with complex input streams [210,211].”
BackgroundSarazin, M., Victor, J., Medernach, D., Naudé, J., & Delord, B. (2021) · Frontiers in Neural Circuits · doi:10.3389/fncir.2021.648538 · Cited by 4
“AI spiking is compatible with critical or even chaotic dynamics (Beggs and Plenz, 2003; Hahn et al., 2010; London et al., 2010), which may benefit temporally complex computations (Bertschinger and Natschläger, 2004) believed to be performed by the PFC (Compte, 2003).”
Perakakis, P. (2011) · Institutional Repository of the University of Granada (University of Granada) · Cited by 4
El‐Boustani, S., & Alain Destexhe, A. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0904.4217 · Cited by 4
“From a computational point of view, chaotic behaviour or nearly chaotic regime (edge of chaos) can be optimal for information processing [Bertschinger & Natschläger, 2004; Legenstein & Maass, 2007].”
BackgroundTang, G., Polykretis, I., Ivanov, V. A., Shah, A., & Michmizos, K. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.01620 · Cited by 5
“gory of complex nonlinear dynamical systems, which maximize their computational capacity when they operate at the edge of chaos, as shown by studies ranging from cellular automata to boolean networks [7, 14, 39, 43, 63]. It is at the critical point between ordered and chaotic dynamics where balance of robustness and v…”
BackgroundEdge of chaos as a guiding principle for modern neural network trainingPreprint
Zhang, L., Feng, L., Chen, K., & Lai, C. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.09437 · Cited by 19
The capabilities of chaos and complexity
Abel, D. L. (2008) · PsycEXTRA Dataset · doi:10.1037/e484302008-001 · Cited by 5
Xu, M., Furuta, K., Karacali, A., Umezaki, Y., Zaman, A. S. K., Usami, Y., Tanaka, H., & Horibe, Y. (2025) · Small · doi:10.1002/smll.202506397 · Cited by 5
Takasu, S., & Aoyagi, T. (2025) · Physical Review Research · doi:10.1103/cwvm-s53p · Cited by 9
“The computational ability of RC has been predominantly discussed from the perspective of proximity to the edge of chaos [14, 15, 39, 40], typically for a fixed number of readout neurons [13, 27].”
Kawase, T., & Ikeda, H. (2025) · Actuators · doi:10.3390/act14110548 · Cited by 3
“In reservoir computing, it is often said that maximal computational power is achieved near the “edge of chaos” [33].”
Impact of weak generalized synchronization on time series forecasting using reservoir computers
Suetani, H., & Parlitz, U. (2026) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0283017 · Cited by 4
Seeking optimal parameters for achieving a lightweight reservoir computing: A computational endeavor
Zhao, B. (2022) · Electronic Research Archive · doi:10.3934/era.2022152 · Cited by 3
Shaping dynamical neural computations using spatiotemporal constraints
Kim, J. Z., Larsen, B., & Parkes, L. (2024) · Biochemical and Biophysical Research Communications · doi:10.1016/j.bbrc.2024.150302 · Cited by 4
Horizumi, K., Chiba, T., & Komine, T. (2025) · Journal of the Magnetics Society of Japan · doi:10.3379/msjmag.2505r002 · Cited by 4
Reservoir Computing with a Single Oscillating Gas Bubble: Emphasizing the Chaotic Regime
Abdel-Ghani, H., Abbas, A. H., & Maksymov, I. S. (2025) · AppliedMath · doi:10.3390/appliedmath5030101 · Cited by 4
Exploiting Bistability and Viscoelasticity in Reservoir Computing
Ghoshal, P., Gibert, J. M., & Bajaj, A. K. (2025) · Nonlinear Dynamics · doi:10.1007/s11071-025-11759-z · Cited by 3
Chaos-based reinforcement learning with TD3
Matsuki, T., Sakemi, Y., & Aihara, K. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108202 · Cited by 9
“However, g > 1 sometimes achieves better performance, and it is argued that the best value for learning is realized when the reservoir dynamics is around the edge of chaos [48, 49].”
Synaptic plasticity alters the nature of the chaos transition in neural networks
Du, W., & Huang, H. (2025) · Physical review. E · doi:10.1103/7kk9-3jm8 · Cited by 5
Adaptive Local Information Transfer in Random Boolean Networks
Haruna, T. (2017) · Artificial Life · doi:10.1162/artl_a_00224 · Cited by 3
Maximizing memory capacity of echo state networks with orthogonalized reservoirs
Farkaš, I., & Gergeľ, P. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966152 · Cited by 3
“The well-known approach from the literature is the (characteristic) Lyapunov exponent (LE), based on evaluating the average sensitivity to perturbations of the initial conditions [15], [16].”
MethodExploring Criticality as a Generic Adaptive Mechanism
Aguilera, M., & Bedía, M. G. (2018) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00055 · Cited by 5
“Some authors have studied the computational capabilities of recurrent neural networks that operate near the edge of chaos, that is, the transition from ordered to chaotic dynamics (Bertschinger and Natschläger, 2004).”
BackgroundProbabilistic Deterministic Finite Automata and Recurrent Networks, Revisited
Marzen, S., & Crutchfield, J. P. (2022) · Entropy · doi:10.3390/e24010090 · Cited by 4
“The matrix W is then scaled so that it is near the “edge of chaos” [34]–[37], where RCs are conjectured to have maximal memory [38], [39].”
BackgroundThe non linear dynamics of retinal waves
Cessac, B., & Karvouniari, D. (2022) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2022.133436 · Cited by 3
“From a theoretical point of view, it has been suggested [49, 89] that such a scale-free organisation could favor information storage and transfer, improvement of the computational capabilities [10], information transmission [9, 10, 91], sensitivity to stimuli and enlargement of dynamic range [66, 90, 38, 39].”
BackgroundThe connectivity degree controls the difficulty in reservoir design of random boolean networks
Calvet, E., Reulet, B., & Rouat, J. (2024) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1348138 · Cited by 5
Hirayae, S., Yoshioka, K., Yokota, A., Kawashima, I., Tanaka, Y., Katori, Y., Nomura, O., Morie, T., & Tamukoh, H. (2024) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas58744.2024.10557841 · Cited by 5
“(1) and (3), which involves simultaneously measuring the memory capacity and nonlinearity [13].”
BackgroundMethodSun, Y., Chen, X., Chen, C., Liu, B., Chen, B.-Y., Zhao, Z., Wei, D., Back, C. H., Kang, W., Zhao, W. S., et al. (2024) · Applied Physics Letters · doi:10.1063/5.0221747 · Cited by 3
Liu, Q., Chen, W., Qu, Y., & Liang, Z. (2024) · Advances in neurobiology · doi:10.1007/978-3-031-69188-1_3 · Cited by 6
Reduced connection strength leads to enhancement of working memory capacity in cognitive training
Lv, G., Xu, T., Li, J., Zhu, P., Chen, F., Yang, D., & Guo-guang, H. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121055 · Cited by 3
Reservoir controllers design though robot-reservoir timescale alignment
Ye, F., Abdulali, A., Chu, K.-F., Zhang, X.-P. S., & Fumiya Iida, A. (2025) · Communications Engineering · doi:10.1038/s44172-025-00418-1 · Cited by 6
Marcucci, G., Olivieri, L., & Gongora, J. S. T. (2025) · Frontiers in Nanotechnology · doi:10.3389/fnano.2025.1631564 · Cited by 7
What Makes a Brain Smart? Reservoir Computing as an Approach for General Intelligence
Szary, J., Kerster, B., & Kello, C. T. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22887-2_51 · Cited by 5
“2(b-c), computational performance is maximal near R ∼ 1, indicating that the performance of reservoir models is enhanced when spiking dynamics approach their CB point [17](4).”
BackgroundIchimura, T., Nakane, R., Tanaka, G., & Hirose, A. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207629 · Cited by 3
“Many researchers reported their analyses [5]–[7] including the utilization of the so-called edge of chaos [8], [9], performance analyses in terms of embedding dimension [10], nonlinearity in constructing elements such as memristor [11] and its variability among the elements [12].”
BackgroundExploring Looping Effects in RNN-based Architectures
Щербаков, А. В., Muradoğlu, S., & Vylomova, E. (2020) · Cited by 3
Canavier, C. C., & Shepard, D. S. (2009) · Springer eBooks · doi:10.1007/978-3-211-92660-4_9 · Cited by 3
“Furthermore, it has been suggested that rather than being detrimental to certain computations, complex system dynamics on the edge of chaos may actually enhance them (Bertschinger and Natschlager 2004).”
BackgroundA POPULATION MODEL OF THE STABILITY–FLEXIBILITY TRADEOFF
Voorhees, B. H., SENEZ, J., Keeler, T. A., & Connors, M. G. (2008) · Advances in Complex Systems · doi:10.1142/s021952590800174x · Cited by 3
Dynamical coherence patterns in neural field model at criticality
Termsaithong, T., Oku, M., & Aihara, K. (2012) · Artificial Life and Robotics · doi:10.1007/s10015-012-0020-x · Cited by 3
“Some numerical studies also show that at the critical point, the dynamic range [2], memory capacity [3], and computational power [4] are optimum in neural network models.”
BackgroundVisual Motion Perception using Critical Branching Neural Computation
Szary, J., & Kello, C. T. (2011) · eScholarship (California Digital Library) · Cited by 3
Recurrent Information Optimization with Local, Metaplastic Synaptic Dynamics
Liu, S., & Ching, S. (2017) · Neural Computation · doi:10.1162/neco_a_00993 · Cited by 4
Critical Neural Networks Minimize Metabolic Cost
Aguilar-Velázquez, D. (2021) · Physics · doi:10.3390/physics3010005 · Cited by 5
“Finally, critical dynamics has been related to a maximum dynamic repertoire [3,4], high information storage [59,60], parametric dimension reduction [61], robustness [14,16,62], and computational efficiency [63].”
BackgroundMonostable stochastic resonance activation unit-based physical reservoir computing
Tao, Y., & Luo, B. (2023) · Journal of the Korean Physical Society · doi:10.1007/s40042-023-00727-8 · Cited by 4
The Role of Criticality in Flexible Visual Information Processing
Tömen, N., & Ernst, U. A. (2019) · Springer series on bio- and neurosystems · doi:10.1007/978-3-030-20965-0_12 · Cited by 5
“In general, many modelling studies which similarly put forward computational 669 benefits of criticality rely on comparatively abstract measures or are restricted to 670 homogeneous or slowly-driven networks [33, 6, 30, 59].”
BackgroundFar-from-equilibrium computation
Florian, R. V., & Dumitrescu, D. (2004) · Cited by 3
Neural Information Processing: between synchrony and chaosPreprint
Rosselló, J. L., Canals, V., & Morro, A. (2012) · Nature Precedings · doi:10.1038/npre.2012.6935.1 · Cited by 3
Erratum: How to build a critical mind
Beggs, J. M. (2008) · Nature Physics · doi:10.1038/nphys836 · Cited by 3
Collaboration on the edge of chaos
Clarke, T. L., & Goldiez, B. F. (2007) · International Conference on Collaboration Technologies and Systems (CTS) · doi:10.1109/cts.2007.4621747 · Cited by 3
“Much theoretical work has been done showing how complex computational tasks can be accomplished by dynamical systems at the edge of chaos (see Bertschinger and Natschlager [3]).”
BackgroundPractical investigations of complex systems
Brodu, N. (2007) · Spectrum Research Repository (Concordia University) · Cited by 3
Inference, validation and predictions about statistics and propagation of cortical spiking in vivoPreprint
Wilting, J., & Priesemann, V. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/363085 · Cited by 3
The Processing and Storage of Information in Neuronal Memory Systems Across Time Scales
Nachstedt, T. (2018) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-6885 · Cited by 3
A local Echo State Property through the largest Lyapunov exponentPreprint
Galtier, M., & Wainrib, G. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.1619 · Cited by 3
“We do not claim that the edge of chaos is always the best regime, but it has been shown that for some applications, typically requiring a lot of memory, it was optimal [36].”
BackgroundOptimal Machine Intelligence at the Edge of ChaosPreprint
Feng, L., Zhang, L., & Lai, C. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.05176 · Cited by 14
“Early neural networks models have been able to show clear correlation between edge of chaos and computational power ( 7,8 ).”
BackgroundConsciousness is supported by near-critical cortical electrodynamicsPreprint
Toker, D., Pappas, I., Lendner, J. D., Frohlich, J., Mateos, D. M., Muthukumaraswamy, S. D., Carhart-Harris, R. L., Paff, M. R., Vespa, P. M., Monti, M. M., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.06.10.447959 · Cited by 3
Morales, G. B., Santo, S. D., & Muñoz, M. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.23.469734 · Cited by 3
Pazienti, A., Galluzzi, A., Pani, P., Ferraina, S., & Mattia, M. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.09.20.613889 · Cited by 6
“Such a system yields scale-free dependence of both temporal and spatial scales and is presumed to offer computational advantages (Bertschinger and Natschläger, 2004; De Arcangelis et al., 2006; Beggs, 2008).”
Background
Metadata
- Authors
- Bertschinger, N., & Natschläger, T.
- Affiliations
- Graz University of Technology (AT)
- Software Competence Center Hagenberg (Austria) (AT)
- ORCID
- Bertschinger, Nils
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2004-07-01
- Volume
- 16
- Issue
- 7
- Pages
- 1413-1436
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2057755457
- Cited by
- 833
- References
- 26
- Citations by year
- 2026: 45 · 2025: 73 · 2024: 61 · 2023: 48 · 2022: 66 · 2021: 73 · 2020: 52 · 2019: 53 · 2018: 47 · 2017: 48 · 2016: 26 · 2015: 33 · 2014: 29 · 2013: 33 · 2012: 27
- FWCI
- 13.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Cellular Automata and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Keywords
- edge of chaos, recurrent neural networks, critical connectivity, threshold gates, random connectivity, real-time processing, dynamical systems
- MeSH terms
- Animals, Artificial Intelligence, Computer Simulation, Feedback, Memory, Models, Neurological, Time Factors, Neural Networks, Computer, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.