Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
A key challenge for neural modeling is to explain how a continuous stream of multimodal input from a rapidly changing environment can be processed by stereotypical recurrent circuits of integrate-and-fire neurons in real time. We propose a new computational model for real-time computing on time-varying input that provides an alternative to paradigms based on Turing machines or attractor neural networks. It does not require a task-dependent construction of neural circuits. Instead, it is based on principles of high-dimensional dynamical systems in combination with statistical learning theory and can be implemented on generic evolved or found recurrent circuitry. It is shown that the inherent transient dynamics of the high-dimensional dynamical system formed by a sufficiently large and heterogeneous neural circuit may serve as universal analog fading memory. Readout neurons can learn to extract in real time from the current state of such recurrent neural circuit information about current and past inputs that may be needed for diverse tasks. Stable internal states are not required for giving a stable output, since transient internal states can be transformed by readout neurons into stable target outputs due to the high dimensionality of the dynamical system. Our approach is based on a rigorous computational model, the liquid state machine, that, unlike Turing machines, does not require sequential transitions between well-defined discrete internal states. It is supported, as the Turing machine is, by rigorous mathematical results that predict universal computational power under idealized conditions, but for the biologically more realistic scenario of real-time processing of time-varying inputs. Our approach provides new perspectives for the interpretation of neural coding, the design of experiments and data analysis in neurophysiology, and the solution of problems in robotics and neurotechnology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although work in artificial intelligence and machine-learning research has shown that similar or even more complex outcomes can be achieved with a variety of techniques, including deep neural networks with trained weights (Gibney, 2015), reservoir networks with a trained output mapping (Maass et al., 2002;Jaeger & Haas, 2004), networks that are evolved using a genetic algorithm (Iizuka & Di Paolo,”
From A potential mechanism for Gibsonian resonance: behavioral entrainment emerges from local homeostasis in an unsupervised reservoir network (2024) · cites this paper as Maass et al., 2002
In the citing paper
“Finally, we show that a randomly connected circuit model, akin to a “reservoir” network13-15, can reproduce the observed distribution of timescales, provided that the network operates at the critical point (or “edge of chaos”)16-18.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [13]
In the citing paper
“Reservoir-type networks have been the subject of active research in computational neuroscience and machine learning13-15, but so far experimental support that such networks are adopted by the brain has been lacking.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [13]
In the citing paper
“Those models predict that the memory of input signals is stored in a large, recurrent and heterogeneous network (reservoir), in a distributed manner, and that a desired output is obtained by a trainable combination of the response signals in the reservoir.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [13]
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Introduction to the theory of neural computation
(1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,401
The Synaptic Organization of the Brain
(2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195159561.001.1 · Cited by 3,546 · cited 2×
“This informationisprocessed by extremely complexbut surprisingly stereotypic microcircuits that can perform a wide spectrum of tasks (Shep-herd, 1988 ; Douglas & Martin, 1998 ; von Melchner, Pallas, & Sur, 2000).”
Dynamics of ongoing activity: explanation of the large variability in evoked cortical responses
Arieli, A., Sterkin, A., Grinvald, A., & Aertsen, A. (1996) · Science · doi:10.1126/science.273.5283.1868 · Cited by 1,660 · cited 1×
“Furthermore, although the input rate may contain salient information that is constant for a particular readout element, it may not be for another (see, for example, Figure 8), indicating that equivalence classes and dynamic stability exist purely from the perspective of the readout elements.”
BackgroundDifferential signaling via the same axon of neocortical pyramidal neurons
Markram, H., Wang, Y., & Tsodyks, M. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.9.5323 · Cited by 1,102 · cited 2×
“In the case of a synaptic connection from a to b , we modeled the synaptic dynamics according to the model proposed in Markram, Wang, and Tsodyks (1998), with the synaptic parameters U (use), D (time constant for depression), and F (time constant for facilitation) randomly chosen from gaussian…”
BackgroundMethodSelf-citationOrganizing principles for a diversity of GABAergic interneurons and synapses in the neocortex
Gupta, A., Wang, Y., & Markram, H. (2000) · Science · doi:10.1126/science.287.5451.273 · Cited by 1,036
Self-citationFading memory and the problem of approximating nonlinear operators with Volterra series
Boyd, S., & Chua, L. (1985) · IEEE Transactions on Circuits and Systems · doi:10.1109/tcs.1985.1085649 · Cited by 991 · cited 2×
“> The proof of this theorem follows from the Stone-Weierstrass approximation theorem, like the proof of theorem 1 in Boyd and Chua (1985).”
BackgroundGradient calculations for dynamic recurrent neural networks: a survey
Pearlmutter, B. A. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.410363 · Cited by 582 · cited 1×
“Methods for controllingthe dynamics of recurrent neural networks through adaptive mechanisms are reviewed in Pearlmutter (1995).”
Temporal Information Transformed into a Spatial Code by a Neural Network with Realistic Properties
Buonomano, D. V., & Merzenich, M. M. (1995) · Science · doi:10.1126/science.7863330 · Cited by 449 · cited 1×
“Special cases of this mechanism have already been reported in Buonomano and Merzenich (1995) and Dominey, Arbib, and Joseph (1995).”
BackgroundLearning and Extracting Finite State Automata with Second-Order Recurrent Neural Networks
Giles, C. L., Miller, C. B., Chen, D., Chen, H. H., Sun, G. Z., & Lee, Y. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.393 · Cited by 392
Cited by
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
“In fact, some popular RNN algorithms restricted credit assignment to a single step backwards (Elman, 1990; Jordan, 1986, 1997), also inmore recent studies (Jaeger, 2001, 2004; Maass et al., 2002).”
ResultHarnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication
Jaeger, H., & Haas, H. (2004) · Science · doi:10.1126/science.1091277 · Cited by 3,811
Reservoir computing approaches to recurrent neural network training
Lukoševičius, M., & Jaeger, H. (2009) · Computer Science Review · doi:10.1016/j.cosrev.2009.03.005 · Cited by 2,956
“Liquid State Machines (LSMs) [11] are the other pioneering reservoir method, developed independently”
BackgroundMethodInfluentialRecent advances in physical reservoir computing: A review
Tanaka, G., Yamane, T., Héroux, J. B., Nakane, R., Kanazawa, N., Takeda, S., Numata, H., Nakano, D., & Hirose, A. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.03.005 · Cited by 2,146
“…RC is a unified computational framework (Lukoševičius & Jaeger, 2009; Verstraeten, Schrauwen, d’ Haene, & Stroobandt, 2007), derived from independently proposed RNN models, such as echo state networks (ESNs) (Jaeger, 2001) and liquid state machines (LSMs) (Maass, Natschläger, & Markram, 2002).”
BackgroundMethodInfluentialInformation processing using a single dynamical node as complex system
Appeltant, L., Soriano, M. C., Van der Sande, G., Danckaert, J., Massar, S., Dambre, J., Schrauwen, B., Mirasso, C. R., & Fischer, I. (2011) · Nature Communications · doi:10.1038/ncomms1476 · Cited by 1,716
The importance of mixed selectivity in complex cognitive tasks
Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., & Fusi, S. (2013) · Nature · doi:10.1038/nature12160 · Cited by 1,639
Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors
Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S. (2013) · Neural Computation · doi:10.1162/neco_a_00393 · Cited by 1,598
Deep learning in spiking neural networks
Tavanaei, A., Ghodrati, M., Kheradpisheh, S. R., Masquelier, T., & Maida, A. (2019) · Neural Networks · doi:10.1016/j.neunet.2018.12.002 · Cited by 1,386
“In an effort to model the computations that might be taking place within the canonical neocortical microcircuit, the liquid state machine (LSM) was introduced [221] which has since been partly absorbed by the field of reservoir computing [222], [223].”
Neuromorphic computing with nanoscale spintronic oscillators
Torrejon, J., Riou, M., Araujo, F. A., Tsunegi, S., Khalsa, G., Querlioz, D., Bortolotti, P., Cros, V., Yakushiji, K., Fukushima, A., et al. (2017) · Nature · doi:10.1038/nature23011 · Cited by 1,374
Pathak, J., Hunt, B., Girvan, M., Lu, Z., & Ott, E. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.024102 · Cited by 1,303
Neural syntax: cell assemblies, synapsembles, and readers
Buzsáki, G. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.023 · Cited by 1,289
“…of neuronal patterns can be strengthened by reinforcers (i.e., goals), which optimize the connectivity of the upstream assembly post-hoc so that it will activate the reader more effectively on future occasions (Izhikevich, 2007; Legenstein and Maass, 2007; Maass et al., 2002; Seung, 2003).”
Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control
Brunton, S. L., & Kutz, J. N. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690 · Cited by 1,154
An experimental unification of reservoir computing methods
Verstraeten, D., Schrauwen, B., D’Haene, M., & Stroobandt, D. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.003 · Cited by 1,135
Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
“selected inhibitory neurons and 80% excitatory neurons. Connections from input to liquid: for every pair of input signal and liquid neuron there is a certain chance of being connected, e.g., 30% in [121]. Connections between neurons in the liquid: The connections between the neurons are allocated in a stochastic manne…”
BackgroundMethodInfluentialKriegeskorte, N. (2015) · Annual Review of Vision Science · doi:10.1146/annurev-vision-082114-035447 · Cited by 1,093
Generating Coherent Patterns of Activity from Chaotic Neural Networks
Sussillo, D., & Abbott, L. F. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.018 · Cited by 1,092
“In the absence of such a complete model, we need to have a way of describing what the network is ''doing,'' and here we follow another suggestion from the liquid-and echo-state approach (Maass et al., 2002; Jaeger, 2003; see also Buonomano and Merzenich, 1995).”
InfluentialPolychronization: Computation with Spikes
Izhikevich, E. M. (2006) · Neural Computation · doi:10.1162/089976606775093882 · Cited by 1,062
GHOSH-DASTIDAR, S., & ADELI, H. (2009) · International Journal of Neural Systems · doi:10.1142/s0129065709002002 · Cited by 1,057
Reservoir computing using dynamic memristors for temporal information processing
Du, C., Cai, F., Zidan, M. A., Ma, W., Lee, S. H., & Lu, W. D. (2017) · Nature Communications · doi:10.1038/s41467-017-02337-y · Cited by 1,015
“The memristor-based RC system was further analyzed through simulation using a physics-based memristor model (details are shown in Supplementary Note 3 and Supplementary Tables 1 – 4).”
MethodInfluentialThe neural basis of temporal processing
Mauk, M. D., & Buonomano, D. V. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144247 · Cited by 976
Optimization and applications of echo state networks with leaky- integrator neurons
Jaeger, H., Lukoševičius, M., Popovici, D., & Siewert, U. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.016 · Cited by 948
State-dependent computations: spatiotemporal processing in cortical networks
Buonomano, D. V., & Maass, W. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2558 · Cited by 926
Self-citationExperimental demonstration of reservoir computing on a silicon photonics chip
Vandoorne, K., Mechet, P., Van Vaerenbergh, T., Fiers, M., Morthier, G., Verstraeten, D., Schrauwen, B., Dambre, J., & Bienstman, P. (2014) · Nature Communications · doi:10.1038/ncomms4541 · Cited by 892
“Without the trained feedback, any continuous problem that requires only fading memory (a broad class of real-world problems) can be solved under some general and mild conditions 2 .”
BackgroundA Practical Guide to Applying Echo State Networks
Lukoševičius, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_36 · Cited by 867
“Ten years ago an alternative trend of understanding, training, and using RNNs has been proposed with Echo State Networks (ESNs) [6,7] in ML, and Liquid State Machines (LSMs) [8] in computational neuroscience.”
Background‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework
Stokes, M. G. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.05.004 · Cited by 850
Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity
Ikegaya, Y., Aaron, G., Cossart, R., Aronov, D., Lampl, I., Ferster, D., & Yuste, R. (2004) · Science · doi:10.1126/science.1093173 · Cited by 838
Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks
Bertschinger, N., & Natschläger, T. (2004) · Neural Computation · doi:10.1162/089976604323057443 · Cited by 833
“(Maass et al., 2002) and indepenently by Jaeger (Jaeger, 2002) who called it “echo state networks”.”
BackgroundInfluentialSelf-citationDynamical principles in neuroscience
Rabinovich, M. I., Varona, P., Selverston, A. I., & Abarbanel, H. D. I. (2006) · Reviews of Modern Physics · doi:10.1103/revmodphys.78.1213 · Cited by 824
Simulation of networks of spiking neurons: A review of tools and strategies
Brette, R., Rudolph, M., Carnevale, T., Hines, M., Beeman, D., Bower, J. M., Diesmann, M., Morrison, A., Goodman, P. H., Harris, F. C., et al. (2007) · Journal of Computational Neuroscience · doi:10.1007/s10827-007-0038-6 · Cited by 822
Self-citationOptoelectronic Reservoir Computing
Paquot, Y., Duport, F., Smerieri, A., Dambre, J., Schrauwen, B., Haelterman, M., & Massar, S. (2012) · Scientific Reports · doi:10.1038/srep00287 · Cited by 783
Why neurons mix: high dimensionality for higher cognition
Fusi, S., Miller, E. K., & Rigotti, M. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2016.01.010 · Cited by 766
“Moreover, high-dimensional neural representations are also a crucial component of dynamical models of recurrent neural networks like echo state machines or liquid state machines [35–40].”
BackgroundDeep Learning With Spiking Neurons: Opportunities and Challenges
Pfeiffer, M., & Pfeil, T. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00774 · Cited by 766
“In these cases, instead of a deep or structured recurrent architecture the networks were configured as liquid state machines (Maass et al., 2002), which consist of a reservoir of randomly and recurrently connected neurons, followed by a linear readout.”
BackgroundFrom the neuron doctrine to neural networks
Yuste, R. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3962 · Cited by 754
“…new methods to measure multi-neuronal activity in vitro or in vivo 14,149,178–180 or to analyse and model multidimensional and dynamical activity 37,109,181 may usher in a Kuhnian ‘scientific revolution’ 36 , in which the single-neuron doctrine taught in text-books is replaced by a new neural…”
BackgroundMethodMinimum Complexity Echo State Network
Rodan, A., & Tino, P. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2089641 · Cited by 710
“Liquid state machines (LSMs) [33] also mostly have a linear readout and the reservoirs are driven by the dynamics of a set of coupled spiking neuron models.”
BackgroundQiao, N., Mostafa, H., Corradi, F., Osswald, M., Stefanini, F., Sumislawska, D., & Indiveri, G. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00141 · Cited by 698
“An other alternative could consist in interconnecting the neurons in the hidden layer to form a Liquid State Machine (LSM) (Maass et al., 2002).”
BackgroundComputation Through Neural Population Dynamics
Vyas, S., Golub, M. D., Sussillo, D., & Shenoy, K. V. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092619-094115 · Cited by 671
“…state-dependent networks, which inherently keep track of time as they are composed of units that have time-dependent biological properties, and thus evolving states of these networks encode the passage of time (Buonomano 2000, Buonomano &Maass 2009, Karmarkar & Buonomano 2007, Maass et al. 2002).”
BackgroundEmbedded Devices for Neuromorphic Time-Series Assessment
Mazumder, A. N., Hosseini, M., & Mohsenin, T. (2022) · Research Explorer (The University of Manchester) · doi:10.13016/m2ksy0-wxr3 · Cited by 652
Can structure predict function in the human brain?
Honey, C. J., Thivierge, J.-P., & Sporns, O. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.01.071 · Cited by 629
“trained to accommodate a variety of functional roles (Maass et al., 2002; Buonomano and Maass, 2009; Sussillo and Abbott, 2009).”
Using machine learning to replicate chaotic attractors and calculate Lyapunov exponents from data
Pathak, J., Lu, Z., Hunt, B. R., Girvan, M., & Ott, E. (2017) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5010300 · Cited by 620
Integration of nanoscale memristor synapses in neuromorphic computing architectures
Indiveri, G., Linares-Barranco, B., Legenstein, R., Deligeorgis, G., & Prodromakis, T. (2013) · Nanotechnology · doi:10.1088/0957-4484/24/38/384010 · Cited by 613
Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing
(2021) · doi:10.1038/s41467-020-20692-1 · Cited by 597
Advances in photonic reservoir computing
Van der Sande, G., Brunner, D., & Soriano, M. C. (2017) · Nanophotonics · doi:10.1515/nanoph-2016-0132 · Cited by 591
“It was meant to unify two closely related RNN structures: the echo state network by Jaeger [18], described in 2001, and the liquid state machine by Maass et al. [14], in 2002.”
BackgroundMethodInfluentialNext generation reservoir computing
Gauthier, D. J., Bollt, E., Griffith, A., & Barbosa, W. A. S. (2021) · Nature Communications · doi:10.1038/s41467-021-25801-2 · Cited by 582
“The output layer expresses the RC output Y as a linear transformation of a feature vector O , r , constructed from the reservoir state r , through the relation Y W O , r , (2)”
BackgroundInfluentialTiming in the Absence of Clocks: Encoding Time in Neural Network States
Karmarkar, U. R., & Buonomano, D. V. (2007) · Neuron · doi:10.1016/j.neuron.2007.01.006 · Cited by 577
“…networks (SDNs), propose that neural circuits are inherently capable of temporal processing as a result of the natural complexity of cortical networks coupled with the presence of time-dependent neuronal properties (Buonomano and Merzenich, 1995; Buonomano, 2000; Maass et al., 2002).”
BackgroundMethodInfluentialOpening the black box: low-dimensional dynamics in high-dimensional recurrent neural networks
Sussillo, D., & Barak, O. (2013) · Neural Computation · doi:10.1162/neco_a_00409 · Cited by 575
“Recently, there has been progress in training RNNs to perform desired behaviors (Maass et al., 2002; Jaeger and Haas, 2004; Maass et al., 2007; Sussillo and Abbott, 2009; Martens and Sutskever, 2011).”
BackgroundPonulak, F., & Kasiński, A. (2010) · Neural Computation · doi:10.1162/neco.2009.11-08-901 · Cited by 573
“We illustrate this ability in a classification task proposed by Maass and colleagues (Maass et al., 2002; Natschlaeger, Markram, & Maass, 2003), where a spiking neural network is supposed to categorize the particular jittered segments of the input spike trains.”
BackgroundMethodInfluentialNeuromorphic Electronic Circuits for Building Autonomous Cognitive Systems
Chicca, E., Stefanini, F., Bartolozzi, C., & Indiveri, G. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2313954 · Cited by 552
“Indeed, intrinsic variability and diverse activation patterns are often identified as fundamental aspects of neural computation for information maximization and transmission [30], [148]–[150].”
BackgroundA new approach to neuroimaging with magnetoencephalography
Hillebrand, A., Singh, K. D., Holliday, I. E., Furlong, P. L., & Barnes, G. R. (2005) · Human Brain Mapping · doi:10.1002/hbm.20102 · Cited by 549
“These nonlinear connections bestow a complexity on the system that gives it memory and adaptability [Maass et al., 2002].”
BackgroundA neuronal model of predictive coding accounting for the mismatch negativity.
Wacongne, C., Changeux, J.-P., & Dehaene, S. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5003-11.2012 · Cited by 542
“In a more realistic memory network, the artificial delay lines that we used could be replaced by more realistic chaotic temporal dynamics, as in “reservoir” or echo state networks models (Maass et al., 2002; Buonomano, 2005; Buonomano and Laje, 2010; Pascanu and Jaeger, 2011).”
MethodThe criticality hypothesis: how local cortical networks might optimize information processing
Beggs, J. M. (2008) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2092 · Cited by 533
“By changing the variance in synaptic weights in a spiking network model, Bertschinger and colleagues (Maass et al. 2002; Bertschinger & Natschlager 2004) produced networks with damped,”
MethodColloquium: Criticality and dynamical scaling in living systems
Muñoz, M. A. (2018) · Reviews of Modern Physics · doi:10.1103/revmodphys.90.031001 · Cited by 530
“…intelligence, criticality is exploited in socalled “reservoir computing” (Lukoševičius et al., 2012) that was developed independently in the fields of machine learning (“echo state networks” of Jaeger (2007)) and computational neuroscience (“liquid state machine” in Maass et al. (2002)).”
BackgroundThe rise of intelligent matter
Kaspar, C., Ravoo, B. J., van der Wiel, W. G., Wegner, S. V., & Pernice, W. H. P. (2021) · Nature · doi:10.1038/s41586-021-03453-y · Cited by 526
SuperSpike: Supervised Learning in Multilayer Spiking Neural Networks
Zenke, F., & Ganguli, S. (2018) · Neural Computation · doi:10.1162/neco_a_01086 · Cited by 515
“For instance, Maass et al. (2002) have used the p-delta rule (Auer et al., 2008) to train the readout layer of a liquid state machine.”
MethodLarger, L., Baylón-Fuentes, A., Martinenghi, R., Udaltsov, V. S., Chembo, Y. K., & Jacquot, M. (2017) · Physical Review X · doi:10.1103/physrevx.7.011015 · Cited by 509
“Such auto-oscillations are considered to prevent an important required property for reservoir dynamics, referred to as the fading memory property [3].”
BackgroundAll-optical reservoir computing
Duport, F., Schneider, B., Smerieri, A., Haelterman, M., & Massar, S. (2012) · Optics Express · doi:10.1364/oe.20.022783 · Cited by 502
Liu, K., Zhang, T., Dang, B., Bao, L., Xu, L., Cheng, C., Yang, Z., Huang, R., & Yang, Y. (2022) · Nature Electronics · doi:10.1038/s41928-022-00847-2 · Cited by 498
Being Critical of Criticality in the Brain
Beggs, J. M., & Timme, N. (2012) · Frontiers in Physiology · doi:10.3389/fphys.2012.00163 · Cited by 494
“Researchers have developed many models to attempt to more fully incorporate neural behavior, and specifically to deal with temporal dynamics (Maass et al., 2002).”
BackgroundTransient Dynamics for Neural Processing
Rabinovich, M., Huerta, R., & Laurent, G. (2008) · Science · doi:10.1126/science.1155564 · Cited by 491
Re-visiting the echo state property
Yildiz, I. B., Jaeger, H., & Kiebel, S. J. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.07.005 · Cited by 486
“This basic functional principle is shared with Liquid State Machines (LSM), which were developed independently from and simultaneously with ESNs by Wolfgang Maass [19].”
BackgroundVlachas, P. R., Pathak, J., Hunt, B. R., Sapsis, T. P., Girvan, M., Ott, E., & Koumoutsakos, P. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.02.016 · Cited by 480
“This technique has been proposed in the context of Echo-State-Networks (ESNs) (Jaeger & Haas, 2004) and Liquid State Machines with spiking neurons (LSM) (Maass, Natschläger, & Markram, 2002).”
MethodInformation Processing Capacity of Dynamical Systems
Dambre, J., Verstraeten, D., Schrauwen, B., & Massar, S. (2012) · Scientific Reports · doi:10.1038/srep00514 · Cited by 480
Efficient codes and balanced networks
Denève, S., & Machens, C. K. (2016) · Nature Neuroscience · doi:10.1038/nn.4243 · Cited by 471
“These include, among others, attractor networks based on positive feedback 61 , Mexican-hat architectures for sensory processing 61 or reservoir computing schemes 62,63 .”
BackgroundHaldeman, C., & Beggs, J. M. (2005) · Physical Review Letters · doi:10.1103/physrevlett.94.058101 · Cited by 469
Reorganization between preparatory and movement population responses in motor cortex
Elsayed, G. F., Lara, A. H., Kaufman, M. T., Churchland, M. M., & Cunningham, J. P. (2016) · Nature Communications · doi:10.1038/ncomms13239 · Cited by 464
Milano, G., Pedretti, G., Montano, K., Ricci, S., Hashemkhani, S., Boarino, L., Ielmini, D., & Ricciardi, C. (2022) · Nature Materials · doi:10.1038/s41563-021-01099-9 · Cited by 462
Jaeger, H. (2007) · Scholarpedia · doi:10.4249/scholarpedia.2330 · Cited by 459
Broadcast and Weight: An Integrated Network For Scalable Photonic Spike Processing
Tait, A. N., Nahmias, M. A., Shastri, B. J., & Prucnal, P. R. (2014) · Journal of Lightwave Technology · doi:10.1109/jlt.2014.2345652 · Cited by 457
Robust timing and motor patterns by taming chaos in recurrent neural networks
Laje, R., & Buonomano, D. V. (2013) · Nature Neuroscience · doi:10.1038/nn.3405 · Cited by 454
“…complex sensory stimuli or generate motor patterns (Buonomano and Laje, 2010; Buonomano and Mauk, 1994; Buonomano and Merzenich, 1995; Haeusler and Maass, 2007; Jaeger, 2001; Jaeger and Haas, 2004; Karmarkar and Buonomano, 2007; Maass et al., 2002; Mauk and Donegan, 1997; Medina et al., 2000).”
BackgroundKasabov, N. K. (2014) · Neural Networks · doi:10.1016/j.neunet.2014.01.006 · Cited by 454
“Several spiking neuronal models have been proposed so far (e.g. Gerstner, 2001; Hodgkin & Huxley, 1952; Izhikevich, 2006; Maass et al., 2002).”
Edge of chaos and prediction of computational performance for neural circuit models
Legenstein, R., & Maass, W. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.017 · Cited by 453
Self-citationEfficient Learning Machines: Theories, Concepts, and Applications for Engineers and System Designers
Awad, M., & Khanna, R. (2015) · Directory of Open access Books (OAPEN Foundation) · doi:10.1007/978-1-4302-5990-9 · Cited by 448
The Neural Basis of Timing: Distributed Mechanisms for Diverse Functions
Paton, J. J., & Buonomano, D. V. (2018) · Neuron · doi:10.1016/j.neuron.2018.03.045 · Cited by 442
Self-organized criticality as a fundamental property of neural systems
Hesse, J., & Gross, T. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00166 · Cited by 440
“(Kauffman, 1984; Derrida and Pomeau, 1986), liquid state machines (Langton, 1990), and neuronal networks (Maass et al., 2002; Bertschinger and Natschläger, 2004), for a review also see Legenstein and Maass (2007).”
BackgroundPhysical reservoir computing—an introductory perspective
Nakajima, K. (2020) · Japanese Journal of Applied Physics · doi:10.35848/1347-4065/ab8d4f · Cited by 422
“Accordingly, several reservoir settings implement brain-inspired connections [134] or simply implement the neighboring connections [4], introducing a spatial dimension that is not random at all.”
BackgroundOn simplicity and complexity in the brave new world of large-scale neuroscience
Gao, P., & Ganguli, S. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.04.003 · Cited by 405
“In the realm of short-term sequence memory, the idea of liquid state machines [80, 81] posited that generic neural circuits could convert temporal information into instantaneous spatial patterns of activity, but theoretical work [82, 83, 84] revealed general principles relating circuit connectivity to memory, highligh…”
BackgroundBock, F. E., Aydin, R. C., Cyron, C. J., Huber, N., Kalidindi, S. R., & Klusemann, B. (2019) · Frontiers in Materials · doi:10.3389/fmats.2019.00110 · Cited by 403
Lukoševičius, M., Jaeger, H., & Schrauwen, B. (2012) · KI - Künstliche Intelligenz · doi:10.1007/s13218-012-0204-5 · Cited by 392
“can be utilized for purposeful computation [34].”
BackgroundNeural networks: An overview of early research, current frameworks and new challenges
Prieto, A., Prieto, B., Ortigosa, E. M., Ros, E., Pelayo, F., Ortega, J., & Rojas, I. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.06.014 · Cited by 391
Kasabov, N., Dhoble, K., Nuntalid, N., & Indiveri, G. (2013) · Neural Networks · doi:10.1016/j.neunet.2012.11.014 · Cited by 384
Machine learning and integrative analysis of biomedical big data
Mirza, B., Wang, W., Wang, J., Choi, H., Chung, N. C., & Ping, P. (2019) · Genes · doi:10.3390/genes10020087 · Cited by 380
“Non-iterative solutions for ANN include extreme learning machine (ELM) [188], random vector functional link (RVFL) [189,190], liquid state machine [191], echo state network [192], etc.”
BackgroundAttractor reconstruction by machine learning
Lu, Z., Hunt, B. R., & Ott, E. (2018) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5039508 · Cited by 374
Short-term memory for serial order: A recurrent neural network model.
Botvinick, M. M., & Plaut, D. C. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.201 · Cited by 369
“Subsequent theoretical work supports the idea that networks with essentially arbitrary recurrent connectivity can encode sequences of inputs (Jaeger, 2001; Maass et al., 2002; White et al., 2004).”
BackgroundAn overview of reservoir computing: theory, applications and implementations
Schrauwen, B., Verstraeten, D., & Campenhout, J. V. (2007) · Ghent University Academic Bibliography (Ghent University) · Cited by 552
Introduction to spiking neural networks: Information processing, learning and applications
Ponulak, 2., & Kasinski, A. (2011) · Acta Neurobiologiae Experimentalis · doi:10.55782/ane-2011-1862 · Cited by 368
“Yet, some attempts to harvest precise spiking timing in recurrent networks have been made for example by exploring the idea of reservoir computation (Maass et al. 2002a, Ponulak and Kasinski 2010).”
BackgroundMethodInfluentialThe cortex as a central pattern generator
Yuste, R., MacLean, J. N., Smith, J., & Lansner, A. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1686 · Cited by 355
Randomness in neural networks: an overview
Scardapane, S., & Wang, D. (2017) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1200 · Cited by 352
“It can be shown that, under these conditions, ESNs can approximate any time series with fading memory to the desired level of accuracy (whereas it cannot be used for tasks requiring unbounded memory).(95) In practice, the ESP can be guaranteed almost always by rescaling the matrix W r so that its spectral radius ρ W r…”
BackgroundA survey of randomized algorithms for training neural networks
Zhang, L., & Suganthan, P. N. (2016) · Information Sciences · doi:10.1016/j.ins.2016.01.039 · Cited by 352
“Among them, Liquid State Machine [50] randomly fixes the input weights and internal weights, while the output weights are learned by the wellknown recursive least squares (RLS) algorithm.”
BackgroundRecurrent network models of sequence generation and memory
Rajan, K., Harvey, C. D., & Tank, D. W. (2016) · Neuron · doi:10.1016/j.neuron.2016.02.009 · Cited by 351
“…thanbeing specificallydesigned foronesingle task, have been modified by training to perform a variety of tasks (Buonomano and Merzenich, 1995; Buonomano, 2005; Williams and Zipser, 1989; Pearlmutter, 1989; Jaeger and Haas, 2004; Maass et al., 2002, 2007; Sussillo and Abbott, 2009; Jaeger, 2003).”
MethodEmerging opportunities and challenges for the future of reservoir computing
Yan, M., Huang, C., Bienstman, P., Tino, P., Lin, W., & Sun, J. (2024) · Nature Communications · doi:10.1038/s41467-024-45187-1 · Cited by 346
“This inquiry was attempted in the early 2000s by Jaeger ( echo state networks (ESNs) 11 ) and Maass ( liquid statemachines(LSMs) , 12 ),achievingsurprisinglyhighlevelofprediction accuracy in systems that exhibit strong nonlinearity and chaotic behavior.”
BackgroundOptimal Control of Transient Dynamics in Balanced Networks Supports Generation of Complex Movements
Hennequin, G., Vogels, T. P., & Gerstner, W. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.045 · Cited by 346
“Moreover, the dynamicsmust be sufficiently rich to support complexmovement patterns (Maass et al., 2002; Sussillo and Abbott, 2009; Laje and Buonomano, 2013).”
Zhong, Y., Tang, J., Li, X., Liang, X., Liu, Z., Li, Y., Xi, Y., Yao, P., Hao, Z., Gao, B., et al. (2022) · Nature Electronics · doi:10.1038/s41928-022-00838-3 · Cited by 343
Memory without Feedback in a Neural Network
Goldman, M. S. (2009) · Neuron · doi:10.1016/j.neuron.2008.12.012 · Cited by 342
“This may explain why previous studies of temporal processing by networks with random connectivities, such as those used to model temporal intervals (Buonomano, 2000; Karmarkar and Buonomano, 2007) and temporal classification (Maass et al., 2002), were limited in applicability to time intervals on the order of 1 s (on…”
BackgroundMethodInfluentialHarnessing Disordered-Ensemble Quantum Dynamics for Machine Learning
Fujii, K., & Nakajima, K. (2017) · Physical Review Applied · doi:10.1103/physrevapplied.8.024030 · Cited by 337
“A number of different implementations of reservoirs have been proposed, such as abstract dynamical systems for echo state networks (ESNs) [18] or models of neurons for liquid state machines [19].”
BackgroundSilicon Photonic Modulator Neuron
Tait, A. N., Ferreira de Lima, T., Nahmias, M. A., Miller, H. B., Peng, H.-T., Shastri, B. J., & Prucnal, P. R. (2019) · Physical Review Applied · doi:10.1103/physrevapplied.11.064043 · Cited by 331
“neurons can also, of course, act as a reservoir by remaining ignorant to its theoretical model [105].”
BackgroundMethodMehonic, A., Sebastian, A., Rajendran, B., Simeone, O., Vasilaki, E., & Kenyon, A. J. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000085 · Cited by 331
Towards a theoretical foundation for morphological computation with compliant bodies
Hauser, H., Ijspeert, A. J., Füchslin, R. M., Pfeifer, R., & Maass, W. (2011) · Biological Cybernetics · doi:10.1007/s00422-012-0471-0 · Cited by 330
“For a detailed proof, we refer to Theorem 1 in Maass et al. (2002) and Theorem 3.1 in Maass and Sontag (2000) and their corresponding proofs.”
MethodInfluentialSelf-citationInformation processing via physical soft body
Nakajima, K., Hauser, H., Li, T., & Pfeifer, R. (2015) · Scientific Reports · doi:10.1038/srep10487 · Cited by 324
“A number of different implementations for reservoirs have been proposed, such as abstract dynamical systems for echo state networks 7,8 or models of neurons for liquid state machines 9 , the surface of water in a laminar state 14 , and nonlinear mass spring systems 15–19 .”
MethodThalamic regulation of switching between cortical representations enables cognitive flexibility
Rikhye, R. V., Gilra, A., & Halassa, M. M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0269-z · Cited by 310
Analysis and Design of Echo State Networks
Ozturk, M. C., Xu, D., & Príncipe, J. C. (2007) · Neural Computation · doi:10.1162/neco.2007.19.1.111 · Cited by 308
“A similar problem exists in the design of the LSM. LSMs have been shown to possess universal approximation given the separation property (SP) for the liquid (reservoir in ESNs) and the approximation property (AP) for the readout (Maass et al., 2002).”
BackgroundPathak, J., Wikner, A., Fussell, R., Chandra, S., Hunt, B. R., Girvan, M., & Ott, E. (2018) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5028373 · Cited by 307
Metadata
- Authors
- Maass, W., Natschläger, T., & Markram, H.
- Affiliations
- Graz University of Technology (AT)
- École Polytechnique Fédérale de Lausanne (CH)
- Corresponding author
- Maass, Wolfgang
- Natschläger, Thomas
- Markram, Henry
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2002-11-01
- Volume
- 14
- Issue
- 11
- Pages
- 2531-2560
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2103179919
- Cited by
- 4,025
- References
- 28
- Citations by year
- 2026: 286 · 2025: 351 · 2024: 307 · 2023: 309 · 2022: 276 · 2021: 303 · 2020: 239 · 2019: 244 · 2018: 217 · 2017: 173 · 2016: 155 · 2015: 135 · 2014: 142 · 2013: 139 · 2012: 125
- FWCI
- 18.37
- Type
- journal article
- Language
- en
- Open access
- green
- infoscience.epfl.ch
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- liquid state machines, recurrent neural circuits, transient dynamics, high-dimensional dynamical systems, fading memory, integrate-and-fire neurons, real-time processing, time-varying inputs, neural coding, statistical learning theory, computational power, attractor networks
- MeSH terms
- Action Potentials, Computer Simulation, Computer Systems, Computers, Models, Neurological, Neurons, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.