The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Optimization and applications of echo state networks with leaky- integrator neurons
Abstract
Standard echo state networks (ESNs) are built from simple additive units with a sigmoid activation function. Here we investigate ESNs whose reservoir units are leaky integrator units. Units of this type have individual state dynamics, which can be exploited in various ways to accommodate the network to the temporal characteristics of a learning task. We present stability conditions, introduce and investigate a stochastic gradient descent method for the optimization of the global learning parameters (input and output feedback scalings, leaking rate, spectral radius) and demonstrate the usefulness of leaky-integrator ESNs for (i) learning very slow dynamic systems and replaying the learnt system at different speeds, (ii) classifying relatively slow and noisy time series (the Japanese Vowel dataset--here we obtain a zero test error rate), and (iii) recognizing strongly time-warped dynamic patterns.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Finally, we show that a randomly connected circuit model, akin to a “reservoir” network13-15, can reproduce the observed distribution of timescales, provided that the network operates at the critical point (or “edge of chaos”)16-18.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [14]
In the citing paper
“Those models predict that the memory of input signals is stored in a large, recurrent and heterogeneous network (reservoir), in a distributed manner, and that a desired output is obtained by a trainable combination of the response signals in the reservoir.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [14]
In the citing paper
“Reservoir-type networks have been the subject of active research in computational neuroscience and machine learning13-15, but so far experimental support that such networks are adopted by the brain has been lacking.”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [14]
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,394
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025
Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication
Jaeger, H., & Haas, H. (2004) · Science · doi:10.1126/science.1091277 · Cited by 3,811
Self-citationMinimum prediction residual principle applied to speech recognition
Itakura, F. (1975) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1975.1162641 · Cited by 1,620
The neural basis of temporal processing
Mauk, M. D., & Buonomano, D. V. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144247 · Cited by 976
Adaptive Filters Theory and Applications
Farhang‐Boroujeny, B. (1999) · doi:10.1002/9781118591352 · Cited by 965
Gradient calculations for dynamic recurrent neural networks: a survey
Pearlmutter, B. A. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.410363 · Cited by 578
Readings in Speech Recognition
(1990) · Elsevier eBooks · doi:10.1016/c2009-0-27652-5 · Cited by 574
Research works printed but not linked: 3
- Jaeger, 2003, Adaptive nonlinear system identification with echo state networks, Vol. 15, 593
- Levin, 1992, Vol. 4, 151
- Sun, 1993, Vol. 5, 180
Cited by
Sorted by citations
Items 901–949 of 949
Reduced-Order Echo State Networks for Real-Time Model Predictive Control in Industrial ApplicationsPreprint
González-Mateos, G., Prada, M. A., Morán, A., Ossorio, J. R. R., Díaz, I., & Domínguez, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5343846
Lee, Y., Lee, W., Shin, J., Jang, N., Kim, H., Kim, D. Y., Kim, J., & Kim, J. S. (2026) · Advanced Intelligent Systems · doi:10.1002/aisy.202501045
Gryazev, V., Armani, U., Zang, B., Wang, Z., Markesteijn, A. P., TOROPOV, V. V., Murali, A. R., Jacob, M. C., Kennedy, L. K., Naghibi, E., et al. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6218405
Donald, J. R., Johnson, B. A., Mehrnejat, A., Gabbitas, A., Coveney, A. G. T., Balanov, A. G., Savel'ev, S. E., & Borisov, P. (2026) · Advanced Intelligent Systems · doi:10.1002/aisy.202500833 · Cited by 1
González-Mateos, G., Morán, A., Prada, M. A., Fuertes, J. J., Alonso, S., & Domínguez, M. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.133319
Abadi, F. H. H., & Ser, J. D. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729843
Functionnal organization of complex behavioral processes
Perdikis, D. (2011) · theses.fr (ABES) · doi:10.70675/485f1ad2za3d3z49a6z994dz45174fdb5432 · Cited by 1
Enhanced reservoir computing with Ginzburg-Landau equation for chaotic dynamics predictionPreprint
Xu, X., Chong, Y.-J., & Sun, Z.-H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6505800
Stark, P. S. (2021) · theses.fr (ABES) · doi:10.70675/fc6628b1z85b2z488czaa64z116a1a677cf4
A High-Angular Misalignment Tolerance Wireless Power Transfer System Based on Primary-Side Control
Wang, M., Peng, C., Shi, Y., Feng, J., Yang, L., & Luo, Q. (2026) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2026.3680868
Neuromorphic photonic systems for information processing
Mwamsojo, N. (2023) · theses.fr (ABES) · doi:10.70675/16013f38zb45dz4205za1d3zc1e15e7f5ff0
Neuro-inspired computing with excitable microlasers
Masominia, A. H. (2024) · theses.fr (ABES) · doi:10.70675/f448ec0bz8e07z4e59z8b05z1aef41e55b65 · Cited by 1
Swirl-adaptive hyperbolic small-world reservoir topologies for chaotic flows
Singh, P., Kumar, A., Hrishit, B. P., Ghosh, S., & Raman, B. (2026) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2026.135238
Xiao, J., Yan, J., Li, B., & Peng, H. J. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.110294 · Cited by 1
Pasupuleti, R. R. (2026) · Research Square · doi:10.21203/rs.3.rs-9448229/v1
Pasupuleti, R. R. (2026) · Research Square · doi:10.21203/rs.3.rs-9447723/v1
Moahker, Y., Tiomoko, M., Louart, C., & Liao, Z. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464627
Data efficient language learning through random projections
Hinaut, X. (2026) · Advances in child development and behavior · doi:10.1016/bs.acdb.2026.04.006
Reduced-order echo state networks for model predictive control in industrial applications
González-Mateos, G., Prada, M. A., Morán, A., Ossorio, J. R. R., Díaz, I., & Domínguez, M. (2026) · European Journal of Control · doi:10.1016/j.ejcon.2026.101527
Yao, X.-S., Zhang, L., & Sun, J. (2026) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2026.108745
Lightweight Echo State Networks for Upper-Limb Movement Classification Using Multimodal Signals
Syulistyo, A. R., Tanaka, Y., Fuengfusin, N., Pramanta, D., & Tamukoh, H. (2026) · International Conference on Activity and Behavior Computing (ABC) · doi:10.1109/abc68169.2026.11567362
Effect of time scale on chaotic time series prediction using echo state network
Yoshida, S., Sawada, K., & Ikeguchi, T. (2026) · Nonlinear Theory and Its Applications IEICE · doi:10.1587/nolta.17.998
Zhou, W., Liu, H., Li, M., Лиу, Л., & Cui, J. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.115423
Reservoir Computing Causal Operators for Data-Driven Moment Control of Nonlinear Ensembles
Kuan, Y.-H., Tang, L., & Li, J.-S. (2026) · IEEE Control Systems Letters · doi:10.1109/lcsys.2026.3710701
Multiscale deep reservoir computing for predicting chaotic dynamical systems
Zhan, Y., Qin, X., & Li, Y. (2026) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0323200
MPC Approximation with Echo State Networks for Industrial Control Systems
González-Mateos, G., Prada, M. A., Morán, A., Ossorio, J. R. R., González-Herbón, R., & Domínguez, M. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-31144-3_7
Jeong, D. Y., Jang, S., Kim, Y., Park, H., Handriani, L. S., Chang, W. J., & Park, W. I. (2026) · Advanced Materials Technologies · doi:10.1002/admt.71186
Adaptive Dual-Path Reservoir Computing for Systemic Risk Early Warning via Connectedness ForecastingPreprint
Fang, Z., Gu, C., Liao, X., Gao, G., Wang, Z., Sun, T., Liu, Y., & Wang, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7170620
A Cosine Leaky Integral Echo State Network for Time Series Prediction
Xu, W., & Gong, Y. (2026) · IEEE Data Driven Control and Learning Systems Conference (DDCLS) · doi:10.1109/ddcls71227.2026.11610234
Qin, W., Pan, Y., Tan, Y., 大野, 信., Wu, H., Dai, G., & Wang, D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7199956
Chaos Prediction: Machine Learning Versus Dynamical Models
Angelidis, A. K., Makris, G. C., Ioannidis, E., Antoniou, I. E., & Bratsas, C. (2026) · Mathematics · doi:10.3390/math14152748
Physical Reservoir Computing on the basis of a POM/SWCNT Heterojunction
Wang, Y., Wang, Y., Zhang, F., Qi, M., Duan, Y., & Zhou, W. (2026) · IEEE International Conference on Nano/Micro Engineered and Molecular Systems · doi:10.1109/nems69704.2026.11633699
Understanding the role of dropout in Deep Echo State Networks
Mallea, M., Àngela Nebot, B., & Mugica, F. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116766
Koyama, S., Inoue, D., Yoshida, H., Aihara, K., & Tanaka, G. (2026) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0324305
Singh, P., Shekhar, T. S., & Raman, B. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116866
Living deep reservoir computing by microfluidic axon routingPreprint
Wang, K., Dai, W., Li, Y., Han, Z., Du, J., Deng, Y., Ren, M., Zhang, T. Y., Sha, L., Xu, Q., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-10680995/v1
Zhen, Z., Zhang, Y., & Xu, H. (2026) · Physics of Fluids · doi:10.1063/5.0345322
Gryazev, V., Armani, U., Zang, B., Murali, A. R., Kennedy, L. K., Wang, Z., Markesteijn, A. P., TOROPOV, V. V., Jacob, M. C., Naghibi, E., et al. (2026) · Physics of Fluids · doi:10.1063/5.0341107
The Role of Echo State and Fading Memory Properties in Reservoir Computing Systems
Smith, C. J., & Blain, J. (2026) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas67364.2026.11680701
Forecasting Financial Variables from Structured Accounting Time Series with Echo State Networks
Motai, R., Fukuzaki, R., Ando, H., & Okada, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38404-1_39
Plasticity Dynamics Improves Reservoir Performance on Mixed-Timescale Memory TasksPreprint
Becker, M. P., & Fauth, M. J. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.24.754073
Q-learning dynamics of trust games on temporal higher-order networks
Pan, Z., Xing, B., Zhu, Y., & Xia, C. (2026) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2026.132056
Application of a tetrahedral structured multi-reservoir echo state network for wind speed prediction
Xu, W., & Gong, Y. (2026) · Journal of Earth System Science · doi:10.1007/s12040-026-02911-3
Ordinal-pattern transition networks as a symbolic substrate for reservoir computing
Potratzki, M., de Jong, T. G., SMALL, M. P., & Bröhl, T. (2026) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0355934
Improving Hardware-Based Reservoir Robustness Using Conceptors
Llinares, G. I., Kang, H., & Soriano, M. C. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729602
A temporal sequence-oriented associative memory using echo state network
Kage, H. (2026) · Machine Learning with Applications · doi:10.1016/j.mlwa.2026.101048
Learning-Based Quadcopter Control via Echo State Networks
Fujioka, T., Ito, Y., Inoue, D., MATSUMORI, T., Yoshida, H., & Tanaka, G. (2026) · SICE Annual Conference (SICE) · doi:10.23919/sicefes71276.2026.11739247
Spraakherkenning met Reservoir Computing
Defour, D. J. (2007)
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Metadata
- Authors
- Jaeger, H., Lukoševičius, M., Popovici, D., & Siewert, U.
- Affiliations
- Constructor University (DE)
- Planet (DE)
- Corresponding author
- Jaeger, Herbert
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 2007-04
- Volume
- 20
- Issue
- 3
- Pages
- 335-352
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W2001263627
- Semantic Scholar
- 370984d3910e61d41ee8318714cd610b689de726
- Cited by
- 948
- References
- 32
- Citations by year
- 2026: 61 · 2025: 87 · 2024: 90 · 2023: 65 · 2022: 71 · 2021: 68 · 2020: 68 · 2019: 81 · 2018: 51 · 2017: 38 · 2016: 44 · 2015: 33 · 2014: 37 · 2013: 28 · 2012: 42
- FWCI
- 24.86
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Networks (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Keywords
- echo state networks, reservoir computing, stability conditions, stochastic gradient descent, spectral radius, time series classification, time warping
- MeSH terms
- Animals, Feedback, Humans, Learning, Models, Neurological, Nerve Net, Neurons, Stochastic Processes, Neural Networks, Computer, Nonlinear Dynamics, Recognition, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review