The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Deep reservoir computing: A critical experimental analysis
Open accessAbstract
In this paper, we propose an empirical analysis of deep recurrent neural network (RNN) architectures with stacked layers. The main aim is to address some fundamental open research issues on the significance of creating deep layered architectures in RNN and to characterize the inherent hierarchical representation of time in such models, especially for efficient implementations. In particular, the analysis aims at the study and proposal of approaches to develop and enhance hierarchical dynamics in deep architectures within the efficient Reservoir Computing (RC) framework for RNN modeling. The effect of a deep layered organization of RC models is investigated in terms of both occurrence of multiple time-scale and increasing of richness of the dynamics. It turns out that a deep layering of recurrent models allows an effective diversification of temporal representations in the layers of the hierarchy, by amplifying the effects of the factors influencing the time-scales and the richness of the dynamics, measured as the entropy of recurrent units activations. The advantages of the proposed approach are also highlighted by measuring the increment of the short-term memory capacity of the RC models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
(2016) · Cited by 11,679
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication
Jaeger, H., & Haas, H. (2004) · Science · doi:10.1126/science.1091277 · Cited by 3,811
Reservoir computing approaches to recurrent neural network training
Lukoševičius, M., & Jaeger, H. (2009) · Computer Science Review · doi:10.1016/j.cosrev.2009.03.005 · Cited by 2,956
Proceedings IEEE International Conference on Acoustics Speech and Signal Processing
Zheng, F., McLaughlin, S., & Mulgrew, B. (1991) · Cited by 1,905
Cited by
Recent advances in physical reservoir computing: A review
Tanaka, G., Yamane, T., Héroux, J. B., Nakane, R., Kanazawa, N., Takeda, S., Numata, H., Nakano, D., & Hirose, A. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.03.005 · Cited by 2,146
Embedded Devices for Neuromorphic Time-Series Assessment
Mazumder, A. N., Hosseini, M., & Mohsenin, T. (2022) · Research Explorer (The University of Manchester) · doi:10.13016/m2ksy0-wxr3 · Cited by 652
Temporal data classification and forecasting using a memristor-based reservoir computing system
Moon, J., Ma, W., Shin, J. H., Cai, F., Du, C., Lee, S. H., & Lu, W. D. (2019) · Nature Electronics · doi:10.1038/s41928-019-0313-3 · Cited by 645
Emerging opportunities and challenges for the future of reservoir computing
Yan, M., Huang, C., Bienstman, P., Tino, P., Lin, W., & Sun, J. (2024) · Nature Communications · doi:10.1038/s41467-024-45187-1 · Cited by 346
Random vector functional link neural network based ensemble deep learning
Shi, Q., Katuwal, R., Suganthan, P. N., & Tanveer, M. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107978 · Cited by 286
Design of deep echo state networks
Gallicchio, C., Micheli, A., & Pedrelli, L. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.08.002 · Cited by 262
Self-citationEmerging dynamic memristors for neuromorphic reservoir computing
Cao, J., Zhang, X., Cheng, H., Qiu, J., Liu, X., Wang, M., & Liu, Q. (2022) · Nanoscale · doi:10.1039/d1nr06680c · Cited by 134
Online Learning of Oil Leak Anomalies in Wind Turbines with Block-Based Binary Reservoir
Cardoni, M., Pau, D. P., Falaschetti, L., Turchetti, C., & Lattuada, M. (2021) · Electronics · doi:10.3390/electronics10222836 · Cited by 17
“The coefficients of W (1) and W (2) have been rescaled in order to have spectral radius [65,67] ρ(W (1)) = ρ(W (2)) = 0.”
BackgroundBonci, A., Fredianelli, L., Kermenov, R., Longarini, L., Longhi, S., Pompei, G., Prist, M., & Verdini, C. (2024) · Applied Sciences · doi:10.3390/app14198686 · Cited by 16
Learning reservoir dynamics with temporal self-modulation
Sakemi, Y., Nobukawa, S., Matsuki, T., Morie, T., & Aihara, K. (2024) · Communications Physics · doi:10.1038/s42005-023-01500-w · Cited by 16
A memristive computational neural network model for time-series processing
Pistolesi, V., Ceni, A., Milano, G., Ricciardi, C., & Gallicchio, C. (2025) · APL Machine Learning · doi:10.1063/5.0255168 · Cited by 9
Self-citationSafety and Robustness for Deep Neural Networks: An Automotive Use Case
Bacciu, D., Carta, A., Gallicchio, C., & Schmittner, C. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-40953-0_9 · Cited by 7
Self-citationQuantized Reservoir Computing on Edge Devices for Communication Applications
Liu, S., Liu, L., & Yi, Y. (2020) · 2020 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec50012.2020.00068 · Cited by 5
2022 roadmap on neuromorphic computing and engineering
Christensen, D. V., Dittmann, R., Linares-Barranco, B., Sebastian, A., Le Gallo, M., Redaelli, A., Slesazeck, S., Mikolajick, T., Spiga, S., Menzel, S., et al. (2022) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac4a83
Metadata
- Authors
- Gallicchio, C., Micheli, A., & Pedrelli, L.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2017-12
- Volume
- 268
- Pages
- 87-99
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W2608997467
- Cited by
- 519
- References
- 29
- FWCI
- 17.22
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.