Low-cost hardware implementation of Reservoir Computers
The DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.
Abstract
The hardware implementation of massive Recurrent Neural Networks to efficiently perform time dependent signal processing is an active field of research. In this work we review the basic principles of stochastic logic and its application to the hardware implementation of Neural Networks. In particular, we focus on the implementation of the recently introduced Reservoir Computer architecture. We show the functionality and low hardware resources used to implement the Reservoir Computer by synthesizing a network performing a mathematical regression.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Based on the sequential/temporal data processing ability of short-term memristors, a simple neural network, which is called a readout function, can easily learn the input data with a very small number of parameters compared to conventional long short-term memory (LSTM) model24–26.”
From Experimental demonstration of highly reliable dynamic memristor for artificial neuron and neuromorphic computing (2022) · cites this paper as [25]
Citations
Cites
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025 · cited 1×
“Reservoir Computing (RC) [1-5] is a recently introduced paradigm of understanding and training Recurrent Neural Networks (RNN).”
BackgroundHarnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication
Jaeger, H., & Haas, H. (2004) · Science · doi:10.1126/science.1091277 · Cited by 3,811 · cited 1×
“Reservoir Computing (RC) [1-5] is a recently introduced paradigm of understanding and training Recurrent Neural Networks (RNN).”
BackgroundInformation processing using a single dynamical node as complex system
Appeltant, L., Soriano, M. C., Van der Sande, G., Danckaert, J., Massar, S., Dambre, J., Schrauwen, B., Mirasso, C. R., & Fischer, I. (2011) · Nature Communications · doi:10.1038/ncomms1476 · Cited by 1,716
An experimental unification of reservoir computing methods
Verstraeten, D., Schrauwen, B., D’Haene, M., & Stroobandt, D. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.003 · Cited by 1,135
Larger, L., Soriano, M. C., Brunner, D., Appeltant, L., Gutierrez, J. M., Pesquera, L., Mirasso, C. R., & Fischer, I. (2012) · Optics Express · doi:10.1364/oe.20.003241 · Cited by 864
Optoelectronic Reservoir Computing
Paquot, Y., Duport, F., Smerieri, A., Dambre, J., Schrauwen, B., Haelterman, M., & Massar, S. (2012) · Scientific Reports · doi:10.1038/srep00287 · Cited by 783
Lukoševičius, M., Jaeger, H., & Schrauwen, B. (2012) · KI - Künstliche Intelligenz · doi:10.1007/s13218-012-0204-5 · Cited by 392
Toward optical signal processing using Photonic Reservoir Computing
Vandoorne, K., Dierckx, W., Schrauwen, B., Verstraeten, D., Baets, R., Bienstman, P., & Campenhout, J. V. (2008) · Optics Express · doi:10.1364/oe.16.011182 · Cited by 276
Himavathi, S., Anitha, D., & Muthuramalingam, A. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2007.891626 · Cited by 200
Compact hardware liquid state machines on FPGA for real-time speech recognition
Schrauwen, B., D’Haene, M., Verstraeten, D., & Campenhout, J. V. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.12.009 · Cited by 164
Research works printed but not linked: 1
- jaeger, 2001, The 'echo state' approach to analysing and training recurrent neural networks
Cited by
Recent advances in physical reservoir computing: A review
Tanaka, G., Yamane, T., Héroux, J. B., Nakane, R., Kanazawa, N., Takeda, S., Numata, H., Nakano, D., & Hirose, A. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.03.005 · Cited by 2,146
Physical reservoir computing—an introductory perspective
Nakajima, K. (2020) · Japanese Journal of Applied Physics · doi:10.35848/1347-4065/ab8d4f · Cited by 422
Park, S.-O., Jeong, H., Park, J., Bae, J., & Choi, S. (2022) · Nature Communications · doi:10.1038/s41467-022-30539-6 · Cited by 331
Hands-on reservoir computing: a tutorial for practical implementation
Cucchi, M., Abreu, S., Ciccone, G., Brunner, D., & Kleemann, H. (2022) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac7db7 · Cited by 199
Learning function from structure in neuromorphic networks
Suárez, L. E., Richards, B. A., Lajoie, G., & Misic, B. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00376-1 · Cited by 134
Zhang, H., & Vargas, D. V. (2023) · IEEE Access · doi:10.1109/access.2023.3299296 · Cited by 108
FPGA based spike-time dependent encoder and reservoir design in neuromorphic computing processors
Yi, Y., Liao, Y., Wang, B., Fu, X., Shen, F., Hou, H., & Liu, L. (2016) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2016.03.009 · Cited by 79
FPGA-Based Stochastic Echo State Networks for Time-Series Forecasting
Alomar, M. L., Canals, V., Pérez-Mora, N., Martínez-Moll, V., & Rosselló, J. L. (2015) · Computational Intelligence and Neuroscience · doi:10.1155/2016/3917892 · Cited by 72
Self-citationConnectome-based reservoir computing with the conn2res toolbox
Suárez, L. E., Mihalik, Á., Milisav, F., Marshall, K., Li, M., Vértes, P. E., Lajoie, G., & Mišić, B. (2024) · Nature Communications · doi:10.1038/s41467-024-44900-4 · Cited by 83
IoT Based Virtual E-Learning System for Sustainable Development of Smart Cities
Setiawan, R., Devadass, M. M. V., Rajan, R., Sharma, D. K., Singh, N. P., Amarendra, K., Ganga, R. K. R., Manoharan, R. R., Subramaniyaswamy, V., & Sengan, S. (2022) · Journal of Grid Computing · doi:10.1007/s10723-022-09616-z · Cited by 51
A Cost-Efficient Digital ESN Architecture on FPGA for OFDM Symbol Detection
Gan, V. M., Liang, Y., Li, L., Liu, L., & Yi, Y. (2021) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3440017 · Cited by 31
Reservoir computing dissection and visualization based on directed network embedding
Han, X., & Zhao, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.029 · Cited by 10
On-Device Deep Learning: Survey on Techniques Improving Energy Efficiency of DNNs
Boumendil, A., Bechkit, W., & Benatchba, K. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3430028 · Cited by 13
An Area-Efficient Recurrent Neural Network Core for Unsupervised Time-Series Anomaly Detection
Sakuma, T., & Matsutani, H. (2020) · IEICE Transactions on Electronics · doi:10.1587/transele.2020lhp0003 · Cited by 4
Real-Time Echo State Network Based on FPGA and Its Applications
Liao, Y. (2020) · IntechOpen eBooks · doi:10.5772/intechopen.88820 · Cited by 2
FPGA Based Real-Time Processing Architecture for Recurrent Neural Network
Liao, Y., Li, H., & Wang, Z. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-69096-4_99 · Cited by 2
An FPGA Based Real Time Reservoir Computing System for Neuromorphic Processors
Liao, Y., Li, H., Shen, Y., & Li, W. (2018) · Asia-Pacific Conference on Intelligent Robot Systems (ACIRS) · doi:10.1109/acirs.2018.8467252 · Cited by 2
Unsupervised Learning in Complex SystemsPreprint
Cisneros, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.10993 · Cited by 2
Stochastic-Based Implementation of Reservoir Computers
Alomar, M. L., Canals, V., Martínez-Moll, V., & Rosselló, J. L. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19222-2_16 · Cited by 2
Self-citationTakeda, K., & Torikai, H. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191396
Neuromorphic photonic systems for information processing
Mwamsojo, N. (2023) · theses.fr (ABES) · doi:10.70675/16013f38zb45dz4205za1d3zc1e15e7f5ff0
Metadata
- Authors
- Alomar, M. L., Canals, V., Martinez-Moll, V., & Rossello, J. L.
- Affiliations
- Universitat de les Illes Balears (ES)
- ORCID
- Canals, V.
- Venue
- 2014 24th International Workshop on Power and Timing Modeling, Optimization and Simulation (PATMOS)
- Publisher
- IEEE
- Published
- 2014-09
- Pages
- 1-5
- OpenAlex
- W2095141405
- Cited by
- 20
- References
- 17
- Citations by year
- 2024: 2 · 2023: 4 · 2022: 3 · 2021: 3 · 2020: 2 · 2019: 1 · 2018: 1 · 2017: 1 · 2016: 1 · 2015: 2
- FWCI
- 0.79
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Workshop on Power and Timing Modeling, Optimization and Simulation (PATMOS) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- recurrent neural networks, hardware implementation, stochastic logic, low-cost hardware, neural network synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.