MERRC: A Memristor-Enabled Reconfigurable Low-Power Reservoir Computing Architecture at the Edge
The DOI matches its Crossref record; 77 of the 85 references it cites were found in a registry or an index.
Abstract
The massive growth in the Internet of Things (IoT) has led to an increase in demand for devices receiving and transmitting data to and from the cloud during operations. Edge computing has been developed in an attempt to bring computations in proximity to the devices to overcome latency and cost overhead. IoT applications heavily reliant on machine learning (ML) tasks such as image or voice recognition can benefit from edge devices that facilitate real-time operations without costly data transmission back and forth from memory. In this work, we develop MERRC, a memristor-enabled reconfigurable architecture that incorporates processing-in-memory and reservoir computing to carry out ML tasks of image classification at the edge. This design uses a novel masking circuit to allow for image segmentation, which is combined with a delay-based reservoir to form a recurrent neural network. We further implement the final stage of classification using a fabricated memristor crossbar. Our hardware measurement results on the MNIST dataset of the delay-based reservoir with memristor crossbar arrays provide a recognition accuracy of 98%. On a more complex image classification dataset of CIFAR-10, MERRC shows a high accuracy of 88%, further highlighting the edge computing capabilities of the architecture.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Hodgkin, A. L., & Huxley, A. F. (1952) · The Journal of Physiology · doi:10.1113/jphysiol.1952.sp004764 · Cited by 23,191
Simple model of spiking neurons
Izhikevich, E. M. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820440 · Cited by 4,828
Networks of spiking neurons: The third generation of neural network models
Maass, W. (1997) · Neural Networks · doi:10.1016/s0893-6080(97)00011-7 · Cited by 3,481
Computational Methods for Inverse Problems
Vogel, C. R. (2002) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898717570 · Cited by 2,370
Fully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179
Information processing using a single dynamical node as complex system
Appeltant, L., Soriano, M. C., Van der Sande, G., Danckaert, J., Massar, S., Dambre, J., Schrauwen, B., Mirasso, C. R., & Fischer, I. (2011) · Nature Communications · doi:10.1038/ncomms1476 · Cited by 1,716
A State-of-the-Art Survey on Deep Learning Theory and Architectures
Alom, M. Z., Taha, T. M., Yakopcic, C., Westberg, S., Sidike, P., Nasrin, M. S., Hasan, M., Van Essen, B. C., Awwal, A. A. S., & Asari, V. K. (2019) · Electronics · doi:10.3390/electronics8030292 · Cited by 1,620
Deep Learning With Edge Computing: A Review
Chen, J., & Ran, X. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2921977 · Cited by 1,540 · cited 1×
“When deployed on edge devices, deep learning becomes exceptionally advantageous, especially in domains like natural language processing, computer vision, and the IoT [12], [13].”
BackgroundAn Overview on Edge Computing Research
Cao, K., Liu, Y., Meng, G., & Sun, Q. (2020) · IEEE Access · doi:10.1109/access.2020.2991734 · Cited by 1,254
Chi, P., Li, S., Xu, C., Zhang, T., Zhao, J., Liu, Y., Wang, Y., & Xie, Y. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001140 · Cited by 1,231
Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence
Deng, S., Zhao, H., Fang, W., Yin, J., Dustdar, S., & Zomaya, A. Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2984887 · Cited by 1,147
GHOSH-DASTIDAR, S., & ADELI, H. (2009) · International Journal of Neural Systems · doi:10.1142/s0129065709002002 · Cited by 1,057
An Analysis of Deep Neural Network Models for Practical Applications
Canziani, A., Paszke, A., & Culurciello, E. (2016) · arXiv · doi:10.48550/arxiv.1605.07678 · Cited by 969 · cited 1×
“The spatiotemporal information processing capabilities of reservoir computing have allowed it to solve complex tasks in the areas of time-series prediction, classification and segmentation, de-noising, and channel equalization and control [18].”
BackgroundShiDianNao: shifting vision processing closer to the sensor
Du, Z., Fasthuber, R., Chen, T., Ienne, P., Li, L., Luo, T., Feng, X., Chen, Y., & Temam, O. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2750389 · Cited by 933
Larger, L., Soriano, M. C., Brunner, D., Appeltant, L., Gutierrez, J. M., Pesquera, L., Mirasso, C. R., & Fischer, I. (2012) · Optics Express · doi:10.1364/oe.20.003241 · Cited by 864
High spectral purity Kerr frequency comb radio frequency photonic oscillator
Liang, W., Eliyahu, D., Ilchenko, V. S., Savchenkov, A. A., Matsko, A. B., Seidel, D., & Maleki, L. (2015) · Nature Communications · doi:10.1038/ncomms8957 · Cited by 676
Temporal data classification and forecasting using a memristor-based reservoir computing system
Moon, J., Ma, W., Shin, J. H., Cai, F., Du, C., Lee, S. H., & Lu, W. D. (2019) · Nature Electronics · doi:10.1038/s41928-019-0313-3 · Cited by 645
(2014) · International Conference on Learning Representations · Cited by 634
Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing
(2021) · doi:10.1038/s41467-020-20692-1 · Cited by 597
Complex photonics: Dynamics and applications of delay-coupled semiconductors lasers
Soriano, M. C., García-Ojalvo, J., Mirasso, C. R., & Fischer, I. (2013) · Reviews of Modern Physics · doi:10.1103/revmodphys.85.421 · Cited by 582
Emerging Memory Devices for Neuromorphic Computing
Upadhyay, N. K., Jiang, H., Wang, Z., Asapu, S., Xia, Q., & Joshua Yang, J. (2019) · Advanced Materials Technologies · doi:10.1002/admt.201800589 · Cited by 540
Self-citationLarger, L., Baylón-Fuentes, A., Martinenghi, R., Udaltsov, V. S., Chembo, Y. K., & Jacquot, M. (2017) · Physical Review X · doi:10.1103/physrevx.7.011015 · Cited by 509
Machine learning for image based species identification
Wäldchen, J., & Mäder, P. (2018) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13075 · Cited by 504
Advances in optimizing recurrent networks
Bengio, Y., Boulanger-Lewandowski, N., & Pascanu, R. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639349 · Cited by 469
Long short-term memory networks in memristor crossbar arrays
Li, C., Wang, Z., Rao, M., Belkin, D., Song, W., Jiang, H., Yan, P., Li, Y., Lin, P., Hu, M., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-018-0001-4 · Cited by 429 · cited 1×
“With their nonvolatile memory property, compatibility to be integrated with CMOS technology, ability to mimic biological synapses, and their analog conductance modulation properties, memris-tors have successfully carried out ML tasks in hardware [30], [32], [33], [34].”
BackgroundSelf-citationReinforcement learning with analogue memristor arrays
Wang, Z., Li, C., Song, W., Rao, M., Belkin, D., Li, Y., Yan, P., Jiang, H., Lin, P., Hu, M., et al. (2019) · Nature Electronics · doi:10.1038/s41928-019-0221-6 · Cited by 370
Self-citationA Survey on Edge Computing Systems and Tools
Liu, F., Tang, G., Li, Y., Cai, Z., Zhang, X., & Zhou, T. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2920341 · Cited by 331
Rusk, N. (2016) · Nature Methods · doi:10.1038/nmeth.3707 · Cited by 326
CMOS-integrated memristive non-volatile computing-in-memory for AI edge processors
Chen, W.-H., Dou, C., Li, K.-X., Lin, W.-Y., Li, P.-Y., Huang, J.-H., Wang, J.-H., Wei, W.-C., Xue, C.-X., Chiu, Y.-C., et al. (2019) · Nature Electronics · doi:10.1038/s41928-019-0288-0 · Cited by 276 · cited 1×
“There have been several notable works on PIM-based deep learning accelerators using SRAM, DRAM and emerging eNVMs as the core memory element [24], [25], [26], [27], [28], [29].”
BackgroundHigh-performance photonic reservoir computer based on a coherently driven passive cavity
Vinckier, Q., Duport, F., Smerieri, A., Vandoorne, K., Bienstman, P., Haelterman, M., & Massar, S. (2015) · Optica · doi:10.1364/optica.2.000438 · Cited by 265
24.5 A Twin-8T SRAM Computation-In-Memory Macro for Multiple-Bit CNN-Based Machine Learning
Si, X., Chen, J.-J., Tu, Y.-N., Huang, W.-H., Wang, J.-H., Chiu, Y.-C., Wei, W.-C., Wu, S.-Y., Sun, X., Liu, R., et al. (2019) · 2019 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2019.8662392 · Cited by 254
Laser dynamical reservoir computing with consistency: an approach of a chaos mask signal
Nakayama, J., Kanno, K., & Uchida, A. (2016) · Optics Express · doi:10.1364/oe.24.008679 · Cited by 244
How to Construct Deep Recurrent Neural Networks
Pascanu, R., Gülçehre, Ç., Cho, K., & Bengio, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6026 · Cited by 228
Reservoir Computing: Theory, Physical Implementations, and Applications
(2021) · Natural Computing Series · doi:10.1007/978-981-13-1687-6 · Cited by 225
Machine Learning in Computer Vision
Khan, A. I., & Al-Habsi, S. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.03.355 · Cited by 220
Fully analogue photonic reservoir computer
Duport, F., Smerieri, A., Akrout, A., Haelterman, M., & Massar, S. (2016) · Scientific Reports · doi:10.1038/srep22381 · Cited by 206
Photonic Nonlinear Transient Computing with Multiple-Delay Wavelength Dynamics
Martinenghi, R., Rybalko, S., Jacquot, M., Chembo, Y. K., & Larger, L. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.244101 · Cited by 205
Kim, H., Yoo, T., Kim, T. T.-H., & Kim, B. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3061508 · Cited by 199
Broadband Chaos Generated by an Optoelectronic Oscillator
Callan, K. E., Illing, L., Gao, Z., Gauthier, D. J., & Schöll, E. (2010) · Physical Review Letters · doi:10.1103/physrevlett.104.113901 · Cited by 189
Optoelectronic reservoir computing: tackling noise-induced performance degradation
Soriano, M. C., Ortín, S., Brunner, D., Larger, L., Mirasso, C. R., Fischer, I., & Pesquera, L. (2013) · Optics Express · doi:10.1364/oe.21.000012 · Cited by 187
Delay-Based Reservoir Computing: Noise Effects in a Combined Analog and Digital Implementation
Soriano, M. C., Ortin, S., Keuninckx, L., Appeltant, L., Danckaert, J., Pesquera, L., & van der Sande, G. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2311855 · Cited by 174
A Modern Primer on Processing in Memory
Mutlu, O., Ghose, S., Gómez-Luna, J., & Ausavarungnirun, R. (2023) · Computer Architecture and Design Methodologies · doi:10.1007/978-981-16-7487-7_7 · Cited by 168
Impact of input mask signals on delay-based photonic reservoir computing with semiconductor lasers
Kuriki, Y., Nakayama, J., Takano, K., & Uchida, A. (2018) · Optics Express · doi:10.1364/oe.26.005777 · Cited by 164
Exploring Low Power and Ultrafast Memristor on p-Type van der Waals SnS
Lu, X. F., Zhang, Y., Wang, N., Luo, S., Peng, K., Wang, L., Chen, H., Gao, W., Chen, X. H., Bao, Y., et al. (2021) · Nano Letters · doi:10.1021/acs.nanolett.1c03169 · Cited by 152
Constructing optimized binary masks for reservoir computing with delay systems
Appeltant, L., Van der Sande, G., Danckaert, J., & Fischer, I. (2014) · Scientific Reports · doi:10.1038/srep03629 · Cited by 144
ReRAM-Based Processing-in-Memory Architecture for Recurrent Neural Network Acceleration
Long, Y., Na, T., & Mukhopadhyay, S. (2018) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2018.2819190 · Cited by 136
Kim, G., In, J. H., Kim, Y. S., Rhee, H., Park, W., Song, H., Park, J., & Kim, K. M. (2021) · Nature Communications · doi:10.1038/s41467-021-23184-y · Cited by 126
Review of ASIC accelerators for deep neural network
Machupalli, R., Hossain, M., & Mandal, M. K. (2022) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2022.104441 · Cited by 108
Larger, L., & Dudley, J. M. (2010) · Nature · doi:10.1038/465041a · Cited by 106
(2010) · doi:10.4249/scholarpedia.6908 · Cited by 104
A fully hardware-based memristive multilayer neural network
Kiani, F., Yin, J., Wang, Z., Yang, J. J., & Xia, Q. (2021) · Science Advances · doi:10.1126/sciadv.abj4801 · Cited by 97 · cited 1×
“The top electrode which is 20-nm Ta and 20-nm Pt was patterned by photolithography, deposited by DC sputtering, and then lifted off in acetone at room temperature [67].”
MethodSelf-citationMemristor crossbar architectures for implementing deep neural networks
Liu, X., & Zeng, Z. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00282-4 · Cited by 93
A memristor-based long short term memory circuit
Smagulova, K., Krestinskaya, O., & James, A. P. (2018) · Analog Integrated Circuits and Signal Processing · doi:10.1007/s10470-018-1180-y · Cited by 86
Deep Liquid State Machines With Neural Plasticity for Video Activity Recognition
Soures, N., & Kudithipudi, D. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00686 · Cited by 58
Memristor-based signal processing for edge computing
Zhao, H., Liu, Z., Tang, J., Gao, B., Zhang, Y., Qian, H., & Wu, H. (2021) · Tsinghua Science & Technology · doi:10.26599/tst.2021.9010043 · Cited by 56
Bai, K., & Yi, Y. (2018) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3264659 · Cited by 54
Self-citationA note on stability of Mackey–Glass equations with two delays
(2017) · doi:10.1016/j.jmaa.2017.01.050 · Cited by 54
Kumar, P., Zhu, K., Gao, X., Wang, S.-D., Lanza, M., & Thakur, C. S. (2022) · npj 2D Materials and Applications · doi:10.1038/s41699-021-00284-3 · Cited by 54
Chen, J., Pan, W.-Q., Li, Y., Kuang, R., He, Y., Lin, C.-Y., Duan, N., Feng, G.-R., Zheng, H.-X., Chang, T., et al. (2020) · IEEE Electron Device Letters · doi:10.1109/led.2020.2968388 · Cited by 51
Deep learning acceleration based on in-memory computing
Eleftheriou, E., Gallo, M. L., Nandakumar, S. R., Piveteau, C., Boybat, I., Joshi, V., Khaddam-Aljameh, R., Dazzi, M., Giannopoulos, I., Karunaratne, G., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2947008 · Cited by 40
Memristor-Based Edge Computing of Blaze Block for Image Recognition
Ran, H., Wen, S., Li, Q., Yang, Y., Shi, K., Feng, Y., Zhou, P., & Huang, T. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3045029 · Cited by 38
MRAM Co-designed Processing-in-Memory CNN Accelerator for Mobile and IoT ApplicationsPreprint
Sun, B., Liu, D., Yu, L., Li, J., Liu, H., Zhang, W., & Torng, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.12179 · Cited by 36
Nguyen, T. V., An, J., & Min, K. (2021) · Micromachines · doi:10.3390/mi12070791 · Cited by 35
Integrate and Fire neurons and their application in pattern recognition
Vazquez, R. A., & Cachón, A. (2010) · International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE) · doi:10.1109/iceee.2010.5608622 · Cited by 32
AIDA: Associative In-Memory Deep Learning Accelerator
Garzón, E., Teman, A., Lanuzza, M., & Yavits, L. (2022) · IEEE Micro · doi:10.1109/mm.2022.3190924 · Cited by 27
Tateno, M., & Uchida, A. (2012) · Nonlinear Theory and Its Applications IEICE · doi:10.1587/nolta.3.155 · Cited by 12
Memristor based object detection using neural network
Ravikumar, K., & Sukumar, R. (2022) · High-Confidence Computing · doi:10.1016/j.hcc.2022.100085 · Cited by 9
Energy Efficient and Adaptive Analog IC Design for Delay-Based Reservoir Computing
Nowshin, F., Liu, L., & Yi, Y. (2020) · Conference proceedings · doi:10.1109/mwscas48704.2020.9184677 · Cited by 5
Self-citationImproving the Robustness and Efficiency of PIM-Based Architecture by SW/HW Co-Design
Yang, X., Li, S., Zheng, Q., & Chen, Y. (2023) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1145/3566097.3568358 · Cited by 5
Design and Challenges of Edge Computing ASICs on Front-End Electronics
Miryala, S., Carini, G. A., Deptuch, G. W., Huang, J., Katkoori, S., Maj, P. G., Mandal, S., Ren, Y., & Zaman, M. A. (2022) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed54688.2022.9806248 · Cited by 4
Research works printed but not linked: 1
- 2019, Google’s Purpose-Built ASIC Designed to Run Inference at the Edge
Cited by
Memristor-based hardware accelerators for artificial intelligence
Huang, Y., Ando, T., Sebastian, A., Chang, M., Yang, J. J., & Xia, Q. (2024) · Nature Reviews Electrical Engineering · doi:10.1038/s44287-024-00037-6 · Cited by 192
“One demonstration utilizes the rich dynamics of 2D memristive crossbar arrays in reservoir computing 65–69 , in which the input signals are mapped into higher dimensional computational spaces.”
Self-citationReconfigurable Architecture Application Using Machine Learning in Edge Computing for IoT Devices
(2024) · doi:10.1109/pdgc64653.2024.10984266 · Cited by 17
“Additionally, the creation of a memristor-powered, reconfigurable, low-power reservoir computing architecture enhances edge computing by boosting both performance and energy efficiency [2].”
Initials-dependent dynamics and synchronization in a memristor coupled memristive map
Zhao, Q., Bao, H., Zhang, X., Wu, H., & Bao, B. (2024) · Nonlinear Dynamics · doi:10.1007/s11071-024-10341-3 · Cited by 12
“These characteristics are crucial for enhancing the complexity and unpre-dictability, hence the recent progress of memristors in applications such as secure communication [14], deep learning [15], and edge computing [16].”
An Enhanced Photonic Spiking Neural Network Based on the VCSEL-SA for Recognition and Classification
Zhang, Y., Huang, Y., Yang, Y., Feng, Y., Zhou, P., Xiang, S., & Li, N. (2024) · Journal of Lightwave Technology · doi:10.1109/jlt.2024.3383719 · Cited by 13
“Our system can be further optimized by introducing the digital-to-analog circuit and FPGA to achieve computation in real-time [45], [46].”
MethodSelf-citationAmiri, M., & Nazari, S. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109255 · Cited by 7
Metadata
- Authors
- Nowshin, F., Huang, Y., Sarkar, M. R., Xia, Q., & Yi, Y.
- Affiliations
- Virginia Tech (US)
- University of Massachusetts Amherst (US)
- Venue
- IEEE Transactions on Circuits and Systems I: Regular Papers
- Published
- 2024-01
- Volume
- 71
- Issue
- 1
- Pages
- 174-186
- ISSN
- 1549-8328 (ISSN-L)
- 1558-0806
- OpenAlex
- W4388505522
- Cited by
- 12
- References
- 85
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 6
- FWCI
- 0.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Circuits and Systems I Regular Papers (publishedVersion)
- Funders
- U.S. National Science Foundation (CCF-1750450, ECCS-1731928, ECCS-2128594, ECCS-2314813, CCF-1937487, CCF-2133475)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Keywords
- memristors, reservoir computing, edge computing, in-memory computing, reconfigurable architecture, memristor crossbar, image classification, image segmentation, recurrent neural networks, Internet of Things, low-power electronics, MNIST, CIFAR-10
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.