Implementation of Convolutional Neural Networks in Memristor Crossbar Arrays with Binary Activation and Weight Quantization
The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
We propose a hardware-friendly architecture of a convolutional neural network using a 32 × 32 memristor crossbar array having an overshoot suppression layer. The gradual switching characteristics in both set and reset operations enable the implementation of a 3-bit multilevel operation in a whole array that can be utilized as 16 kernels. Moreover, a binary activation function mapped to the read voltage and ground is introduced to evaluate the result of training with a boundary of 0.5 and its estimated gradient. Additionally, we adopt a fixed kernel method, where inputs are sequentially applied to a crossbar array with a differential memristor pair scheme, reducing unused cell waste. The binary activation has robust characteristics against device state variations, and a neuron circuit is experimentally demonstrated on a customized breadboard. Thanks to the analogue switching characteristics of the memristor device, the accurate vector-matrix multiplication (VMM) operations can be experimentally demonstrated by combining sequential inputs and the weights obtained through tuning operations in the crossbar array. In addition, the feature images extracted by VMM during the hardware inference operations on 100 test samples are classified, and the classification performance by off-chip training is compared with the software results. Finally, inference results depending on the tolerance are statistically verified through several tuning cycles.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“the memristive dot product engine (MDPE), which performs large-scale vector-matrix multiplication (VMM) operations using a memristive crossbar array6–13”
From Flexible self-rectifying synapse array for energy-efficient edge multiplication in electrocardiogram diagnosis (2025) · cites this paper as [11]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Convolutional Neural Networks for Speech Recognition
Abdel-Hamid, O., Mohamed, A.-R., Jiang, H., Deng, L., Penn, G., & Yu, D. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2339736 · Cited by 2,262
Fully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179
Memristive crossbar arrays for brain-inspired computing
Xia, Q., & Yang, J. J. (2019) · Nature Materials · doi:10.1038/s41563-019-0291-x · Cited by 1,800
Analogue signal and image processing with large memristor crossbars
Li, C., Hu, M., Li, Y., Jiang, H., Ge, N., Montgomery, E., Zhang, J., Song, W., Dávila, N., Graves, C. E., et al. (2017) · Nature Electronics · doi:10.1038/s41928-017-0002-z · Cited by 1,292
Going Deeper in Spiking Neural Networks: VGG and Residual Architectures
Sengupta, A., Ye, Y., Wang, R., Liu, C., & Roy, K. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00095 · Cited by 1,211
Quantizing deep convolutional networks for efficient inference: A whitepaper
Krishnamoorthi, R. (2018) · arXiv · doi:10.48550/arxiv.1806.08342 · Cited by 753
Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine
Hu, M., Graves, C. E., Li, C., Li, Y., Ge, N., Montgomery, E., Davila, N., Jiang, H., Williams, R. S., Yang, J. J., et al. (2018) · Advanced Materials · doi:10.1002/adma.201705914 · Cited by 751
An Analysis Of Convolutional Neural Networks For Image Classification
Sharma, N., Jain, V., & Mishra, A. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.05.198 · Cited by 701
Lee, H. Y., Chen, P. S., Wu, T. Y., Chen, Y. S., Wang, C. C., Tzeng, P. J., Lin, C. H., Chen, F., Lien, C. H., & Tsai, M.-J. (2008) · 2008 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2008.4796677 · Cited by 641
Yu, S., Gao, B., Fang, Z., Yu, H., Kang, J., & Wong, H. ‐. P. (2013) · Advanced Materials · doi:10.1002/adma.201203680 · Cited by 527
Seok, J. Y., Song, S. J., Yoon, J. H., Yoon, K. J., Park, T. H., Kwon, D. E., Lim, H., Kim, G. H., Jeong, D. S., & Hwang, C. S. (2014) · Advanced Functional Materials · doi:10.1002/adfm.201303520 · Cited by 383
Bayat, F. M., Prezioso, M., Chakrabarti, B., Nili, H., Kataeva, I., & Strukov, D. (2018) · Nature Communications · doi:10.1038/s41467-018-04482-4 · Cited by 377
Three-dimensional memristor circuits as complex neural networks
Lin, P., Li, C., Wang, Z., Li, Y., Jiang, H., Song, W., Rao, M., Zhuo, Y., Upadhyay, N. K., Barnell, M., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-0397-9 · Cited by 375
Suri, M., Bichler, O., Querlioz, D., Cueto, O., Perniola, L., Sousa, V., Vuillaume, D., Gamrat, C., & DeSalvo, B. (2011) · 2011 International Electron Devices Meeting · doi:10.1109/iedm.2011.6131488 · Cited by 314
Le Gallo, M., Khaddam-Aljameh, R., Stanisavljevic, M., Vasilopoulos, A., Kersting, B., Dazzi, M., Karunaratne, G., Brändli, M., Singh, A., Müller, S. M., et al. (2023) · Nature Electronics · doi:10.1038/s41928-023-01010-1 · Cited by 310
In situ training of feed-forward and recurrent convolutional memristor networks
Wang, Z., Li, C., Lin, P., Rao, M., Nie, Y., Song, W., Qiu, Q., Li, Y., Yan, P., Strachan, J. P., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0089-1 · Cited by 307
4K-memristor analog-grade passive crossbar circuit
Kim, H., Mahmoodi, M. R., Nili, H., & Strukov, D. B. (2021) · Nature Communications · doi:10.1038/s41467-021-25455-0 · Cited by 265
Self-citationResearch progress on solutions to the sneak path issue in memristor crossbar arrays
Shi, L., Zheng, G., Tian, B., Dkhil, B., & Duan, C. (2020) · Nanoscale Advances · doi:10.1039/d0na00100g · Cited by 262
Self-selective van der Waals heterostructures for large scale memory array
Sun, L., Zhang, Y., Han, G., Hwang, G., Jiang, J., Joo, B., Watanabe, K., Taniguchi, T., Kim, Y.-M., Yu, W. J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-11187-9 · Cited by 248
Kim, K. M., Zhang, J., Graves, C., Yang, J. J., Choi, B. J., Hwang, C. S., Li, Z., & Williams, R. S. (2016) · Nano Letters · doi:10.1021/acs.nanolett.6b01781 · Cited by 246
Self-citationXNOR-RRAM: A scalable and parallel resistive synaptic architecture for binary neural networks
Sun, X., Yin, S., Peng, X., Liu, R., Seo, J.-S., & Yu, S. (2018) · 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date.2018.8342235 · Cited by 246
Hardware Implementation of Neuromorphic Computing Using Large‐Scale Memristor Crossbar Arrays
Li, Y., & Ang, K.-W. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202000137 · Cited by 220
Amirsoleimani, A., Alibart, F., Yon, V., Xu, J., Pazhouhandeh, M. R., Ecoffey, S., Beilliard, Y., Genov, R., & Drouin, D. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000115 · Cited by 216
Multilevel HfO2-based RRAM devices for low-power neuromorphic networks
Milo, V., Zambelli, C., Olivo, P., Pérez, E., K. Mahadevaiah, M., G. Ossorio, O., Wenger, C., & Ielmini, D. (2019) · APL Materials · doi:10.1063/1.5108650 · Cited by 200
Spin-Based Neuron Model With Domain-Wall Magnets as Synapse
Sharad, M., Augustine, C., Panagopoulos, G., & Roy, K. (2012) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2012.2202125 · Cited by 199
Binary convolutional neural network on RRAM
Tang, T., Xia, L., Li, B., Wang, Y., & Yang, H. (2017) · 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2017.7858419 · Cited by 176
Energy-efficient Mott activation neuron for full-hardware implementation of neural networks
Oh, S., Shi, Y., del Valle, J., Salev, P., Lu, Y., Huang, Z., Kalcheim, Y., Schuller, I. K., & Kuzum, D. (2021) · Nature Nanotechnology · doi:10.1038/s41565-021-00874-8 · Cited by 161
One Nanometer HfO2‐Based Ferroelectric Tunnel Junctions on Silicon
Cheema, S., Shanker, N., Hsu, C., Datar, A., Bae, J., Kwon, D., & Salahuddin, S. (2021) · Advanced Electronic Materials · doi:10.1002/aelm.202100499 · Cited by 134
Data Clustering using Memristor Networks
Choi, S., Sheridan, P., & Lu, W. D. (2015) · Scientific Reports · doi:10.1038/srep10492 · Cited by 132
Chang, C.-C., Chen, P.-C., Chou, T., Wang, I.-T., Hudec, B., Chang, C.-C., Tsai, C.-M., Chang, T.-S., & Hou, T.-H. (2018) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2017.2771529 · Cited by 116
Parasitic Effect Analysis in Memristor-Array-Based Neuromorphic Systems
Jeong, Y., Zidan, M. A., & Lu, W. D. (2018) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2017.2784364 · Cited by 115
Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update
Kim, T.-Y., Hu, S., Kim, J., Kwak, J. Y., Park, J., Lee, S., Kim, I., Park, J., & Jeong, Y. (2021) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2021.646125 · Cited by 107
Self-citationA fully hardware-based memristive multilayer neural network
Kiani, F., Yin, J., Wang, Z., Yang, J. J., & Xia, Q. (2021) · Science Advances · doi:10.1126/sciadv.abj4801 · Cited by 97
Zhang, H., Jiang, B., Cheng, C., Huang, B., Zhang, H., Chen, R., Xu, J., Huang, Y., Chen, H., Pei, W., et al. (2023) · Nano Letters · doi:10.1021/acs.nanolett.2c03624 · Cited by 96
Memristor crossbar architectures for implementing deep neural networks
Liu, X., & Zeng, Z. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00282-4 · Cited by 93
Lo, C.-L., Hou, T.-H., Chen, M.-C., & Huang, J.-J. (2013) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2012.2225147 · Cited by 91
Fu, Y., Zhou, Y., Huang, X., Dong, B., Zhuge, F., Li, Y., He, Y., Chai, Y., & Miao, X. (2022) · Advanced Functional Materials · doi:10.1002/adfm.202111996 · Cited by 86
Sun, X., Peng, X., Chen, P.-Y., Liu, R., Seo, J.-S., & Yu, S. (2018) · 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2018.8297384 · Cited by 80
Neuromorphic Motion Detection and Orientation Selectivity by Volatile Resistive Switching Memories
Wang, W. J., Covi, E., Milozzi, A., Farronato, M., Ricci, S., Sbandati, C., Pedretti, G., & Ielmini, D. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000224 · Cited by 75
Banerjee, W., Xu, X., Lv, H., Liu, Q., Long, S., & Liu, M. (2017) · ACS Omega · doi:10.1021/acsomega.7b01211 · Cited by 72
Memristive Crossbar Arrays for Storage and Computing Applications
Li, H., Wang, S., Zhang, X., Wang, W. J., Yang, R., Sun, Z., Feng, W., Lin, P., Wang, Z., Sun, L., et al. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202170065 · Cited by 70
Kim, T., Kim, S., Hong, K., Park, J., Hwang, Y., Park, B., & Kim, H. (2021) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2021.111587 · Cited by 67
Self-citationKim, S., Park, J., Kim, T., Hong, K., Hwang, Y., Park, B., & Kim, H. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202100273 · Cited by 65
Self-citationHardware‐Friendly Stochastic and Adaptive Learning in Memristor Convolutional Neural Networks
Zhang, W., Pan, L., Xuelong, Y., Zhao, G., Chen, H., Wang, X., Tay, B. K., Zhong, G., Li, J., & Huang, M. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202100041 · Cited by 61
Three-dimensional 4F2 ReRAM cell with CMOS logic compatible process
Wang, C.-H., Tsai, Y.-H., Lin, K.-C., Chang, M.-F., King, Y.-C., Lin, C.-J., Sheu, S.-S., Chen, Y.-S., Lee, H.-Y., Chen, F. T., et al. (2010) · 2010 International Electron Devices Meeting · doi:10.1109/iedm.2010.5703446 · Cited by 56
Kim, S., Kim, T., Kim, H., & Park, B. (2020) · Applied Physics Letters · doi:10.1063/5.0027757 · Cited by 52
Self-citationLv, H., Xu, X., Yuan, P., Dong, D., Gong, T., Liu, J., Yu, Z., Huang, P. C., Zhang, K., Huo, C., et al. (2017) · Technical digest - International Electron Devices Meeting/Technical digest · doi:10.1109/iedm.2017.8268312 · Cited by 50
Kim, T., Lee, J., Kim, S., Park, J., Park, B., & Kim, H. (2021) · Nanotechnology · doi:10.1088/1361-6528/abf0cc · Cited by 46
Self-citationMemristor Based Binary Convolutional Neural Network Architecture With Configurable Neurons
Huang, L., Diao, J., Nie, H., Wang, W., Li, Z., Li, Q., & Liu, H. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.639526 · Cited by 45
Deep Neural Network Optimized to Resistive Memory with Nonlinear Current-Voltage Characteristics
Kim, H., Kim, T., Kim, J.-S., & Kim, J. (2018) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3145478 · Cited by 42
Self-citationDesign of High Robustness BNN Inference Accelerator Based on Binary Memristors
Qin, Y., Kuang, R., Huang, X., Li, Y., Chen, J., & Miao, X. (2020) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2020.2998457 · Cited by 42
Cheong, W. H., Jeon, J. B., In, J. H., Kim, G., Song, H., An, J., Park, J., Kim, Y. S., Hwang, C. S., & Kim, K. M. (2022) · Advanced Functional Materials · doi:10.1002/adfm.202200337 · Cited by 42
Self-citationThe marriage of training and inference for scaled deep learning analog hardware
Gokmen, T., Rasch, M. J., & Haensch, W. (2019) · 2019 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm19573.2019.8993573 · Cited by 37
Effect of Program Error in Memristive Neural Network With Weight Quantization
Kim, T., Kim, S., Hong, K., Park, J., Youn, S., Lee, J., Park, B., & Kim, H. (2022) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2022.3169112 · Cited by 31
Self-citationMemristive DeepLab: A hardware friendly deep CNN for semantic segmentation
Zhang, L., Hu, X., Zhou, Y., Zhou, G., & Duan, S. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.061 · Cited by 23
Intrinsic variation effect in memristive neural network with weight quantization
Park, J., Song, M. S., Youn, S., Kim, T., Kim, S., Hong, K., & Kim, H. (2022) · Nanotechnology · doi:10.1088/1361-6528/ac7651 · Cited by 23
Self-citationHFNet: A CNN Architecture Co-designed for Neuromorphic Hardware With a Crossbar Array of Synapses
Gopalakrishnan, R., Chua, Y., Sun, P., Kumar, A. J. S., & Basu, A. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00907 · Cited by 22
Kim, Y., Kim, J., Kim, S. S., Kwon, Y. J., Kim, G. S., Jeon, J. W., Kwon, D. E., Yoon, J. H., & Hwang, C. S. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.201900116 · Cited by 17
Self-citationYang, H., Chen, B., Song, B., Meng, D., Tiwari, S., Krishnamoorthy, A., Yan, X., Liu, Z., Wang, Y., Hu, P., et al. (2020) · ACS Applied Electronic Materials · doi:10.1021/acsaelm.0c00148 · Cited by 17
Effect of weight overlap region on neuromorphic system with memristive synaptic devices
Lee, G. H., Kim, T., Song, M. S., Park, J., Kim, S., Hong, K., Kim, Y., Park, B., & Kim, H. (2022) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2022.111999 · Cited by 15
Self-citationHwang, S., Kim, H., & Park, B. (2021) · Applied Sciences · doi:10.3390/app11052059 · Cited by 3
Self-citation
Research works printed but not linked: 4
- Sheu, S.S.; Chiang, P.C.; Lin, W.P.; Lee, H.Y.; Chen, P.S.; Chen, Y.S.; Wu, T.Y.; Chen, F. T.; Su, K.L.; Kao, M.J. A 5ns Fast Write Multi-level Non-volatile 1 K Bits RRAM Memory with Advance Write Scheme. In 2009 Symposium on VLSI Circuits ; IEEE, 2009; pp 82–83.
- Courbariaux, M.; Hubara, I.; Soudry, D.; El-Yaniv, R.; Bengio, Y. Binarized neural networks: Training deep neural networks with weights and activations constrained to+ 1 or–1 arXiv preprint arXiv:1602.030 2016.
- Courbariaux, M.; Bengio, Y.; David, J.P. Binaryconnect: Training deep neural networks with binary weights during propagations Adv. Neural Inf. Process. Syst. 2015; Vol. 28.
- Hubara I., 2017, J. Mach. Learn. Res., 18, 1
Cited by
Fang, J., Tang, Z., Lai, X.-C., Qiu, F., Jiang, Y., Liu, Q., Tang, X., Sun, Q., Zhou, Y., Fan, J., et al. (2024) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.4c05316 · Cited by 64
Review of Memristors for In‐Memory Computing and Spiking Neural Networks
Shooshtari, M., Serrano‐Gotarredona, T., & Linares‐Barranco, B. (2025) · Advanced Intelligent Systems · doi:10.1002/aisy.202500806 · Cited by 74
Pan, J., Kan, H., Liu, Z., Gao, S., Wu, E., Li, Y., & Zhang, C. (2024) · npj Flexible Electronics · doi:10.1038/s41528-024-00356-6 · Cited by 60
“…on buses and memory access but also breaks the traditional von Neumann bottleneck, since each memristor can concurrently perform both memory and logic operations, greatly enhancing chip integration density and signi fi cantly reducing energy consumption between storage and calculation 10 – 14 .”
Recent advances in ferroelectric materials, devices, and in-memory computing applications
Hwang, H., Youn, S., & Kim, H. (2025) · Nano Convergence · doi:10.1186/s40580-025-00520-2 · Cited by 58
Self-citationProgrammable Threshold Logic Implementations in a Memristor Crossbar Array
Youn, S., Lee, J., Kim, S., Park, J., Kim, K., & Kim, H. (2024) · Nano Letters · doi:10.1021/acs.nanolett.3c04073 · Cited by 47
Self-citation
Metadata
- Authors
- Park, J., Kim, S., Song, M. S., Youn, S., Kim, K., Kim, T.-H., & Kim, H.
- Affiliations
- Inha University (KR)
- Seoul National University (KR)
- Seoul National University of Science and Technology (KR)
- Hanyang University (KR)
- Corresponding author
- Kim, Hyungjin
- Venue
- ACS Applied Materials & Interfaces
- Publisher
- American Chemical Society (ACS)
- Published
- 2024-01-01
- Volume
- 16
- Issue
- 1
- Pages
- 1054-1065
- ISSN
- 1944-8244 (ISSN-L)
- 1944-8252
- OpenAlex
- W4390478144
- Cited by
- 56
- References
- 64
- Citations by year
- 2026: 16 · 2025: 24 · 2024: 16
- FWCI
- 5.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- ACS Applied Materials & Interfaces (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Research Foundation of Korea (2020M3H5A1081111, 2022M3I7A1078544, 2022R1A6A1A03051705, 2021R1C1C1014530)
- Institute for Information and Communications Technology Promotion (IITP-2021-0-02052)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Ferroelectric and Negative Capacitance Devices
- Keywords
- memristor crossbar, convolutional neural network hardware, weight quantization, matrix-vector multiplication, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.