Demonstration of Convolution Kernel Operation on Resistive Cross-Point Array
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Convolution is the key operation in the convolutional neural network, one of the most popular deep learning algorithms. The implementation of the convolution kernel on the resistive cross-point array is different than the implementation of the matrix-vector multiplication in prior works. In this letter, we propose a dimensional reduction of 2-D kernel matrix into 1-D column vector, i.e., a column of the array, and enable the parallel readout of multiple 2-D kernels simultaneously. As a proof-of-concept demonstration, we use the Prewitt kernels to detect both horizontal and vertical edges of the 20 × 20 pixels of black and-white MNIST handwritten digits. The experiments were performed on the fabricated 12 × 12 resistive cross-point array based on the Pt/HfOx/TiN structure. The experimental results of the Prewitt kernel operation perfectly matches the simulation results, indicating the feasibility of the proposed implementation methodology of the convolution kernel on resistive cross-point array.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Memristive devices for computing
Yang, J. J., Strukov, D. B., & Stewart, D. R. (2013) · Nature Nanotechnology · doi:10.1038/nnano.2012.240 · Cited by 3,885 · cited 1×
“ristor [5] that exhibits analog memory functionality with multilevel tunable weights, emulates the synaptic weight in a neural network.”
BackgroundTraining and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 1×
“, 40 × 40 Ag:a-Si crossbar (loading weights only without learning) [12], 12×12 TiOx/Al2O3 crossbar (simple perceptron algorithm with software neurons) [13], 32×32 PCMO crossbar (off-chip neuron circuits on a board) [14], 10×10 phase change memory (PCM) 1-transitor-1-resistor (1T1R) array (simple”
MethodKim, K.-H., Gaba, S., Wheeler, D., Cruz-Albrecht, J. M., Hussain, T., Srinivasa, N., & Lu, W. (2012) · Nano Letters · doi:10.1021/nl203687n · Cited by 924 · cited 1×
“, 40 × 40 Ag:a-Si crossbar (loading weights only without learning) [12], 12×12 TiOx/Al2O3 crossbar (simple perceptron algorithm with software neurons) [13], 32×32 PCMO crossbar (off-chip neuron circuits on a board) [14], 10×10 phase change memory (PCM) 1-transitor-1-resistor (1T1R) array (simple”
MethodElectronic system with memristive synapses for pattern recognition
Park, S., Chu, M., Kim, J., Noh, J., Jeon, M., Hun Lee, B., Hwang, H., Lee, B., & Lee, B.-G. (2015) · Scientific Reports · doi:10.1038/srep10123 · Cited by 181 · cited 1×
“, 40 × 40 Ag:a-Si crossbar (loading weights only without learning) [12], 12×12 TiOx/Al2O3 crossbar (simple perceptron algorithm with software neurons) [13], 32×32 PCMO crossbar (off-chip neuron circuits on a board) [14], 10×10 phase change memory (PCM) 1-transitor-1-resistor (1T1R) array (simple”
MethodExperimental demonstration of array-level learning with phase change synaptic devices
Eryilmaz, S. B., Kuzum, D., Jeyasingh, R. G. D., Kim, S., BrightSky, M., Lam, C., & Wong, H.-S. P. (2013) · 2013 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2013.6724691 · Cited by 51
Cited by
Fully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179
Parallel convolutional processing using an integrated photonic tensor core
Feldmann, J., Youngblood, N., Karpov, M., Gehring, H., Li, X., Stappers, M., Le Gallo, M., Fu, X., Lukashchuk, A., Raja, A. S., et al. (2021) · Nature · doi:10.1038/s41586-020-03070-1 · Cited by 1,900
Analogue signal and image processing with large memristor crossbars
Li, C., Hu, M., Li, Y., Jiang, H., Ge, N., Montgomery, E., Zhang, J., Song, W., Dávila, N., Graves, C. E., et al. (2017) · Nature Electronics · doi:10.1038/s41928-017-0002-z · Cited by 1,292
Neuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
“[100] proposed a scheme to implement the convolution kernel in CNN by unrolling 2-D kernel matrix into 1-D column vector and demonstrated the concept in a 12 × 12 HfOx crossbar array.”
MethodSelf-citationA fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations
Cai, F., Correll, J. M., Lee, S. H., Lim, Y., Bothra, V., Zhang, Z., Flynn, M. P., & Lu, W. D. (2019) · Nature Electronics · doi:10.1038/s41928-019-0270-x · Cited by 728
Emerging Memristive Artificial Synapses and Neurons for Energy‐Efficient Neuromorphic Computing
Choi, S., Yang, J., & Wang, G. (2020) · Advanced Materials · doi:10.1002/adma.202004659 · Cited by 424
Brain-inspired computing with memristors: Challenges in devices, circuits, and systems
Zhang, Y., Wang, Z., Zhu, J., Yang, Y., Rao, M., Song, W., Zhuo, Y., Zhang, X., Cui, M., Shen, L., et al. (2020) · Applied Physics Reviews · doi:10.1063/1.5124027 · Cited by 384
Space-efficient optical computing with an integrated chip diffractive neural network
Zhu, H. H., Zou, J., Zhang, H., Shi, Y. Z., Luo, S. B., Wang, N., Cai, H., Wan, L. X., Wang, B., Jiang, X. D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28702-0 · Cited by 376
Three-dimensional memristor circuits as complex neural networks
Lin, P., Li, C., Wang, Z., Li, Y., Jiang, H., Song, W., Rao, M., Zhuo, Y., Upadhyay, N. K., Barnell, M., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-0397-9 · Cited by 375
“It has been implemented in standard 2D memristor crossbar arrays, but each array can only process convolutions from the same input pixels due to the aforementioned full connectivity 31,32 .”
MethodIn situ training of feed-forward and recurrent convolutional memristor networks
Wang, Z., Li, C., Lin, P., Rao, M., Nie, Y., Song, W., Qiu, Q., Li, Y., Yan, P., Strachan, J. P., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0089-1 · Cited by 307
XNOR-RRAM: A scalable and parallel resistive synaptic architecture for binary neural networks
Sun, X., Yin, S., Peng, X., Liu, R., Seo, J.-S., & Yu, S. (2018) · 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date.2018.8342235 · Cited by 246
Self-citationTraining Deep Convolutional Neural Networks with Resistive Cross-Point Devices
Gokmen, T., Onen, M., & Haensch, W. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00538 · Cited by 162
Strategies to Improve the Accuracy of Memristor-Based Convolutional Neural Networks
Pan, W.-Q., Chen, J., Kuang, R., Li, Y., He, Y.-H., Feng, G.-R., Duan, N., Chang, T.-C., & Miao, X.-S. (2020) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2019.2963323 · Cited by 76
Metadata
- Authors
- Gao, L., Chen, P.-Y., & Yu, S.
- Venue
- IEEE Electron Device Letters
- Published
- 2016-07
- Volume
- 37
- Issue
- 7
- Pages
- 870-873
- ISSN
- 0741-3106 (ISSN-L)
- 1558-0563
- OpenAlex
- W2404581299
- Cited by
- 146
- References
- 7
- FWCI
- 6.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.