The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Binary convolutional neural network on RRAM
Abstract
Recent progress in the machine learning field makes low bit-level Convolutional Neural Networks (CNNs), even CNNs with binary weights and binary neurons, achieve satisfying recognition accuracy on ImageNet dataset. Binary CNNs (BCNNs) make it possible for introducing low bit-level RRAM devices and low bit-level ADC/DAC interfaces in RRAM-based Computing System (RCS) design, which leads to faster read-and-write operations and better energy efficiency than before. However, some design challenges still exist: (1) how to make matrix splitting when one crossbar is not large enough to hold all parameters of one layer; (2) how to design the pipeline to accelerate the whole CNN forward process. In this paper, an RRAM crossbar-based accelerator is proposed for BCNN forward process. Moreover, the special design for BCNN is well discussed, especially the matrix splitting problem and the pipeline implementation. In our experiment, BCNNs on RRAM show much smaller accuracy loss than multi-bit CNNs for LeNet on MNIST when considering device variation. For AlexNet on ImageNet, the RRAM-based BCNN accelerator saves 58.2% energy consumption and 56.8% area compared with multi-bit CNN structure.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.12 · Cited by 775
High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm
Alibart, F., Gao, L., Hoskins, B. D., & Strukov, D. B. (2012) · Nanotechnology · doi:10.1088/0957-4484/23/7/075201 · Cited by 557 · cited 2×
“However, the current resistance precision of RRAM device is limited [9], and the impact of writing variation and reliability problem increases with the bit-level amounts of RRAM device [10].”
Background
Cited by
Neuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
“With this principle, there are a few simulation works to explore the binary neural network with eNVMs [133]–[135].”
BackgroundModel Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2976475 · Cited by 996
“In addition, binary neural networks are beneficial for the deployment on emerging memory architectures with only two stable levels or supporting only simple logic operations [292]–[295].”
BackgroundChen, P.-Y., Peng, X., & Yu, S. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2789723 · Cited by 652
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“Therefore, BNN can be realized easily by utilizing the memory architectures and logic operations [341].”
MethodNeuromemristive Circuits for Edge Computing: A Review
Krestinskaya, O., James, A. P., & Chua, L. O. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2899262 · Cited by 319
XNOR-RRAM: A scalable and parallel resistive synaptic architecture for binary neural networks
Sun, X., Yin, S., Peng, X., Liu, R., Seo, J.-S., & Yu, S. (2018) · 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date.2018.8342235 · Cited by 246
Chakraborty, I., Ali, M., Ankit, A., Jain, S., Roy, S., Sridharan, S., Agrawal, A., Raghunathan, A., & Roy, K. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3003007 · Cited by 140
“Due to the intrinsic physics of these NVM devices, they can store multiple states in a highly dense memory with a bit-cell area of ∼ 4 F 2 [27].”
BackgroundHirtzlin, T., Bocquet, M., Penkovsky, B., Klein, J.-O., Nowak, E., Vianello, E., Portal, J.-M., & Querlioz, D. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01383 · Cited by 93
Pan, Y., Ouyang, P., Zhao, Y., Kang, W., Yin, S., Zhang, Y., Zhao, W., & Wei, S. (2018) · IEEE Transactions on Magnetics · doi:10.1109/tmag.2018.2848625 · Cited by 89
Analog/Mixed-Signal Hardware Error Modeling for Deep Learning Inference
Rekhi, A. S., Zimmer, B., Nedovic, N., Liu, N., Venkatesan, R., Wang, M., Khailany, B., Dally, W. J., & Gray, C. T. (2019) · Proceedings of the 56th Annual Design Automation Conference 2019 · doi:10.1145/3316781.3317770 · Cited by 67
Park, J., Kim, S., Song, M. S., Youn, S., Kim, K., Kim, T.-H., & Kim, H. (2024) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.3c13775 · Cited by 56
Outstanding Bit Error Tolerance of Resistive RAM-Based Binarized Neural Networks
Hirtzlin, T., Bocquet, M., Klein, J.-O., Nowak, E., Vianello, E., Portal, J.-M., & Querlioz, D. (2019) · 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas.2019.8771544 · Cited by 51
“An optimal implementation would be with RRAM [5], [13]–[15], as RRAM cells are much more compact than SRAM, and yet non-volatile.”
BackgroundMask Technique for Fast and Efficient Training of Binary Resistive Crossbar Arrays
Fouda, M. E., Lee, S., Lee, J., Eltawil, A., & Kurdahi, F. (2019) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2019.2927493 · Cited by 41
An All-digital Compute-in-memory FPGA Architecture for Deep Learning Acceleration
Li, Y., Li, X., Shen, H., Fan, J., Xu, Y., & Huang, K. (2024) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3640469 · Cited by 5
Metadata
- Authors
- Tang, T., Xia, L., Li, B., Wang, Y., & Yang, H.
- Venue
- 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC)
- Publisher
- IEEE
- Published
- 2017-01
- Pages
- 782-787
- OpenAlex
- W2588666075
- Cited by
- 176
- References
- 3
- FWCI
- 44.36
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.