Digital Offset for RRAM-based Neuromorphic Computing: A Novel Solution to Conquer Cycle-to-cycle Variation
The DOI matches its Crossref record; 19 of the 22 references it cites were found in a registry or an index.
Abstract
Resistance variation in memristor device hinders the practical use of resistive random access memory (RRAM) crossbars as neural network (NN) accelerators. Previous fault-tolerant methods cannot effectively handle cycle-to-cycle variation (CCV). Many of them also use a pair of positive-weight and negative-weight crossbars to store a weight matrix, which implicitly enhances the fault tolerance but doubles the hardware cost. This paper proposes a novel solution that dramatically reduces the NN accuracy loss under CCV, while still using a single crossbar to store a weight matrix. The key idea is to introduce digital offsets into the crossbar, which further enables two techniques to conquer CCV. The first is a variation-aware weight optimization method that determines the optimal target weights to be written into the crossbar; the second is a post-writing tuning method that optimally sets the digital offsets to recover the accuracy loss due to variation. Simulation results show that the accuracy maintains the ideal value for LeNet with MNIST and only drops by 2.77% over the ideal value for ResNet-18 with CIFAR-10 under a large resistance variation. Moreover, compared to state-of-the-art fault-tolerant methods, our method achieves a better NN accuracy with at least 50% fewer crossbars.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Strukov, D. B., Snider, G. S., Stewart, D. R., & Williams, R. S. (2008) · Nature · doi:10.1038/nature06932 · Cited by 11,828
A Suggestion for a Fast Multiplier
Wallace, C. S. (1964) · IEEE Transactions on Electronic Computers · doi:10.1109/pgec.1964.263830 · Cited by 1,808
ISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
Chi, P., Li, S., Xu, C., Zhang, T., Zhao, J., Liu, Y., Wang, Y., & Xie, Y. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001140 · Cited by 1,231
High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm
Alibart, F., Gao, L., Hoskins, B. D., & Strukov, D. B. (2012) · Nanotechnology · doi:10.1088/0957-4484/23/7/075201 · Cited by 557 · cited 2×
“Although the repeated programming method is a potential solution [5], [6], it needs to program the device many times, which shortens the device lifetime.”
MethodYu, S., Wu, Y., & Wong, H.-S. P. (2011) · Applied Physics Letters · doi:10.1063/1.3564883 · Cited by 288
Accelerator-friendly neural-network training: Learning variations and defects in RRAM crossbar
Chen, L., Li, J., Chen, Y., Deng, Q., Shen, J., Liang, X., & Jiang, L. (2017) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017 · doi:10.23919/date.2017.7926952 · Cited by 245 · cited 4×
“Some other methods overcome hardware defects by properly mapping the weights to the devices [7], [10]–[12].”
BackgroundMethodInfluentialSelf-citationVortex: variation-aware training for memristor X-bar
Liu, B., Li, H., Chen, Y., Li, X., Wu, Q., & Huang, T. (2015) · Proceedings of the 52nd Annual Design Automation Conference · doi:10.1145/2744769.2744930 · Cited by 197
Lee, S. R., Kim, Y.-B., Chang, M., Kim, K. M., Lee, C. B., Hur, J. H., Park, G.-S., Lee, D., Lee, M.-J., Kim, C. J., et al. (2012) · 2012 Symposium on VLSI Technology (VLSIT) · doi:10.1109/vlsit.2012.6242466 · Cited by 165
Research works printed but not linked: 1
- 2008, Nangate 45nm open cell library
Cited by
He, Y., Huang, Y., Yue, J., Sun, W., Zhang, L., & Liu, Y. (2022) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas48785.2022.9937513 · Cited by 16
“Other works alleviate the accuracy problem by adding digital offset circuits [8] or employing error-correcting codes [7].”
MethodHyperX: A Hybrid RRAM-SRAM partitioned system for error recovery in memristive Xbars
Kosta, A. K., Soufleri, E., Chakraborty, I., Agrawal, A., Ankit, A., & Roy, K. (2022) · Design, Automation, and Test in Europe · doi:10.23919/date54114.2022.9774549 · Cited by 16
Write or not: programming scheme optimization for RRAM-based neuromorphic computing
Meng, Z., Sun, Y., & Qian, W. (2022) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3489517.3530558 · Cited by 10
“3530558 SRAM [6, 7], into the architecture to compensate the variation, at a cost of some hardware overhead.”
Self-citationRescuing ReRAM-based Neural Computing Systems from Device Variation
Huang, C., Xu, N., Zeng, J., Wang, W., Hu, Y., Fang, L., Ma, D., & Chen, Y.-T. (2022) · ACM Transactions on Design Automation of Electronic Systems · doi:10.1145/3533706 · Cited by 7
“Some hardwaresoftware-based methods also achieve a better DNN accuracy with the extra compensatory circuits [5, 26].”
MethodInfluentialHe, J., Huang, Y., Lastras-Montaño, M. Á., Ye, T. T., Tsui, C.-Y., & Cheng, K.-T. T. (2023) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1145/3566097.3567858 · Cited by 7
“developed a solution to compensate with digital offsets [10].”
BackgroundMethodResultInfluential
Metadata
- Authors
- Meng, Z., Qian, W., Zhao, Y., Sun, Y., Yang, R., & Jiang, L.
- Affiliations
- Shanghai Jiao Tong University (CN)
- Fudan University (CN)
- Venue
- 2021 Design, Automation & Test in Europe Conference & Exhibition (DATE)
- Publisher
- IEEE
- Published
- 2021-02-01
- Pages
- 1078-1083
- OpenAlex
- W3186222796
- Cited by
- 10
- References
- 22
- Citations by year
- 2024: 1 · 2023: 5 · 2022: 4
- FWCI
- 3.92
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Design, Automation, and Test in Europe (publishedVersion)
- Funders
- National Natural Science Foundation of China (61834006)
- Shanghai Science and Technology Committee (18ZR1421400)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Ferroelectric and Negative Capacitance Devices
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- resistive random access memory, memristors, neuromorphic computing, cycle-to-cycle variation, neural network accelerators, fault tolerance, resistance variation, LeNet, ResNet-18
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Digital Offset for RRAM-based Neuromorphic Computing: A Novel Solution to Conquer Cycle-to-cycle Variation. https://app.cochat.ai/papers/10.23919/date51398.2021.9474179
- The paper
- Meng, Z., Qian, W., Zhao, Y., Sun, Y., Yang, R., & Jiang, L. (2021). Digital Offset for RRAM-based Neuromorphic Computing: A Novel Solution to Conquer Cycle-to-cycle Variation. 2021 Design, Automation & Test in Europe Conference & Exhibition (DATE). https://doi.org/10.23919/date51398.2021.9474179
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.