A 40-nm MLC-RRAM Compute-in-Memory Macro With Sparsity Control, On-Chip Write-Verify, and Temperature-Independent ADC References
The DOI matches its Crossref record; 35 of the 37 references it cites were found in a registry or an index.
Abstract
Resistive random access memory (RRAM)-based compute-in-memory (CIM) has shown great potential for accelerating deep neural network (DNN) inference. However, device characteristics, such as low-resistance values, susceptibility to drift, and single-level cells, may limit the capabilities of RRAM-based CIM. In addition, prior works generally used the off-chip write-verify scheme to tighten RRAM resistance distributions and used off-chip analog-to-digital converter (ADC) references for fine-tuning partial sum quantization. Although off-chip techniques are viable for testing purposes, they may be unsuitable for practical applications. In this work, we present an RRAM-CIM macro to accelerate DNN inference. The chip features: 1) multi-level cell (MLC) RRAM for improving compute performance and density; 2) sparsity-aware input control to leverage the high activation sparsity in DNN models; 3) on-chip write-verify to speed up initial weight programming and periodically refresh cells to compensate for resistance drift under stress; and 4) on-chip ADC reference generation that provides column-wise tunability and stability with varying temperatures to guarantee the CIFAR-10 accuracy of 85.8% at 120 °C. The design is fabricated in TSMC 40-nm process with embedded RRAM technology and achieves a macro-level peak performance of 97.8 GOPS/mm2and 44.5 TOPS/W for multiply-and-accumulate (MAC) operations on VGG-8 network with ternary weights.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“these approaches have been demonstrated mostly for the weight update of isolated devices, with just a few examples of on-chip integrated approaches214.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [214]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 1×
“MLC RRAM research and development so far remain at passive device or array level [23], [24], with a few advances on the integration on legacy CMOS platform (90 nm or older) [25]–[27].”
BackgroundWong, H.-S. P., Lee, H.-Y., Yu, S., Chen, Y.-S., Wu, Y., Chen, P.-S., Lee, B., Chen, F. T., & Tsai, M.-J. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2190369 · Cited by 2,757
Self-citationMemory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Fully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179
Neuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170 · cited 1×
“Compute-in-memory (CIM) has been widely recognized as a promising paradigm to alleviate the von Neumann bottleneck [7], [8], due to its highly parallel nature of compute and potential to suppress data movements.”
BackgroundSelf-citationMoons, B., Uytterhoeven, R., Dehaene, W., & Verhelst, M. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870353 · Cited by 479
Three-dimensional memristor circuits as complex neural networks
Lin, P., Li, C., Wang, Z., Li, Y., Jiang, H., Song, W., Rao, M., Zhuo, Y., Upadhyay, N. K., Barnell, M., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-0397-9 · Cited by 375 · cited 1×
“MLC RRAM research and development so far remain at passive device or array level [23], [24], with a few advances on the integration on legacy CMOS platform (90 nm or older) [25]–[27].”
BackgroundSelf-citationPeng, X., Huang, S., Luo, Y., Sun, X., & Yu, S. (2019) · 2019 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm19573.2019.8993491 · Cited by 359
Self-citationDong, Q., Sinangil, M. E., Erbagci, B., Sun, D., Khwa, W.-S., Liao, H.-J., Wang, Y., & Chang, J. (2020) · 2020 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc19947.2020.9062985 · Cited by 346
14.2 DNPU: An 8.1TOPS/W reconfigurable CNN-RNN processor for general-purpose deep neural networks
Shin, D., Lee, J., Lee, J., & Yoo, H.-J. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870350 · Cited by 307
Training and Inference with Integers in Deep Neural Networks
Wu, S., Li, G., Chen, F., & Shi, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04680 · Cited by 306
Khwa, W.-S., Chen, J.-J., Li, J.-F., Si, X., Yang, E.-Y., Sun, X., Liu, R., Chen, P.-Y., Li, Q., Yu, S., et al. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310401 · Cited by 260
Self-citationA Multi-Functional In-Memory Inference Processor Using a Standard 6T SRAM Array
Kang, M., Gonugondla, S. K., Patil, A., & Shanbhag, N. R. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2782087 · Cited by 224
Mochida, R., Kouno, K., Hayata, Y., Nakayama, M., Ono, T., Suwa, H., Yasuhara, R., Katayama, K., Mikawa, T., & Gohou, Y. (2018) · 2018 IEEE Symposium on VLSI Technology · doi:10.1109/vlsit.2018.8510676 · Cited by 194
Yin, S., Sun, X., Yu, S., & Seo, J.-S. (2020) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2020.3015178 · Cited by 171
Self-citationRRAM for Compute-in-Memory: From Inference to Training
Yu, S., Shim, W., Peng, X., & Luo, Y. (2021) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2021.3072200 · Cited by 171
Self-citationSun, X., & Yu, S. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2019.2933148 · Cited by 170 · cited 1×
“4) Resiliency to read disturb and resistance drift is another desirable device trait for CIM [32], [33], but cells that are prone to vary under stress can cause the BL voltages to fluctuate during compute, thereby reducing the sensing accuracy.”
BackgroundSelf-citationAndo, K., Ueyoshi, K., Orimo, K., Yonekawa, H., Sato, S., Nakahara, H., Takamaeda-Yamazaki, S., Ikebe, M., Asai, T., Kuroda, T., et al. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2778702 · Cited by 160
Wan, W., Kubendran, R., Eryilmaz, S. B., Zhang, W., Liao, Y., Wu, D., Deiss, S., Gao, B., Raina, P., Joshi, S., et al. (2020) · 2020 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc19947.2020.9062979 · Cited by 143
XNOR-SRAM: In-Memory Computing SRAM Macro for Binary/Ternary Deep Neural Networks
Jiang, Z., Yin, S., Seok, M., & Seo, J.-S. (2018) · 2018 IEEE Symposium on VLSI Technology · doi:10.1109/vlsit.2018.8510687 · Cited by 133
Accelerating Deep Convolutional Networks using low-precision and sparsity
Venkatesh, G., Nurvitadhi, E., & Marr, D. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952679 · Cited by 123 · cited 1×
“We implement a sparsity-aware input controller that leverages the typically high sparsity level of input activations in DNN models [35].”
MethodYin, S., Kim, Y., Han, X., Barnaby, H., Yu, S., Luo, Y., He, W., Sun, X., Kim, J.-J., & Seo, J.-S. (2019) · IEEE Micro · doi:10.1109/mm.2019.2943047 · Cited by 90
Self-citationLee, J., Valavi, H., Tang, Y., & Verma, N. (2021) · Symposium on VLSI Circuits · doi:10.23919/vlsicircuits52068.2021.9492444 · Cited by 75
Analog-to-Digital Converter Design Exploration for Compute-in-Memory Accelerators
Jiang, H., Li, W., Huang, S., Cosemans, S., Catthoor, F., & Yu, S. (2021) · IEEE Design and Test · doi:10.1109/mdat.2021.3050715 · Cited by 70
Self-citationYoon, J., Chang, M., Khwa, W.-S., Chih, Y.-D., Chang, M., & Raychowdhury, A. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3101209 · Cited by 68
2-Bit-Per-Cell RRAM-Based In-Memory Computing for Area-/Energy-Efficient Deep Learning
He, W., Yin, S., Kim, Y., Sun, X., Kim, J.-J., Yu, S., & Seo, J.-S. (2020) · IEEE Solid-State Circuits Letters · doi:10.1109/lssc.2020.3010795 · Cited by 67
Self-citationTwo-step write–verify scheme and impact of the read noise in multilevel RRAM-based inference engine
Shim, W., Seo, J.-S., & Yu, S. (2020) · Semiconductor Science and Technology · doi:10.1088/1361-6641/abb842 · Cited by 61
Self-citationShim, W., Luo, Y., Seo, J.-S., & Yu, S. (2020) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2020.2985013 · Cited by 58
Self-citationLi, W., Huang, S., Sun, X., Jiang, H., & Yu, S. (2021) · Custom Integrated Circuits Conference · doi:10.1109/cicc51472.2021.9431558 · Cited by 47
Self-citationCorrell, J. M., Bothra, V., Cai, F., Lim, Y., Lee, S. H., Lee, S., Lu, W. D., Zhang, Z., & Flynn, M. P. (2020) · IEEE Journal on Exploratory Solid-State Computational Devices and Circuits · doi:10.1109/jxcdc.2020.2992228 · Cited by 36
A Variation Robust Inference Engine Based on STT-MRAM with Parallel Read-Out
Luo, Y., Peng, X., Hatcher, R., Rakshit, T., Kittl, J. A., Rodder, M. S., Seo, J.-S., & Yu, S. (2020) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas45731.2020.9181022 · Cited by 21
Self-citationLi, W., Sun, X., Jiang, H., Huang, S., & Yu, S. (2021) · European Solid-State Device Research Conference · doi:10.1109/essderc53440.2021.9631810 · Cited by 9
Self-citation
Research works printed but not linked: 2
- Xue, A 1 Mb multibit ReRAM computing-in-memory macro with 14.6 ns parallel MAC computing time for CNN based AI edge processors, 388
- Xue, A 22 nm 4 Mb 8b-precision ReRAM computing-in-memory macro with 11.91 to 195.7TOPS/W for tiny AI edge devices, 245
Cited by
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
“For this reason, these approaches have been demonstrated mostly for the weight update of isolated devices, with just a few examples of on-chip integrated approaches 214 .”
Ye, W., Wang, L., Zhou, Z., An, J., Li, W., Gao, H., Li, Z., Yue, J., Hu, H., Xu, X., et al. (2023) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2023.3280357 · Cited by 71
Self-citationLi, W., Manley, M., Read, J., Kaul, A., Bakir, M. S., & Yu, S. (2023) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2023.3299509 · Cited by 45
Self-citationLow-Power and Scalable BEOL-Compatible IGZO TFT eDRAM-Based Charge-Domain Computing
Tang, W., Liu, J., Sun, C., Zheng, Z., Liu, Y., Yang, H., Jiang, C. H., Ni, K., Gong, X., & Li, X. (2023) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2023.3317170 · Cited by 28
Yang, J., Mao, R., Jiang, M., Cheng, Y., Sun, P.-S. V., Dong, S., Pedretti, G., Sheng, X., Ignowski, J., Li, H., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-56254-6 · Cited by 38
Metadata
- Authors
- Li, W., Sun, X., Huang, S., Jiang, H., & Yu, S.
- Affiliations
- Georgia Institute of Technology (US)
- Taiwan Semiconductor Manufacturing Company (United States) (US)
- Venue
- IEEE Journal of Solid-State Circuits
- Published
- 2022-09
- Volume
- 57
- Issue
- 9
- Pages
- 2868-2877
- ISSN
- 0018-9200 (ISSN-L)
- 1558-173X
- OpenAlex
- W4226111665
- Cited by
- 77
- References
- 37
- Citations by year
- 2026: 19 · 2025: 21 · 2024: 15 · 2023: 19 · 2022: 3
- FWCI
- 3.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Journal of Solid-State Circuits (publishedVersion)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- resistive random access memory, in-memory computing, ternary weights, CIFAR-10
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.