DNN+NeuroSim V2.0: An End-to-End Benchmarking Framework for Compute-in-Memory Accelerators for On-Chip Training
Open accessThe DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
DNN+NeuroSim is an integrated framework to benchmark compute-in-memory (CIM) accelerators for deep neural networks, with hierarchical design options from device-level, to circuit level and up to algorithm level. A python wrapper is developed to interface NeuroSim with a popular machine learning platform: Pytorch, to support flexible network structures. The framework provides automatic algorithm-to-hardware mapping, and evaluates chip-level area, energy efficiency and throughput for training or inference, as well as training/inference accuracy with hardware constraints. Our prior inference version of DNN+NeuroSim framework available at https://github.com/neurosim/DNN_NeuroSim_V1.2 was developed to estimate the impact of reliability in synaptic devices, and analog-to-digital converter (ADC) quantization loss on the accuracy and hardware performance of an inference engine. In this work, we further investigated the impact of the “analog” emerging nonvolatile memory (eNVM)’s nonideal device properties for on-chip training. By introducing the nonlinearity, asymmetry, device-to-device and cycle-to-cycle variation of weight update into the python wrapper, and peripheral circuits for error/weight gradient computation in NeuroSim core, we benchmarked CIM accelerators based on state-of-the-art SRAM and eNVM devices for VGG-8 on CIFAR-10 dataset, revealing the crucial specs of synaptic devices for on-chip training. The latest training version of the DNN+NeuroSim framework is available at…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Jo, S. H., Chang, T., Ebong, I., Bhadviya, B. B., Mazumder, P., & Lu, W. (2010) · Nano Letters · doi:10.1021/nl904092h · Cited by 4,174 · cited 1×
“…the CIM accelerators for VGG-8 training on CIFAR-10 dataset, with versatile synaptic devices, including the sequential and parallel read-out SRAM-based accelerators at both 7nm and 32nm, and state-of-the-art parallel read-out eNVM-based (including [2][4][6], and [21~23]) accelerators at 32nm.”
BackgroundNeuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
Self-citationBurr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936
Choi, S., Tan, S. H., Li, Z., Kim, Y., Choi, C., Chen, P.-Y., Yeon, H., Yu, S., & Kim, J. (2018) · Nature Materials · doi:10.1038/s41563-017-0001-5 · Cited by 690
Self-citationChen, P.-Y., Peng, X., & Yu, S. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2789723 · Cited by 652
Self-citationFerroelectric FET analog synapse for acceleration of deep neural network training
Jerry, M., Chen, P.-Y., Zhang, J., Sharma, P., Ni, K., Yu, S., & Datta, S. (2017) · 2017 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2017.8268338 · Cited by 599
Self-citationWoo, J., Moon, K., Song, J., Lee, S., Kwak, M., Park, J., & Hwang, H. (2016) · IEEE Electron Device Letters · doi:10.1109/led.2016.2582859 · Cited by 512
Peng, X., Huang, S., Luo, Y., Sun, X., & Yu, S. (2019) · 2019 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm19573.2019.8993491 · Cited by 359
Self-citationSeo, J.-S., Brezzo, B., Liu, Y., Parker, B. D., Esser, S. K., Montoye, R. K., Rajendran, B., Tierno, J. A., Chang, L., Modha, D. S., et al. (2011) · 2011 IEEE Custom Integrated Circuits Conference (CICC) · doi:10.1109/cicc.2011.6055293 · Cited by 344
Training and Inference with Integers in Deep Neural Networks
Wu, S., Li, G., Chen, F., & Shi, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04680 · Cited by 306
Neuromorphic speech systems using advanced ReRAM-based synapse
Park, S., Sheri, A., Kim, J., Noh, J., Jang, J., Jeon, M., Lee, B., Lee, B. R., Lee, B. H., & Hwang, H. (2013) · 2013 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2013.6724692 · Cited by 201
A Methodology to Improve Linearity of Analog RRAM for Neuromorphic Computing
Wu, W., Wu, H., Gao, B., Yao, P., Zhang, X., Peng, X., Yu, S., & Qian, H. (2018) · 2018 IEEE Symposium on VLSI Technology · doi:10.1109/vlsit.2018.8510690 · Cited by 197
Self-citationECRAM as Scalable Synaptic Cell for High-Speed, Low-Power Neuromorphic Computing
Tang, J., Bishop, D., Kim, S., Copel, M., Gokmen, T., Todorov, T., Shin, S., Lee, K.-T., Solomon, P., Chan, K., et al. (2018) · 2018 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2018.8614551 · Cited by 161
Peng, X., Liu, R., & Yu, S. (2019) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2019.8702715 · Cited by 131
Self-citationPeng, X., Liu, R., & Yu, S. (2019) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2019.2958568 · Cited by 108
Self-citationKim, W. W., Bruce, R. L., Masuda, T., Fraczak, G., Gong, N., Adusumilli, P., Ambrogio, S., Tsai, H.-Y. S., Bruley, J., Han, J., et al. (2019) · Symposium on VLSI Technology · doi:10.23919/vlsit.2019.8776551 · Cited by 74
CIMAT: A Compute-In-Memory Architecture for On-chip Training Based on Transpose SRAM Arrays
Jiang, H., Peng, X., Huang, S., & Yu, S. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2980533 · Cited by 69
Self-citationReliability perspective of resistive synaptic devices on the neuromorphic system performance
Chen, P.-Y., & Yu, S. (2018) · IEEE International Reliability Physics Symposium proceedings · doi:10.1109/irps.2018.8353615 · Cited by 48
Self-citationSidler, S., Boybat, I., Shelby, R. M., Narayanan, P., Jang, J., Fumarola, A., Moon, K., Leblebici, Y., Hwang, H., & Burr, G. W. (2016) · 2016 46th European Solid-State Device Research Conference (ESSDERC) · doi:10.1109/essderc.2016.7599680 · Cited by 47
A Two-way SRAM Array based Accelerator for Deep Neural Network On-chip Training
Jiang, H., Huang, S., Peng, X., Su, J.-W., Chou, Y.-C., Huang, W.-H., Liu, T.-W., Liu, R., Chang, M., & Yu, S. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218524 · Cited by 44
Self-citationAccelerating machine learning with Non-Volatile Memory: Exploring device and circuit tradeoffs
Fumarola, A., Narayanan, P., Sanches, L. L., Sidler, S., Jang, J., Moon, K., Shelby, R. M., Hwang, H., & Burr, G. W. (2016) · 2016 IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2016.7738684 · Cited by 37
Partition SRAM and RRAM based synaptic arrays for neuro-inspired computing
Chen, P.-Y., & Yu, S. (2016) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2016.7539046 · Cited by 27
Self-citationMINT: Mixed-Precision RRAM-Based IN-Memory Training Architecture
Jiang, H., Huang, S., Peng, X., & Yu, S. (2020) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas45731.2020.9181020 · Cited by 26
Self-citationOvercoming Challenges for Achieving High in-situ Training Accuracy with Emerging Memories
Huang, S., Sun, X., Peng, X., Jiang, H., & Yu, S. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116215 · Cited by 19
Self-citation
Research works printed but not linked: 1
- 2016, ASU PTM Model
Cited by
Neuromorphic computing at scale
Kudithipudi, D., Schuman, C., Vineyard, C. M., Pandit, T., Merkel, C., Kubendran, R., Aimone, J. B., Orchard, G., Mayr, C., Benosman, R., et al. (2025) · Nature · doi:10.1038/s41586-024-08253-8 · Cited by 357
Recent Advances and Future Prospects for Memristive Materials, Devices, and Systems
Song, M.-K., Kang, J.-H., Zhang, X., Ji, W., Ascoli, A., Messaris, I., Demirkol, A. S., Dong, B., Aggarwal, S., Wan, W., et al. (2023) · ACS Nano · doi:10.1021/acsnano.3c03505 · Cited by 300
Ferroelectric Transistors for Memory and Neuromorphic Device Applications
Kim, I., & Lee, J. (2023) · Advanced Materials · doi:10.1002/adma.202206864 · Cited by 256
Seo, S., Lee, J., Lee, R., Kim, T. H., Park, S., Jung, S., Lee, H., Andreev, M., Lee, K., Jung, K., et al. (2021) · Advanced Materials · doi:10.1002/adma.202102980 · Cited by 167
Frenkel, C., Bol, D., & Indiveri, G. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3273520 · Cited by 196
Metadata
- Authors
- Peng, X., Huang, S., Jiang, H., Lu, A., & Yu, S.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
- Published
- 2021-11
- Volume
- 40
- Issue
- 11
- Pages
- 2306-2319
- ISSN
- 0278-0070 (ISSN-L)
- 1937-4151
- OpenAlex
- W3112740243
- Semantic Scholar
- 8de446ad3bc957a86f3b76369a1020acb360bdf7
- Cited by
- 317
- References
- 25
- Citations by year
- 2026: 56 · 2025: 85 · 2024: 61 · 2023: 62 · 2022: 31 · 2021: 19
- FWCI
- 9.88
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- ASCENT, one of the SRC/DARPA JUMP centers, NSF/SRC E2CDA program (NSF-CCF-1903951)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- on-chip learning, device-to-device variation, cycle-to-cycle variation, SRAM, CIFAR-10, energy efficiency, PyTorch integration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.