The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
NeuroSim: A Circuit-Level Macro Model for Benchmarking Neuro-Inspired Architectures in Online Learning
Abstract
Neuro-inspired architectures based on synaptic memory arrays have been proposed for on-chip acceleration of weighted sum and weight update in machine/deep learning algorithms. In this paper, we developed NeuroSim, a circuit-level macro model that estimates the area, latency, dynamic energy, and leakage power to facilitate the design space exploration of neuro-inspired architectures with mainstream and emerging device technologies. NeuroSim provides flexible interface and a wide variety of design options at the circuit and device level. Therefore, NeuroSim can be used by neural networks (NNs) as a supporting tool to provide circuit-level performance evaluation. With NeuroSim, an integrated framework can be built with hierarchical organization from the device level (synaptic device properties) to the circuit level (array architectures) and then to the algorithm level (NN topology), enabling instruction-accurate evaluation on the learning accuracy as well as the circuit-level performance metrics at the run-time of online learning. Using multilayer perceptron as a case-study algorithm, we investigated the impact of the “analog” emerging nonvolatile memory (eNVM)'s “nonideal” device properties and benchmarked the tradeoffs between SRAM, digital, and analog eNVM-based architectures for online learning and offline classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“In this section, we demonstrate the third usage scenario of NeuroSim in Section III-E using a 2-layer MLP NN with MNIST handwritten digits [42] as the training and testing dataset to implement online learning and offline classification.”
MethodNanoscale Memristor Device as Synapse in Neuromorphic Systems
Jo, S. H., Chang, T., Ebong, I., Bhadviya, B. B., Mazumder, P., & Lu, W. (2010) · Nano Letters · doi:10.1021/nl904092h · Cited by 4,174 · cited 3×
“For example, Ag:a-Si devices [20] show a nonlinear and noisy weight increase/decrease; though TaOx/TiO2 devices [21] exhibit a more linear and smooth weight increase/decrease, the ON/OFF ratio is very limited (∼2).”
BackgroundMethodA million spiking-neuron integrated circuit with a scalable communication network and interface
Merolla, P. A., Arthur, J. V., Alvarez-Icaza, R., Cassidy, A. S., Sawada, J., Akopyan, F., Jackson, B. L., Imam, N., Guo, C., Nakamura, Y., et al. (2014) · Science · doi:10.1126/science.1254642 · Cited by 4,147
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 1×
“To achieve even higher integration density, faster speed, and lower programming voltage, compact synaptic devices based on eNVM are proposed for the neuromorphic systems, including resistive random access memory [20]–[25] and phase change memory [11], [26], [27], etc.”
MethodISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing
Kuzum, D., Jeyasingh, R. G. D., Lee, B., & Wong, H.-S. P. (2012) · Nano Letters · doi:10.1021/nl201040y · Cited by 1,267 · cited 1×
“To achieve even higher integration density, faster speed, and lower programming voltage, compact synaptic devices based on eNVM are proposed for the neuromorphic systems, including resistive random access memory [20]–[25] and phase change memory [11], [26], [27], etc.”
MethodNeurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations
Benjamin, B. V., Gao, P., McQuinn, E., Choudhary, S., Chandrasekaran, A. R., Bussat, J.-M., Alvarez-Icaza, R., Arthur, J. V., Merolla, P. A., & Boahen, K. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2313565 · Cited by 1,266
Synaptic electronics: materials, devices and applications
Kuzum, D., Yu, S., & Philip Wong, H.-S. (2013) · Nanotechnology · doi:10.1088/0957-4484/24/38/382001 · Cited by 1,258
Self-citationChi, P., Li, S., Xu, C., Zhang, T., Zhao, J., Liu, Y., Wang, Y., & Xie, Y. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001140 · Cited by 1,231
NVSim: A Circuit-Level Performance, Energy, and Area Model for Emerging Nonvolatile Memory
Dong, X., Xu, C., Xie, Y., & Jouppi, N. P. (2012) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2012.2185930 · Cited by 1,217
Burr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936
DRAMSim2: A Cycle Accurate Memory System Simulator
Rosenfeld, P., Cooper-Balis, E., & Jacob, B. (2011) · IEEE Computer Architecture Letters · doi:10.1109/l-ca.2011.4 · Cited by 908
CACTI: an enhanced cache access and cycle time model
Wilton, S. J. E., & Jouppi, N. P. (1996) · IEEE Journal of Solid-State Circuits · doi:10.1109/4.509850 · Cited by 872
14.5 Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural networks
Chen, Y.-H., Krishna, T., Emer, J., & Sze, V. (2016) · 2016 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2016.7418007 · Cited by 713
Emerging Memory Technologies: Recent Trends and Prospects
Yu, S., & Chen, P.-Y. (2016) · IEEE Solid-State Circuits Magazine · doi:10.1109/mssc.2016.2546199 · Cited by 555
Self-citationYu, S., Gao, B., Fang, Z., Yu, H., Kang, J., & Wong, H. ‐. P. (2013) · Advanced Materials · doi:10.1002/adma.201203680 · Cited by 527
Self-citationWoo, J., Moon, K., Song, J., Lee, S., Kwak, M., Park, J., & Hwang, H. (2016) · IEEE Electron Device Letters · doi:10.1109/led.2016.2582859 · Cited by 512 · cited 1×
“Such nonideal behaviors commonly exist in today’s synaptic devices [20]–[23], possibly due to the inherent drift and diffusion dynamics of the ions/vacancies in these materials.”
BackgroundFinding a roadmap to achieve large neuromorphic hardware systems
Hasler, J., & Marr, B. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00118 · Cited by 392
Suri, M., Bichler, O., Querlioz, D., Cueto, O., Perniola, L., Sousa, V., Vuillaume, D., Gamrat, C., & DeSalvo, B. (2011) · 2011 International Electron Devices Meeting · doi:10.1109/iedm.2011.6131488 · Cited by 314 · cited 1×
“To achieve even higher integration density, faster speed, and lower programming voltage, compact synaptic devices based on eNVM are proposed for the neuromorphic systems, including resistive random access memory [20]–[25] and phase change memory [11], [26], [27], etc.”
Method14.2 DNPU: An 8.1TOPS/W reconfigurable CNN-RNN processor for general-purpose deep neural networks
Shin, D., Lee, J., Lee, J., & Yoo, H.-J. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870350 · Cited by 307
Liang, J., & Wong, H.-S. P. (2010) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2010.2062187 · Cited by 276
The cat is out of the bag: cortical simulations with 10 9 neurons, 10 13 synapses
Ananthanarayanan, R., Esser, S. K., Simon, H. D., & Modha, D. S. (2009) · Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis · doi:10.1145/1654059.1654124 · Cited by 263
Mitigating effects of non-ideal synaptic device characteristics for on-chip learning
Chen, P.-Y., Lin, B., Wang, I.-T., Hou, T.-H., Ye, J., Vrudhula, S., Seo, J.-S., Cao, Y., & Yu, S. (2015) · 2015 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad.2015.7372570 · Cited by 232
Self-citationScaling-up resistive synaptic arrays for neuro-inspired architecture: Challenges and prospect
Yu, S., Chen, P.-Y., Cao, Y., Xia, L., Wang, Y., & Wu, H. (2015) · 2015 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2015.7409718 · Cited by 219
Self-citationResistive memory device requirements for a neural algorithm accelerator
Agarwal, S., Plimpton, S. J., Hughart, D. R., Hsia, A. H., Richter, I., Cox, J. A., James, C. D., & Marinella, M. J. (2016) · 2016 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727298 · Cited by 213
Neuromorphic speech systems using advanced ReRAM-based synapse
Park, S., Sheri, A., Kim, J., Noh, J., Jang, J., Jeon, M., Lee, B., Lee, B. R., Lee, B. H., & Hwang, H. (2013) · 2013 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2013.6724692 · Cited by 201
Hardware realization of BSB recall function using memristor crossbar arrays
Hu, M., Li, H., Wu, Q., & Rose, G. S. (2012) · Proceedings of the 49th Annual Design Automation Conference · doi:10.1145/2228360.2228448 · Cited by 187
Binary convolutional neural network on RRAM
Tang, T., Xia, L., Li, B., Wang, Y., & Yang, H. (2017) · 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2017.7858419 · Cited by 176
MNSIM: Simulation Platform for Memristor-based Neuromorphic Computing System
Xia, L., Li, B., Tang, T., Gu, P., Chen, P.-Y., Yu, S., Cao, Y., Wang, Y., Xie, Y., & Yang, H. (2017) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2729466 · Cited by 171
Self-citationFully parallel write/read in resistive synaptic array for accelerating on-chip learning
Gao, L., Wang, I., Chen, P.-Y., Vrudhula, S. B. K., Seo, J.-S., Cao, Y. K., Hou, T., & Yu, S. (2015) · Nanotechnology · doi:10.1088/0957-4484/26/45/455204 · Cited by 145
Self-citationSchmitt, S., Klahn, J., Bellec, G., Grubl, A., Guttler, M., Hartel, A., Hartmann, S., Husmann, D., Husmann, K., Jeltsch, S., et al. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966125 · Cited by 138
Schmitt, S., Klähn, J., Bellec, G., Grübl, A., Güttler, M., Hartel, A., Hartmann, S., Husmann, D., Husmann, K., Jeltsch, S., et al. (2017) · TUGraz OPEN Library (Graz University of Technology) · Cited by 125
Programming Protocol Optimization for Analog Weight Tuning in Resistive Memories
Gao, L., Chen, P.-Y., & Yu, S. (2015) · IEEE Electron Device Letters · doi:10.1109/led.2015.2481819 · Cited by 101
Self-citationNeuro-inspired Computing Using Resistive Synaptic Devices
Yu, S. (2017) · Springer eBooks · doi:10.1007/978-3-319-54313-0 · Cited by 89
Self-citationTemperature-insensitive analog vector-by-matrix multiplier based on 55 nm NOR flash memory cells
Guo, X., Bayat, F. M., Prezioso, M., Chen, Y., Nguyen, B. Q., Do, N., & Strukov, D. B. (2017) · Custom Integrated Circuits Conference · doi:10.1109/cicc.2017.7993628 · Cited by 82
MNSIM: Simulation Platform for Memristor-based Neuromorphic Computing System
Xia, L., Li, B., Tang, T., Gu, P., Yin, X., Huangfu, W., Chen, P.-Y., Yu, S., Cao, Y. K., Wang, Y., et al. (2016) · Design, Automation, and Test in Europe · doi:10.3850/9783981537079_0549 · Cited by 76
Self-citationChen, P.-Y., Kadetotad, D. V., Xu, Z., Mohanty, A., Lin, B., Ye, J., Vrudhula, S. B. K., Seo, J.-S., Cao, Y. K., & Yu, S. (2015) · Design, Automation, and Test in Europe · doi:10.7873/date.2015.0620 · Cited by 74
Self-citationLiu, X., Mao, M., Liu, B., Li, B., Wang, Y., Jiang, H., Barnell, M. D., Wu, Q., Yang, J. J., Li, H. H., et al. (2016) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2016.2529279 · Cited by 70
Parallel Architecture With Resistive Crosspoint Array for Dictionary Learning Acceleration
Kadetotad, D. V., Xu, Z., Mohanty, A., Chen, P.-Y., Lin, B., Ye, J., Vrudhula, S. B. K., Yu, S., Cao, Y. K., & Seo, J.-S. (2015) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2015.2426495 · Cited by 63
Self-citationDesign of Resistive Synaptic Array for Implementing On-Chip Sparse Learning
Chen, P.-Y., Gao, L., & Yu, S. (2016) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2016.2598742 · Cited by 45
Self-citationPartition SRAM and RRAM based synaptic arrays for neuro-inspired computing
Chen, P.-Y., & Yu, S. (2016) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2016.7539046 · Cited by 27
Self-citation
Cited by
Neuro-inspired computing chips
Zhang, W., Gao, B., Tang, J., Yao, P., Yu, S., Chang, M.-F., Yoo, H.-J., Qian, H., & Wu, H. (2020) · Nature Electronics · doi:10.1038/s41928-020-0435-7 · Cited by 892
Self-citationA fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations
Cai, F., Correll, J. M., Lee, S. H., Lim, Y., Bothra, V., Zhang, Z., Flynn, M. P., & Lu, W. D. (2019) · Nature Electronics · doi:10.1038/s41928-019-0270-x · Cited by 728
Embedded Devices for Neuromorphic Time-Series Assessment
Mazumder, A. N., Hosseini, M., & Mohsenin, T. (2022) · Research Explorer (The University of Manchester) · doi:10.13016/m2ksy0-wxr3 · Cited by 652
Ferroelectric Analog Synaptic Transistors
Kim, M.-K., & Lee, J.-S. (2019) · Nano Letters · doi:10.1021/acs.nanolett.9b00180 · Cited by 594
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
“For benchmarking a device or a chip, it is essential to evaluate the accuracy of standard deep neural network models like VGG 89 and ResNet 90 on CIFAR and ImageNet dataset by utilizing architecture-levelsimulationandrealistichardwarestatistics 91,92 .”
Metadata
- Authors
- Chen, P.-Y., Peng, X., & Yu, S.
- Venue
- IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
- Published
- 2018-12
- Volume
- 37
- Issue
- 12
- Pages
- 3067-3080
- ISSN
- 0278-0070 (ISSN-L)
- 1937-4151
- OpenAlex
- W2782046614
- Cited by
- 652
- References
- 41
- FWCI
- 14.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.