The DOI matches its Crossref record; 27 of the 29 references it cites were found in a registry or an index.
Design of Ternary Neural Network With 3-D Vertical RRAM Array
Abstract
Recently, 2-D cross-point array of resistive random access memory (RRAM) has been proposed for implementing the weighted sum and weight update operations to accelerate the neuro-inspired learning algorithms on chip. This paper aims to extend such 2-D cross-point array to 3-D vertical array for storing and computing the large-scale weight matrices in the neural network. Considering the fabrication and 3-D integration of analog synapses (i.e., multilevel RRAM devices) are premature at this stage, we propose using today's available digital or binary RRAM devices for implementing a ternary neural network, which aggressively reduces the weight precision to ternary levels (+1, 0,-1) for the weighted sum in both feedforward and backward inference, while the multiple 3-D layers could serve for accumulating the small errors in a higher precision format for weight update. Compared to the 2-D implementation, the proposed 3-D vertical implementation shows larger read/write margin for weighted sum/weight update, smaller latency, and energy consumption for weight update. This paper demonstrates the attractiveness for building a monolithic 3-D neuromorphic hardware platform.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous work on 3D RRAM-based nvCIMs has been limited only to the memory array, and effective 3D computing systems that include peripheral circuits are lacking 20-31 .”
From A computing-in-memory macro based on three-dimensional resistive random-access memory (2022) · cites this paper as [27]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 1×
“, 12 × 12 TiOx/Al2O3 crossbar [5]) to medium-scale arrays (e.”
BinaryConnect: Training Deep Neural Networks with binary weights during propagations
Courbariaux, M., Bengio, Y., & David, J.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.00363 · Cited by 2,180
Seok, J. Y., Song, S. J., Yoon, J. H., Yoon, K. J., Park, T. H., Kwon, D. E., Lim, H., Kim, G. H., Jeong, D. S., & Hwang, C. S. (2014) · Advanced Functional Materials · doi:10.1002/adfm.201303520 · Cited by 383
Yu, S., Chen, H.-Y., Gao, B., Kang, J., & Wong, H.-S. P. (2013) · ACS Nano · doi:10.1021/nn305510u · Cited by 339
Self-citationSuri, M., Bichler, O., Querlioz, D., Cueto, O., Perniola, L., Sousa, V., Vuillaume, D., Gamrat, C., & DeSalvo, B. (2011) · 2011 International Electron Devices Meeting · doi:10.1109/iedm.2011.6131488 · Cited by 314 · cited 4×
“In the recent years, emerging nonvolatile memory such as phase-change memory (PCM) [2] and resistive random access memory (RRAM) [3], [4] based “analog” synapses that exploit the multilevel states have been demonstrated at single device level.”
BackgroundInfluentialBackpropagation for energy-efficient neuromorphic computing
Esser, S. K., Appuswamy, R., Merolla, P. A., Arthur, J. V., & Modha, D. S. (2015) · neural information processing systems · Cited by 281
Chen, A. (2013) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2013.2246791 · Cited by 230
Yu, S., Guan, X., & Wong, H.-S. P. (2012) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2012.2184544 · Cited by 224
Self-citationScaling-up resistive synaptic arrays for neuro-inspired architecture: Challenges and prospect
Yu, S., Chen, P.-Y., Cao, Y., Xia, L., Wang, Y., & Wu, H. (2015) · 2015 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2015.7409718 · Cited by 219
Self-citationBinary neural network with 16 Mb RRAM macro chip for classification and online training
Yu, S., Li, Z., Chen, P.-Y., Wu, H., Gao, B., Wang, D., Wu, W., & Qian, H. (2016) · 2016 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2016.7838429 · Cited by 219
Self-citationBurr, G. W., Shelby, R. M., di Nolfo, C., Jang, J. W., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., Kurdi, B., & Hwang, H. (2014) · 2014 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2014.7047135 · Cited by 208
Neuromorphic speech systems using advanced ReRAM-based synapse
Park, S., Sheri, A., Kim, J., Noh, J., Jang, J., Jeon, M., Lee, B., Lee, B. R., Lee, B. H., & Hwang, H. (2013) · 2013 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2013.6724692 · Cited by 201
Kim, S., Ishii, M., Lewis, S., Perri, T., BrightSky, M., Kim, W., Jordan, R., Burr, G. W., Sosa, N., Ray, A., et al. (2015) · 2015 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2015.7409716 · Cited by 194
Gao, B., Bi, Y., Chen, H.-Y., Liu, R., Huang, P., Chen, B., Liu, L., Liu, X., Yu, S., Wong, H.-S. P., et al. (2014) · ACS Nano · doi:10.1021/nn501824r · Cited by 188
Self-citationRealization of vertical resistive memory (VRRAM) using cost effective 3D process
Baek, I.-H., Park, C., Ju, H., Seong, D. J., Ahn, H. S., Kim, J., Yang, M., Song, S.-B., Kim, E., Park, S. O., et al. (2011) · Technical digest - International Electron Devices Meeting/Technical digest · doi:10.1109/iedm.2011.6131654 · Cited by 141
3D synaptic architecture with ultralow sub-10 fJ energy per spike for neuromorphic computation
Wang, I., Lin, Y.-C., Wang, Y., Hsu, C.-W., & Hou, T. (2014) · Technical digest - International Electron Devices Meeting/Technical digest · doi:10.1109/iedm.2014.7047127 · Cited by 101
Chang, M., Shen, S.-J., Liu, C., Wu, C.-W., Lin, Y.-F., King, Y., Lin, C.-J., Liao, H.-J., Chih, Y.-D., & Yamauchi, H. (2013) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2012.2235013 · Cited by 99
Luo, Q., Xu, X., Liu, H., Lv, H., Gong, T., Long, S., Liu, Q., Sun, H., Banerjee, W., Li, L., et al. (2015) · Technical digest - International Electron Devices Meeting/Technical digest · doi:10.1109/iedm.2015.7409667 · Cited by 86
Li, H., Li, K.-S., Lin, C.-H., Hsu, J.-L., Chiu, W.-C., Chen, M.-C., Wu, T.-T., Sohn, J., Eryilmaz, S. B., Shieh, J.-M., et al. (2016) · 2016 IEEE Symposium on VLSI Technology · doi:10.1109/vlsit.2016.7573431 · Cited by 75
Design and optimization methodology for 3D RRAM arrays
Deng, Y., Chen, H.-Y., Gao, B., Yu, S., Wu, S.-C., Zhao, L., Chen, B., Jiang, Z., Liu, X., Hou, T.-H., et al. (2013) · 2013 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2013.6724693 · Cited by 55 · cited 1×
“It is noted that the RC delay of the 3-D V-RRAM is negligible (<ns) from previous HSPICE simulation [29], therefore, in this paper we only conduct dc simulation to evaluate the IR drop and sneak paths.”
MethodSelf-citationAnalysis of vertical cross-point resistive memory (VRRAM) for 3D RRAM design
Zhang, L., Cosemans, S., Wouters, D. J., Govoreanu, B., Groeseneken, G., & Jurczak, M. (2013) · IEEE International Memory Workshop (IMW) · doi:10.1109/imw.2013.6582122 · Cited by 46
(2013) · Symposium on VLSI Technology · Cited by 45
Self-citationDesign Tradeoffs of Vertical RRAM-Based 3-D Cross-Point Array
Chen, P.-Y., Li, Z., & Yu, S. (2016) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2016.2553123 · Cited by 43
Self-citationInvestigation of the potentialities of Vertical Resistive RAM (VRRAM) for neuromorphic applications
Piccolboni, G., Molas, G., Portal, J. M., Coquand, R., Bocquet, M., Garbin, D., Vianello, E., Carabasse, C., Delaye, V., Pellissier, C., et al. (2015) · Technical digest - International Electron Devices Meeting/Technical digest · doi:10.1109/iedm.2015.7409717 · Cited by 35
Fang, Z., Wang, X. P., Li, X., Chen, Z., Kamath, A., Lo, G. Q., & Kwong, D. (2013) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2013.2240389 · Cited by 31
Research works printed but not linked: 3
- hsu, 2013, 3D Vertical TaOx/TiO2 RRAM with over 103 selfrectifying ratio and sub- $\mu$ a operating current, IEDM Tech Dig, 10.4.1
- lecun, 2012, The MNIST Database of Handwritten Digits
- chen, 2012, HfOx based vertical RRAM for cost-effective 3D cross-point architecture without cell selector, IEDM Tech Dig, 20.7.1
Cited by
Neuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
“hybrid precision requirement for the weight propagation and weight update [127].”
BackgroundSelf-citationThree-dimensional memristor circuits as complex neural networks
Lin, P., Li, C., Wang, Z., Li, Y., Jiang, H., Song, W., Rao, M., Zhuo, Y., Upadhyay, N. K., Barnell, M., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-0397-9 · Cited by 375
Recent progress in analog memory-based accelerators for deep learning
Tsai, H., Ambrogio, S., Narayanan, P., Shelby, R. M., & Burr, G. W. (2018) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aac8a5 · Cited by 225
Analog architectures for neural network acceleration based on non-volatile memory
Xiao, T. P., Bennett, C. H., Feinberg, B., Agarwal, S., & Marinella, M. J. (2020) · Applied Physics Reviews · doi:10.1063/1.5143815 · Cited by 193
A computing-in-memory macro based on three-dimensional resistive random-access memory
Huo, Q., Yang, Y., Wang, Y., Lei, D., Fu, X., Ren, Q., Xu, X., Luo, Q., Xing, G., Chen, C., et al. (2022) · Nature Electronics · doi:10.1038/s41928-022-00795-x · Cited by 159
Metadata
- Authors
- Li, Z., Chen, P.-Y., Xu, H., & Yu, S.
- Affiliations
- National University of Defense Technology (CN)
- Arizona State University (US)
- Venue
- IEEE Transactions on Electron Devices
- Published
- 2017-06
- Volume
- 64
- Issue
- 6
- Pages
- 2721-2727
- ISSN
- 0018-9383 (ISSN-L)
- 1557-9646
- OpenAlex
- W2610452982
- Cited by
- 70
- References
- 29
- Citations by year
- 2025: 4 · 2024: 4 · 2023: 5 · 2022: 11 · 2021: 9 · 2020: 15 · 2019: 13 · 2018: 9
- FWCI
- 4.21
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Electron Devices (publishedVersion)
- Funders
- National Natural Science Foundation of China Program (61471377)
- National Science Foundation (NSF-CCF-1552687)
- NUDT Outstanding Graduate Student Innovation Fund (B150403)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Ferroelectric and Negative Capacitance Devices
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- ternary neural networks, resistive random access memory, cross-point array, weight updating, neuromorphic hardware, monolithic 3D integration, analog synapses, energy-efficient inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.