Parallel Operation of Self‐Limited Analog Programming for Fast Array‐Level Weight Programming and Update
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Memristive neural networks perform vector matrix multiplication efficiently, which is used for the accelerator of neuromorphic computing. To train the memristor cells in a memristive neural network, the analog conductance state of the memristor should be programmed in parallel; otherwise, the resulting long training time can limit the size of the neural network. Herein, a novel parallel programming method using the self‐limited analog switching behavior of the memristor is proposed. A Pt/Ti:NbOx/NbOx/TiN charge trap memristor device for the programming demonstration is utilized, and a convolutional neural network is emulated to train the MNIST dataset, based on the device characteristics. In the simulation, the proposed programming method is able to reduce programming time to as low as 1/130, compared with the sequential programming method. The simulation suggests that the programming time required by the proposed method is not affected by array size, which makes it very promising in a high‐density neural network.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The rationality of the methodology has been proven by multiple groups.[ 35 , 36 , 37 ]”
From Retention Secured Nonlinear and Self-Rectifying Analog Charge Trap Memristor for Energy-Efficient Neuromorphic Hardware (2023) · cites this paper as [37]
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Jo, S. H., Chang, T., Ebong, I., Bhadviya, B. B., Mazumder, P., & Lu, W. (2010) · Nano Letters · doi:10.1021/nl904092h · Cited by 4,174
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001
Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing
Wang, Z., Joshi, S., Savel’ev, S. E., Jiang, H., Midya, R., Lin, P., Hu, M., Ge, N., Strachan, J. P., Li, Z., et al. (2017) · Nature Materials · doi:10.1038/nmat4756 · Cited by 2,358
Equivalent-accuracy accelerated neural-network training using analogue memory
Ambrogio, S., Narayanan, P., Tsai, H., Shelby, R. M., Boybat, I., di Nolfo, C., Sidler, S., Giordano, M., Bodini, M., Farinha, N. C. P., et al. (2018) · Nature · doi:10.1038/s41586-018-0180-5 · Cited by 1,151
Fully memristive neural networks for pattern classification with unsupervised learning
Wang, Z., Joshi, S., Savel’ev, S., Song, W., Midya, R., Li, Y., Rao, M., Yan, P., Asapu, S., Zhuo, Y., et al. (2018) · Nature Electronics · doi:10.1038/s41928-018-0023-2 · Cited by 1,106
Burr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936
Efficient and self-adaptive in-situ learning in multilayer memristor neural networks
Li, C., Belkin, D., Li, Y., Yan, P., Hu, M., Ge, N., Jiang, H., Montgomery, E., Lin, P., Wang, Z., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-04484-2 · Cited by 931
Face classification using electronic synapses
Yao, P., Wu, H., Gao, B., Eryilmaz, S. B., Huang, X., Zhang, W., Zhang, Q., Deng, N., Shi, L., Wong, H.-S. P., et al. (2017) · Nature Communications · doi:10.1038/ncomms15199 · Cited by 909
Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine
Hu, M., Graves, C. E., Li, C., Li, Y., Ge, N., Montgomery, E., Davila, N., Jiang, H., Williams, R. S., Yang, J. J., et al. (2018) · Advanced Materials · doi:10.1002/adma.201705914 · Cited by 751
Kim, S., Du, C., Sheridan, P., Ma, W., Choi, S., & Lu, W. D. (2015) · Nano Letters · doi:10.1021/acs.nanolett.5b00697 · Cited by 603
High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm
Alibart, F., Gao, L., Hoskins, B. D., & Strukov, D. B. (2012) · Nanotechnology · doi:10.1088/0957-4484/23/7/075201 · Cited by 557
Long short-term memory networks in memristor crossbar arrays
Li, C., Wang, Z., Rao, M., Belkin, D., Song, W., Jiang, H., Yan, P., Li, Y., Lin, P., Hu, M., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-018-0001-4 · Cited by 429
Immunity to Device Variations in a Spiking Neural Network With Memristive Nanodevices
Querlioz, D., Bichler, O., Dollfus, P., & Gamrat, C. (2013) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2013.2250995 · Cited by 420
Reinforcement learning with analogue memristor arrays
Wang, Z., Li, C., Song, W., Rao, M., Belkin, D., Li, Y., Yan, P., Jiang, H., Lin, P., Hu, M., et al. (2019) · Nature Electronics · doi:10.1038/s41928-019-0221-6 · Cited by 370
In situ training of feed-forward and recurrent convolutional memristor networks
Wang, Z., Li, C., Lin, P., Rao, M., Nie, Y., Song, W., Qiu, Q., Li, Y., Yan, P., Strachan, J. P., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0089-1 · Cited by 307
Yoon, J. H., Song, S. J., Yoo, I., Seok, J. Y., Yoon, K. J., Kwon, D. E., Park, T. H., & Hwang, C. S. (2014) · Advanced Functional Materials · doi:10.1002/adfm.201400064 · Cited by 277
Kim, K. M., Zhang, J., Graves, C., Yang, J. J., Choi, B. J., Hwang, C. S., Li, Z., & Williams, R. S. (2016) · Nano Letters · doi:10.1021/acs.nanolett.6b01781 · Cited by 246
Self-citationMerced-Grafals, E. J., Dávila, N., Ge, N., Williams, R. S., & Strachan, J. P. (2016) · Nanotechnology · doi:10.1088/0957-4484/27/36/365202 · Cited by 184
Pt/Ta2O5/HfO2−x/Ti Resistive Switching Memory Competing with Multilevel NAND Flash
Yoon, J. H., Kim, K. M., Song, S. J., Seok, J. Y., Yoon, K. J., Kwon, D. E., Park, T. H., Kwon, Y. J., Shao, X., & Hwang, C. S. (2015) · Advanced Materials · doi:10.1002/adma.201501167 · Cited by 175
Self-citationVoltage divider effect for the improvement of variability and endurance of TaOx memristor
Kim, K. M., Yang, J. J., Strachan, J. P., Grafals, E. M., Ge, N., Dávila, N., Li, Z., & Williams, R. S. (2016) · Scientific Reports · doi:10.1038/srep20085 · Cited by 140
Self-citationSelf‐Limited Switching in Ta2O5/TaOx Memristors Exhibiting Uniform Multilevel Changes in Resistance
Kim, K. M., Lee, S. R., Kim, S., Chang, M., & Hwang, C. S. (2015) · Advanced Functional Materials · doi:10.1002/adfm.201403621 · Cited by 128
Self-citationHsieh, C.-C., Roy, A., Chang, Y.-F., Shahrjerdi, D., & Banerjee, S. K. (2016) · Applied Physics Letters · doi:10.1063/1.4971188 · Cited by 72
Kim, G. S., Song, H., Lee, Y. K., Kim, J. H., Kim, W., Park, T. H., Kim, H. J., Min Kim, K., & Hwang, C. S. (2019) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.9b16499 · Cited by 64
Self-citationYoon, J. H., Yoo, S., Song, S. J., Yoon, K. J., Kwon, D. E., Kwon, Y. J., Park, T. H., Kim, H. J., Shao, X. L., Kim, Y., et al. (2016) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.6b05657 · Cited by 57
Self-citationBousoulas, P., Michelakaki, I., Skotadis, E., Tsigkourakos, M., & Tsoukalas, D. (2017) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2017.2709338 · Cited by 57
Yoon, J. H., Kwon, D. E., Kim, Y., Kwon, Y. J., Yoon, K. J., Park, T. H., Shao, X. L., & Hwang, C. S. (2017) · Nanoscale · doi:10.1039/c7nr02215h · Cited by 52
Self-citationDesign of Resistive Synaptic Array for Implementing On-Chip Sparse Learning
Chen, P.-Y., Gao, L., & Yu, S. (2016) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2016.2598742 · Cited by 45
Weight Programming in DNN Analog Hardware Accelerators in the Presence of NVM Variability
Mackin, C., Tsai, H., Ambrogio, S., Narayanan, P., Chen, A., & Burr, G. W. (2019) · Advanced Electronic Materials · doi:10.1002/aelm.201900026 · Cited by 41
Low Variability Resistor–Memristor Circuit Masking the Actual Memristor States
Kim, K. M., Yang, J. J., Merced, E., Graves, C. E., Lam, S., Dávila, N., Hu, M., Ge, N., Li, Z., Williams, R. S., et al. (2015) · Advanced Electronic Materials · doi:10.1002/aelm.201500095 · Cited by 39
Self-citationSakellaropoulos, D., Bousoulas, P., & Tsoukalas, D. (2019) · Journal of Applied Physics · doi:10.1063/1.5094242 · Cited by 28
Song, H., Kim, Y. S., Park, J., & Kim, K. M. (2019) · Advanced Electronic Materials · doi:10.1002/aelm.201800740 · Cited by 18
Self-citation
Research works printed but not linked: 4
- Hu M., 2016, 53nd ACM/EDAC/IEEE Design Automation Conf, 1
- Suri M., 2011, Int. Electron Devices Meeting, 4.4.1
- Burr G. W., 2014, IEEE Int. Electron Devices Meeting, 29.5.1
- Donahue J., 2014, 31st Int. Conf. Machine Learning, 647
Cited by
Kim, G., Son, S., Song, H., Jeon, J. B., Lee, J., Cheong, W. H., Choi, S., & Kim, K. M. (2023) · Advanced Science · doi:10.1002/advs.202205654 · Cited by 72
Self-citationMemristive Explainable Artificial Intelligence Hardware
Song, H., Park, W., Kim, G., Choi, M. G., In, J. H., Rhee, H., & Kim, K. M. (2024) · Advanced Materials · doi:10.1002/adma.202400977 · Cited by 18
Self-citationShin, H. S., Song, H., Kim, D. H., Martinez, A., Cheong, W. H., & Kim, K. M. (2022) · ACS Applied Electronic Materials · doi:10.1021/acsaelm.2c00320 · Cited by 12
Self-citationEvolutionary Learning of Binary Neural Network Using a TaO x Memristor via Stochastic Stateful Logic
Kim, D. H., Kim, Y. S., Cheong, W. H., Song, H., Rhee, H., Kay, S. N., Han, J., & Kim, K. M. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202200058 · Cited by 8
Self-citation
Metadata
- Authors
- Song, H., An, J., Son, S., Kim, Y. S., Park, J., Jeon, J. B., Kim, G., & Kim, K. M.
- Affiliations
- Korea Advanced Institute of Science and Technology (KR)
- Corresponding author
- Kim, Kyung Min
- Venue
- Advanced Intelligent Systems
- Publisher
- Wiley
- Published
- 2020-04-24
- Volume
- 2
- Issue
- 7
- ISSN
- 2640-4567 (ISSN-L)
- OpenAlex
- W3015006963
- Cited by
- 4
- References
- 32
- Citations by year
- 2024: 1 · 2022: 3
- FWCI
- 0.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Advanced Intelligent Systems (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministry of Trade, Industry and Energy (20003655, 20003789)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Ferroelectric and Negative Capacitance Devices
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- memristive neural networks, parallel programming, neuromorphic computing, MNIST, programming time reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.