Mitigating Asymmetric Nonlinear Weight Update Effects in Hardware Neural Network Based on Analog Resistive Synapse
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Asymmetric nonlinear weight update is considered as one of the major obstacles for realizing hardware neural networks based on analog resistive synapses, because it significantly compromises the online training capability. This paper provides new solutions to this critical issue through co-optimization with the hardware-applicable deep-learning algorithms. New insights on engineering activation functions and a threshold weight update scheme effectively suppress the undesirable training noise induced by inaccurate weight update. We successfully trained a two-layer perceptron network online and improved the classification accuracy of MNIST handwritten digit data set to 87.8%/94.8% by using 6-/8-b analog synapses, respectively, with extremely high asymmetric nonlinearity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001
Face classification using electronic synapses
Yao, P., Wu, H., Gao, B., Eryilmaz, S. B., Huang, X., Zhang, W., Zhang, Q., Deng, N., Shi, L., Wong, H.-S. P., et al. (2017) · Nature Communications · doi:10.1038/ncomms15199 · Cited by 909
Sparse coding with memristor networks
Sheridan, P. M., Cai, F., Du, C., Ma, W., Zhang, Z., & Lu, W. D. (2017) · Nature Nanotechnology · doi:10.1038/nnano.2017.83 · Cited by 619
Woo, J., Moon, K., Song, J., Lee, S., Kwak, M., Park, J., & Hwang, H. (2016) · IEEE Electron Device Letters · doi:10.1109/led.2016.2582859 · Cited by 512
Optimization of Conductance Change in Pr1–xCaxMnO3-Based Synaptic Devices for Neuromorphic Systems
Jang, J.-W., Park, S., Burr, G. W., Hwang, H., & Jeong, Y.-H. (2015) · IEEE Electron Device Letters · doi:10.1109/led.2015.2418342 · Cited by 310
Yu, S., Gao, B., Fang, Z., Yu, H., Kang, J., & Wong, H.-S. P. (2012) · 2012 International Electron Devices Meeting · doi:10.1109/iedm.2012.6479018 · Cited by 213
Electronic system with memristive synapses for pattern recognition
Park, S., Chu, M., Kim, J., Noh, J., Jeon, M., Hun Lee, B., Hwang, H., Lee, B., & Lee, B.-G. (2015) · Scientific Reports · doi:10.1038/srep10123 · Cited by 181
Cited by
SLIM: Simultaneous Logic-in-Memory Computing Exploiting Bilayer Analog OxRAM Devices
Kingra, S. K., Parmar, V., Chang, C.-C., Hudec, B., Hou, T.-H., & Suri, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-59121-0 · Cited by 1,439
Self-citationReliability of analog resistive switching memory for neuromorphic computing
Zhao, M., Gao, B., Tang, J., Qian, H., & Wu, H. (2020) · Applied Physics Reviews · doi:10.1063/1.5124915 · Cited by 349
A memristive deep belief neural network based on silicon synapses
Wang, W., Danial, L., Li, Y., Herbelin, E., Pikhay, E., Roizin, Y., Hoffer, B., Wang, Z., & Kvatinsky, S. (2022) · Nature Electronics · doi:10.1038/s41928-022-00878-9 · Cited by 66
Park, J., Kim, S., Song, M. S., Youn, S., Kim, K., Kim, T.-H., & Kim, H. (2024) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.3c13775 · Cited by 56
Mask Technique for Fast and Efficient Training of Binary Resistive Crossbar Arrays
Fouda, M. E., Lee, S., Lee, J., Eltawil, A., & Kurdahi, F. (2019) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2019.2927493 · Cited by 41
Metadata
- Authors
- Chang, C.-C., Chen, P.-C., Chou, T., Wang, I.-T., Hudec, B., Chang, C.-C., Tsai, C.-M., Chang, T.-S., & Hou, T.-H.
- Venue
- IEEE Journal on Emerging and Selected Topics in Circuits and Systems
- Published
- 2018-03
- Volume
- 8
- Issue
- 1
- Pages
- 116-124
- ISSN
- 2156-3357 (ISSN-L)
- 2156-3365
- OpenAlex
- W2767433132
- Cited by
- 116
- References
- 10
- FWCI
- 4.14
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Mitigating Asymmetric Nonlinear Weight Update Effects in Hardware Neural Network Based on Analog Resistive Synapse. https://app.cochat.ai/papers/10.1109/jetcas.2017.2771529
- The paper
- Chang, C.-C., Chen, P.-C., Chou, T., Wang, I.-T., Hudec, B., Chang, C.-C., Tsai, C.-M., Chang, T.-S., & Hou, T.-H. (2018). Mitigating Asymmetric Nonlinear Weight Update Effects in Hardware Neural Network Based on Analog Resistive Synapse. IEEE Journal on Emerging and Selected Topics in Circuits and Systems. https://doi.org/10.1109/jetcas.2017.2771529
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.