Stuck-at-Fault Tolerant Schemes for Memristor Crossbar Array-Based Neural Networks
The DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index.
Abstract
In this study, a circuit technique and training algorithm that minimizes the effect of stuck-at-faults (SAFs) within a memristor crossbar array of neural networks (NNs) are presented. To improve the network performance in the presence of SAFs, a conventional transimpedance amplifier, which is used for summing the currents that flow through the memristors, is modified to ensure that the amplifier output is within the appropriate operating range. Further improvement in the network performance is achieved by using the proposed training algorithm, which utilizes the locations and values of faulty memristors for network training. A feedforward NN employing 32×32 memristor crossbar arrays is implemented to verify the performance improvement in the NNs using the proposed circuit technique and training algorithm.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A similar approach is considered in ref. 85 where a 640×480 pixels image is captured by an image sensor and then resized to a 16×16 image.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [85]
In the citing paper
“Both cases consider an FPGA in order interface the image acquisition system (i.e. CMOS image sensor and the resizing algorithm) with the memristor crossbar and its peripheral circuitry.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [85]
In the citing paper
“many authors focusing on the optimization of the 1T1R memory cell structures have opted for using off-the-shelf integrated circuits, assembled in printed circuit boards54,85, as in this way they can avoid the limitations posed by the trade-offs between resolution, area and power of the ADCs.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [85]
In the citing paper
“Then, analogue VMM has been demonstrated both for binary inputs and weights218–220, as well as for binary inputs and analogue/multilevel weights60,85,105,217.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [85]
In the citing paper
“Crossbar arrays of two-terminal metal/insulator/metal (MIM) memristive devices can be fabricated easily using standard lithography and deposition techniques; this has been readily achieved by multiple groups57,64,68–70,85,93,105,216,217.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [85]
Citations
Cites
ISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
Neuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170 · cited 1×
“VECTOR–MATRIX multiplication (VMM), which requires high-density memories, is one of the most common but energy-expensive computational operations in neural networks (NNs) [1]–[3].”
BackgroundHu, M., Strachan, J. P., Li, Z., Grafals, E. M., Davila, N., Graves, C., Lam, S., Ge, N., Yang, J. J., & Williams, R. S. (2016) · Proceedings of the 53rd Annual Design Automation Conference · doi:10.1145/2897937.2898010 · Cited by 686
Memristor Crossbar-Based Neuromorphic Computing System: A Case Study
Hu, M., Li, H., Chen, Y., Wu, Q., Rose, G. S., & Linderman, R. W. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2296777 · Cited by 414
Spintronic Memristor Through Spin-Torque-Induced Magnetization Motion
Wang, X., Chen, Y., Xi, H., Li, H., & Dimitrov, D. (2009) · IEEE Electron Device Letters · doi:10.1109/led.2008.2012270 · Cited by 378
14.2 DNPU: An 8.1TOPS/W reconfigurable CNN-RNN processor for general-purpose deep neural networks
Shin, D., Lee, J., Lee, J., & Yoo, H.-J. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870350 · Cited by 307
Neuromorphic Hardware System for Visual Pattern Recognition With Memristor Array and CMOS Neuron
Chu, M., Kim, B., Park, S., Hwang, H., Jeon, M., Lee, B. H., & Lee, B.-G. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2356439 · Cited by 296
Self-citationA/D converter trends: Power dissipation, scaling and digitally assisted architectures
Murmann, B. (2008) · 2008 IEEE Custom Integrated Circuits Conference · doi:10.1109/cicc.2008.4672032 · Cited by 267
RRAM Defect Modeling and Failure Analysis Based on March Test and a Novel Squeeze-Search Scheme
Chen, C.-Y., Shih, H.-C., Wu, C.-W., Lin, C.-H., Chiu, P.-F., Sheu, S.-S., & Chen, F. T. (2015) · IEEE Transactions on Computers · doi:10.1109/tc.2014.12 · Cited by 261
Rescuing Memristor-based Neuromorphic Design with High Defects
Liu, C., Hu, M., Strachan, J. P., & Li, H. (. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062310 · Cited by 257
Park, J., Kwak, M., Moon, K., Woo, J., Lee, D., & Hwang, H. (2016) · IEEE Electron Device Letters · doi:10.1109/led.2016.2622716 · Cited by 225
Self-citationStuck-at Fault Tolerance in RRAM Computing Systems
Xia, L., Huangfu, W., Tang, T., Yin, X., Chakrabarty, K., Xie, Y., Wang, Y., & Yang, H. (2018) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2017.2776980 · Cited by 177 · cited 1×
“In previous works, training algorithms [16]–[19], which require redundant hardware either to replace faulty memristors with the functional ones [16], [19] or to correct errors using”
Lee, S. R., Kim, Y.-B., Chang, M., Kim, K. M., Lee, C. B., Hur, J. H., Park, G.-S., Lee, D., Lee, M.-J., Kim, C. J., et al. (2012) · 2012 Symposium on VLSI Technology (VLSIT) · doi:10.1109/vlsit.2012.6242466 · Cited by 165
A 1 TOPS/W Analog Deep Machine-Learning Engine With Floating-Gate Storage in 0.13 µm CMOS
Lu, J., Young, S., Arel, I., & Holleman, J. (2015) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2014.2356197 · Cited by 122
Efficient training algorithms for neural networks based on memristive crossbar circuits
Kataeva, I., Merrikh-Bayat, F., Zamanidoost, E., & Strukov, D. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280785 · Cited by 103
Switched by input: power efficient structure for RRAM-based convolutional neural network
Xia, L., Tang, T., Huangfu, W., Cheng, M., Yin, X., Li, B., Wang, Y., & Yang, H. (2016) · Proceedings of the 53rd Annual Design Automation Conference · doi:10.1145/2897937.2898101 · Cited by 100
Li, B., Xia, L., Gu, P., Wang, Y., & Yang, H. (2015) · Proceedings of the 52nd Annual Design Automation Conference · doi:10.1145/2744769.2744870 · Cited by 94
Technological exploration of RRAM crossbar array for matrix-vector multiplication
Gu, P., Li, B., Tang, T., Yu, S., Cao, Y. K., Wang, Y., & Yang, H. (2015) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2015.7058989 · Cited by 81
Neuromorphic Character Recognition System With Two PCMO Memristors as a Synapse
Sheri, A. M., Hwang, H., Jeon, M., & Lee, B. (2013) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2275966 · Cited by 80
Self-citationMoon, K., Fumarola, A., Sidler, S., Jang, J., Narayanan, P., Shelby, R. M., Burr, G. W., & Hwang, H. (2018) · IEEE Journal of the Electron Devices Society · doi:10.1109/jeds.2017.2780275 · Cited by 79
Self-citationFrom average case complexity to improper learning complexity
Daniely, A., Linial, N., & Shalev‐Shwartz, S. (2014) · ACM Symposium on Theory of Computing (STOC) · doi:10.1145/2591796.2591820 · Cited by 70
DSH-MRAM: Differential Spin Hall MRAM for On-Chip Memories
Kim, Y., Choday, S. H., & Roy, K. (2013) · IEEE Electron Device Letters · doi:10.1109/led.2013.2279153 · Cited by 63
Fault-Tolerant Training Enabled by On-Line Fault Detection for RRAM-Based Neural Computing Systems
Xia, L., Liu, M., Ning, X., Chakrabarty, K., & Wang, Y. (2019) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2855145 · Cited by 61
Analysis and Design of a Passive Switched-Capacitor Matrix Multiplier for Approximate Computing
Lee, E. H., & Wong, S. S. (2016) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2599536 · Cited by 58
Analog Synapse Device With 5-b MLC and Improved Data Retention for Neuromorphic System
Moon, K., Cha, E., Park, J., Gi, S., Chu, M., Baek, K., Lee, B., Oh, S. H., & Hwang, H. (2016) · IEEE Electron Device Letters · doi:10.1109/led.2016.2583545 · Cited by 53
Self-citationICE: inline calibration for memristor crossbar-based computing engine
Li, B., Wang, Y., Chen, Y., Li, H. H., & Yang, H. (2014) · doi:10.5555/2616606.2616832 · Cited by 43
AEPE: An area and power efficient RRAM crossbar-based accelerator for deep CNNs
Tang, S., Yin, S., Zheng, S., Ouyang, P., Tu, F., Yao, L., Wu, J., Cheng, W., Liu, L., & Wei, S. (2017) · IEEE Non-Volatile Memory Systems and Applications Symposium (NVMSA) · doi:10.1109/nvmsa.2017.8064475 · Cited by 42
Memristor-based perceptron classifier: Increasing complexity and coping with imperfect hardware
Bayat, F. M., Prezioso, M., Chakrabarti, B., Kataeva, I., & Strukov, D. (2017) · 2017 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad.2017.8203825 · Cited by 29
Permanent and Transient Fault Tolerance for Reconfigurable Nano-Crossbar Arrays
Tunali, O., & Altun, M. (2016) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2016.2602804 · Cited by 23
ICE: Inline calibration for memristor crossbar-based computing engine
Li, B., Wang, Y., Chen, Y., Li, H. H., & Yang, H. (2014) · Design, Automation, and Test in Europe · doi:10.7873/date.2014.197 · Cited by 18
Research works printed but not linked: 1
- lecun, 1998, The MNIST Database of Handwritten Digits
Cited by
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
“Then, analogue VMM has been demonstrated both for binary inputs and weights 218 – 220 , as well as for binary inputs and analogue/multilevel weights 60,85,105,217 .”
InfluentialResearch Progress on Memristor: From Synapses to Computing Systems
Yang, X., Taylor, B., Wu, A., Chen, Y., & Chua, L. O. (2022) · IEEE Transactions on Circuits and Systems I: Regular Papers · doi:10.1109/tcsi.2022.3159153 · Cited by 200
Ham, S., Kang, M., Jang, S., Jang, J., Choi, S., Kim, T.-W., & Wang, G. (2020) · Science Advances · doi:10.1126/sciadv.aba1178 · Cited by 184
Kim, K., Song, M. S., Hwang, H., Hwang, S., & Kim, H. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1279708 · Cited by 81
“Yeo et al. (2019) proposed the fault-aware training algorithm with experimental demonstration.”
BackgroundSelf-citationIn-Memory Computing for Machine Learning and Deep Learning
Lepri, N., Glukhov, A., Cattaneo, L., Farronato, M., Mannocci, P., & Ielmini, D. (2023) · IEEE Journal of the Electron Devices Society · doi:10.1109/jeds.2023.3265875 · Cited by 58
“Steady-state currents collected at the grounded rows are generally acquired by a readout chain consisting of a transimpedance amplifier (TIA) and an analog-to-digital converter (ADC) [98].”
Background
Metadata
- Authors
- Yeo, I., Chu, M., Gi, S.-G., Hwang, H., & Lee, B.-G.
- Affiliations
- Gwangju Institute of Science and Technology (KR)
- Samsung Electronics (South Korea) (KR)
- Pohang University of Science and Technology (KR)
- Venue
- IEEE Transactions on Electron Devices
- Published
- 2019-07
- Volume
- 66
- Issue
- 7
- Pages
- 2937-2945
- ISSN
- 0018-9383 (ISSN-L)
- 1557-9646
- OpenAlex
- W2946641467
- Cited by
- 55
- References
- 31
- Citations by year
- 2026: 9 · 2025: 4 · 2024: 10 · 2023: 12 · 2022: 12 · 2021: 4 · 2020: 4
- FWCI
- 1.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Electron Devices (publishedVersion)
- Open Access System for Information Sharing (Pohang University of Science and Technology) (submittedVersion)
- Funders
- MOTIE Research Grant of 2019 (10067764)
- Electronics and Telecommunications Research Institute
- ICT Research and Development Program of MSIT/IITP (Brain-Inspired Neuromorphic Perception and Learning Processor) (2016-0-00098)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Hardware and Architecture › VLSI and Analog Circuit Testing
- Keywords
- memristor crossbar, neuromorphic hardware, neural network training algorithms, transimpedance amplifier, feedforward neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.