Soft Error Resilience of Deep Residual Networks for Object Recognition
Open accessThe DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Convolutional Neural Networks (CNNs) have truly gained attention in object recognition and object classification in particular. When being implemented on Graphics Processing Units (GPUs), deeper networks are more accurate than shallow ones. Residual Networks (ResNets) are one of the deepest CNN architectures used in various fields including safety-critical ones. GPUs have proven to be the major accelerator for CNN models. However, modern GPUs are prone to radiation-induced soft errors, which is a serious issue in safety-compliant systems. In this work, we analyze and propose an approach to address the reliability of ResNet on GPUs. We firstly analyze three popular ResNet models, explicitly, ResNet-50, ResNet-101, and ResNet-152 through NVIDIA’s fault injector, SASSIFI. We perform an in-depth analysis of the model from the perspective of layer and kernel vulnerability. Then, we experimentally show the vulnerability of ResNet models and identify the most vulnerable portions. Finally, we validate our solution, which is a selective-hardening technique, through hardening the worth-hardening kernels to avoid unnecessary overheads. Our strategy is demonstrated to mask up to 93.38% of the injected errors with performance overhead less than 5.35%. Furthermore, the percentage of the errors causing misclassifications can be reduced from 4.2% to 0.104%, thereby significantly improving the model’s reliability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


















Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Managing the Risks of Organizational Accidents
Reason, J. (2016) · Routledge eBooks · doi:10.4324/9781315543543 · Cited by 4,430
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Radiation-induced soft errors in advanced semiconductor technologies
Baumann, R. C. (2005) · IEEE Transactions on Device and Materials Reliability · doi:10.1109/tdmr.2005.853449 · Cited by 1,549
NVIDIA Tesla: A Unified Graphics and Computing Architecture
Lindholm, E., Nickolls, J., Oberman, S., & Montrym, J. (2008) · IEEE Micro · doi:10.1109/mm.2008.31 · Cited by 1,362
Algorithm-Based Fault Tolerance for Matrix Operations
Huang, K.-H., & Abraham, J. A. (1984) · IEEE Transactions on Computers · doi:10.1109/tc.1984.1676475 · Cited by 1,283
Mukherjee, S. S., Weaver, C. T., Emer, J., Reinhardt, S. K., & Austin, T. M. (2003) · Cited by 840
Mukherjee, S. S., Weaver, C., Emer, J., Reinhardt, S. K., & Austin, T. (2004) · 22nd Digital Avionics Systems Conference. Proceedings (Cat. No.03CH37449) · doi:10.1109/micro.2003.1253181 · Cited by 656
A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends
Hatcher, W. G., & Yu, W. (2018) · IEEE Access · doi:10.1109/access.2018.2830661 · Cited by 654 · cited 1×
“DNNs models are executed on a wide range of DNN accelerators [5], including Graphics Processing Units (GPU), Google’s Tensor Processing Unit (TPU) [6], and FPGA [7].”
Method
Research works printed but not linked: 3
- J. Redmon. (2016). Darknet: Open Source Neural Networks in C. [Online]. Available: http://pjreddie.com/darknet/
- E. Strohmaier, J. Dongarra, H. Simon, and H. Meuer. (Nov. 2018). The Top 500 List. [Online]. Available: https://www.top500.org/lists/2018/11
- NVIDIA Corporation, Santa Clara, CA, USA. NVIDIA GeForce GTX 750 Ti Whitepaper V1.1, [Online]. Available: https://international. download.nvidia.com/geforcecom/international/pdfs/GeForce-GTX-750- TiWhitepaper.pdf
Cited by
A Systematic Literature Review on Hardware Reliability Assessment Methods for Deep Neural Networks
Ahmadilivani, M. H., Taheri, M., Raik, J., Daneshtalab, M., & Jenihhin, M. (2024) · ACM Computing Surveys · doi:10.1145/3638242 · Cited by 134
Soft errors in DNN accelerators: A comprehensive review
Ibrahim, Y., Wang, H., Liu, J., Wei, J., Chen, L., Rech, P., Adam, K., & Guo, G. (2020) · Microelectronics Reliability · doi:10.1016/j.microrel.2020.113969 · Cited by 102
Self-citationTestability and Dependability of AI Hardware: Survey, Trends, Challenges, and Perspectives
Su, F., Liu, C., & Stratigopoulos, H. (2023) · IEEE Design and Test · doi:10.1109/mdat.2023.3241116 · Cited by 97
A Review on Medical Textual Question Answering Systems Based on Deep Learning Approaches
Mutabazi, E., Ni, J., Tang, G., & Cao, W. (2021) · Applied Sciences · doi:10.3390/app11125456 · Cited by 91
Rech, P. (2024) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2024.3349956 · Cited by 75
“What is clear is that due to the large area and the high amount of (critical) resources available, the radiation-induced error rate of the available commercial off-the-shelf (COTS) products for AI is far from being negligible [15], [16].”
Background
Metadata
- Authors
- Ibrahim, Y., Wang, H., Bai, M., Liu, Z., Wang, J., Yang, Z., & Chen, Z.
- Affiliations
- Hohai University (CN)
- Harbin Institute of Technology (CN)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 19490-19503
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3002446690
- Cited by
- 72
- References
- 30
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 23 · 2023: 12 · 2022: 15 · 2021: 13 · 2020: 3
- FWCI
- 3.69
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- China Institute of Atomic Energy (KFZC2018040205)
- Changzhou Sci and Tech Program (CZ20180003)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Radiation Effects in Electronics
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- soft errors, ResNet, object recognition, GPU reliability, radiation-induced faults, fault injection, selective hardening, kernel hardening, safety-critical systems, ResNet50, ResNet-101, ResNet-152, fault tolerance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Soft Error Resilience of Deep Residual Networks for Object Recognition. https://app.cochat.ai/papers/10.1109/access.2020.2968129
- The paper
- Ibrahim, Y., Wang, H., Bai, M., Liu, Z., Wang, J., Yang, Z., & Chen, Z. (2020). Soft Error Resilience of Deep Residual Networks for Object Recognition. IEEE Access. https://doi.org/10.1109/access.2020.2968129
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.