Analyzing and Increasing the Reliability of Convolutional Neural Networks on GPUs
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
Graphics processing units (GPUs) are playing a critical role in convolutional neural networks (CNNs) for image detection. As GPU-enabled CNNs move into safety-critical environments, reliability is becoming a growing concern. In this paper, we evaluate and propose strategies to improve the reliability of object detection algorithms, as run on three NVIDIA GPU architectures. We consider three algorithms: 1) you only look once; 2) a faster region-based CNN (Faster R-CNN); and 3) a residual network, exposing live hardware to neutron beams. We complement our beam experiments with fault injection to better characterize fault propagation in CNNs. We show that a single fault occurring in a GPU tends to propagate to multiple active threads, significantly reducing the reliability of a CNN. Moreover, relying on error correcting codes dramatically reduces the number of silent data corruptions (SDCs), but does not reduce the number of critical errors (i.e., errors that could potentially impact safety-critical applications). Based on observations on how faults propagate on GPU architectures, we propose effective strategies to improve CNN reliability. We also consider the benefits of using an algorithm-based fault-tolerance technique for matrix multiplication, which can correct more than 87% of the critical SDCs in a CNN, while redesigning maxpool layers of the CNN to detect up to 98% of critical SDCs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“as commented in [9], SASSIFI is the only tool working with the NVIDIA proprietary libraries generally employed when implementing CNNs.”
From Fast and Accurate Error Simulation for CNNs Against Soft Errors (2023) · cites this paper as [9]
In the citing paper
“radiation test offers the most adherent solution to cause soft errors, however, apart from the highly expensive equipment and the complex setup, there is little to no controllability on the injection process, and the observability is only on the primary outputs. As a result, it is suitable for final validation and blackbox campaigns, not for in-depth analysis and investigations [9], [36].”
From Fast and Accurate Error Simulation for CNNs Against Soft Errors (2023) · cites this paper as [9]
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“Specifically, neural networks for object detection have the peculiarity of using convolution to reduce the information to be processed [15], a class of computations where reliability has not been studied deeply to date.”
BackgroundYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879 · cited 2×
“5 to compare the corrupted output of a CNN with the radiation-free output, following the T J tradeoff discussion presented in Fawcett et al. [47], which is valid, independent of the source of detection imprecision (intrinsic algorithm detection imprecision or radiation-induced corruption).”
MethodThe pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“We use the PASCAL VOC 2012 [48] and the Caltech Pedes-trian datasets [49] as input for our study.”
MethodCaffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077 · cited 2×
“Convolutional neural networks (CNNs) have, in fact, been deployed in self-driving cars to dynamically identify/classify objects [2], [3].”
BackgroundMethodIdentity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665 · cited 2×
“This process is performed repeatedly for all layers in the network, allowing us to use deeper network structures (e.g., 50 to 1000 layers) without impacting precision, and without increasing the algorithmic complexity [45].”
MethodIn-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · cited 1×
“As GPUs are highly efficient for accelerating matrix multiplication, they are a great target for CNNs. Specific processors can be designed for DNN, achieving good performance and low power consumption [42], [43].”
Background
Research works printed but not linked: 4
- sridharan, 2009, The effect of input data on program vulnerability, Workshop on Silicon Errors in Logic-System Effects, 1
- 10.1109/TNS.2014.2301768 · DOI
- 2018, Log database for IEEE transaction on reliability, Github
- collobert, 0, BigLearn NIPS Workshop
Cited by
Items 201–223 of 223
Achaq, S., Pouget, V., Artola, L., Manni, F., Dufour, A., & Boch, J. (2024) · European Conference on Radiation and Its Effects on Components and Systems · doi:10.1109/radecs61970.2024.11298599
Tian, H., Ibrahim, Y., Sharma, M., Belev, G. S., Wen, S., & Chen, L. T. J. (2024) · European Conference on Radiation and Its Effects on Components and Systems · doi:10.1109/radecs61970.2024.11298613
Concurrent Self-Testing and Uncertainty Estimation of Neural Networks Using Uncertainty Fingerprint
Ahmed, S. T., & Tahoori, M. B. (2025) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2025.3640505
“In general, the existing fault detection mechanisms for NN accelerator architectures [13], [14], [15], [18], [19], [20], [21], [22], [23], [24] either 1) is infeasible for always-on NN applications as they require stopping the functional operation of NN accelerator architectures, 2) requires the…”
Research on Fault-Tolerant Methods for Matrix Multiplication in GPGPU
Gao, Y., Wang, P., Wang, P., Zheng, Y., Li, S., & Liu, B. (2025) · International Conference on Pattern Recognition and Artificial Intelligence (PRAI) · doi:10.1109/prai67447.2025.11412949
Su, P., Yan, Z., & Chen, D. (2026) · IEEE Transactions on Reliability · doi:10.1109/tr.2026.3673605
“Within these errors, some works indicate that bit-flip errors, especially silent data corruption, are often more severe than other types of errors to the bit-level data [2], [13], [26], [32].”
Zhang, J., Li, P., Xie, Z., Zheng, X., Wen, W., Ge, J., Hu, M., Dang, Z., & Cai, C. (2026) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2026.102366
Evaluating and Enhancing YOLOv8’s Soft Error Resilience
Yang, A., Zhi, L., Guan, Y., Tan, T., & Shen, J. (2026) · Electronics · doi:10.3390/electronics15071404
Assessment of Edge Machine-Learning Systems under Radiation-Induced Effects
Trindade, M. G. (2021) · theses.fr (ABES) · doi:10.70675/f5059808z4029z40afz983ez963fb3b627bd
Functional safety and reliability of neuromorphic computing systems
Spyrou, T. (2023) · theses.fr (ABES) · doi:10.70675/76481b77z6471z475cz9788z94892a1c1779
Dependability analysis and hardening of vision transformers against soft errors
Frias-Dominguez, L., Badía, J. M., León, G., Amor-Martín, A., & Belloch, J. A. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08373-0 · Cited by 2
Bosio, A., Sánchez, E., Sinha, A., Pappalardo, S., Ruospo, A., & Turco, V. (2026) · Springer eBooks · doi:10.1007/978-3-032-17948-7_10
Understanding Neural Network Fault Tolerance: From Analog Hardware to the GPU
Evans, A., Dampfhoffer, M., Burel, S., dos Santos, F. F., & Lopez, J. M. (2026) · Springer eBooks · doi:10.1007/978-3-032-17948-7_1
Self-citationFezza, L., Porsia, A., Ruospo, A., Sánchez, E., Reorda, M. S., & Turco, V. (2026) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2026.105306
Thinking Inside the Box: Injecting Realistic Radiation Faults in ML Accelerators
Coelho, B. L., Sadati, M., Chan, A., Hands, A. D. P., Pattabiraman, K., & Rech, P. (2026) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn69566.2026.00017 · Cited by 1
“Conversely, increasing the data precision also increases the error density, as small numerical errors propagate to the output, as shown in Santos et al. [52].”
Self-citationDennis, W., & Pope, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-25032-2_10
Versal ACAP AI Engine Heavy-Ion Testing With Spill Synchronization
Smith, G., Price, C., Morgan, B., Wilcox, E. P., Allen, G. R., & Wirthlin, M. (2026) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2026.3714665
“[10], [11], multicore processors [12], and dedicated AI accelerators [13].”
Yoshida, M., Matsuoka, K., & Hashimoto, M. (2026) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2026.3714766
“As a result, research on the reliability of GPU-based applications has expanded considerably, particularly in fields like convolutional neural networks (CNNs) for image recognition [18].”
InfluentialBN-Guard: Batch-Normalization-Guided Activation Bounding for Reliable CNN Inference
Qian, Y., Xing, M., & Wu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3410-3_14
The Effect of Heavy Ions on Inference Performance on the IBM NorthPole
Viramontes, F. O., Vergara, V. M., Romero, A. E., Spear, M. E., Slater, W. S., & Quinn, H. (2026) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2026.3715116
“They can also result in propagation of errors to other memory elements in GPUs [12].”
Sparsity-Aware Fault Tolerance for Reliable CNN Inference on GPUs
Byeon, G., Lee, S., Kim, S., Kim, Y. W., Nair, P. J., & Hong, S. (2026) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2026.3715635
“Recently, Algorithm-based Error Detection (ABED) techniques have been proposed [18], [19], [20], [21], [22], [23].”
InfluentialEslami, M., Ullah, S., & Kumar, A. (2026) · IEEE International On-Line Testing Symposium (IOLTS) · doi:10.1109/iolts69666.2026.11633846
N-slim: N-balanced structured channel pruning for onboard solar flare forecasting
Zhao, D., Feng, X., Huang, X., Ma, S., & Xu, L. (2026) · Frontiers in Astronomy and Space Sciences · doi:10.3389/fspas.2026.1866227
“Selective hardening protects only the most critical parameters (Santos et al., 2019).”
Wu, H., Tian, Z., & Zuo, M. (2026) · IEEE Transactions on Reliability · doi:10.1109/tr.2026.3734078
“Neu-ralnetworksexcelatmodellingcomplexnonlinearrelationships butrequirelargetrainingdatasetsandrigorousregularizationto avoidoverfitting[32],[33].”
Metadata
- Authors
- Santos, F. F. D., Pimenta, P. F., Lunardi, C., Draghetti, L., Carro, L., Kaeli, D., & Rech, P.
- Affiliations
- Universidade Federal do Rio Grande do Sul (BR)
- Northeastern University (US)
- ORCID
- Venue
- IEEE Transactions on Reliability
- Published
- 2019-06
- Volume
- 68
- Issue
- 2
- Pages
- 663-677
- ISSN
- 0018-9529 (ISSN-L)
- 1558-1721
- OpenAlex
- W2901848761
- Cited by
- 226
- References
- 67
- Citations by year
- 2026: 18 · 2025: 18 · 2024: 41 · 2023: 33 · 2022: 42 · 2021: 34 · 2020: 27 · 2019: 13
- FWCI
- 7.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Reliability (publishedVersion)
- Institutional Research Information System (Università degli Studi di Trento) (submittedVersion)
- Science and Technology Facilities Council (submittedVersion)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Radiation Effects in Electronics
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Keywords
- convolutional neural networks, GPU reliability, fault injection, silent data corruption, error-correcting codes, algorithm-based fault tolerance, matrix multiplication, object detection, safety-critical systems, fault propagation, NVIDIA GPUs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.