Algorithm-Based Fault Tolerance for Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Convolutional neural networks (CNNs) are becoming more and more important for solving challenging and critical problems in many fields. CNN inference applications have been deployed in safety-critical systems, which may suffer from soft errors caused by high-energy particles, high temperature, or abnormal voltage. Of critical importance is ensuring the stability of the CNN inference process against soft errors. Traditional fault tolerance methods are not suitable for CNN inference because error-correcting code is unable to protect computational components, instruction duplication techniques incur high overhead, and existing algorithm-based fault tolerance (ABFT) techniques cannot protect all convolution implementations. In this article, we focus on how to protect the CNN inference process against soft errors as efficiently as possible, with the following three contributions. (1) We propose several systematic ABFTschemes based on checksum techniques and analyze their fault protection ability and runtime thoroughly. Unlike traditional ABFT based on matrix-matrix multiplication, our schemes support any convolution implementations. (2) We design a novel workflow integrating all the proposed schemes to obtain a high detection/correction ability with limited total runtime overhead. (3) We perform our evaluation using ImageNet with well-known CNN models including AlexNet, VGG-19, ResNet-18, and YOLOv2. Experimental results demonstrate that our implementation can handle soft errors with very limited runtime overhead (4%~8% in both error-free and error-injected situations).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247 · cited 1×
“We focus on the convolutional layers in CNN because they consume the major portion of the computation time [2, 7].”
Neural Network Methods for Natural Language Processing
Goldberg, Y. (2017) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02165-7 · Cited by 821
Deep Learning in Drug Discovery
Gawehn, E., Hiss, J. A., & Schneider, G. (2016) · Molecular Informatics · doi:10.1002/minf.201501008 · Cited by 723 · cited 1×
“Deep learning using convolutional neural networks (CNNs) is becoming the key state-of-the-art technique in science and technology fields such as image classification [1], [2], [3], object detection [4], natural language processing [5], medical image analysis [6], and drug design [7].”
BackgroundMinerva: enabling low-power, highly-accurate deep neural network accelerators
Reagen, B., Whatmough, P., Adolf, R., Rama, S., Lee, H., Lee, S. K., Hernández-Lobato, J. M., Wei, G.-Y., & Brooks, D. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001165 · Cited by 446 · cited 1×
“Many [22], [23], [24] of the accelerators adopt overclocking with voltage underscaling, incurring more soft errors than common hardware incurs.”
Background
Cited by
Towards Energy-Efficient and Secure Edge AI: A Cross-Layer Framework ICCAD Special Session Paper
Shafique, M., Marchisio, A., Wicaksana Putra, R. V., & Hanif, M. A. (2021) · 2021 IEEE/ACM International Conference On Computer Aided Design (ICCAD) · doi:10.1109/iccad51958.2021.9643539 · Cited by 58
“To mitigate their negative impact, several techniques have been proposed [51], [53]–[57].”
MethodArithmetic-intensity-guided fault tolerance for neural network inference on GPUs
Kosaian, J., & Rashmi, K. V. (2021) · Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1145/3458817.3476184 · Cited by 53
Soft Error Reliability Analysis of Vision Transformers
Xue, X., Liu, C., Wang, Y., Yang, B., Luo, T., Zhang, L., Li, H., & Li, X. (2023) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2023.3317138 · Cited by 35
“Algorithm-based fault-tolerance (ABFT) techniques [37], [38], [39], [40], originally developed for matrix–matrix multiplication based on checksum, have also been explored to detect and recover faults in deep learning without model modification, which are particularly suitable for…”
BackgroundMethodInfluentialLow-Voltage Energy Efficient Neural Inference by Leveraging Fault Detection Techniques
Safarpour, M., Deng, T. Z., Massingham, J., Xun, L., Sabokrou, M., & Silven, O. (2021) · 2021 IEEE Nordic Circuits and Systems Conference (NorCAS) · doi:10.1109/norcas53631.2021.9599648 · Cited by 12
Reliability of Vision Transformers and CNNs on Edge AI Systems Under Neutron Radiation
Badia, J. M., Martin-Salinas, I., Leon, G., Amor-Martin, A., Frias-Dominguez, L., Belloch, J. A., Garcia-Valderas, M., Lindoso, A., Cazzaniga, C., & Entrena, L. (2025) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2025.3536519 · Cited by 11
“These include the ECC memory protection mechanism, software duplication, or different ABFT strategies applied to different kernels and layers, such as matrix multiplication or convolution [32], [33], [34].”
Metadata
- Authors
- Zhao, K., Di, S., Li, S., Liang, X., Zhai, Y., Chen, J., Ouyang, K., Cappello, F., & Chen, Z.
- Venue
- IEEE Transactions on Parallel and Distributed Systems
- Published
- 2021
- Pages
- 1-1
- ISSN
- 1045-9219 (ISSN-L)
- 1558-2183
- 2161-9883
- OpenAlex
- W3014034225
- Cited by
- 119
- References
- 8
- FWCI
- 8.25
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Algorithm-Based Fault Tolerance for Convolutional Neural Networks. https://app.cochat.ai/papers/10.1109/tpds.2020.3043449
- The paper
- Zhao, K., Di, S., Li, S., Liang, X., Zhai, Y., Chen, J., Ouyang, K., Cappello, F., & Chen, Z. (2021). Algorithm-Based Fault Tolerance for Convolutional Neural Networks. IEEE Transactions on Parallel and Distributed Systems. https://doi.org/10.1109/tpds.2020.3043449
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.