The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Arithmetic-intensity-guided fault tolerance for neural network inference on GPUs
Open accessAbstract
Neural networks (NNs) are increasingly employed in safety-critical domains and in environments prone to unreliability (e.g., soft errors), such as on spacecraft. Therefore, it is critical to impart fault tolerance to NN inference. Algorithm-based fault tolerance (ABFT) is emerging as an efficient approach for fault tolerance in NNs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Particularly, we want to emphasize that standard ABFT is widely utilized and can still be considered to be one of the state-of-the-art algorithm-based fault tolerance approaches.”
From Soft Error Reliability Analysis of Vision Transformers (2023) · cites this paper as [40]
In the citing paper
“They conduct ABFT with the granularity of GEMMs and can only recover from a single computing error.”
From Soft Error Reliability Analysis of Vision Transformers (2023) · cites this paper as [40]
In the citing paper
“Despite the different application scenarios of ABFT, [40] [52]-[57] essentially utilize standard ABFT approaches.”
From Soft Error Reliability Analysis of Vision Transformers (2023) · cites this paper as [40]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Williams, S., Waterman, A., & Patterson, D. A. (2009) · Communications of the ACM · doi:10.1145/1498765.1498785 · Cited by 2,798
Mattson, P., Cheng, C., Coleman, C., Diamos, G., Micikevicius, P., Patterson, D., Tang, H., Wei, G.-Y., Bailis, P., Bittorf, V., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.01500 · Cited by 206
Dissecting the NVidia Turing T4 GPU via Microbenchmarking
Jia, Z., Maggioni, M., Smith, J., & Scarpazza, D. P. (2019) · arXiv · doi:10.48550/arxiv.1903.07486 · Cited by 69
Research works printed but not linked: 76
- GPU., 2021, https://www.nvidia.com/en-us/data-center/a100/. Last accessed
- 2021, Last accessed
- Tensor Cores, 2021, Last accessed
- Tesla GPU, 2021, https://images.nvidia.com/content/pdf/tesla/184457-Tesla-P4-Datasheet-NV-Final-Letter-Web.pdf. Last accessed
- Torchvision Models, 2021, https://pytorch.org/vision/stable/models.html. Last accessed
- Warps, 2011, https://on-demand.gputechconf.com/gtc-express/2011/presentations/cuda_webinars_WarpsAndOccupancy.pdf
- Turing GPU, 2018, Architecture. Tech. Rep. WP-, 09183, v01
- Hewlett Packard Enterprise accelerates space exploration with first ever in-space commercial edge computing and artificial intelligence capabilities. https://www.hpe.com/us/en/newsroom/press-release/2021/02/hewlett-packard-enterprise-accelerates-space-exploration-with-first-ever-in-space-commercial-edge-computing-and-artificial-intelligence-capabilities.html 2021. Last accessed 23 August 2021. Hewlett Packard Enterprise accelerates space exploration with first ever in-space commercial edge computing and artificial intelligence capabilities. https://www.hpe.com/us/en/newsroom/press-release/2021/02/hewlett-packard-enterprise-accelerates-space-exploration-with-first-ever-in-space-commercial-edge-computing-and-artificial-intelligence-capabilities.html 2021. Last accessed 23 August 2021.
- Bartlett W., 2004, Commercial Fault Tolerance: A Tale of Two Systems. IEEE Transactions on Dependable and Secure Computing, 1, 1
- Blalock D., 2020, The Third Conference on Systems and Machine Learning (MLSys 20)
- Bosilca G., 2009, Journal of Parallel and Distributed Computing, 69, 4, 10.1016/j.jpdc.2008.12.002 · DOI
- Braun C., J. A-ABFT: Autonomous Algorithm-Based Fault Tolerance for Matrix Multiplications on Graphics Processing Units. In, 2014
- Campbell A., 1992, Single Event Upset Rates in Space. IEEE Transactions on Nuclear Science, 39, 6
- Chen J., 2016, Online Algorithm-Based Fault Tolerance for Cholesky Decomposition on Heterogeneous Systems with GPUs. In 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS 16)
- Chen T., 2018, 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18)
- Chen, 2013, Z. Online-ABFT: An Online Algorithm Based Fault Tolerance Scheme for Soft Error Detection in Iterative Methods. In ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP 13)
- Chen Z., 2021, A Low-cost Fault Corrector for Deep Neural Networks through Range Restriction. arXiv preprint arXiv:2003.13874v4 · arXiv
- Chen Z., 2019, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC 19)
- Chen Z., 2020, N. TensorFI: A Flexible Fault Injection Framework for TensorFlow Applications. In 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE 20)
- Chung E., 2018, Datacenter Scale with Project Brainwave. IEEE Micro, 38, 2
- Dakkak A., 2019, Proceedings of the ACM International Conference on Supercomputing (ICS 19)
- Dell T. J., 1997, A White Paper on the Benefits of Chipkill-Correct ECC for PC Server Main Memory. IBM Microelectronics division 11
- Denby B., 2020, Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 20)
- Dimitrov M., 2009, Proceedings of 2nd Workshop on General Purpose Processing on Graphics Processing Units (GPGPU 09)
- Dixit H. D., 2021, Silent Data Corruptions at Scale. arXiv preprint arXiv:2102.11245 · arXiv
- dos Santos F. F., 2019, Reliability Evaluation of Mixed-Precision Architectures. In 2019 IEEE International Symposium on High Performance Computer Architecture (HPCA 19)
- Dutta S., 2019, CodeNet: Training Large Scale Neural Networks in Presence of Soft-Errors. arXiv preprint arXiv:1903.01042 · arXiv
- Feng B., 2021, Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP 21)
- Geist, 2016, Supercomputing's Monster in the Closet. IEEE Spectrum, 53, 3
- Haidar A., 2018, International Conference for High Performance Computing, Networking, Storage and Analysis (SC 18)
- Hari S. K. S., 2021, Making Convolutions Resilient via Algorithm-Based Error Detection Techniques
- Hochschild P. H., 2021, Proceedings of the 18th Workshop on Hot Topics in Operating System (HotOS 21)
- Hsieh K., 2018, Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18)
- Huang K.-H., 1984, Algorithm-Based Fault Tolerance for Matrix Operations. IEEE Transactions on Computers, 100, 6
- Jeon H., 2012, Warped-DMR: Light-Weight Error Detection for GPGPU. In 2012 45th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 12)
- Kang D., 2020, BlazeIt: Optimizing Declarative Aggregation and Limit Queries for Neural Network-Based Video Analytics. Proceedings of the VLDB Endowment, 13, 4
- Kang D., 2017, Scale. Proceedings of the VLDB Endowment, 10, 11
- Kim H., 2020, Proceedings of the 41st ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 20)
- Koppula S., 2019, Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 19)
- Krizhevsky A., 2012, Advances in Neural Information Processing Systems (NIPS 12)
- Li G., 2017, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC 17)
- Li G., 2018, Modeling Soft-Error Propagation in Programs. In 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 18)
- Li S., 2021, Efficient Soft-Error Detection for Low-Precision Deep Learning Recommendation Models. arXiv preprint arXiv:2103.00130 · arXiv
- Li S., 2019, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC 19)
- Li Y., 2020, Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security (CCS 20)
- Liu Q., 2016, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC 16)
- Mahmoud A., 2020, PyTorchFI: A Runtime Perturbation Tool for DNNs. In 2020 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W 20)
- Mahmoud A., 2020, HarDNN: Feature Map Vulnerability Evaluation in CNNs. arXiv preprint arXiv:2002.09786 · arXiv
- Mahmoud A., 2018, Optimizing Software-Directed Instruction Replication for GPU Error Detection. In International Conference for High Performance Computing, Networking, Storage and Analysis (SC 18)
- Mittal S., 2015, A Survey of Techniques for Modeling and Improving Reliability of Computing Systems
- Mullapudi R. T., 2019, Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV 19), 3573
- Naumov M., 2019, Deep Learning Recommendation Model for Personalization and Recommendation Systems. arXiv preprint arXiv:1906.00091 · arXiv
- Ozen E., 2019, Sanity-Check: Boosting the Reliability of Safety-Critical Deep Neural Network Applications. In 2019 IEEE 28th Asian Test Symposium (ATS 19)
- Ozen E., 2020, Concurrent Monitoring of Operational Health in Neural Networks Through Balanced Output Partitions. In 2020 25th Asia and South Pacific Design Automation Conference (ASP-DAC 20)
- Ozen E., 2020, Just Say Zero: Containing Critical Bit-Error Propagation in Deep Neural Networks with Anomalous Feature Suppression. In 2020 IEEE/ACM International Conference On Computer Aided Design (ICCAD 20), 10.1145/3400302.3415680 · DOI
- Reis G. A., 2005, Proceedings of the International Symposium on Code Generation and Optimization (CGO 05)
- Russakovsky O. Deng J. Su H. Krause J. Satheesh S. Ma S. Huang Z. Karpathy A. Khosla A. Bernstein M. Berg A. C. and Fei-Fei L. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV) 115 3 (2015) 211--252. Russakovsky O. Deng J. Su H. Krause J. Satheesh S. Ma S. Huang Z. Karpathy A. Khosla A. Bernstein M. Berg A. C. and Fei-Fei L. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV) 115 3 (2015) 211--252. · DOI · Paper page
- Saxena N., 2018, 2018 IEEE International Reliability Physics Symposium (IRPS) Keynote
- Schorn C., 2020, FACER: A Universal Framework for Detecting Anomalous Operation of Deep Neural Networks. In 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC 21)
- Schorn C., 2018, Efficient On-Line Error Detection and Mitigation for Deep Neural Network Accelerators. In International Conference on Computer Safety, Reliability, and Security (SAFECOMP 18)
- Shen H., 2017, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 17)
- Sullivan M. B., 2018, Swapcodes: Error Codes for Hardware-Software Cooperative GPU Pipeline Error Detection. In 2018 51st Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 18)
- Tan M., 2019, Proceedings of the 36th International Conference on Machine Learning (ICML 19)
- Torres-Huitzil C., 2017, Error Tolerance in Neural Networks: A Review. IEEE Access, 5, 17322
- Wadden J., 2014, Real-World Design and Evaluation of Compiler-Managed GPU Redundant Multithreading. In 2014 ACM/IEEE 41st Annual International Symposium on Computer Architecture (ISCA 14)
- Weiss T. R., 2021, Edge, Cloud to Earth Orbit in Preparation for Mars Missions. https://www.hpcwire.com/2021/02/12/microsoft-hpe-bringing-ai-edge-cloud-to-earth-orbit-in-preparation-for-mars-missions/. Last accessed
- Williams S., 2009, Insightful Visual Performance Model for Multicore Architectures. Communications of the ACM, 52, 4
- Wu P., 2016, Proceedings of the 25th ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC 16)
- Yang L., 2021, 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE 21)
- Zamani H., 2019, Proceedings of the ACM International Conference on Supercomputing (ICS 19)
- Zhai Y., 2021, FT-BLAS: A High Performance BLAS Implementation With Online Fault Tolerance. arXiv preprint arXiv:2104.00897 · arXiv
- Zhang J., 2018, Proceedings of the 55th Annual Design Automation Conference (DAC 18)
- Zhang M., 2018, 2018 USENIX Annual Technical Conference (USENIX ATC 18)
- Zhao K., 2021, Z. FT-CNN: Algorithm-Based Fault Tolerance for Convolutional Neural Networks. IEEE Transactions on Parallel & Distributed Systems, 32, 07
- Zhao W., 2019, Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM 2019)
- Zoph B., 2016, Neural Architecture Search with Reinforcement Learning. arXiv preprint arXiv:1611.01578 · arXiv
Cited by
Sorted by citations
Soft Error Reliability Analysis of Vision Transformers
Xue, X., Liu, C., Wang, Y., Yang, B., Luo, T., Zhang, L., Li, H., & Li, X. (2023) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2023.3317138 · Cited by 35
“Algorithm-based fault-tolerance (ABFT) techniques [37], [38], [39], [40], originally developed for matrix–matrix multiplication based on checksum, have also been explored to detect and recover faults in deep learning without model modification, which are particularly suitable for…”
BackgroundInfluentialLow-Voltage Energy Efficient Neural Inference by Leveraging Fault Detection Techniques
Safarpour, M., Deng, T. Z., Massingham, J., Xun, L., Sabokrou, M., & Silven, O. (2021) · 2021 IEEE Nordic Circuits and Systems Conference (NorCAS) · doi:10.1109/norcas53631.2021.9599648 · Cited by 12
Reliability of Vision Transformers and CNNs on Edge AI Systems Under Neutron Radiation
Badia, J. M., Martin-Salinas, I., Leon, G., Amor-Martin, A., Frias-Dominguez, L., Belloch, J. A., Garcia-Valderas, M., Lindoso, A., Cazzaniga, C., & Entrena, L. (2025) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2025.3536519 · Cited by 11
“These include the ECC memory protection mechanism, software duplication, or different ABFT strategies applied to different kernels and layers, such as matrix multiplication or convolution [32], [33], [34].”
Winograd convolution: a perspective from fault tolerance
Xue, X., Huang, H., Liu, C., Luo, T., Zhang, L., & Wang, Y. (2022) · Proceedings of the 59th ACM/IEEE Design Automation Conference · doi:10.1145/3489517.3530531 · Cited by 10
Metadata
- Authors
- Kosaian, J., & Rashmi, K. V.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
- Publisher
- ACM
- Published
- 2021-11-13
- Pages
- 1-15
- ISSN
- 2167-4337 (ISSN-L)
- OpenAlex
- W3156988338
- Cited by
- 53
- References
- 4
- Citations by year
- 2026: 9 · 2025: 11 · 2024: 15 · 2023: 10 · 2022: 4 · 2021: 4
- FWCI
- 7.63
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- International Conference for High Performance Computing, Networking, Storage and Analysis (SC) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- European Regional Development Fund (AIDA -- Adaptive, Intelligent and Distributed Assurance Platform -- project (reference POCI-01-0247-FEDER-045907) co-financed by the ERDF - European Regional Development Fund through the Operational Program for Competitiveness and Internationalisation)
- Amazon Web Services
- National Science Foundation (DGE-1745016 and DGE-1252522)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Radiation Effects in Electronics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Keywords
- fault tolerance, neural network inference, GPU computing, arithmetic intensity, algorithm-based fault tolerance, soft errors, safety-critical systems, spacecraft
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
