GPU-Qin: A methodology for evaluating the error resilience of GPGPU applications
The DOI matches its Crossref record; 23 of the 25 references it cites were found in a registry or an index.
Abstract
While graphics processing units (GPUs) have gained wide adoption as accelerators for general-purpose applications (GPGPU), the end-to-end reliability implications of their use have not been quantified. Fault injection is a widely used method for evaluating the reliability of applications. However, building a fault injector for GPGPU applications is challenging due to their massive parallelism, which makes it difficult to achieve representativeness while being time-efficient. This paper makes three key contributions. First, it presents the design of a fault-injection methodology to evaluate end-to-end reliability properties of application kernels running on GPUs. Second, it introduces a fault-injection tool that uses real GPU hardware and offers a good balance between the representativeness and the efficiency of the fault injection experiments. Third, this paper characterizes the error resilience characteristics of twelve GPGPU applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Architecture-Level Fault Injection , FI in short, provides controllability and observability, as well as high accuracy, because of the ability of emulating the physical effects of the faults in the architecture components.”
From Fast and Accurate Error Simulation for CNNs Against Soft Errors (2023) · cites this paper as [14]
Citations
Cites
Rodinia: A benchmark suite for heterogeneous computing
Che, S., Boyer, M., Meng, J., Tarjan, D., Sheaffer, J. W., Lee, S.-H., & Skadron, K. (2009) · 2009 IEEE International Symposium on Workload Characterization (IISWC) · doi:10.1109/iiswc.2009.5306797 · Cited by 3,018
(2006) · Cited by 1,979
Analyzing CUDA workloads using a detailed GPU simulator
Bakhoda, A., Yuan, G. L., Fung, W. W. L., Wong, H., & Aamodt, T. M. (2009) · 2009 IEEE International Symposium on Performance Analysis of Systems and Software · doi:10.1109/ispass.2009.4919648 · Cited by 1,663
Borkar, S. (2005) · IEEE Micro · doi:10.1109/mm.2005.110 · Cited by 1,320 · cited 1×
“Transient fault rates have been increasing due to diminishing noise margins, smaller voltages, and shrinking microprocessor feature sizes [9].”
BackgroundFault injection techniques and tools
Hsueh, M.-C., Tsai, T. K., & Iyer, R. K. (1997) · Computer · doi:10.1109/2.585157 · Cited by 884
Parboil: A Revised Benchmark Suite for Scientific and Commercial Throughput Computing
Stratton, J. A., Rodrigues, C. I., Sung, I.-J., Obeid, N., Chang, L., Anssari, N., Liu, G. D., & Hwu, W. (2012) · Cited by 707
Trends and challenges in VLSI circuit reliability
Constantinescu, C. (2003) · IEEE Micro · doi:10.1109/mm.2003.1225959 · Cited by 615
Designing efficient sorting algorithms for manycore GPUs
Satish, N., Harris, M., & Garland, M. (2009) · 2009 IEEE International Symposium on Parallel & Distributed Processing · doi:10.1109/ipdps.2009.5161005 · Cited by 571
Parallel Prefix Sum (Scan) with CUDA
Harris, M. (2011) · Cited by 545
CUDA Compatible GPU as an Efficient Hardware Accelerator for AES Cryptography
Manavski, S. A. (2007) · 2007 IEEE International Conference on Signal Processing and Communications · doi:10.1109/icspc.2007.4728256 · Cited by 307
Research works printed but not linked: 1
- farazman, 2012, Statistical fault injection-based avf analysis of a gpu architecure, IEEE Workshop on Silicon Errors in Logic
Cited by
Items 101–159 of 159
Speeding up safety verification by fault abstraction and simulation to transaction level
Tabacaru, B.-A., Chaari, M., Ecker, W., Kruse, T., & Novello, C. (2016) · IFIP/IEEE International Conference on Very Large Scale Integration · doi:10.1109/vlsi-soc.2016.7753547 · Cited by 8
Zuzak, M., & Srivastava, A. (2020) · International Symposium on Memory Systems (MEMSYS) · doi:10.1145/3422575.3422798 · Cited by 8
Lunardi, C., Quinn, H., Monroe, L., Oliveira, D., Navaux, P. O. A., & Rech, P. (2017) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2017.2727499 · Cited by 7
Evaluating the Soft Error Resilience of Instructions for GPU Applications
Wei, X., Zhang, R., Liu, Y., Yue, H., & Tan, J. (2019) · IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC) · doi:10.1109/cse/euc.2019.00091 · Cited by 7
Understanding Fault Scenarios and Impacts through Fault Injection Experiments in CieloPreprint
Formicola, V., Jha, S., Chen, D., Deng, F., Bonnie, A., Mason, M., Brandt, J. M., Gentile, A., Kaplan, L., Repik, J., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.01019 · Cited by 7
Data access skipping for recursive partitioning methods
Kislal, O., & Kandemir, M. (2018) · Computer Languages · doi:10.1016/j.cl.2018.03.003 · Cited by 6
Zhu, Q., & Zaidman, A. (2020) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst46399.2020.00030 · Cited by 6
SUGAR: Speeding Up GPGPU Application Resilience Estimation with Input Sizing
Yang, L., Nie, B., Jog, A., & Smirni, E. (2021) · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · doi:10.1145/3410220.3453917 · Cited by 6
Regional soft error vulnerability and error propagation analysis for GPGPU applications
Öz, I., & Karadaş, Ö. F. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-021-04026-6 · Cited by 6
Increasing the Efficiency and Efficacy of Selective-Hardening for Parallel Applications
Oliveira, D., Navaux, P., & Rech, P. (2019) · 2019 IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems (DFT) · doi:10.1109/dft.2019.8875300 · Cited by 5
“For NVIDIA GPUs one can use SASSIFI [17], which is a tool designed by NVIDIA or the GPU-Qin [18].”
MethodGPU Architecture Aware Instruction Scheduling for Improving Soft-Error Reliability
Lee, H., & Faruque, M. A. A. (2017) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2017.2667661 · Cited by 5
GEREM: Fast and Precise Error Resilience Assessment for GPU Microarchitectures
Tan, J., Li, X., Zhong, A., Yan, K., Wei, X., & Li, G. (2025) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2025.3552679 · Cited by 4
Evaluating the Prevalence of SFUs in the Reliability of GPUs
Condia, J. E. R., Guerrero-Balaguera, J.-D., Núñez, E. J. P., Sierra, R. L., & Reorda, M. S. (2023) · IEEE European Test Symposium (ETS) · doi:10.1109/ets56758.2023.10174110 · Cited by 4
Can GPU performance increase faster than the code error rate?
dos Santos, F. F., & Rech, P. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06119-4 · Cited by 4
Probing Weaknesses in GPU Reliability Assessment: A Cross-Layer Approach
Yang, L., Papadimitriou, G., Sartzetakis, D., Jog, A., Smirni, E., & Gizopoulos, D. (2024) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass61541.2024.00048 · Cited by 4
HAppA: A Modular Platform for HPC Application Resilience Analysis with LLMs Embedded
Jiang, H., Zhu, J., Fang, B., BARKER, K. J., Chen, C., Jin, R., & Guan, Q. (2024) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds64841.2024.00015 · Cited by 4
Self-citationEffective Running of End-to-End HPC Workflows on Emerging Heterogeneous Architectures
Tang, K., Tiwari, D., Gupta, S., Vazhkudai, S. S., & He, X. (2017) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/cluster.2017.22 · Cited by 4
Advances in GPU reliability research
Wadden, J., & Skadron, K. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-803738-6.00022-7 · Cited by 4
Self-Supervised Pretraining and Quantization for Fault Tolerant Neural Networks: Friend or Foe?
Milazzo, R., Fosson, S. M., Morra, L., & Sterpone, L. (2025) · IEEE Access · doi:10.1109/access.2025.3564834 · Cited by 3
Transient Fault Resilient QR Factorization on GPUs
Loh, F., Ramanathan, P., & Saluja, K. K. (2015) · IEEE/ACM Workshop on Fault Tolerance for HPC at eXtreme Scale (FTXS) · doi:10.1145/2751504.2751505 · Cited by 3
Resilience Proportionality—A Paradigm for Efficient and Reliable System Design
Sridharan, V., & Gurumurthi, S. (2017) · Springer eBooks · doi:10.1007/978-3-319-54422-9_9 · Cited by 3
Self-citationAlcaide, S. (2023) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-402844 · Cited by 3
A Structured Method to Generate Self-Test Libraries for Tensor Cores
Sierra, R. L., Guerrero-Balaguera, J.-D., Condia, J. E. R., & Reorda, M. S. (2025) · Electronics · doi:10.3390/electronics14112148 · Cited by 2
Investigating Resilience of Loops in HPC Programs: A Semantic Approach with LLMs
Jiang, H., Zhu, J., Fang, B., Chen, C., & Guan, Q. (2024) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec62836.2024.10938472 · Cited by 2
Self-citationA New Simulation-Based Fault Injection Approach for the Evaluation of Transient Errors in GPGPUs
Azimi, S., Du, B., & Sterpone, L. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-30695-7_29 · Cited by 2
Gate-Level-Accurate Fault-Effect Analysis at Virtual-Prototype Speed
Tabacaru, B.-A., Chaari, M., Ecker, W., Kruse, T., & Novello, C. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45480-1_12 · Cited by 2
Kicherer, M., & Karl, W. (2015) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2015.10.001 · Cited by 2
Concurrent Detection of Failures in GPU Control Logic for Reliable Parallel Computing
Itsuji, H., Uezono, T., Toba, T., Ito, K., & Hashimoto, M. (2020) · IEEE International Test Conference (ITC) · doi:10.1109/itc44778.2020.9325216 · Cited by 2
Cross layer reliability estimation for digital systems
Vallero, A. (2017) · PORTO@Iris · doi:10.6092/polito/porto/2673865 · Cited by 2
Chen, J. (2019) · eScholarship (California Digital Library) · Cited by 2
Fast and Accurate Error Simulation for CNNs Against Soft Errors
Bolchini, C., Cassano, L., Miele, A., & Toschi, A. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2022.3184274 · Cited by 1
“256 13 13 256 13 13 Bias add 256 13 13 256 13 13 Div 1 10647 1 10647 Exp 1 8112 2 1 8112 2 Leaky ReLU 256 26 26 256 26 26 Slope = 0.1 Mul 1 8112 2 1 8112 2 Sigmoid 1 2028 80 1 2028 80 TABLE 2 Results From the Fault Injection Experiments Operator Number of injected faults Number of corrupted tensors Conv.”
MethodInfluentialFu, J., & Liu, Y. (2020) · Brazilian Symposium on Computing System Engineering (SBESC) · doi:10.1109/sbesc51047.2020.9277841 · Cited by 1
BarkBeetle: Stealing Decision Tree Models with Fault Injection
Wang, Q., Sander, J., Jiang, M., Eisenbarth, T., & Oswald, D. (2026) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3779208.3785372 · Cited by 1
Analysis of LLM Vulnerability to GPU Soft Errors: An Instruction-Level Fault Injection Study
Chai, D., Liu, Z., Wang, S., Pei, S., Liu, C., Li, H., & Wang, S. (2026) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2026.3744542 · Cited by 1
Vallero, A., & Carlo, S. D. (2019) · Proceedings · doi:10.1109/dft.2019.8875392 · Cited by 1
Low-Overhead Techniques For Secure And Reliable Gpu Computing
Kadam, G. (2021) · W&M Publish (College of William & Mary) · doi:10.21220/s2-jvrg-8s06 · Cited by 1
Dependability of Alternative Computing Paradigms for Machine Learning: hype or hope?
Bolchini, C., Bosio, A., Cassano, L., Deveautour, B., Natale, G. D., Miele, A., O’Connor, I., & Vatajelu, E. I. (2022) · IEEE International Symposium on Design and Diagnostics of Electronic Circuits & Systems (DDECS) · doi:10.1109/ddecs54261.2022.9770138 · Cited by 1
An open source embedded-GPGPU model for the accurate analysis and mitigation of SEU effects
Du, B., Condia, J. E. R., Reorda, M. S., & Sterpone, L. (2019) · European Conference on Radiation and Its Effects on Components and Systems · doi:10.1109/radecs47380.2019.9745670 · Cited by 1
A Hardware-Aware Failure-Detection Method for GPU Control-Logic
Itsuji, H., Uezono, T., Toba, T., Ito, K., & Hashimoto, M. (2025) · IEEE Access · doi:10.1109/access.2025.3584759 · Cited by 1
Heterogeneity-aware Fault Tolerance using a Self-Organizing Runtime SystemPreprint
Kicherer, M., & Karl, W. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.2912 · Cited by 1
Error resilience evaluation on GPGPU applications
Fang, B. (2014) · cIRcle (University of British Columbia) · doi:10.14288/1.0165934 · Cited by 1
Self-citationThe application perspective of mutatoin testing
Zhu, Q. (2020) · Research Repository (Delft University of Technology) · doi:10.4233/uuid:116a487e-c14d-47f8-b1f5-8e9738d263d0 · Cited by 1
Braun, C. (2015) · OPUS Publication Server of the University of Stuttgart (University of Stuttgart) · doi:10.18419/opus-3545
Soft-Error Effects on Graphics Processing Units
Rech, P., Oliveira, D., Navaux, P. O. A., & Carro, L. (2015) · Springer eBooks · doi:10.1007/978-3-319-14352-1_20
Architectural vulnerability factor estimation through fault injections
Previlon, F. G. (2016) · Digital Repository Service (Northeastern University) · doi:10.17760/d20213017
Nedel, W. M. (2015) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Fault injections on mission-critical computer systems
Devnani, L. R. (2018) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Reliability and Timing Aware GPU Management on Embedded Systems
Lee, H. (2017) · eScholarship (California Digital Library)
Understanding and modeling error propagation in programs
Li, G. (2019) · cIRcle (University of British Columbia) · doi:10.14288/1.0376650
Improving soft error reliability in modern processors
Naithani, A. (2019) · Ghent University Academic Bibliography (Ghent University)
Characterization and remediation for soft error reliability on GPU
Previlon, F. G. (2019) · Digital Repository Service (Northeastern University) · doi:10.17760/d20323961
New Techniques for On-line Testing and Fault Mitigation in GPUs
Condia, J. E. R., & Esteban, J. (2021) · PORTO@Iris
Qian, Z., Lianguo, W. A. N. G., Zhang, P., & Jianing, R. A. O. (2026) · Future Generation Computer Systems · doi:10.1016/j.future.2026.108372
FaultSpy: On the Insecurity of SPDM Protocols under Fault Injection
Sun, P., Wang, Q., Oswald, D., Ryan, M. D., Sassone, V., & Atamli, A. (2025) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom66490.2025.00252
Reliable Remote Inference from Unreliable Components: Joint Communication and Computation LimitsPreprint
Liu, Z., Ma, Y., & Tafazolli, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.19231
Yoshida, M., Matsuoka, K., & Hashimoto, M. (2026) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2026.3714766
Reliability Enhancement in GPU Architectures
Guerrero-Balaguera, J.-D. (2024) · PORTO@Iris
Enhancing safety and resilience in AI-driven systems: from autonomous vehicles to data centers
Chen, Z. (2025) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Towards efficient and reliable infrastructure for machine learning
Patke, A. (2025) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Metadata
- Authors
- Fang, B., Pattabiraman, K., Ripeanu, M., & Gurumurthi, S.
- Affiliations
- University of British Columbia (CA)
- Advanced Micro Devices (United States) (US)
- Venue
- 2014 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)
- Publisher
- IEEE
- Published
- 2014-03
- Pages
- 221-230
- OpenAlex
- W2027716782
- Cited by
- 142
- References
- 25
- Citations by year
- 2026: 1 · 2025: 8 · 2024: 9 · 2023: 6 · 2022: 9 · 2021: 17 · 2020: 19 · 2019: 16 · 2018: 11 · 2017: 16 · 2016: 14 · 2015: 11 · 2014: 5
- FWCI
- 11.94
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Radiation Effects in Electronics
- Keywords
- error resilience, fault injection, GPU reliability, fault injection tool, GPU accelerators
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.