Neutron-Induced Error Rate of Vision Transformer Models on GPUs
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index; 2 of the 12 sources its claims cite were checked for support.
Abstract
Vision Transformers (ViTs) are the new trend to improve performance and accuracy of machine learning. Through neutron beam experiments we show that ViTs have a higher FIT rate than traditional models but similar error criticality.
Overview
CoChat Summary
TL;DR
In neutron beam experiments on an NVIDIA Quadro M2000 GPU, Vision Transformer models showed higher silent data corruption FIT rates than ResNet-50, while error criticality was similar. The smallest-patch ViT 16/224 had the lowest critical SDC rate among the tested ViTs.
Key findings
- SDC FIT rates were 71.60 for ResNet 50, 101.81 for ViT 16/224, 372.36 for ViT 32/224, and 398.97 for ViT 32/384, so ViT configurations had similar or much higher SDC rates than ResNet 50.
- Critical SDC rates were 15.91 for ResNet 50, 10.43 for ViT 16/224, 16.93 for ViT 32/224, and 14.91 for ViT 32/384; ViT 16/224 had the lowest critical SDC rate across tested configurations.
- DUE rates were similar among the tested models; System Crash/Hang and Misaligned/Illegal memory accesses were the primary DUE sources, accounting for an average of 85.2% of DUEs.
- ViT 16/224’s SDC rate was 3.66× lower than ViT 32/224 and 3.92× lower than ViT 32/384, attributed to its smaller patch size.
Methods
- Controlled neutron beam experiments were performed at the ChipIR facility of the Rutherford Appleton Laboratory, UK, with a neutron flux of about 10^6 n/(cm^2/s), about 7–8 orders of magnitude higher than the terrestrial flux of 13 n/(cm^2×h); observed error rates were lower than 1 error per 700 executions, and FIT rates are presented with a Poisson distribution and 95% confidence interval.
- The device under test was an NVIDIA Quadro M2000 GPU (Maxwell ISA, 28 nm TSMC CMOS, 4 GB DDR, 768 CUDA cores, 75 W, 796 MHz). Evaluated models were ResNet 50, ViT 16/224, ViT 32/224*, and ViT 32/384, using a 256-image ImageNet subset grouped into four batches of 64, with PyTorch 1.13.0 and CUDA 11.7.
- Outputs were compared against golden values after each iteration; events were classified as Masked, DUE, or SDC, with SDCs split into Tolerable SDCs and Critical SDCs. Only the GPU core was exposed to the beam, while board DDR and power control circuitry were outside the beam spot.
Limitations
- The paper states that further investigation is required to understand how Transformer characteristics such as patch size and encoder structure impact error criticality, and whether the observed trend is consistent across other ViT models such as ViT-G/14, SwinV2-G, and DaViT-G.
- The study evaluates only one GPU model and uses a 256-image ImageNet subset for efficiency; only the GPU core is irradiated, not the DDR or power control circuitry.
- The text makes evident an ambiguity: the results paragraph reports DUE rates with the same numeric values as the Critical SDC rates, which may confuse the reported DUE figures.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig. 1 The architecture of the Transformer model used in the experiments. The input image is divided into a sequence of linear patches and passed through the Encoder, which consists of a series of operations, including normalization, MLP, and the attention mechanism. The figure was extracted from [1].](https://figures.cochat.ai/paper-figures/17a5fe825c044426a9976381e687690b/neutron-induced-error-rate-of-vision-transformer-models-on-gpus-figure-1.png)


Verification
Claims the paper makes
0 Valid · 2 Not valid · 5 Not checked · 22 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Not surprisingly, System Crash/Hang and Misaligned/Illegal memory accesses are the primary sources of DUEs, accounting for an average of 85.2% of the DUEs.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All tested ML models have a Critical SDC rate much lower than the Tolerable SDC rate.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“One exciting result from Figure 3 is that the error rate of ViT 16/224 is significantly lower than the other two configurations (3.66 × lower than 32/224 and 3.92 × lower than 32/384).”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Through neutron beam experiments we show that ViTs have a higher FIT rate than traditional models but similar error criticality.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Notably, the ViT model with the smallest patch size has the lowest Critical SDC rate across all tested configurations.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
9 more claims
Create a free account to see all 29 claims and to verify the 4 references still open.
- Probably not a substantial claim. 7
- It may state two separate claims as one. 11
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
2008 IEEE Conference on Computer Vision and Pattern Recognition
(2008) · doi:10.1109/cvpr12618.2008 · Cited by 4,212
IEEE Transactions on Dependable and Secure Computing
(2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.8858 · Cited by 309
IEEE Design & Test of Computers
(1985) · IEEE Design & Test of Computers · doi:10.1109/mdt.1985.294883 · Cited by 35
(2014) · FCP_INDI Datasets · doi:10.15387/fcp_indi.corr · Cited by 5
Research works printed but not linked: 8
- Khan, 2022, ACM Comput. Surv.
- Oliveira, 2016, IEEE Trans Comput
- Sullivan, IEEE/ACM International Symposium on Microarchitecture
- Santos, 2019, IEEE Trans. Reliab.
- Libano, 2019, IEEE Trans. Nucl. Sci.
- Junior, 2022, IEEE Trans. Nucl. Sci.
- Vaswani, 2017, CoRR
- 2006, JEDEC, JEDEC Standard, Tech. Rep.
Cited by
Reliability of Vision Transformers and CNNs on Edge AI Systems Under Neutron Radiation
Badia, J. M., Martin-Salinas, I., Leon, G., Amor-Martin, A., Frias-Dominguez, L., Belloch, J. A., Garcia-Valderas, M., Lindoso, A., Cazzaniga, C., & Entrena, L. (2025) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2025.3536519 · Cited by 11
“The work presented in [12] compares the reliability of a CNN and three ViTs on an NVIDIA Maxwell GPU and shows that the ViT has a higher FIT rate than convolutional networks but similar error criticality.”
InfluentialImpact of Radiation-Induced Effects on Embedded GPUs Executing Large Machine Learning Models
Coelho, B. L., dos Santos, F. F., Saveriano, M., Allen, G. R., Daniel, A. C., Guertin, S. M., Vartanian, S., Wyrwas, E. J., Frost, C. D., & Rech, P. (2025) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2025.3528764 · Cited by 8
“…to characterizing the DUT, our experimental results shown in Section IV-C revealed that the ViT architecture is more susceptible to radiation-induced errors than CNNs. Results from related work confirm this and also show that the criticality of the two ML model architectures are similar [26], [27].”
Self-citationDependability analysis and hardening of vision transformers against soft errors
Frias-Dominguez, L., Badía, J. M., León, G., Amor-Martín, A., & Belloch, J. A. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08373-0 · Cited by 1
Cherezova, N., Jutman, A., & Jenihhin, M. (2026) · IEEE International On-Line Testing Symposium (IOLTS) · doi:10.1109/iolts69666.2026.11633827
“We also compare the reliability of ViTs with CNNs, namely ResNet-50, following previous works [1], [5], [6].”
Metadata
- Authors
- Dos Santos, F. F., Rech, P., Kritikakou, A., & Sentieys, O.
- Affiliations
- Univ. Rennes,Inria,France
- University of Trento (IT)
- Institut national de recherche en sciences et technologies du numérique (FR)
- Venue
- 2023 23rd European Conference on Radiation and Its Effects on Components and Systems (RADECS)
- Publisher
- IEEE
- Published
- 2023-09-25
- Pages
- 1-4
- OpenAlex
- W4392278819
- Semantic Scholar
- 34c0dd0b8f4ceab818b3f8f6fa294fbc2fe779e6
- Cited by
- 4
- References
- 4
- Citations by year
- 2026: 2 · 2025: 2
- FWCI
- 1.96
- Type
- conference paper
- Language
- en
- Open access
- green
- inria.hal.science
- Locations
- European Conference on Radiation and Its Effects on Components and Systems (publishedVersion)
- HAL (submittedVersion, cc-by)
- Funders
- European Commission (HORIZON2020, 101008126, 899546)
- Agence Nationale de la Recherche (ANR-21-CE25-0008, ANR-21-CE24-0015)
- Région Bretagne (899546)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Radiation Effects in Electronics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- vision transformer, neutron-induced errors, GPU reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Neutron-Induced Error Rate of Vision Transformer Models on GPUs. https://app.cochat.ai/papers/10.1109/radecs59069.2023.10767034
- The paper
- Dos Santos, F. F., Rech, P., Kritikakou, A., & Sentieys, O. (2023). Neutron-Induced Error Rate of Vision Transformer Models on GPUs. 2023 23rd European Conference on Radiation and Its Effects on Components and Systems (RADECS). https://doi.org/10.1109/radecs59069.2023.10767034
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.