BinFI: an efficient fault injector for safety-critical machine learning systems
The DOI matches its Crossref record; 66 of the 67 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
As machine learning (ML) becomes pervasive in high performance computing, ML has found its way into safety-critical domains (e.g., autonomous vehicles). Thus the reliability of ML has grown in importance. Specifically, failures of ML systems can have catastrophic consequences, and can occur due to soft errors, which are increasing in frequency due to system scaling. Therefore, we need to evaluate ML systems in the presence of soft errors.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The latter focuses on identifying the safety-critical bits in ML applications, relying on TensorFI for the injection of bit-flips in the operators.”
From Fast and Accurate Error Simulation for CNNs Against Soft Errors (2023) · cites this paper as [12]
In the citing paper
“The effects of the faults on the outputs are analyzed with respect to the application, to determine the actual impact in the case of safety-critical contexts.”
From Fast and Accurate Error Simulation for CNNs Against Soft Errors (2023) · cites this paper as [12]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
Research works printed but not linked: 8
- Autonomous Car - A New Driver for Resilient Computing and Design-for-Test. https://nepp.nasa.gov/workshops/etw2016/talks/15WED/20160615-0930-Autonomous_Saxena-Nirmal-Saxena-Rec2016Jun16-nasaNEPP.pdf Autonomous Car - A New Driver for Resilient Computing and Design-for-Test. https://nepp.nasa.gov/workshops/etw2016/talks/15WED/20160615-0930-Autonomous_Saxena-Nirmal-Saxena-Rec2016Jun16-nasaNEPP.pdf
- Nathan DeBardeleben , James Laros , John T Daly , Stephen L Scott , Christian Engelmann , and Bill Harrod . 2009 . High-end computing resilience: Analysis of issues facing the HEC community and path-forward for research and development . Whitepaper , Dec (2009). Nathan DeBardeleben, James Laros, John T Daly, Stephen L Scott, Christian Engelmann, and Bill Harrod. 2009. High-end computing resilience: Analysis of issues facing the HEC community and path-forward for research and development. Whitepaper, Dec (2009).
- Simon Haykin . 1994. Neural networks . Vol. 2 . Prentice hall New York . Simon Haykin. 1994. Neural networks. Vol. 2. Prentice hall New York.
- Geoffrey Hinton , Oriol Vinyals , and Jeff Dean . 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 ( 2015 ). Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015). · arXiv
- Wenchao Li , Susmit Jha , and Sanjit A Seshia . 2013 . Generating control logic for optimized soft error resilience . In Proceedings of the 9th Workshop on Silicon Errors in Logic-System Effects (SELSE'13) , Palo Alto, CA, USA. Citeseer. Wenchao Li, Susmit Jha, and Sanjit A Seshia. 2013. Generating control logic for optimized soft error resilience. In Proceedings of the 9th Workshop on Silicon Errors in Logic-System Effects (SELSE'13), Palo Alto, CA, USA. Citeseer.
- Andrew L Maas , Awni Y Hannun , and Andrew Y Ng . 2013 . Rectifier nonlinearities improve neural network acoustic models . In Proc. icml , Vol. 30 . 3. Andrew L Maas, Awni Y Hannun, and Andrew Y Ng. 2013. Rectifier nonlinearities improve neural network acoustic models. In Proc. icml, Vol. 30. 3.
- 10.5555/3104322.3104425 · doi:10.5555/3104322.3104425
- 10.5555/3298023.3298188 · doi:10.5555/3298023.3298188
Cited by
DeepTrust^RT: Confidential Deep Neural Inference Meets Real-Time!
Babar, M. F., & Hasan, M. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.ecrts.2024.13 · Cited by 708
AV-FUZZER: Finding Safety Violations in Autonomous Driving Systems
Li, G., Li, Y., Jha, S., Tsai, T., Sullivan, M., Hari, S. K. S., Kalbarczyk, Z., & Iyer, R. (2020) · 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre5003.2020.00012 · Cited by 205
A Low-cost Fault Corrector for Deep Neural Networks through Range Restriction
Chen, Z., Li, G., & Pattabiraman, K. (2021) · 2021 51st Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN) · doi:10.1109/dsn48987.2021.00018 · Cited by 104
Self-citationSoftware Verification and Validation of Safe Autonomous Cars: A Systematic Literature Review
Rajabli, N., Flammini, F., Nardone, R., & Vittorini, V. (2020) · IEEE Access · doi:10.1109/access.2020.3048047 · Cited by 146
PyTorchFI: A Runtime Perturbation Tool for DNNs
Mahmoud, A., Aggarwal, N., Nobbe, A., Vicarte, J. R. S., Adve, S. V., Fletcher, C. W., Frosio, I., & Hari, S. K. S. (2020) · 2020 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W) · doi:10.1109/dsn-w50199.2020.00014 · Cited by 140
Metadata
- Authors
- Chen, Z., Li, G., Pattabiraman, K., & DeBardeleben, N.
- Affiliations
- University of British Columbia (CA)
- Los Alamos National Laboratory (US)
- Venue
- Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
- Publisher
- ACM
- Published
- 2019-11-17
- Pages
- 1-23
- ISSN
- 2167-4337 (ISSN-L)
- OpenAlex
- W2983012040
- Cited by
- 91
- References
- 64
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 11 · 2023: 14 · 2022: 16 · 2021: 23 · 2020: 13
- FWCI
- 11.23
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference for High Performance Computing, Networking, Storage and Analysis (SC) (publishedVersion)
- Funders
- Natural Sciences and Engineering Research Council of Canada (NSERC)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Radiation Effects in Electronics
- Keywords
- machine learning reliability, soft errors, safety-critical systems, autonomous vehicles, high-performance computing, fault tolerance, failure evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: BinFI: an efficient fault injector for safety-critical machine learning systems. https://app.cochat.ai/papers/10.1145/3295500.3356177
- The paper
- Chen, Z., Li, G., Pattabiraman, K., & DeBardeleben, N. (2019). BinFI: an efficient fault injector for safety-critical machine learning systems. Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. https://doi.org/10.1145/3295500.3356177
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.