The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
A large-scale study of failures in high-performance computing systems
Abstract
Designing highly dependable systems requires a good understanding of failure characteristics. Unfortunately, little raw data on failures in large IT installations is publicly available. This paper analyzes failure data recently made publicly available by one of the largest high-performance computing sites. The data has been collected over the past 9 years at Los Alamos National Laboratory and includes 23000 failures recorded on more than 20 different systems, mostly large clusters of SMP and NUMA nodes. We study the statistics of the data, including the root cause of failures, the mean time between failures, and the mean time to repair. We find for example that average failure rates differ wildly across systems, ranging from 20-1000 failures per year, and that time between failures is modeled well by a Weibull distribution with decreasing hazard rate. From one system to another, mean repair time varies from less than an hour to more than a day, and repair times are well modeled by a lognormal distribution
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to Probability Models.
Jolliffe, F., & Ross, S. M. (1995) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983433 · Cited by 4,525
Willinger, W., Taqqu, M. S., Sherman, R., & Wilson, D. V. (1997) · IEEE/ACM Transactions on Networking · doi:10.1109/90.554723 · Cited by 1,654
Disk failures in the real world: what does an MTTF of 1,000,000 hours mean to you?
Schroeder, B., & Gibson, G. A. (2007) · Cited by 762
Self-citationWhy Do Computers Stop and What Can Be Done About It?
Gray, J. (2024) · doi:10.6084/m9.figshare.27043420 · Cited by 663
Why Do Internet Services Fail, and What Can Be Done About It?
Oppenheimer, D., Ganapathi, A., & Patterson, D. A. (2002) · Cited by 607
A census of Tandem system availability between 1985 and 1990
Gray, J. (1990) · IEEE Transactions on Reliability · doi:10.1109/24.58719 · Cited by 322
Error log analysis: statistical modeling and heuristic trend analysis
Lin, T.-T. Y., & Siewiorek, D. P. (1990) · IEEE Transactions on Reliability · doi:10.1109/24.58720 · Cited by 184
Modeling Machine Availability in Enterprise and Wide-Area Distributed Computing Environments
Nurmi, D. C., Brevik, J., & Wolski, R. (2005) · Lecture notes in computer science · doi:10.1007/11549468_50 · Cited by 180
A longitudinal survey of Internet host reliability
Long, D. D. E., Muir, A., & Golding, R. A. (2002) · Proceedings/Proceedings - Symposium on Reliable Distributed Systems · doi:10.1109/reldis.1995.518718 · Cited by 128
Performance Implications of Failures in Large-Scale Cluster Scheduling
Zhang, Y., Squillante, M. S., Sivasubramaniam, A., & Sahoo, R. K. (2005) · Lecture notes in computer science · doi:10.1007/11407522_13 · Cited by 121
Cited by
What Supercomputers Say: A Study of Five System Logs
Oliner, A., & Stearley, J. (2007) · 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07) · doi:10.1109/dsn.2007.103 · Cited by 620
DRAM errors in the wild: a large-scale field study
Schroeder, B., Pinheiro, E., & Weber, W.-D. (2009) · Proceedings of the eleventh international joint conference on Measurement and modeling of computer systems · doi:10.1145/1555349.1555372 · Cited by 557
Self-citationDesign, Modeling, and Evaluation of a Scalable Multi-level Checkpointing System
Moody, A., Bronevetsky, G., Mohror, K., & Supinski, B. R. D. (2010) · 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1109/sc.2010.18 · Cited by 521
Exascale computing and big data
Reed, D. A., & Dongarra, J. (2015) · Communications of the ACM · doi:10.1145/2699414 · Cited by 418
Understanding failures in petascale computers
Schroeder, B., & Gibson, G. A. (2007) · Journal of Physics: Conference Series · doi:10.1088/1742-6596/78/1/012022 · Cited by 358
Self-citation
Metadata
- Authors
- Schroeder, B., & Gibson, G. A.
- Venue
- International Conference on Dependable Systems and Networks (DSN'06)
- Publisher
- IEEE
- Published
- 2006-07-21
- Pages
- 249-258
- OpenAlex
- W1558516248
- Cited by
- 584
- References
- 11
- FWCI
- 27.51
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A large-scale study of failures in high-performance computing systems. https://app.cochat.ai/papers/10.1109/dsn.2006.5
- The paper
- Schroeder, B., & Gibson, G. A. (2006). A large-scale study of failures in high-performance computing systems. International Conference on Dependable Systems and Networks (DSN'06). https://doi.org/10.1109/dsn.2006.5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.