The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
BlueGene/L Failure Analysis and Prediction Models
Abstract
The growing computational and storage needs of several scientific applications mandate the deployment of extreme-scale parallel machines, such as IBM’s BlueGene/L which can accommodate as many as 128K processors. One of the challenges when designing and deploying these systems in a production setting is the need to take failure occurrences, whether it be in the hardware or in the software, into account. Ear- lier work has shown that conventional runtime fault- tolerant techniques such as periodic checkpointing are not effective to the emerging systems. Instead, the ability to predict failure occurrences can help develop more effective checkpointing strategies. Failure predic- tion has long been regarded as a challenging research problem, mainly due to the lack of realistic failure data from actual production systems. In this study, we have collected RAS event logs from BlueGene/L over a pe- riod of more than 100 days. We have investigated the characteristics of fatal failure events, as well as the correlation between fatal events and non-fatal events. Based on the observations, we have developed three simple yet effective failure prediction methods, which can predict around 80% of the memory and network failures, and 47% of the application I/O failures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mukherjee, S. S., Weaver, C. T., Emer, J., Reinhardt, S. K., & Austin, T. M. (2003) · Cited by 840
Mukherjee, S. S., Weaver, C., Emer, J., Reinhardt, S. K., & Austin, T. (2004) · 22nd Digital Avionics Systems Conference. Proceedings (Cat. No.03CH37449) · doi:10.1109/micro.2003.1253181 · Cited by 656
Critical event prediction for proactive management in large-scale computer clusters
Sahoo, R. K., Oliner, A. J., Rish, I., Gupta, M., Moreira, J. E., Ma, S., Vilalta, R., & Sivasubramaniam, A. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956799 · Cited by 264
Self-citationLearning to predict rare events in event sequences
Weiss, G. M., & Hirsh, H. (1998) · Cited by 219
Improved disk-drive failure warnings
Hughes, G. F., Murray, J. F., Kreutz-Delgado, K., & Elkan, C. (2002) · IEEE Transactions on Reliability · doi:10.1109/tr.2002.802886 · Cited by 216
Predicting rare events in temporal domains
Vilalta, R., & Ma, S. (2003) · Proceedings · doi:10.1109/icdm.2002.1183991 · Cited by 160
Filtering Failure Logs for a BlueGene/L Prototype
Liang, Y., Zhang, Y., Sivasubramaniam, A., Sahoo, R. K., Moreira, J. E., & Gupta, M. (2005) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2005.50 · Cited by 129
Self-citationPerformance Implications of Failures in Large-Scale Cluster Scheduling
Zhang, Y., Squillante, M. S., Sivasubramaniam, A., & Sahoo, R. K. (2005) · Lecture notes in computer science · doi:10.1007/11407522_13 · Cited by 121
Self-citationFault-aware job scheduling for bBueGene/L systems
Oliner, A. J., Sahoo, R. K., Moreira, J. E., Gupta, M., & Sivasubramaniam, A. (2004) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps.2004.1302991 · Cited by 83
Self-citationAnalysis and modeling of correlated failures in multicomputer systems
Tang, D., & Iyer, R. K. (1992) · IEEE Transactions on Computers · doi:10.1109/12.142683 · Cited by 76
Cited by
What Supercomputers Say: A Study of Five System Logs
Oliner, A., & Stearley, J. (2007) · 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07) · doi:10.1109/dsn.2007.103 · Cited by 620
A survey of online failure prediction methods
Salfner, F., Lenk, M., & Malek, M. (2010) · ACM Computing Surveys · doi:10.1145/1670679.1670680 · Cited by 560
Failure Prediction in IBM BlueGene/L Event Logs
Liang, Y., Zhang, Y., Xiong, H., & Sahoo, R. (2007) · Seventh IEEE International Conference on Data Mining (ICDM 2007) · doi:10.1109/icdm.2007.46 · Cited by 292
Self-citation
Metadata
- Authors
- Liang, Y., Zhang, Y., Sivasubramaniam, A., Jette, M., & Sahoo, R.
- Venue
- International Conference on Dependable Systems and Networks (DSN'06)
- Publisher
- IEEE
- Published
- 2006-07-21
- Pages
- 425-434
- OpenAlex
- W2158907675
- Cited by
- 259
- References
- 10
- FWCI
- 10.26
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.