The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
What Supercomputers Say: A Study of Five System Logs
Abstract
If we hope to automatically detect and diagnose failures in large-scale computer systems, we must study real deployed systems and the data they generate. Progress has been hampered by the inaccessibility of empirical data. This paper addresses that dearth by examining system logs from five supercomputers, with the aim of providing useful insight and direction for future research into the use of such logs. We present details about the systems, methods of log collection, and how alerts were identified; propose a simpler and more effective filtering algorithm; and define operational context to encompass the crucial information that we found to be currently missing from most logs. The machines we consider (and the number of processors) are: Blue Gene/L (131072), Red Storm (10880), Thunderbird (9024), Spirit (1028), and Liberty (512). This is the first study of raw system logs from multiple supercomputers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Disk failures in the real world: what does an MTTF of 1,000,000 hours mean to you?
Schroeder, B., & Gibson, G. A. (2007) · Cited by 762
A large-scale study of failures in high-performance computing systems
Schroeder, B., & Gibson, G. A. (2006) · International Conference on Dependable Systems and Networks (DSN'06) · doi:10.1109/dsn.2006.5 · Cited by 584
Critical event prediction for proactive management in large-scale computer clusters
Sahoo, R. K., Oliner, A. J., Rish, I., Gupta, M., Moreira, J. E., Ma, S., Vilalta, R., & Sivasubramaniam, A. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956799 · Cited by 264
Self-citationBlueGene/L Failure Analysis and Prediction Models
Liang, Y., Zhang, Y., Sivasubramaniam, A., Jette, M., & Sahoo, R. (2006) · International Conference on Dependable Systems and Networks (DSN'06) · doi:10.1109/dsn.2006.18 · Cited by 259
Mining partially periodic event patterns with unknown periods
Ma, S., & Hellerstein, J. L. (2002) · Proceedings 17th International Conference on Data Engineering · doi:10.1109/icde.2001.914829 · Cited by 236
Dynamic syslog mining for network failure monitoring
Yamanishi, K., & Maruyama, Y. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081927 · Cited by 213
Error log analysis: statistical modeling and heuristic trend analysis
Lin, T.-T. Y., & Siewiorek, D. P. (1990) · IEEE Transactions on Reliability · doi:10.1109/24.58720 · Cited by 184
An Overview of the BlueGene/L Supercomputer
Adiga, N. R., Almasi, G., Almasi, G. S., Aridor, Y., Barik, R., Beece, D., Bellofatto, R., Bhanot, G., Bickford, R., Blumrich, M., et al. (2002) · ACM/IEEE SC 2002 Conference (SC'02) · doi:10.1109/sc.2002.10017 · Cited by 161
Self-citationFiltering Failure Logs for a BlueGene/L Prototype
Liang, Y., Zhang, Y., Sivasubramaniam, A., Sahoo, R. K., Moreira, J. E., & Gupta, M. (2005) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2005.50 · Cited by 129
Towards informatic analysis of syslogs
Stearley, J. (2005) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/clustr.2004.1392628 · Cited by 117
Self-citation
Research works printed but not linked: 11
- 10.1145/1183401.1183406 · doi:10.1145/1183401.1183406
- 10.1109/DSN.2005.80 · doi:10.1109/dsn.2005.80
- nassar, 1985, A methodology for analysis of failure prediction data, Real-Time Systems Symposium, 160
- oliner, 2006, Cooperative check-pointing theory, Proc Int Parallel Distrib Process Symp (IPDPS), 10.1109/IPDPS.2006.1639368 · doi:10.1109/ipdps.2006.1639368
- 10.1109/DSN.2004.1311948 · doi:10.1109/dsn.2004.1311948
- stearley, 2005, Defining and measuring supercomputer Reliability, Availability, and Serviceability (RAS), Proc Linux Cluster Inst Conf
- tsao, 1983, Trend Analysis and Fault Prediction
- 2006, TOP500 Supercomputing Sites
- 2006, Cray red storm architecture documents
- 10.1109/ISPASS.2006.1620806 · doi:10.1109/ispass.2006.1620806
- 10.1109/FTCS.1996.534614 · doi:10.1109/ftcs.1996.534614
Cited by
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332
Drain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943
LogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs
Meng, W., Liu, Y., Zhu, Y., Zhang, S., Pei, D., Liu, Y., Chen, Y., Zhang, R., Tao, S., Sun, P., et al. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/658 · Cited by 708
Experience Report: System Log Analysis for Anomaly Detection
He, S., Zhu, J., He, P., & Lyu, M. R. (2016) · 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2016.21 · Cited by 593
Tools and benchmarks for automated log parsing
Zhu, J., He, S., Liu, J., He, P., Xie, Q., Zheng, Z., & Lyu, M. R. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00021 · Cited by 574
Metadata
- Authors
- Oliner, A., & Stearley, J.
- Venue
- 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07)
- Publisher
- IEEE
- Published
- 2007-06
- Pages
- 575-584
- OpenAlex
- W2107263349
- Cited by
- 620
- References
- 18
- FWCI
- 15.78
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What Supercomputers Say: A Study of Five System Logs. https://app.cochat.ai/papers/10.1109/dsn.2007.103
- The paper
- Oliner, A., & Stearley, J. (2007). What Supercomputers Say: A Study of Five System Logs. 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07). https://doi.org/10.1109/dsn.2007.103
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.