The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
What Supercomputers Say: A Study of Five System Logs
Abstract
If we hope to automatically detect and diagnose failures in large-scale computer systems, we must study real deployed systems and the data they generate. Progress has been hampered by the inaccessibility of empirical data. This paper addresses that dearth by examining system logs from five supercomputers, with the aim of providing useful insight and direction for future research into the use of such logs. We present details about the systems, methods of log collection, and how alerts were identified; propose a simpler and more effective filtering algorithm; and define operational context to encompass the crucial information that we found to be currently missing from most logs. The machines we consider (and the number of processors) are: Blue Gene/L (131072), Red Storm (10880), Thunderbird (9024), Spirit (1028), and Liberty (512). This is the first study of raw system logs from multiple supercomputers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Disk failures in the real world: what does an MTTF of 1,000,000 hours mean to you?
Schroeder, B., & Gibson, G. A. (2007) · Cited by 762
A large-scale study of failures in high-performance computing systems
Schroeder, B., & Gibson, G. A. (2006) · International Conference on Dependable Systems and Networks (DSN'06) · doi:10.1109/dsn.2006.5 · Cited by 584
Critical event prediction for proactive management in large-scale computer clusters
Sahoo, R. K., Oliner, A. J., Rish, I., Gupta, M., Moreira, J. E., Ma, S., Vilalta, R., & Sivasubramaniam, A. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956799 · Cited by 264
Self-citationBlueGene/L Failure Analysis and Prediction Models
Liang, Y., Zhang, Y., Sivasubramaniam, A., Jette, M., & Sahoo, R. (2006) · International Conference on Dependable Systems and Networks (DSN'06) · doi:10.1109/dsn.2006.18 · Cited by 259
Mining partially periodic event patterns with unknown periods
Ma, S., & Hellerstein, J. L. (2002) · Proceedings 17th International Conference on Data Engineering · doi:10.1109/icde.2001.914829 · Cited by 236
Dynamic syslog mining for network failure monitoring
Yamanishi, K., & Maruyama, Y. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081927 · Cited by 213
Error log analysis: statistical modeling and heuristic trend analysis
Lin, T.-T. Y., & Siewiorek, D. P. (1990) · IEEE Transactions on Reliability · doi:10.1109/24.58720 · Cited by 184
An Overview of the BlueGene/L Supercomputer
Adiga, N. R., Almasi, G., Almasi, G. S., Aridor, Y., Barik, R., Beece, D., Bellofatto, R., Bhanot, G., Bickford, R., Blumrich, M., et al. (2002) · ACM/IEEE SC 2002 Conference (SC'02) · doi:10.1109/sc.2002.10017 · Cited by 161
Self-citationFiltering Failure Logs for a BlueGene/L Prototype
Liang, Y., Zhang, Y., Sivasubramaniam, A., Sahoo, R. K., Moreira, J. E., & Gupta, M. (2005) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2005.50 · Cited by 129
Towards informatic analysis of syslogs
Stearley, J. (2005) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/clustr.2004.1392628 · Cited by 117
Self-citation
Research works printed but not linked: 11
- 10.1145/1183401.1183406 · doi:10.1145/1183401.1183406
- 10.1109/DSN.2005.80 · doi:10.1109/dsn.2005.80
- nassar, 1985, A methodology for analysis of failure prediction data, Real-Time Systems Symposium, 160
- oliner, 2006, Cooperative check-pointing theory, Proc Int Parallel Distrib Process Symp (IPDPS), 10.1109/IPDPS.2006.1639368 · doi:10.1109/ipdps.2006.1639368
- 10.1109/DSN.2004.1311948 · doi:10.1109/dsn.2004.1311948
- stearley, 2005, Defining and measuring supercomputer Reliability, Availability, and Serviceability (RAS), Proc Linux Cluster Inst Conf
- tsao, 1983, Trend Analysis and Fault Prediction
- 2006, TOP500 Supercomputing Sites
- 2006, Cray red storm architecture documents
- 10.1109/ISPASS.2006.1620806 · doi:10.1109/ispass.2006.1620806
- 10.1109/FTCS.1996.534614 · doi:10.1109/ftcs.1996.534614
Cited by
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332
Heterogeneity and dynamicity of clouds at scale: Google trace analysis
Reiss, C., Tumanov, A., Ganger, G. R., Katz, R. H., & Kozuch, M. A. (2012) · Proceedings of the Third ACM Symposium on Cloud Computing · doi:10.1145/2391229.2391236 · Cited by 1,063
Drain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943
“Specifically, BGL is a log data set collected by Lawrence Livermore National Labs (LLNL) from BlueGene/L supercomputer system [21].”
MethodLogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs
Meng, W., Liu, Y., Zhu, Y., Zhang, S., Pei, D., Liu, Y., Chen, Y., Zhang, R., Tao, S., Sun, P., et al. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/658 · Cited by 708
Experience Report: System Log Analysis for Anomaly Detection
He, S., Zhu, J., He, P., & Lyu, M. R. (2016) · 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2016.21 · Cited by 593
Tools and benchmarks for automated log parsing
Zhu, J., He, S., Liu, J., He, P., Xie, Q., Zheng, Z., & Lyu, M. R. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00021 · Cited by 574
LogBERT: Log Anomaly Detection via BERT
Guo, H., Yuan, S., & Wu, X. (2021) · 2021 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534113 · Cited by 454
Addressing failures in exascale computing
Snir, M., Wisniewski, R. W., Abraham, J. A., Adve, S. V., Bagchi, S., Balaji, P., Belak, J., Bose, P., Cappello, F., Carlson, B., et al. (2014) · The International Journal of High Performance Computing Applications · doi:10.1177/1094342014522573 · Cited by 373
Self-citationLog-based Anomaly Detection Without Log Parsing
Le, V.-H., & Zhang, H. (2021) · 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678773 · Cited by 361
“The datasets are collected between 2004 and 2006 from real-world supercomputing systems [33] and consist of 14,672,653 log messages in total, among which 353,394 log messages are manually labeled as anomalies.”
MethodInfluentialLoghub: a large collection of system log datasets for AI-driven log analytics
Zhu, J., He, S., He, P., Liu, J., & Lyu, M. R. (2023) · 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre59848.2023.00071 · Cited by 302
Log-based anomaly detection with deep learning: how far are we?
Le, V.-H., & Zhang, H. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510155 · Cited by 257
LogSig: generating system events from raw textual logs
Tang, L., Li, T., & Perng, C.-S. (2011) · Proceedings of the 20th ACM international conference on Information and knowledge management · doi:10.1145/2063576.2063690 · Cited by 244
Towards Automated Log Parsing for Large-Scale Log Data Analysis
He, P., Zhu, J., He, S., Li, J., & Lyu, M. R. (2018) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2017.2762673 · Cited by 230
Self-Attentive Classification-Based Anomaly Detection in Unstructured Logs
Nedelkoski, S., Bogatinovski, J., Acker, A., Cardoso, J., & Kao, O. (2020) · 2020 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm50108.2020.00148 · Cited by 176
LogFiT: Log Anomaly Detection Using Fine-Tuned Language Models
Almodovar, C., Sabrina, F., Karimi, S., & Azad, S. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3358730 · Cited by 111
Lee, U., Han, A., Lee, J., Lee, E., Kim, J., Kim, H., & Lim, C. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12150-4 · Cited by 107
AutoLog: Anomaly detection by deep autoencoding of system logs
Catillo, M., Pecchia, A., & Villano, U. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116263 · Cited by 102
Zuo, Y., Wu, Y., Min, G., Huang, C., & Pei, K. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2966615 · Cited by 94
Log-based Abnormal Task Detection and Root Cause Analysis for Spark
Lu, S., Rao, B., Wei, X., Tak, B., Wang, L., & Wang, L. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.135 · Cited by 86
An empirical investigation of practical log anomaly detection for online service systems
Zhao, N., Wang, H., Li, Z., Peng, X., Wang, G., Pan, Z., Wu, Y., Feng, Z., Wen, X., Zhang, W., et al. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3473933 · Cited by 77
Benchmarking Large Language Models for Log Analysis, Security, and Interpretation
Karlsen, E., Luo, X., Zincir-Heywood, N., & Heywood, M. (2024) · Journal of Network and Systems Management · doi:10.1007/s10922-024-09831-x · Cited by 71
Landauer, M., Skopik, F., & Wurzenberger, M. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3660768 · Cited by 61
“New event types CFDR [17] - Anomalies only affect certain event types and can be detected without sequences.”
BackgroundMethodInfluentialMulti-Scale One-Class Recurrent Neural Networks for Discrete Event Sequence Anomaly Detection
Wang, Z., Chen, Z., Ni, J., Liu, H., Chen, H., & Tang, J. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467125 · Cited by 56
Zhang, C., Wang, X., Zhang, H., Zhang, H., & Han, P. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3125967 · Cited by 49
LogAssist: Assisting Log Analysis Through Log Summarization
Locke, S., Li, H., Chen, T.-H., Shang, W., & Liu, W. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3083715 · Cited by 45
LLM-LADE: Large language model-based log anomaly detection with explanation
Zhang, Z., Li, S., Zhang, L., Ye, J., Hu, C., & Yan, L. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114064 · Cited by 42
Improving Log-Based Anomaly Detection with Component-Aware Analysis
Yin, K., Yan, M., Xu, L., Xu, Z., Li, Z., Yang, D., & Zhang, X. (2020) · 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsme46990.2020.00069 · Cited by 37
OneLog: towards end-to-end software log anomaly detection
Hashemi, S., & Mäntylä, M. (2024) · Automated Software Engineering · doi:10.1007/s10515-024-00428-x · Cited by 24
Practitioners’ expectations on log anomaly detection
Ma, X., Li, Y., Keung, J., Yu, X., Zou, H., Yang, Z., Sarro, F., & Barr, E. T. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3586700 · Cited by 21
“Most of the papers evaluate their techniques on two public datasets, Hadoop Distributed File System (HDFS) [27] and Blue Gene/L supercomputer (BGL) [28], typically grouping logs into sequences using sessions and window sizes.”
LogOnline: A Semi-Supervised Log-Based Anomaly Detector Aided with Online Learning Mechanism
Wang, X., Song, J., Zhang, X., Tang, J., Gao, W., & Lin, Q. (2023) · 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00043 · Cited by 18
LogBERT: Log Anomaly Detection via BERT
Guo, H., Yuan, S., & Wu, X. (2021) · arXiv · doi:10.48550/arxiv.2103.04475 · Cited by 7
LLM meets ML: Data-efficient Anomaly Detection on Unstable Logs
Hadadi, F., Xu, Q., Bianculli, D., & Briand, L. (2024) · arXiv · doi:10.48550/arxiv.2406.07467 · Cited by 7
System log anomaly detection based on contrastive learning and retrieval augmented
Li, W., Wu, Y., Huang, W., Zhou, F., Ou, W., Wang, H., & Deng, L. (2025) · Scientific Reports · doi:10.1038/s41598-025-22208-7 · Cited by 6
“Thus, we must set a fixed window to group logs into log sequences 32 .”
LINEADAPTER: Parameter-Efficient Fine-Tuning for Log Anomaly Detection and Root Cause Analysis
Liu, X., Bao, W., Zhang, Y., Li, Y., Ranjan, R., & Jha, D. N. (2025) · 2025 IEEE 31th International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads67057.2025.11322907
Explainable Anomaly Detection for System Logs in Distributed Environments
Gu, Z., Yue, W., & Liu, C. (2026) · Computers, Materials & Continua · doi:10.32604/cmc.2026.077388
“To validate FedXLog, we selected four public datasets from the field of log anomaly detection for our experiments: HDFS [47], BGL [48], Thunderbird [48], and Spirit [48].”
Metadata
- Authors
- Oliner, A., & Stearley, J.
- Venue
- 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07)
- Publisher
- IEEE
- Published
- 2007-06
- Pages
- 575-584
- OpenAlex
- W2107263349
- Cited by
- 620
- References
- 18
- FWCI
- 15.78
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.