A Survey on Automated Log Analysis for Reliability Engineering
Open accessThe DOI matches its Crossref record; 130 of the 130 references it cites were found in a registry or an index.
Abstract
Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems, because they are often the only data available that record software runtime information. As modern software is evolving into a large scale, the volume of logs has increased rapidly. To enable effective and efficient usage of modern software logs in reliability engineering, a number of studies have been conducted on automated log analysis. This survey presents a detailed overview of automated log analysis research, including how to automate and assist the writing of logging statements, how to compress logs, how to parse logs into structured event templates, and how to employ logs to detect anomalies, predict failures, and facilitate diagnosis. Additionally, we survey work that releases open-source toolkits and datasets. Based on the discussion of the recent advances, we present several promising future directions toward real-world and next-generation automated log analysis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Their importance has grown as modern software systems scale, but the increasing volume and heterogeneity of logs make their analysis a significant challenge [59,60].”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [59]
Citations
Cites
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“NY •Log event sequence: A sequence of log events recording system’s activities. Particularly, each element can simply be the log event ID or log embedding vector, e.g., learned by word2vec algorithms [111]. •Log event count vector: A feature vector recording the log events occurrence in a log partition, where each fea…”
BackgroundKiczales, G., Lamping, J., Mendhekar, A., Maeda, C., Lopes, C., Loingtier, J.-M., & Irwin, J. (1997) · Lecture Notes in Computer Science · doi:10.1007/bfb0053381 · Cited by 2,573
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332 · cited 5×
“en-source implementation of existing log parsers, this survey focuses on the methodological comparison of these parsers. In additional, while parsing rules can be constructed by analyzing source code [144], we focus on parsers that only utilize logs as input. Mode. Mode is the most important log parsing characteristic…”
BackgroundMethodInfluentialThe Daikon system for dynamic detection of likely invariants
Ernst, M. D., Perkins, J. H., Guo, P. J., McCamant, S., Pacheco, C., Tschantz, M. S., & Xiao, C. (2007) · Science of Computer Programming · doi:10.1016/j.scico.2007.01.015 · Cited by 1,080
Dynamically discovering likely program invariants to support program evolution
Ernst, M. D., Cockrell, J., Griswold, W. G., & Notkin, D. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.908957 · Cited by 1,050
Drain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943 · cited 2×
“P [59] All Yes Iterative partitioning MoLFI [108] All Yes Evolutionary algorithms Online SHISO [113] All No Clustering LenMa [131] All No Clustering Spell [41] All No Longest common subsequence Drain [60, 61] All Yes Heuristics Logram [33] All Yes Frequent pattern mining 5.2 Log Parser Characteristics We explore 15 ex…”
MethodInfluentialSelf-citationLSCs: Breathing Life into Message Sequence Charts
Damm, W., & Harel, D. (2001) · Formal Methods in System Design · doi:10.1023/a:1011227529550 · Cited by 818
Robust log-based anomaly detection on unstable log data
Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338931 · Cited by 761 · cited 3×
“Poorly written static text and inconsistent dynamic content could affect the subsequent diagnosis and maintenance activities [86, 111, 136, 196].”
BackgroundMethodLogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs
Meng, W., Liu, Y., Zhu, Y., Zhang, S., Pei, D., Liu, Y., Chen, Y., Zhang, R., Tao, S., Sun, P., et al. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/658 · Cited by 708
Performance debugging for distributed systems of black boxes
Aguilera, M. K., Mogul, J. C., Wiener, J. L., Reynolds, P., & Muthitacharoen, A. (2003) · ACM SIGOPS Operating Systems Review · doi:10.1145/1165389.945454 · Cited by 558
Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis
Fu, Q., Lou, J.-G., Wang, Y., & Li, J. (2009) · 2009 Ninth IEEE International Conference on Data Mining · doi:10.1109/icdm.2009.60 · Cited by 542
On the Synthesis of Finite-State Machines from Samples of Their Behavior
Biermann, A. W., & Feldman, J. A. (1972) · IEEE Transactions on Computers · doi:10.1109/tc.1972.5009015 · Cited by 510
A data clustering algorithm for mining patterns from event logs
Vaarandi, R. (2004) · Proceedings of the 3rd IEEE Workshop on IP Operations & Management (IPOM 2003) (IEEE Cat. No.03EX764) · doi:10.1109/ipom.2003.1251233 · Cited by 453
Log clustering based problem identification for online service systems
Lin, Q., Zhang, H., Lou, J.-G., Zhang, Y., & Chen, X. (2016) · Proceedings of the 38th International Conference on Software Engineering Companion · doi:10.1145/2889160.2889232 · Cited by 427
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Li, W., & Ding, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2887384 · Cited by 410
Liu, F., Wen, Y., Zhang, D., Jiang, X., Xing, X., & Meng, D. (2019) · Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3319535.3363224 · Cited by 319
Failure Prediction in IBM BlueGene/L Event Logs
Liang, Y., Zhang, Y., Xiong, H., & Sahoo, R. (2007) · Seventh IEEE International Conference on Data Mining (ICDM 2007) · doi:10.1109/icdm.2007.46 · Cited by 292 · cited 2×
“s examples are derived from normal ones in terms of some statistical properties. Support Vector Machine (SVM) is a supervised classification method that is commonly used for log anomaly detection. In [84], Liang et al. vectorized log partitions by identifying six types of features, including events number in a time wi…”
MethodZhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Liu, D., Xiang, Q., & He, C. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338961 · Cited by 277
Critical event prediction for proactive management in large-scale computer clusters
Sahoo, R. K., Oliner, A. J., Rish, I., Gupta, M., Moreira, J. E., Ma, S., Vilalta, R., & Sivasubramaniam, A. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956799 · Cited by 264
LogCluster - A data clustering and pattern mining algorithm for event logs
Vaarandi, R., & Pihelgas, M. (2015) · 2015 11th International Conference on Network and Service Management (CNSM) · doi:10.1109/cnsm.2015.7367331 · Cited by 246
LogSig: generating system events from raw textual logs
Tang, L., Li, T., & Perng, C.-S. (2011) · Proceedings of the 20th ACM international conference on Information and knowledge management · doi:10.1145/2063576.2063690 · Cited by 244
Where do developers log? an empirical study on logging practices in industry
Fu, Q., Zhu, J., Hu, W., Lou, J.-G., Ding, R., Lin, Q., Zhang, D., & Xie, T. (2014) · Companion Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2591062.2591175 · Cited by 230
Towards Automated Log Parsing for Large-Scale Log Data Analysis
He, P., Zhu, J., He, S., Li, J., & Lyu, M. R. (2018) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2017.2762673 · Cited by 230 · cited 4×
“ch [82] in logging practice and Deeplog [42] in anomaly detection. Besides machine learning, parallelization has been employed in various recent papers, such as Logzip [90] in log compression and POP [59] in log parsing. These extensive studies on automated log analysis across multiple core directions have largely boo…”
BackgroundMethodInfluentialSelf-citationLogMine: Fast Pattern Recognition for Log Analytics
Hamooni, H., Debnath, B., Xu, J., Zhang, H., Jiang, G., & Mueen, A. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983358 · Cited by 227
Detecting Anomaly in Big Data System Logs Using Convolutional Neural Network
Lu, S., Wei, X., Li, Y., & Wang, L. (2018) · 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech) · doi:10.1109/dasc/picom/datacom/cyberscitec.2018.00037 · Cited by 220
Dynamic syslog mining for network failure monitoring
Yamanishi, K., & Maruyama, Y. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081927 · Cited by 213
Learning to Log: Helping Developers Make Informed Logging Decisions
Zhu, J., He, P., Fu, Q., Zhang, H., Lyu, M. R., & Zhang, D. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.60 · Cited by 212
Self-citationOnline System Problem Detection by Mining Patterns of Console Logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. (2009) · 2009 Ninth IEEE International Conference on Data Mining · doi:10.1109/icdm.2009.19 · Cited by 203
Identifying impactful service system problems via log analysis
He, S., Lin, Q., Lou, J.-G., Zhang, H., Lyu, M. R., & Zhang, D. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236083 · Cited by 201
Self-citationProceedings - IEEE Military Communications Conference MILCOM
Borkotoky, S. S., & Pursley, M. B. (2011) · IEEE Military Communications Conference (MILCOM) · Cited by 201
Inferring models of concurrent systems from logs of their behavior with CSight
Beschastnikh, I., Brun, Y., Ernst, M. D., & Krishnamurthy, A. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568246 · Cited by 181
Mi, H., Wang, H., Zhou, Y., Lyu, M. R.-T., & Cai, H. (2013) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2013.21 · Cited by 176
Self-citationSherLog: error diagnosis by connecting clues from run-time logs
Yuan, D., Mai, H., Xiong, W., Tan, L., Zhou, Y., & Pasupathy, S. (2010) · Proceedings of the fifteenth International Conference on Architectural support for programming languages and operating systems · doi:10.1145/1736020.1736038 · Cited by 176
Logram: Efficient Log Parsing Using n-Gram Dictionaries
Dai, H., Li, H., Chen, C. S., Shang, W., & Chen, T.-H. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3007554 · Cited by 170
Hamou‐Lhadj, A., & Lethbridge, T. C. (2006) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2006.45 · Cited by 168
General LTL Specification Mining (T)
Lemieux, C., Park, D., & Beschastnikh, I. (2015) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.71 · Cited by 157
Improving software diagnosability via log enhancement
Yuan, D., Zheng, J., Park, S., Zhou, Y., & Savage, S. (2011) · Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems · doi:10.1145/1950365.1950369 · Cited by 154
Anomaly Detection Using Program Control Flow Graph Mining From Execution Logs
Nandi, A., Mandal, A., Atreja, S., Dasgupta, G. B., & Bhattacharya, S. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939712 · Cited by 154
A search-based approach for accurate identification of log message formats
Messaoudi, S., Panichella, A., Bianculli, D., Briand, L., & Sasnauskas, R. (2018) · Proceedings of the 26th Conference on Program Comprehension · doi:10.1145/3196321.3196340 · Cited by 149
Characterizing Logging Practices in Open-Source Software
Yuan, D., Park, S., & Zhou, Y. (2012) · Cited by 148
Incremental Mining of System Log Format
Mizutani, M. (2013) · 2013 IEEE International Conference on Services Computing · doi:10.1109/scc.2013.73 · Cited by 139
Event Logs for the Analysis of Software Failures: A Rule-Based Approach
Cinque, M., Cotroneo, D., & Pecchia, A. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.67 · Cited by 125
Chen, B., & Jiang, Z. M. (2016) · Empirical Software Engineering · doi:10.1007/s10664-016-9429-5 · Cited by 124
Reading between the lines of failure logs: Understanding how HPC systems fail
El-Sayed, N., & Schroeder, B. (2013) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2013.6575356 · Cited by 123
Custos: Practical Tamper-Evident Auditing of Operating Systems Using Trusted Execution
Paccagnella, R., Datta, P., Hassan, W. U., Bates, A., Fletcher, C. W., Miller, A. K., & Tian, D. J. (2020) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2020.24065 · Cited by 118
Assisting developers of Big Data Analytics Applications when deploying on Hadoop clouds
Shang, W., Jiang, Z. M., Hemmati, H., Adams, B., Hassan, A. E., & Martin, P. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606586 · Cited by 118
Spell: Online Streaming Parsing of Large Unstructured System Logs
Du, M., & Li, F. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2875442 · Cited by 114
Characterizing and Detecting Anti-Patterns in the Logging Code
Chen, B., & Jiang, Z. M. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.15 · Cited by 112
Predicting Node failure in cloud service systems
Lin, Q., Hsieh, K., Dang, Y., Zhang, H., Sui, K., Xu, Y., Lou, J.-G., Li, C., Wu, Y., Yao, R., et al. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236060 · Cited by 111
System log clustering approaches for cyber security applications: A survey
Landauer, M., Skopik, F., Wurzenberger, M., & Rauber, A. (2020) · Computers & Security · doi:10.1016/j.cose.2020.101739 · Cited by 108
Farshchi, M., Schneider, J.-G., Weber, I., & Grundy, J. (2015) · 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2015.7381796 · Cited by 104
Testing using log file analysis: tools, methods, and issues
Andrews, J. H. (2002) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.1998.732614 · Cited by 104
Mining program workflow from interleaved traces
Lou, J.-G., Fu, Q., Yang, S., Li, J., & Wu, B. (2010) · Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1835804.1835883 · Cited by 103
Zhao, X., Rodrigues, K., Luo, Y., Stumm, M., Yuan, D., & Zhou, Y. (2017) · Proceedings of the 26th Symposium on Operating Systems Principles · doi:10.1145/3132747.3132778 · Cited by 101
LogTransfer: Cross-System Log Anomaly Detection for Software Systems with Transfer Learning
Chen, R., Zhang, S., Li, D., Zhang, Y., Guo, F., Meng, W., Pei, D., Zhang, Y., Chen, X., & Liu, Y. (2020) · 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre5003.2020.00013 · Cited by 101
PreFix: Switch Failure Prediction in Datacenter Networks
Zhang, S., Liu, Y., Meng, W., Luo, Z., Bu, J., Yang, S., Liang, P., Pei, D., Xu, J. J., Zhang, Y., et al. (2018) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3179405 · Cited by 98
Mining behavior models from user-intensive web applications
Ghezzi, C., Pezzè, M., Sama, M., & Tamburrelli, G. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2568225.2568234 · Cited by 95
Zuo, Y., Wu, Y., Min, G., Huang, C., & Pei, K. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2966615 · Cited by 94
CloudSeer: Workflow Monitoring of Cloud Infrastructures via Interleaved Logs
Yu, X., Joshi, P., Xu, J., Jin, G., Zhang, H., & Jiang, G. (2016) · Proceedings of the Twenty-First International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/2872362.2872407 · Cited by 93
Automatic identification of load testing problems
Jiang, Z. M., Hassan, A. E., Hamann, G., & Flora, P. (2008) · 2008 IEEE International Conference on Software Maintenance · doi:10.1109/icsm.2008.4658079 · Cited by 91
Log-based Abnormal Task Detection and Root Cause Analysis for Spark
Lu, S., Rao, B., Wei, X., Tak, B., Wang, L., & Wang, L. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.135 · Cited by 86
LogSed: Anomaly Diagnosis through Mining Time-Weighted Control Flow Graph in Logs
Jia, T., Yang, L., Chen, P., Li, Y., Meng, F., & Xu, J. (2017) · 2017 IEEE 10th International Conference on Cloud Computing (CLOUD) · doi:10.1109/cloud.2017.64 · Cited by 86
Outage Prediction and Diagnosis for Cloud Service Systems
Chen, Y., Yang, X., Lin, Q., Zhang, H., Gao, F., Xu, Z., Dang, Y., Zhang, D., Dong, H., Xu, Y., et al. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313501 · Cited by 85
Studying and detecting log-related issues
Hassani, M., Shang, W., Shihab, E., & Tsantalis, N. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9603-z · Cited by 79
An Approach for Anomaly Diagnosis Based on Hybrid Graph Model with Logs for Distributed Services
Jia, T., Chen, P., Yang, L., Li, Y., Meng, F., & Xu, J. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.12 · Cited by 78
Desh: deep learning for system health prediction of lead times to failure in HPC
Das, A., Mueller, F., Siegel, C., & Vishnu, A. (2018) · Proceedings of the 27th International Symposium on High-Performance Parallel and Distributed Computing · doi:10.1145/3208040.3208051 · Cited by 78
Cotroneo, D., De Simone, L., Liguori, P., Natella, R., & Bidokhti, N. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338916 · Cited by 78
Industry Practices and Event Logging: Assessment of a Critical Software Development Process
Pecchia, A., Cinque, M., Carrozza, G., & Cotroneo, D. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.145 · Cited by 78
Studying the characteristics of logging practices in mobile apps: a case study on F-Droid
Zeng, Y., Chen, J., Shang, W., & Chen, T.-H. P. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09687-9 · Cited by 76
Where shall we log? studying and suggesting logging locations in code blocks
Li, Z., Chen, T.-H. P., & Shang, W. (2020) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3324884.3416636 · Cited by 75
The bones of the system: a case study of logging and telemetry at Microsoft
Barik, T., DeLine, R., Drucker, S., & Fisher, D. (2016) · Proceedings of the 38th International Conference on Software Engineering Companion · doi:10.1145/2889160.2889231 · Cited by 73
Scenario-based and value-based specification mining: better together
Lo, D., & Maoz, S. (2010) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/1858996.1859081 · Cited by 71
Jiang, H., Li, X., Yang, Z., & Xuan, J. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2017.71 · Cited by 70
Mining modal scenario-based specifications from execution traces of reactive systems
Lo, D., Maoz, S., & Khoo, S.-C. (2007) · Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering · doi:10.1145/1321631.1321710 · Cited by 68
Failure Diagnosis for Distributed Systems using Targeted Fault Injection
Pham, C., Wang, L., Tak, B., Baset, S., Tang, C., Kalbarczyk, Z., & Iyer, R. (2016) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2016.2575829 · Cited by 65
A Semantic-aware Representation Framework for Online Log Analysis
Meng, W., Liu, Y., Huang, Y., Zhang, S., Zaiter, F., Chen, B., & Pei, D. (2020) · 2020 29th International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn49398.2020.9209707 · Cited by 63
Trace-based microarchitecture-level diagnosis of permanent hardware faults
Li, M.-L., Ramachandran, P., Sahoo, S. K., Adve, S. V., Adve, V., & Zhou, Y. (2008) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2008.4630067 · Cited by 62
An automated approach to estimating code coverage measures via execution logs
Chen, B., Song, J., Xu, P., Hu, X., & Jiang, Z. M. (. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238214 · Cited by 61
Xia, B., Bai, Y., Yin, J., Li, Y., & Xu, J. (2020) · Information Systems Frontiers · doi:10.1007/s10796-020-10026-3 · Cited by 61
Proceedings IEEE International Conference on Cluster Computing. CLUSTER 2000
Pérez, M. S., Antoniu, G., & Keahey, K. (2000) · doi:10.1109/clustr.2000 · Cited by 59
Understanding Log Lines Using Development Knowledge
Shang, W., Nagappan, M., Hassan, A. E., & Jiang, Z. M. (2014) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2014.24 · Cited by 58
Chen, K., Schach, S. R., Yu, L., Offutt, J., & Heller, G. Z. (2004) · Empirical Software Engineering · doi:10.1023/b:emse.0000027779.70556.d0 · Cited by 57
Mining Scenario-Based Triggers and Effects
Lo, D., & Maoz, S. (2008) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2008.21 · Cited by 57
An exploratory study on assessing the energy impact of logging on Android applications
Chowdhury, S., Nardo, S. D., Hindle, A., & Jiang, Z. M. (2017) · Empirical Software Engineering · doi:10.1007/s10664-017-9545-x · Cited by 56
An Industrial Case Study of Customizing Operational Profiles Using Log Compression
Hassan, A. E., Martin, D. J., Flora, P. K., Mansfield, P., & Dietz, D. (2008) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1368088.1379445 · Cited by 54
LOGAN: Problem Diagnosis in the Cloud Using Log-Based Reference Models
Tak, B. C., Tao, S., Yang, L., Zhu, C., & Ruan, Y. (2016) · 2016 IEEE International Conference on Cloud Engineering (IC2E) · doi:10.1109/ic2e.2016.12 · Cited by 54
DLFinder: Characterizing and Detecting Duplicate Logging Code Smells
Li, Z., Chen, T.-H., Yang, J., & Shang, W. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00032 · Cited by 54
AVA: automated interpretation of dynamically detected anomalies
Babenko, A., Mariani, L., & Pastore, F. (2009) · Proceedings of the eighteenth international symposium on Software testing and analysis · doi:10.1145/1572272.1572300 · Cited by 51
Mining system logs to learn error predictors: a case study of a telemetry system
Russo, B., Succi, G., & Pedrycz, W. (2014) · Empirical Software Engineering · doi:10.1007/s10664-014-9303-2 · Cited by 49
Comprehending performance from real-world execution traces: a device-driver case
Yu, X., Han, S., Zhang, D., & Xie, T. (2014) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2541940.2541968 · Cited by 49
Aarohi: Making Real-Time Node Failure Prediction Feasible
Das, A., Mueller, F., & Rountree, B. (2020) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps47924.2020.00115 · Cited by 48
Digging deeper into cluster system logs for failure prediction and root cause diagnosis
Fu, X., Ren, R., McKee, S. A., Zhan, J., & Sun, N. (2014) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/cluster.2014.6968768 · Cited by 47
Chen, B., & Jiang, Z. M. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09690-0 · Cited by 47
An Approach to Cloud Execution Failure Diagnosis Based on Exception Logs in OpenStack
Yuan, Y., Shi, W., Liang, B., & Qin, B. (2019) · 2019 IEEE 12th International Conference on Cloud Computing (CLOUD) · doi:10.1109/cloud.2019.00031 · Cited by 44
To log, or not to log: using heuristics to identify mandatory log events – a controlled experiment
King, J., Stallings, J., Riaz, M., & Williams, L. (2016) · Empirical Software Engineering · doi:10.1007/s10664-016-9449-1 · Cited by 38
Assessing and improving the effectiveness of logs for the analysis of software faults
Cinque, M., Cotroneo, D., Natella, R., & Pecchia, A. (2010) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2010.5544279 · Cited by 37
Cowic: A Column-Wise Independent Compression for Log Stream Analysis
Lin, H., Zhou, J., Yao, B., Guo, M., & Li, J. (2015) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid.2015.45 · Cited by 35
Studying the use of Java logging utilities in the wild
Chen, B., & Jiang, Z. M. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377811.3380408 · Cited by 35
Behavioral log analysis with statistical guarantees
Busany, N., & Maoz, S. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884805 · Cited by 34
Proactive Failure Detection Learning Generation Patterns of Large-Scale Network Logs
Kimura, T., Watanabe, A., Toyono, T., & Ishibashi, K. (2018) · IEICE Transactions on Communications · doi:10.1587/transcom.2018ebp3103 · Cited by 34
Zhang, Y., Rodrigues, K., Luo, Y., Stumm, M., & Yuan, D. (2019) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3341301.3359650 · Cited by 33
Adaptive log compression for massive log data
Christensen, R. R., & Li, F. (2013) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/2463676.2465341 · Cited by 32
Experience Report: Log-Based Behavioral Differencing
Goldstein, M., Raz, D., & Segall, I. (2017) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2017.14 · Cited by 32
Mining Historical Issue Repositories to Heal Large-Scale Online Service Systems
Ding, R., Fu, Q., Lou, J. G., Lin, Q., Zhang, D., & Xie, T. (2014) · 2014 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks · doi:10.1109/dsn.2014.39 · Cited by 31
Scenario-based and value-based specification mining: better together
Lo, D., & Maoz, S. (2012) · Automated Software Engineering · doi:10.1007/s10515-012-0103-x · Cited by 30
MLC: An Efficient Multi-level Log Compression Method for Cloud Backup Systems
Feng, B., Wu, C., & Li, J. (2016) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom.2016.0215 · Cited by 29
CloudRaid: hunting concurrency bugs in the cloud via log-mining
Lu, J., Li, F., Li, L., & Feng, X. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236071 · Cited by 28
An Empirical Study on Leveraging Logs for Debugging Production Failures
Chen, A. R. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion.2019.00055 · Cited by 28
Chen, J., Shang, W., Hassan, A. E., Wang, Y., & Lin, J. (2019) · 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00068 · Cited by 28
Comprehensive Log Compression with Frequent Patterns
Hätönen, K., Boulicaut, J., Klemettinen, M., Miettinen, M., & Masson, C. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45228-7_36 · Cited by 27
Using finite-state models for log differencing
Amar, H., Bao, L., Busany, N., Lo, D., & Maoz, S. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3236069 · Cited by 25
Bridging the divide between software developers and operators using logs
Shang, W. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227031 · Cited by 25
PADLA: A Dynamic Log Level Adapter Using Online Phase Detection
Mizouchi, T., Shimari, K., Ishio, T., & Inoue, K. (2019) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2019.00029 · Cited by 23
High density compression of log files
Rácz, B., & Lukács, A. (2004) · DCC · doi:10.1109/dcc.2004.1281533 · Cited by 22
The Game of Twenty Questions: Do You Know Where to Log?
Zhao, X., Rodrigues, K., Luo, Y., Stumm, M., Yuan, D., & Zhou, Y. (2017) · Workshop on Hot Topics in Operating Systems · doi:10.1145/3102980.3103001 · Cited by 22
Huynh, T. P., & Miller, J. (2008) · Empirical Software Engineering · doi:10.1007/s10664-008-9084-6 · Cited by 21
Computer operating system logging and security issues: a survey
Zeng, L., Xiao, Y., Chen, H., Sun, B., & Han, W. (2016) · Security and Communication Networks · doi:10.1002/sec.1677 · Cited by 21
Guiding log revisions by learning from software evolution history
Li, S., Niu, X., Jia, Z., Liao, X., Wang, J., & Li, T. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09757-y · Cited by 20
Bao, L., Busany, N., Lo, D., & Maoz, S. (2019) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00084 · Cited by 19
Exploring void search for fault detection on extreme scale systems
Berrocal, E., Yu, L., Wallace, S., Papka, M. E., & Lan, Z. (2014) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/cluster.2014.6968757 · Cited by 18
SCMiner: Localizing System-Level Concurrency Faults from Large System Call Traces
Zaman, T. S., Han, X., & Yu, T. (2019) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00055 · Cited by 15
Have We Seen Enough Traces? (T)
Cohen, H., & Maoz, S. (2015) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.62 · Cited by 14
Root-Cause Diagnosis Using Logs Generated by User Actions
Ikeuchi, H., Watanabe, A., Kawata, T., & Kawahara, R. (2018) · Globecom · doi:10.1109/glocom.2018.8647957 · Cited by 12
Insights into the Diagnosis of System Failures from Cluster Message Logs
Chuah, E., Jhumka, A., Browne, J. C., Barth, B., & Narasimhamurthy, S. (2015) · European Dependable Computing Conference · doi:10.1109/edcc.2015.19 · Cited by 10
Rough Logs: A Data Reduction Approach for Log Files
Meinig, M., Tröger, P., & Meinel, C. (2019) · International Conference on Enterprise Information Systems · doi:10.5220/0007735102950302 · Cited by 10
What Logs Should You Look at When an Application Fails? Insights from an Industrial Case Study
Cinque, M., Cotroneo, D., Corte, R. D., & Pecchia, A. (2014) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2014.69 · Cited by 7
Hassine, J., Hamou‐Lhadj, A., & Alawneh, L. M. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2017.11.007 · Cited by 7
Research works printed but not linked: 47
- Anunay Amar and Peter C. Rigby . 2019. Mining historical test logs to predict bugs and localize faults in the test logs . In Proceedings of the IEEE/ACM 41st International Conference on Software Engineering (ICSE’19) . 140--151. Anunay Amar and Peter C. Rigby. 2019. Mining historical test logs to predict bugs and localize faults in the test logs. In Proceedings of the IEEE/ACM 41st International Conference on Software Engineering (ICSE’19). 140--151.
- Raju Balakrishnan and Ramendra K. Sahoo . 2006. Lossless compression for large scale cluster logs . In Proceedings 20th IEEE International Parallel & Distributed Processing Symposium (IPDPS’06) . 7. Raju Balakrishnan and Ramendra K. Sahoo. 2006. Lossless compression for large scale cluster logs. In Proceedings 20th IEEE International Parallel & Distributed Processing Symposium (IPDPS’06). 7.
- Ivan Beschastnikh , Yuriy Brun , Sigurd Schneider , Michael Sloan , and Michael D. Ernst . 2011. Leveraging existing instrumentation to automatically infer invariant-constrained models . In Proceedings of the 19th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE’11) . 267--277. Ivan Beschastnikh, Yuriy Brun, Sigurd Schneider, Michael Sloan, and Michael D. Ernst. 2011. Leveraging existing instrumentation to automatically infer invariant-constrained models. In Proceedings of the 19th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE’11). 267--277.
- CFDR. 2020. Computer failure data repository. Retrieved from https://www.usenix.org/cfdr. CFDR. 2020. Computer failure data repository. Retrieved from https://www.usenix.org/cfdr.
- Edward Chuah , Shyh-hao Kuo, Paul Hiew , William-Chandra Tjhi , Gary Lee , John Hammond , Marek T. Michalewicz , Terence Hung , and James C. Browne . 2010. Diagnosing the root-causes of failures from cluster log files . In Proceedings of the International Conference on High Performance Computing (HPC’10) . 1--10. Edward Chuah, Shyh-hao Kuo, Paul Hiew, William-Chandra Tjhi, Gary Lee, John Hammond, Marek T. Michalewicz, Terence Hung, and James C. Browne. 2010. Diagnosing the root-causes of failures from cluster log files. In Proceedings of the International Conference on High Performance Computing (HPC’10). 1--10.
- Sebastian Deorowicz and Szymon Grabowski . 2008 . Sub-atomic field processing for improved web log compression . In Proceedings of the IEEE International Conference on “Modern Problems of Radio Engineering, Telecommunications and Computer Science” (TCSET’08) . 551--556. Sebastian Deorowicz and Szymon Grabowski. 2008. Sub-atomic field processing for improved web log compression. In Proceedings of the IEEE International Conference on “Modern Problems of Radio Engineering, Telecommunications and Computer Science” (TCSET’08). 551--556.
- Rui Ding , Hucheng Zhou , Jian-Guang Lou , Hongyu Zhang , Qingwei Lin , Qiang Fu , Dongmei Zhang , and Tao Xie . 2015 . Log2: A cost-aware logging mechanism for performance diagnosis . In Proceedings of the USENIX Annual Technical Conference (ATC). 139--150 . Rui Ding, Hucheng Zhou, Jian-Guang Lou, Hongyu Zhang, Qingwei Lin, Qiang Fu, Dongmei Zhang, and Tao Xie. 2015. Log2: A cost-aware logging mechanism for performance diagnosis. In Proceedings of the USENIX Annual Technical Conference (ATC). 139--150.
- Stephen E. Hansen and E. Todd Atkins . 1993. Automated system monitoring and notification with swatch . In Proceedings of the 7th USENIX Large Installation System Administration Conference (LISA’93) , Vol. 93 . 145--152. Stephen E. Hansen and E. Todd Atkins. 1993. Automated system monitoring and notification with swatch. In Proceedings of the 7th USENIX Large Installation System Administration Conference (LISA’93), Vol. 93. 145--152.
- Pinjia He , Zhuangbin Chen , Shilin He , and Michael R. Lyu . 2018. Characterizing the natural language descriptions in software logging statements . In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE’18) . 178--189. Pinjia He, Zhuangbin Chen, Shilin He, and Michael R. Lyu. 2018. Characterizing the natural language descriptions in software logging statements. In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE’18). 178--189.
- Pinjia He , Jieming Zhu , Pengcheng Xu , Zibin Zheng , and Michael R . Lyu . 2018 . A directed acyclic graph approach to online log parsing. Retrieved from https://arXiv:1806.04356. Pinjia He, Jieming Zhu, Pengcheng Xu, Zibin Zheng, and Michael R. Lyu. 2018. A directed acyclic graph approach to online log parsing. Retrieved from https://arXiv:1806.04356.
- Shilin He , Jieming Zhu , Pinjia He , and Michael R. Lyu . 2016. Experience report: System log analysis for anomaly detection . In Proceedings of the 27th IEEE International Symposium on Software Reliability Engineering (ISSRE’16) . 207--218. Shilin He, Jieming Zhu, Pinjia He, and Michael R. Lyu. 2016. Experience report: System log analysis for anomaly detection. In Proceedings of the 27th IEEE International Symposium on Software Reliability Engineering (ISSRE’16). 207--218.
- Shilin He , Jieming Zhu , Pinjia He , and Michael R . Lyu . 2020 . Loghub : A Large Collection of System Log Datasets towards Automated Log Analytics. Retrieved from https://arXiv:2008.06448. Shilin He, Jieming Zhu, Pinjia He, and Michael R. Lyu. 2020. Loghub: A Large Collection of System Log Datasets towards Automated Log Analytics. Retrieved from https://arXiv:2008.06448.
- 10.5555/1525908.1525912 · doi:10.5555/1525908.1525912
- Zhen Ming Jiang , Ahmed E. Hassan , Parminder Flora , and Gilbert Hamann . 2008 . Abstracting execution logs to execution events for enterprise applications . In Proceedings of the 8th International Conference on Quality Software (QSIC). Zhen Ming Jiang, Ahmed E. Hassan, Parminder Flora, and Gilbert Hamann. 2008. Abstracting execution logs to execution events for enterprise applications. In Proceedings of the 8th International Conference on Quality Software (QSIC).
- Suhas Kabinna , Cor-Paul Bezemer , Weiyi Shang , and Ahmed E. Hassan . 2016. Logging library migrations: A case study for the apache software foundation projects . In Proceedings of the 13th International Conference on Mining Software Repositories (MSR’16) . 154--164. Suhas Kabinna, Cor-Paul Bezemer, Weiyi Shang, and Ahmed E. Hassan. 2016. Logging library migrations: A case study for the apache software foundation projects. In Proceedings of the 13th International Conference on Mining Software Repositories (MSR’16). 154--164.
- Suhas Kabinna , Cor-Paul Bezemer , Weiyi Shang , Mark D. Syer , and Ahmed E . Hassan . 2018 . Examining the stability of logging statements. Empir. Softw. Eng . (2018), 290--333. Suhas Kabinna, Cor-Paul Bezemer, Weiyi Shang, Mark D. Syer, and Ahmed E. Hassan. 2018. Examining the stability of logging statements. Empir. Softw. Eng. (2018), 290--333.
- Soila P. Kavulya , Kaustubh Joshi , Felicita Di Giandomenico, and Priya Narasimhan . 2012 . Failure diagnosis of complex systems. In Resilience Assessment and Evaluation of Computing Systems. Springer , 239--261. Soila P. Kavulya, Kaustubh Joshi, Felicita Di Giandomenico, and Priya Narasimhan. 2012. Failure diagnosis of complex systems. In Resilience Assessment and Evaluation of Computing Systems. Springer, 239--261.
- Suleman Khan , Abdullah Gani , Ainuddin Wahid Abdul Wahab , Mustapha Aminu Bagiwa, Muhammad Shiraz, Samee U. Khan, Rajkumar Buyya, and Albert Y. Zomaya. 2016 . Cloud log forensics: Foundations, state of the art, and future directions. ACM Comput. Surveys ( 2016), 178--184. Suleman Khan, Abdullah Gani, Ainuddin Wahid Abdul Wahab, Mustapha Aminu Bagiwa, Muhammad Shiraz, Samee U. Khan, Rajkumar Buyya, and Albert Y. Zomaya. 2016. Cloud log forensics: Foundations, state of the art, and future directions. ACM Comput. Surveys (2016), 178--184.
- Jean-Claude Laprie . 1995 . Dependable computing: Concepts, limits, challenges . In Proceedings of the 25th International Symposium on Fault-tolerant Computing (FTCS’95) . 42--54. Jean-Claude Laprie. 1995. Dependable computing: Concepts, limits, challenges. In Proceedings of the 25th International Symposium on Fault-tolerant Computing (FTCS’95). 42--54.
- Heng Li , Tse-Hsun (Peter) Chen , Weiyi Shang , and Ahmed E . Hassan . 2018 . Studying software logging using topic models. Empir. Softw. Eng . (2018), 2655--2694. Heng Li, Tse-Hsun (Peter) Chen, Weiyi Shang, and Ahmed E. Hassan. 2018. Studying software logging using topic models. Empir. Softw. Eng. (2018), 2655--2694.
- Heng Li , Weiyi Shang , and Ahmed E . Hassan . 2017 . Which log level should developers choose for a new logging statement?Empir. Softw. Eng . (2017), 1684--1716. Heng Li, Weiyi Shang, and Ahmed E. Hassan. 2017. Which log level should developers choose for a new logging statement?Empir. Softw. Eng. (2017), 1684--1716.
- Heng Li , Weiyi Shang , Ying Zou , and Ahmed E . Hassan . 2017 . Towards just-in-time suggestions for log changes. Empir. Softw. Eng . (2017), 1831--1865. Heng Li, Weiyi Shang, Ying Zou, and Ahmed E. Hassan. 2017. Towards just-in-time suggestions for log changes. Empir. Softw. Eng. (2017), 1831--1865.
- Chinghway Lim , Navjot Singh , and Shalini Yajnik . 2008 . A log mining approach to failure analysis of enterprise telephony systems . In Proceedings of the 38th IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’08) . Chinghway Lim, Navjot Singh, and Shalini Yajnik. 2008. A log mining approach to failure analysis of enterprise telephony systems. In Proceedings of the 38th IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’08).
- Jinyang Liu , Jieming Zhu , Shilin He , Pinjia He , Zibin Zheng , and Michael R. Lyu . 2019. Logzip: Extracting hidden structures via iterative clustering for log compression . In Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering (ASE’19) . 863--873. Jinyang Liu, Jieming Zhu, Shilin He, Pinjia He, Zibin Zheng, and Michael R. Lyu. 2019. Logzip: Extracting hidden structures via iterative clustering for log compression. In Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering (ASE’19). 863--873.
- Zhongxin Liu Xin Xia David Lo Zhenchang Xing Ahmed E. Hassan and Shanping Li. 2019. Which variables should I log?IEEE Trans. Softw. Eng. (2019). Zhongxin Liu Xin Xia David Lo Zhenchang Xing Ahmed E. Hassan and Shanping Li. 2019. Which variables should I log?IEEE Trans. Softw. Eng. (2019).
- Joshua Lockerman , Jose M. Faleiro , Juno Kim , Soham Sankaran , Daniel J. Abadi , James Aspnes , Siddhartha Sen , and Mahesh Balakrishnan . 2018 . The fuzzylog: A partially ordered shared log . In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI’18) . 357--372. Joshua Lockerman, Jose M. Faleiro, Juno Kim, Soham Sankaran, Daniel J. Abadi, James Aspnes, Siddhartha Sen, and Mahesh Balakrishnan. 2018. The fuzzylog: A partially ordered shared log. In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI’18). 357--372.
- Jian-Guang Lou , Qiang Fu , Shengqi Yang , Ye Xu , and Jiang Li . 2010 . Mining invariants from console logs for system problem detection . In Proceedings of the USENIX Annual Technical Conference (ATC’10) . 1--14. Jian-Guang Lou, Qiang Fu, Shengqi Yang, Ye Xu, and Jiang Li. 2010. Mining invariants from console logs for system problem detection. In Proceedings of the USENIX Annual Technical Conference (ATC’10). 1--14.
- Liang Luo , Suman Nath , Lenin Ravindranath Sivalingam , Madan Musuvathi , and Luis Ceze . 2018 . Troubleshooting transiently recurring errors in production systems with blame-proportional logging . In Proceedings of the USENIX Annual Technical Conference (ATC’18) . 321--334. Liang Luo, Suman Nath, Lenin Ravindranath Sivalingam, Madan Musuvathi, and Luis Ceze. 2018. Troubleshooting transiently recurring errors in production systems with blame-proportional logging. In Proceedings of the USENIX Annual Technical Conference (ATC’18). 321--334.
- Michael R. Lyu (ed.). 1996. Handbook of Software Reliability Engineering. IEEE Computer Society Press. Michael R. Lyu (ed.). 1996. Handbook of Software Reliability Engineering. IEEE Computer Society Press.
- Adetokunbo Makanju , A. Nur Zincir-Heywood , and Evangelos E . Milios . 2012 . A lightweight algorithm for message type extraction in system application logs. IEEE Trans. Knowl. Data Eng . (2012). Adetokunbo Makanju, A. Nur Zincir-Heywood, and Evangelos E. Milios. 2012. A lightweight algorithm for message type extraction in system application logs. IEEE Trans. Knowl. Data Eng. (2012).
- Adetokunbo A. O. Makanju , A. Nur Zincir-Heywood , and Evangelos E. Milios . 2009. Clustering event logs using iterative partitioning . In Proceedings of International Conference on Knowledge Discovery and Data Mining (KDD’09) . 1255--1264. Adetokunbo A. O. Makanju, A. Nur Zincir-Heywood, and Evangelos E. Milios. 2009. Clustering event logs using iterative partitioning. In Proceedings of International Conference on Knowledge Discovery and Data Mining (KDD’09). 1255--1264.
- Meiyappan Nagappan and Mladen A. Vouk . 2010. Abstracting log lines to log event types for mining software system logs . In Proceedings of the 7th IEEE Working Conference on Mining Software Repositories (MSR’10) . 114--117. Meiyappan Nagappan and Mladen A. Vouk. 2010. Abstracting log lines to log event types for mining software system logs. In Proceedings of the 7th IEEE Working Conference on Mining Software Repositories (MSR’10). 114--117.
- Karthik Nagaraj , Charles Killian , and Jennifer Neville . 2012 . Structured comparative analysis of systems logs to diagnose performance problems . In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI’12) . 353--366. Karthik Nagaraj, Charles Killian, and Jennifer Neville. 2012. Structured comparative analysis of systems logs to diagnose performance problems. In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI’12). 353--366.
- Adam J. Oliner , Archana Ganapathi , and Wei Xu. 2012. Advances and challenges in log analysis. ACM Communication ( 2012 ), 55--61. Adam J. Oliner, Archana Ganapathi, and Wei Xu. 2012. Advances and challenges in log analysis. ACM Communication (2012), 55--61.
- James E. Prewett . 2003 . Analyzing cluster log files using logsurfer . In Proceedings of the 4th Annual Conference on Linux Clusters. Citeseer. James E. Prewett. 2003. Analyzing cluster log files using logsurfer. In Proceedings of the 4th Annual Conference on Linux Clusters. Citeseer.
- John P. Rouillard . 2004 . Real-time log file analysis using the simple event correlator (sec) . In Proceedings of the 18th USENIX Large Installation System Administration Conference (LISA’04) , Vol. 4 . 133--150. John P. Rouillard. 2004. Real-time log file analysis using the simple event correlator (sec). In Proceedings of the 18th USENIX Large Installation System Administration Conference (LISA’04), Vol. 4. 133--150.
- Bianca Schroeder and Garth A. Gibson . 2006. A large-scale study of failures in high-performance computing systems . In Proceedings of the International Conference on Dependable Systems and Networks (DSN’06) . 249--258. Bianca Schroeder and Garth A. Gibson. 2006. A large-scale study of failures in high-performance computing systems. In Proceedings of the International Conference on Dependable Systems and Networks (DSN’06). 249--258.
- Weiyi Shang , Meiyappan Nagappan , and Ahmed E . Hassan . 2015 . Studying the relationship between logging characteristics and the code quality of platform software. Empir. Softw. Eng . (2015), 1--27. Weiyi Shang, Meiyappan Nagappan, and Ahmed E. Hassan. 2015. Studying the relationship between logging characteristics and the code quality of platform software. Empir. Softw. Eng. (2015), 1--27.
- Keiichi Shima. 2016. Length matters: Clustering system log messages using length of words. Retrieved from https://arXiv:1611.03213. Keiichi Shima. 2016. Length matters: Clustering system log messages using length of words. Retrieved from https://arXiv:1611.03213.
- Przemysław Skibiński and Jakub Swacha . 2007 . Fast and efficient log file compression . In Proceedings of 11th East-European Conference on Advances in Databases and Information Systems (ADBIS’07) . 56--69. Przemysław Skibiński and Jakub Swacha. 2007. Fast and efficient log file compression. In Proceedings of 11th East-European Conference on Advances in Databases and Information Systems (ADBIS’07). 56--69.
- Wil Van Der Aalst . 2012. Process mining. Commun. ACM ( 2012 ), 76--83. Wil Van Der Aalst. 2012. Process mining. Commun. ACM (2012), 76--83.
- Stephen Yang , Seo Jin Park , and John K. Ousterhout . 2018. NanoLog: A nanosecond scale logging system . In Proceedings of the USENIX Annual Technical Conference (ATC). 335--350 . Stephen Yang, Seo Jin Park, and John K. Ousterhout. 2018. NanoLog: A nanosecond scale logging system. In Proceedings of the USENIX Annual Technical Conference (ATC). 335--350.
- Kundi Yao , Guilherme B. de Pádua , Weiyi Shang , Catalin Sporea , Andrei Toma , and Sarah Sajedi . 2020. Log4Perf: Suggesting and updating logging locations for web-based systems ’ performance monitoring. Empir. Softw. Eng . ( 2020 ), 488--531. Kundi Yao, Guilherme B. de Pádua, Weiyi Shang, Catalin Sporea, Andrei Toma, and Sarah Sajedi. 2020. Log4Perf: Suggesting and updating logging locations for web-based systems’ performance monitoring. Empir. Softw. Eng. (2020), 488--531.
- Kundi Yao , Heng Li , Weiyi Shang , and Ahmed E . Hassan . 2019 . A study of the performance of general compressors on log files. Empir. Softw. Eng . (2019), 3043--3085. Kundi Yao, Heng Li, Weiyi Shang, and Ahmed E. Hassan. 2019. A study of the performance of general compressors on log files. Empir. Softw. Eng. (2019), 3043--3085.
- 10.5555/2337223.2337236 · doi:10.5555/2337223.2337236
- Xu Zhao , Kirk Rodrigues , Yu Luo , Ding Yuan , and Michael Stumm . 2016 . Non-intrusive performance profiling for entire software stacks based on the flow reconstruction principle . In Proceedings of the 12th Symposium on Operating Systems Design and Implementation (OSDI’16) . 603--618. Xu Zhao, Kirk Rodrigues, Yu Luo, Ding Yuan, and Michael Stumm. 2016. Non-intrusive performance profiling for entire software stacks based on the flow reconstruction principle. In Proceedings of the 12th Symposium on Operating Systems Design and Implementation (OSDI’16). 603--618.
- Jieming Zhu , Shilin He , Jinyang Liu , Pinjia He , Qi Xie , Zibin Zheng , and Michael R. Lyu . 2019. Tools and benchmarks for automated log parsing . In Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’19) . 121--130. Jieming Zhu, Shilin He, Jinyang Liu, Pinjia He, Qi Xie, Zibin Zheng, and Michael R. Lyu. 2019. Tools and benchmarks for automated log parsing. In Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’19). 121--130.
Cited by
Loghub: a large collection of system log datasets for AI-driven log analytics
Zhu, J., He, S., He, P., Liu, J., & Lyu, M. R. (2023) · 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre59848.2023.00071 · Cited by 302
Self-citationLog-based anomaly detection with deep learning: how far are we?
Le, V.-H., & Zhang, H. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510155 · Cited by 257
Experience Report: Deep Learning-based System Log Analysis for Anomaly Detection
Chen, Z., Liu, J., Gu, W., Su, Y., & Lyu, M. R.-T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05908 · Cited by 60
Self-citationLogGPT: Exploring ChatGPT for Log-Based Anomaly Detection
Qi, J., Huang, S., Luan, Z., Yang, S., Fung, C., Yang, H., Qian, D., Shang, J., Xiao, Z., & Wu, Z. (2023) · 2023 IEEE International Conference on High Performance Computing & Communications, Data Science & Systems, Smart City & Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys) · doi:10.1109/hpcc-dss-smartcity-dependsys60770.2023.00045 · Cited by 102
LLMParser: An Exploratory Study on Using Large Language Models for Log Parsing
Ma, Z., Chen, A. R., Kim, D. J., Chen, T.-H., & Wang, S. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3639150 · Cited by 92
Metadata
- Authors
- He, S., He, P., Chen, Z., Yang, T., Su, Y., & Lyu, M. R.
- Affiliations
- Microsoft Research Asia (China) (CN)
- ETH Zurich (CH)
- Chinese University of Hong Kong (HK)
- Venue
- ACM Computing Surveys
- Published
- 2021-07-13
- Volume
- 54
- Issue
- 6
- Pages
- 1-37
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3183619936
- Cited by
- 334
- References
- 127
- Citations by year
- 2026: 84 · 2025: 84 · 2024: 68 · 2023: 55 · 2022: 29 · 2021: 13
- FWCI
- 18.47
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Research Grants Council of the Hong Kong Special Administrative Region, China (CUHK 14210717)
- Key-Area Research and Development Program of Guangdong Province (2020B010165002)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Software › Software Reliability and Analysis Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Keywords
- automated log analysis, software logs, log compression, log parsing, event templates, anomaly detection, failure prediction, fault diagnosis, reliability engineering, open-source software toolkit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.